CERN Accelerating science

Can't copy files

Hi there!
Running into errors while trying to copy files to EOS with eos cp. On one instance, we get a No space left on device

[root@eostest-01 ~]# eos cp /etc/bashrc /eos/users/test/
error: target file open failed - errno=28 : No space left on device
error: failed copying path=root://localhost//eos/users/test/bashrc
#WARNING [eos-cp] copied 0/1 files and 0 B in 0.02 seconds with 0 B/s

am I missing anything?

I am running eos 4.8.40

[root@eostest-01 ~]# rpm -qa | grep eos
eos-xrootd-4.12.8-1.el7.cern.x86_64
eos-folly-2019.11.11.00-1.el7.cern.x86_64
eos-protobuf3-3.5.1-5.el7.cern.eos.x86_64
libmicrohttpd-0.9.38-eos.yves.el7.cern.x86_64
eos-client-4.8.40-1.el7.cern.x86_64
eos-server-4.8.40-1.el7.cern.x86_64
eos-folly-deps-2019.11.11.00-1.el7.cern.x86_64

Grateful for your assistance.

Please run this commands and paste the output:

eos space ls
eos node ls
eos fs ls
eos quota ls

HI Andreas,

eos space ls

┌──────────┬────────────────┬────────────┬────────────┬──────┬─────────┬───────────────┬──────────────┬─────────────┬─────────────┬──────┬──────────┬───────────┬───────────┬──────┬────────┬───────────┬──────┬────────┬───────────┐
│type      │            name│   groupsize│    groupmod│ N(fs)│ N(fs-rw)│ sum(usedbytes)│ sum(capacity)│ capacity(rw)│ nom.capacity│ quota│ balancing│  threshold│  converter│   ntx│  active│        wfe│   ntx│  active│ intergroup│
└──────────┴────────────────┴────────────┴────────────┴──────┴─────────┴───────────────┴──────────────┴─────────────┴─────────────┴──────┴──────────┴───────────┴───────────┴──────┴────────┴───────────┴──────┴────────┴───────────┘
 spaceview           default            1            1      1         0         7.83 GB       15.35 GB           0 B           0 B    off        off          20         off      2        0          on      1        0         off

eos node ls

┌──────────┬────────────────────────────────┬────────────────┬──────────┬────────────┬──────┬──────────┬────────┬────────┬────────────────┬─────┐
│type      │                        hostport│          geotag│    status│   activated│  txgw│ gw-queued│  gw-ntx│ gw-rate│  heartbeatdelta│ nofs│
└──────────┴────────────────────────────────┴────────────────┴──────────┴────────────┴──────┴──────────┴────────┴────────┴────────────────┴─────┘
 nodesview       eostest-01.d.de:1095             test     online           on    off          0       10      120                1     1

eos fs ls

┌────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host                    │port│    id│                            path│      schedgroup│          geotag│        boot│  configstatus│       drain│  active│          health│
└────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
 eostest-01.d.de   1095      1                             /fst        default.0             test       booted             ro                online      no smartctl

eos quota ls

# pre-configuring default route to /eos/user/r/root/
# -use $EOSHOME variable to override

OK, you have one filesystem in read-only mode ‘configstatus = ro’.
‘space ls’ shows that there is no writable filesystems : N(fs-rw) = 0.

You have to do:

eos fs config 1 configstatus=rw

Hi Andreas,

Bear with me for the long pause. I followed your recommendations but unfortunately I still get a no space on device error.

[2021-08-02 18:48:54.351505 +0200][Debug  ][ExDbgMsg          ] [localhost:1094] Calling MsgHandler: 0x17e3040 (message: kXR_open (file: /eos/users/test/bashrc?eos.app=eoscp&eos.bookingsize=2853&eos.rgid=0&eos.ruid=0&eos.targetsize=2853&fst.valid=1627922993, mode: 0640, flags: kXR_delete kXR_open_updt kXR_async kXR_retstat ) ) with status: [ERROR] Error response: No space left on device.

doing the same command on another instance, I get: error: target file open failed - errno=5 : Input/output error

[2021-08-02 18:47:28.205476 +0200][Debug  ][File              ] [0x1faa7a0@root://localhost:1094//eos/users/test/bashrc?eos.app=eoscp&eos.bookingsize=2853&eos.rgid=0&eos.ruid=0&eos.targetsize=2853&fst.valid=1627922907&xrdcl.requuid=313ea998-575e-4f74-835a-47552822ed01] Error while opening at localhost:1094: [ERROR] Server responded with an error: [3005] Unable to [FATAL] Connection error /eos/users/test/bashrc; Transport endpoint is not connected

the eos fs ls output for the latter:

┌────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host                    │port│    id│                            path│      schedgroup│          geotag│        boot│  configstatus│       drain│  active│          health│
└────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
 eostest-devel02.d.de   1095      1                             /fst        default.0             test       booted             rw                online      no smartctl

thanks again.