EOS cp / xrdcp

Hi all,

might anyone have an idea what might be going on here:

[root@tpm03 ~]# xrdcp -f -v -d1 /root/stagetape root://localhost//eos/users/test/
[0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3010] Unable to open file /eos/users/test/stagetape; Operation not permitted (destination)

however with eos cp:

[root@tpm03 ~]# eos cp /root/stagetape /eos/users/test/stagetape
[eoscp] stagetape                Total 0.00 MB	|====================| 100.00 % [0.0 MB/s]
error: [SUCCESS]
error: failed copying path=root://localhost//eos/users/test/stagetape

and checking contents of the dir:

[root@tpm03 ~]# eos ls -y /eos/users/test
d0::t0   -rw-r-----   0 root     root                0 Oct  8 17:11 stage
d0::t0   -rw-r-----   0 root     root                0 Oct  8 17:49 stagetape

mgm logs after the eos cp:

211008 17:49:29 time=1633708169.295823 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:499              tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" op=write trunc=512 path=/eos/users/test/stagetape info=eos.app=eoscp&eos.bookingsize=694&eos.rgid=0&eos.ruid=0&eos.targetsize=694&fst.valid=1633708228
211008 17:49:29 time=1633708169.295850 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:642              tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" msg="rewrote symlinks" sym-path=/eos/users/test/stagetape realpath=/eos/users/test/stagetape
211008 17:49:29 time=1633708169.296019 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:1062             tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" acl=1 r=1 w=1 wo=0 egroup=0 shared=0 mutable=1 facl=0
211008 17:49:29 time=1633708169.296181 func=BroadcastRefreshFromExternal level=INFO  logid=static.............................. unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=Caps:261                       tident= sec=(null) uid=99 gid=99 name=- geo="" id=4f pid=4d
211008 17:49:29 time=1633708169.296317 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:1588             tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" blocksize=4096 lid=100012
211008 17:49:29 time=1633708169.296351 func=BroadcastRefreshFromExternal level=INFO  logid=static.............................. unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=Caps:261                       tident= sec=(null) uid=99 gid=99 name=- geo="" id=4f pid=4d
211008 17:49:29 time=1633708169.296604 func=HandleProtoMethodEvents  level=INFO  logid=static.............................. unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=WFE:1626                       tident= sec=(null) uid=99 gid=99 name=- geo="" default SYNC::CREATE /eos/users/test/stagetape tpm03.desy.de:10955 fxid=0000015f mgm.reqid=""
211008 17:49:29 time=1633708169.307751 func=SendProtoWFRequest       level=INFO  logid=static.............................. unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=WFE:2495                       tident= sec=(null) uid=99 gid=99 name=- geo="" protoWFEndPoint="tpm03.desy.de:10955" protoWFResource="/ctafrontend" fullPath="/eos/users/test/stagetape" event="sync::create" timeSpentMs=9 msg="Sent SSI protocol buffer request"
211008 17:49:29 time=1633708169.307872 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:2922             tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" msg="workflow trigger returned" retc=0 errno=0
211008 17:49:29 time=1633708169.307963 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:2995             tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" op=write path=/eos/users/test/stagetape info=eos.app=eoscp&eos.bookingsize=694&eos.rgid=0&eos.ruid=0&eos.targetsize=694&fst.valid=1633708228 target[0]=(tpm03.desy.de,1)  redirection=tpm03.desy.de?&cap.sym=<...>&cap.msg=<...>&mgm.logid=527ae4ac-284f-11ec-a5be-000af7e08db8&mgm.replicaindex=0&mgm.replicahead=0&mgm.id=0000015f&mgm.event=sync::closew&mgm.workflow=default&mgm.instance=eosdev&mgm.owner_uid=0&mgm.owner_gid=0&mgm.requestor=root&mgm.requestorgroup=root&mgm.attributes=c3lzLmFyY2hpdmUuZmlsZV9pZD0yMTs7O3N5cy5hcmNoaXZlLnN0b3JhZ2VfY2xhc3M9Y3RhU3RvcmFnZUNsYXNz xrd_port=1095 http_port=8001
211008 17:49:29 time=1633708169.307976 func=open                     level=INFO  logid=527ae4ac-284f-11ec-a5be-000af7e08db8 unit=mgm@tpm03.desy.de:1094 tid=00007f65735dc700 source=XrdMgmOfsFile:3003             tident=root.75400:116@localhost sec=sss   uid=0 gid=0 name=eosdev geo="1234test" info="redirection" hostport=tpm03.desy.de?&cap.sym=<...>&cap.msg=<...>&mgm.logid=527ae4ac-284f-11ec-a5be-000af7e08db8&mgm.replicaindex=0&mgm.replicahead=0&mgm.id=0000015f&mgm.event=sync::closew&mgm.workflow=default&mgm.instance=eosdev&mgm.owner_uid=0&mgm.owner_gid=0&mgm.requestor=root&mgm.requestorgroup=root&mgm.attributes=c3lzLmFyY2hpdmUuZmlsZV9pZD0yMTs7O3N5cy5hcmNoaXZlLnN0b3JhZ2VfY2xhc3M9Y3RhU3RvcmFnZUNsYXNz:1095

is it an auth problem or what gives?

thanks,
Mwai

Hi Mwai,

The problem in this case seems to come from the FSTs. Have a look at the logs on this FST: tpm03.desy.de in /var/log/eos/fst/xrdlog.fst.

Cheers,
Elvin

Hi Elvin,

after checking the FST logs:

211012 11:07:36 time=1634029656.617844 func=_close                   level=INFO  logid=d7da55f8-2b3b-11ec-a5be-000af7e08db8 unit=fst@tpm03.desy.de:1095 tid=00007f51e9dfc700 source=XrdFstOfsFile:1257             tident=root.126334:29@tpm03 sec=      uid=0 gid=0 name=nobody geo="" viaDelete=0 writeDelete=0
211012 11:07:36 time=1634029656.617853 func=VerifyChecksum           level=INFO  logid=d7da55f8-2b3b-11ec-a5be-000af7e08db8 unit=fst@tpm03.desy.de:1095 tid=00007f51e9dfc700 source=XrdFstOfsFile:3205             tident=root.126334:29@tpm03 sec=      uid=0 gid=0 name=nobody geo="" (write) checksum type: adler checksum hex: fd50c238 requested-checksum hex: -none-
terminate called after throwing an instance of 'XrdSsiPb::XrdSsiException'
  what():  Name or service not known

I’m guessing the ‘name’ key has to have another value other than ‘nobody’?

Thanks,
mwai

Hi Mwai,

It sounds to me that the FSTs are not properly configured for CTA interaction. Do you have the following configuration variables defined in /etc/xrd.cf.fst? These are just an example:

fstofs.protowfendpoint  ctaproductionfrontend:10955
fstofs.protowfresource  /ctafrontend

Cheers,
Elvin

Hi Elvin,

Indeed this was the issue. Now, properly configured & running smoothly.

Many thanks,
mwai