Xrdcp related problem (Is this permission problem)

Dear All,
At Kolkata Tier-2, we moved ALICE::KOLKATA::EOS to Citrine on SL6.10 and now it looks EOS is ok (after fixing fuse problem and downgrading xrootd from 4.8.5 to 4.8.4) but still xrdcp could not read or copy file.

[root@eos ~]# eos -b group ls
┌──────────┬────────────────┬────────────┬──────┬────────────┬────────────┬────────────┬──────────┬──────────┬──────────┐
│type │ name│ status│ N(fs)│ dev(filled)│ avg(filled)│ sig(filled)│ balancing│ bal-shd│ drain-shd│
└──────────┴────────────────┴────────────┴──────┴────────────┴────────────┴────────────┴──────────┴──────────┴──────────┘
groupview default.0 on 6 0.10 79.30 0.05 idle 0 0
groupview default.1 on 6 0.17 79.67 0.13 idle 0 0
groupview default.2 on 6 0.35 79.40 0.22 idle 0 0
groupview default.3 on 6 0.22 79.69 0.13 idle 0 0
groupview default.4 on 6 16.05 58.88 7.93 balancing 8 0
groupview default.5 on 6 0.18 79.53 0.14 idle 0 0

[root@eos ~]# eos -b space ls
┌──────────┬────────────────┬────────────┬────────────┬──────┬─────────┬───────────────┬──────────────┬─────────────┬─────────────┬──────┬──────────┬───────────┬───────────┬──────┬────────┬───────────┬──────┬────────┬───────────┐
│type │ name│ groupsize│ groupmod│ N(fs)│ N(fs-rw)│ sum(usedbytes)│ sum(capacity)│ capacity(rw)│ nom.capacity│ quota│ balancing│ threshold│ converter│ ntx│ active│ wfe│ ntx│ active│ intergroup│
└──────────┴────────────────┴────────────┴────────────┴──────┴─────────┴───────────────┴──────────────┴─────────────┴─────────────┴──────┴──────────┴───────────┴───────────┴──────┴────────┴───────────┴──────┴────────┴───────────┘
spaceview default 0 24 36 36 107.84 TB 141.74 TB 141.56 TB 0 B off on 1 on 20 0 0 0 on

[root@eos ~]# eos fileinfo /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
File: ‘/eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c’ Flags: 0664
Size: 155204001
Modify: Sat Nov 25 06:28:16 2017 Timestamp: 1511571496.852547000
Change: Sat Nov 25 06:28:15 2017 Timestamp: 1511571495.904413952
CUid: 10367 CGid: 1395 Fxid: 0026ecdc Fid: 2551004 Pid: 4087 Pxid: 00000ff7
XStype: adler XS: 90 3e 1c 1c ETAGs: “684779921997824:903e1c1c”
raid6 Stripes: 6 Blocksize: 1M LayoutId: 20640542
#Rep: 6
┌───┬──────┬────────────────────────┬────────────────┬────────────────┬──────────┬──────────────┬────────────┬────────┬────────────────────────┐
│no.│ fs-id│ host│ schedgroup│ path│ boot│ configstatus│ drainstatus│ active│ geotag│
└───┴──────┴────────────────────────┴────────────────┴────────────────┴──────────┴──────────────┴────────────┴────────┴────────────────────────┘
0 6 eos01.tier2-kol.res.in default.2 /edata3 booted rw nodrain online Kolkata-EOS
1 18 eos02.tier2-kol.res.in default.2 /edata3 booted rw nodrain online Kolkata-EOS
2 30 eos03.tier2-kol.res.in default.2 /edata3 booted rw nodrain online Kolkata-EOS
3 5 eos01.tier2-kol.res.in default.2 /edata2 booted rw nodrain online Kolkata-EOS
4 17 eos02.tier2-kol.res.in default.2 /edata2 booted rw nodrain online Kolkata-EOS
5 29 eos03.tier2-kol.res.in default.2 /edata2 booted rw nodrain online Kolkata-EOS


[root@eos ~]# xrdcp -d3 “root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c” /dev/null -f
[2019-02-01 17:52:51.337638 +0530][Dump ][App ] Chunk size: 16777216, parallel chunks 4, streams: 1
[2019-02-01 17:52:51.337807 +0530][Dump ][App ] Processing source entry: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, type xroot, target file: /dev/null
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] URL: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] Protocol: root
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.337884 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.338101 +0530][Dump ][Utility ] Adding job with properties: ‘checkSumMode’ = ‘none’, ‘checkSumPreset’ = ‘’, ‘checkSumType’ = ‘’, ‘chunkSize’ = ‘16777216’, ‘coerce’ = ‘0’, ‘dynamicSource’ = ‘0’, ‘force’ = ‘1’, ‘initTimeout’ = ‘600’, ‘makeDir’ = ‘0’, ‘parallelChunks’ = ‘4’, ‘posc’ = ‘0’, ‘source’ = ‘root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c’, ‘target’ = ‘/dev/null’, ‘thirdParty’ = ‘none’, ‘tpcTimeout’ = ‘1800’, ‘xcp’ = ‘0’, ‘xcpBlockSize’ = ‘134217728’, ‘zipArchive’ = ‘0’
[2019-02-01 17:52:51.338167 +0530][Debug ][Utility ] CopyProcess: 2 jobs to prepare
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] URL: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] Protocol: root
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.338205 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] URL: /dev/null
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] Protocol: file
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.338253 +0530][Dump ][Utility ] Path: /dev/null
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] URL: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] Protocol: root
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.338304 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] URL: /dev/null
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] Protocol: file
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.338351 +0530][Dump ][Utility ] Path: /dev/null
[2019-02-01 17:52:51.338381 +0530][Debug ][Utility ] Creating a classic copy job, from root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c to file://localhost/dev/null
[2019-02-01 17:52:51.338438 +0530][Debug ][Utility ] Monitor library name not set. No monitoring
[2019-02-01 17:52:51.338576 +0530][Debug ][Poller ] Available pollers: built-in
[2019-02-01 17:52:51.338595 +0530][Debug ][Poller ] Attempting to create a poller according to preference: built-in
[2019-02-01 17:52:51.338610 +0530][Debug ][Poller ] Creating poller: built-in
[2019-02-01 17:52:51.338631 +0530][Debug ][Poller ] Creating and starting the built-in poller…
[2019-02-01 17:52:51.338839 +0530][Debug ][Poller ] Using 1 poller threads
[2019-02-01 17:52:51.338869 +0530][Debug ][TaskMgr ] Starting the task manager…
[2019-02-01 17:52:51.338929 +0530][Debug ][TaskMgr ] Task manager started
[2019-02-01 17:52:51.338951 +0530][Debug ][JobMgr ] Starting the job manager…
[2019-02-01 17:52:51.339077 +0530][Debug ][JobMgr ] Job manager started, 3 workers
[2019-02-01 17:52:51.339102 +0530][Debug ][TaskMgr ] Registering task: “FileTimer task” to be run at: [2019-02-01 17:52:51 +0530]
[2019-02-01 17:52:51.339123 +0530][Debug ][Utility ] Opening root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c for reading
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] URL: root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] Protocol: root
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.339190 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] URL: root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] Protocol: root
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.339255 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-01 17:52:51.339578 +0530][Debug ][File ] [0x2068ad0@root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c] Sending an open command
[2019-02-01 17:52:51.339632 +0530][Dump ][XRootD ] [localhost:1094] Sending message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] URL: localhost:1094
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] Protocol: root
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] User Name:
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] Password:
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] Port: 1094
[2019-02-01 17:52:51.339684 +0530][Dump ][Utility ] Path:
[2019-02-01 17:52:51.339726 +0530][Debug ][PostMaster ] Creating new channel to: localhost:1094 1 stream(s)
[2019-02-01 17:52:51.339769 +0530][Debug ][PostMaster ] [localhost:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800
[2019-02-01 17:52:51.339815 +0530][Debug ][TaskMgr ] Registering task: “TickGeneratorTask for: localhost:1094” to be run at: [2019-02-01 17:53:06 +0530]
[2019-02-01 17:52:51.339855 +0530][Dump ][PostMaster ] [localhost:1094 #0] Sending message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x2069fc0) through substream 0 expecting answer at 0
[2019-02-01 17:52:51.339912 +0530][Debug ][PostMaster ] [localhost:1094] Found 1 address(es): [::ffff:127.0.0.1]:1094
[2019-02-01 17:52:51.339957 +0530][Debug ][AsyncSock ] [localhost:1094 #0.0] Attempting connection to [::ffff:127.0.0.1]:1094
[2019-02-01 17:52:51.340039 +0530][Debug ][Poller ] Adding socket 0x206e410 to the poller
[2019-02-01 17:52:51.340205 +0530][Debug ][AsyncSock ] [localhost:1094 #0.0] Async connection call returned
[2019-02-01 17:52:51.340310 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Sending out the initial hand shake + kXR_protocol
[2019-02-01 17:52:51.340419 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: (0x88000950), 44 bytes
[2019-02-01 17:52:51.340507 +0530][Dump ][XRootDTransport ] [msg: 0x88000950] Expecting 8 bytes of message body
[2019-02-01 17:52:51.340528 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-01 17:52:51.340555 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 16 bytes
[2019-02-01 17:52:51.340582 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 310)
[2019-02-01 17:52:51.340605 +0530][Dump ][XRootDTransport ] [msg: 0x88000950] Expecting 8 bytes of message body
[2019-02-01 17:52:51.340619 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-01 17:52:51.340645 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 16 bytes
[2019-02-01 17:52:51.340666 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 310)
[2019-02-01 17:52:51.340770 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Sending out kXR_login request, username: root, cgi: ?xrd.cc=in&xrd.tz=6&xrd.appname=xrdcp&xrd.info=&xrd.hostname=eos.tier2-kol.res.in&xrd.rn=v4.8.4, dual-stack: true, private IPv4: false, private IPv6: false
[2019-02-01 17:52:51.340827 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: (0x88000a60), 119 bytes
[2019-02-01 17:52:51.340920 +0530][Dump ][XRootDTransport ] [msg: 0x88000950] Expecting 50 bytes of message body
[2019-02-01 17:52:51.340936 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-01 17:52:51.340949 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 58 bytes
[2019-02-01 17:52:51.340970 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Logged in, session: fb0200005e1c000029010000fb020000
[2019-02-01 17:52:51.340983 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Authentication is required: &P=sss,0.13:/etc/eos.keytab&P=unix
[2019-02-01 17:52:51.340996 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Sending authentication data
[2019-02-01 17:52:51.342576 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Trying to authenticate using sss
[2019-02-01 17:52:51.342774 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: (0x88000d90), 175 bytes
[2019-02-01 17:52:51.342996 +0530][Dump ][XRootDTransport ] [msg: 0x88000950] Expecting 0 bytes of message body
[2019-02-01 17:52:51.343009 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-01 17:52:51.343017 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 8 bytes
[2019-02-01 17:52:51.343031 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Authenticated with sss.
[2019-02-01 17:52:51.343047 +0530][Debug ][PostMaster ] [localhost:1094 #0] Stream 0 connected.
[2019-02-01 17:52:51.343088 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x2069fc0), 92 bytes
[2019-02-01 17:52:51.343106 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Successfully sent message: kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x2069fc0).
[2019-02-01 17:52:51.343121 +0530][Dump ][XRootD ] [localhost:1094] Message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) has been successfully sent.
[2019-02-01 17:52:51.343140 +0530][Dump ][PostMaster ] [localhost:1094 #0.0] All messages consumed, disable uplink
[2019-02-01 17:52:51.343723 +0530][Dump ][XRootDTransport ] [msg: 0x88000a40] Expecting 118 bytes of message body
[2019-02-01 17:52:51.343737 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header for 0x88000a40 size: 8
[2019-02-01 17:52:51.343753 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message 0x88000a40 of 126 bytes
[2019-02-01 17:52:51.343763 +0530][Dump ][PostMaster ] [localhost:1094 #0] Handling received message: 0x88000a40.
[2019-02-01 17:52:51.343844 +0530][Dump ][XRootD ] [localhost:1094] Got a kXR_error response to request kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) [3010] Unable to open file /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c; Operation not permitted
[2019-02-01 17:52:51.343911 +0530][Debug ][XRootD ] [localhost:1094] Handling error while processing kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): [ERROR] Error response: Permission denied.
[2019-02-01 17:52:51.344008 +0530][Debug ][File ] [0x2068ad0@root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c] Open has returned with status [ERROR] Server responded with an error: [3010] Unable to open file /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c; Operation not permitted
[2019-02-01 17:52:51.344033 +0530][Debug ][File ] [0x2068ad0@root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c] Error while opening at localhost:1094: [ERROR] Server responded with an error: [3010] Unable to open file /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c; Operation not permitted
[0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3010] Unable to open file /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c; Operation not permitted

[2019-02-01 17:52:51.344335 +0530][Debug ][JobMgr ] Stopping the job manager…
[2019-02-01 17:52:51.344364 +0530][Dump ][JobMgr ] Stopping worker #0
[2019-02-01 17:52:51.344606 +0530][Dump ][JobMgr ] Worker #0 stopped
[2019-02-01 17:52:51.344626 +0530][Dump ][JobMgr ] Stopping worker #1
[2019-02-01 17:52:51.344686 +0530][Dump ][JobMgr ] Worker #1 stopped
[2019-02-01 17:52:51.344700 +0530][Dump ][JobMgr ] Stopping worker #2
[2019-02-01 17:52:51.344754 +0530][Dump ][JobMgr ] Worker #2 stopped
[2019-02-01 17:52:51.344768 +0530][Debug ][JobMgr ] Job manager stopped
[2019-02-01 17:52:51.344781 +0530][Debug ][TaskMgr ] Stopping the task manager…
[2019-02-01 17:52:51.344894 +0530][Debug ][TaskMgr ] Task manager stopped
[2019-02-01 17:52:51.344913 +0530][Debug ][Poller ] Stopping the poller…
[2019-02-01 17:52:51.345009 +0530][Debug ][TaskMgr ] Requesting unregistration of: “TickGeneratorTask for: localhost:1094”
[2019-02-01 17:52:51.345031 +0530][Debug ][AsyncSock ] [localhost:1094 #0.0] Closing the socket
[2019-02-01 17:52:51.345047 +0530][Debug ][Poller ] <[::ffff:127.0.0.1]:39740><–><[::ffff:127.0.0.1]:1094> Removing socket from the poller
[2019-02-01 17:52:51.345101 +0530][Debug ][PostMaster ] [localhost:1094 #0] Destroying stream
[2019-02-01 17:52:51.345125 +0530][Debug ][AsyncSock ] [localhost:1094 #0.0] Closing the socket
[root@eos ~]#

It seems this is permission problem. Present permissions is as below:-

[root@eos ~]# ls -ltr /eos/kolkataalice/grid/
total 0
drwxr-x— 1 10367 1395 0 Sep 6 06:03 13
drwxr-x— 1 10367 1395 0 Sep 7 18:09 02
drwxr-x— 1 10367 1395 0 Sep 8 06:28 04
drwxr-x— 1 10367 1395 0 Sep 8 11:14 11
drwxr-x— 1 10367 1395 0 Sep 8 23:28 14
drwxr-x— 1 10367 1395 0 Oct 16 16:13 07
drwxr-x— 1 10367 1395 0 Oct 19 08:17 01
drwxr-x— 1 10367 1395 0 Oct 19 17:48 06
drwxr-x— 1 10367 1395 0 Oct 19 20:46 09
drwxr-x— 1 10367 1395 0 Oct 19 20:52 10
drwxr-x— 1 10367 1395 0 Oct 20 00:07 15
drwxr-x— 1 10367 1395 0 Oct 25 07:59 12
drwxr-x— 1 10367 1395 0 Oct 25 13:47 00
drwxr-x— 1 10367 1395 0 Oct 28 04:12 03
drwxr-x— 1 10367 1395 0 Oct 30 10:41 05
drwxr-x— 1 10367 1395 0 Nov 6 01:02 08
[root@eos ~]# ls -ld /eos/kolkataalice/grid
drwxr-x— 1 10367 1395 0 Jan 31 16:41 /eos/kolkataalice/grid
[root@eos ~]#

Kindly suggest accordingly.

Vikas

yes, it looks like a permission issue.
Could you please paste here the output of “eos vid ls”

and try to connect to the instance running “eos whoami” (instead of xrdcp, to better understand to which user you are mapped and which protocol is used)

Thanks,
Luca

Dear Luca Mascetti,

Output of eos vid ls and eos whoami are below:-


[root@eos ~]# eos vid ls
https:"":gid => root
https:"":uid => root
krb5:"":gid => root
krb5:"":uid => root
sss:"":gid => root
sss:"":uid => root
sudoer => uids()
tident:"@eos":gid => root
tident:"
@eos":uid => root
unix:"":gid => 1395
unix:"":uid => 10367
[root@eos ~]# eos vid ls -U
https:"":uid => root
krb5:"":uid => root
sss:"":uid => root
tident:"@eos":uid => root
unix:"":uid => 10367
[root@eos ~]#
[root@eos ~]# eos whoami
Virtual Identity: uid=0 (2,99,3,0) gid=0 (99,4,0) [authz:sss] sudo
host=localhost
[root@eos ~]#


I also send the permission of /eos :-

[root@eos ~]# eos -b ls -la /eos/kolkataalice/grid/
drwxr-x–+ 1 10367 1395 0 Feb 4 20:18 .
drwxr-xr-x 1 root root 0 Mar 31 2017 …
drwxr-s–+ 1 10367 1395 0 Oct 25 13:47 00
drwxr-s–+ 1 10367 1395 0 Oct 19 08:17 01
drwxr-s–+ 1 10367 1395 0 Sep 7 18:09 02
drwxr-s–+ 1 10367 1395 0 Oct 28 04:12 03
drwxr-s–+ 1 10367 1395 0 Sep 8 06:28 04
drwxr-s–+ 1 10367 1395 0 Oct 30 10:41 05
drwxr-s–+ 1 10367 1395 0 Oct 19 17:48 06
drwxr-s— 1 10367 1395 0 Oct 16 16:13 07
drwxr-s–+ 1 10367 1395 0 Nov 6 01:02 08
drwxr-s–+ 1 10367 1395 0 Oct 19 20:46 09
drwxr-s–+ 1 10367 1395 0 Oct 19 20:52 10
drwxr-s–+ 1 10367 1395 0 Sep 8 11:14 11
drwxr-s–+ 1 10367 1395 0 Oct 25 07:59 12
drwxr-s–+ 1 10367 1395 0 Sep 6 06:03 13
drwxr-s–+ 1 10367 1395 0 Sep 8 23:28 14
drwxr-s–+ 1 10367 1395 0 Oct 20 00:07 15
[root@eos ~]#

Suggest accordingly.
Thanks
Prasun

If anyone has any suggestion, Please update.

Could you please check the MGM logs about this transfer and upload them here?
(and as well the /etc/xrd.cf.mgm)

With your current setting as who is the process suppose to connect? and using which authentication?

Thanks

Dear Luca,
Thank for you attention.
As per you suggestion, I add xrd.cf. mgm and error messages shown during copy file by xrdcp and eoscp. Also, some portion of xrdlog of mgm are add below.

xrd.cf.mgm:-
[root@eos ~]# cat /etc/xrd.cf.mgm
###########################################################
xrootd.fslib libXrdEosMgm.so
xrootd.seclib libXrdSec.so
xrootd.async off nosf
xrootd.chksum adler32
###########################################################
xrd.sched mint 8 maxt 256 idle 64
###########################################################
all.export /
all.role manager
###########################################################
oss.fdlimit 16384 32768
###########################################################
####### UNIX authentication
sec.protocol unix
####### SSS authentication
sec.protocol sss -c /etc/eos.keytab -s /etc/eos.keytab
####### KRB authentication
#sec.protocol krb5 -exptkn:/var/eos/auth/krb5# host/@CERN.CH
#sec.protocol krb5 host/@CERN.CH
####### GSI authentication
#sec.protocol gsi -crl:0 -cert:/etc/grid-security/daemon/hostcert.pem -key:/etc/grid-security/daemon/hostkey.pem -gridmap:/etc/grid-security/grid-mapfile -d:0 -gmapopt:2 -vomsat:1 -moninfo:1 -exppxy:/var/eos/auth/gsi#

#sec.protocol gsi -crl:0 -cert:/etc/grid-security/daemon/hostcert.pem -key:/etc/grid-security/daemon/hostkey.pem -gridmap:/etc/grid-security/grid-mapfile -d:0 -gmapopt:2 -vomsat:1 -moninfo:1
###########################################################
sec.protbind localhost.localdomain sss unix
sec.protbind localhost sss unix
sec.protbind * only sss unix
###########################################################
mgmofs.fs /
mgmofs.targetport 1095
mgmofs.authlib /usr/lib64/libXrdAliceTokenAcc.so
mgmofs.authorize 1
###########################################################
#mgmofs.trace all debug
####### this URL can be overwritten by EOS_BROKER_URL defined in /etc/sysconfig/eos

mgmofs.broker root://localhost:1097//eos/
####### this name can be overwritten by EOS_INSTANCE_NAME defined in /etc/sysconfig/eos

mgmofs.instance eosdev

####### configuration, namespace , transfer and authentication export directory
mgmofs.configdir /var/eos/config
mgmofs.metalog /var/eos/md
mgmofs.txdir /var/eos/tx
mgmofs.authdir /var/eos/auth
mgmofs.archivedir /var/eos/archive

####### report store path
mgmofs.reportstorepath /var/eos/report

####### this defines the default config to load
mgmofs.autoloadconfig default

#######-------------------------------------------------------------------------------
####### Config Engine Configuration
#######-------------------------------------------------------------------------------
mgmofs.cfgtype file

####### this has to be defined if we have a failover configuration via alias - can be overwritten by EOS_MGM_ALIAS in /etc/sysconfig/eos
#mgmofs.alias eosdev.cern.ch

#######-------------------------------------------------------------------------------
####### Configuration for the authentication plugin EosAuth
#######-------------------------------------------------------------------------------
####### Set the number of authentication worker threads running on the MGM
####### mgmofs.auththreads 10

####### Set the front end port number for incoming authentication requests
#######mgmofs.authport 15555

###########################################################
####### Set the FST gateway host and port
mgmofs.fstgw someproxy.cern.ch:3001

#######-------------------------------------------------------------------------------
####### Configuration for the authentication plugin EosAuth
#######-------------------------------------------------------------------------------
####### Set the number of authentication worker threads running on the MGM
#mgmofs.auththreads 10

####### Set the front end port number for incoming authentication requests
#mgmofs.authport 15555

#######-------------------------------------------------------------------------------
####### Set the namespace plugin implementation
#######-------------------------------------------------------------------------------
mgmofs.nslib /usr/lib64/libEosNsInMemory.so
#mgmofs.nslib /usr/lib64/libEosNsQuardb.so

####### Quarkdb custer configuration used for the namespace
#mgmofs.qdbcluster localhost:7777
#mgmofs.qdbpassword_file /etc/eos.keytab

####### Enable central draining to be use with Quarkdb namespace
#mgmofs.centraldrain true

#######-------------------------------------------------------------------------------
####### Configuration for the MGM workflow engine
#######-------------------------------------------------------------------------------

####### The SSI protocol buffer endpoint for notification messages from “proto” workflow actions
#mgmofs.protowfendpoint HOSTNAME.2NDLEVEL.TOPLEVEL:10955
#mgmofs.protowfresource /SSI_RESOURCE

#######-------------------------------------------------------------------------------
####### Configuration for the tape aware garbage collector
#######-------------------------------------------------------------------------------

####### Whether or not the garbage collector should be enabled. Default is false.
#mgmofs.tapeawaregc.defaultspace.enable false

####### Minimum number of free bytes to be available in the default EOS space. If the
####### actual number of free bytes is less than this value then the garbage collector
####### will try to free up space by garbage collecting disk replicas. Default is 0
####### which effective means no garbage collection.
#mgmofs.tapeawaregc.defaultspace.minfreebytes 0
###########################################################
####### configure bypass and prefix for ALICE SE
#########################################################
alicetokenacc.noauthzhost localhost
alicetokenacc.noauthzhost localhost.localdomain
alicetokenacc.truncateprefix /eos/kolkataalice/grid
[root@eos ~]#
######################################################

Error during copy a file from local file i.e. hosts to /eos/kolkataalice/grid by “eoscp” and “eos cp” and “xrdcp”.
+++++++++++++++
root@eos ~]# eoscp /etc/hosts /eos/kolkataalice/grid/hosts4
error: errc=13 msg=“Permission denied”

[root@eos ~]# eos cp /etc/hosts /eos/kolkataalice/grid/hosts4
^Cerror: file size difference between source and target file source=/etc/hosts [400 B] target=root://localhost//eos/kolkataalice/grid/hosts4 [0 B]
#WARNING [eos-cp] copied 0/1 files and 0 B in 6.34 seconds with 0 B/s

[root@eos ~]# xrdcp -d3 /etc/hosts /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918304 +0530][Dump ][App ] Chunk size: 16777216, parallel chunks 4, streams: 1
[2019-02-07 20:12:02.918451 +0530][Dump ][App ] Processing source entry: /etc/hosts, type local file, target file: file:///eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] URL: file:///etc/hosts
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.918504 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.918682 +0530][Dump ][Utility ] Adding job with properties: ‘checkSumMode’ = ‘none’, ‘checkSumPreset’ = ‘’, ‘checkSumType’ = ‘’, ‘chunkSize’ = ‘16777216’, ‘coerce’ = ‘0’, ‘dynamicSource’ = ‘0’, ‘force’ = ‘0’, ‘initTimeout’ = ‘600’, ‘makeDir’ = ‘0’, ‘parallelChunks’ = ‘4’, ‘posc’ = ‘0’, ‘source’ = ‘file:///etc/hosts’, ‘target’ = ‘file:///eos/kolkataalice/grid/hosts5’, ‘thirdParty’ = ‘none’, ‘tpcTimeout’ = ‘1800’, ‘xcp’ = ‘0’, ‘xcpBlockSize’ = ‘134217728’, ‘zipArchive’ = ‘0’
[2019-02-07 20:12:02.918734 +0530][Debug ][Utility ] CopyProcess: 2 jobs to prepare
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] URL: file:///etc/hosts
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.918769 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] URL: file:///eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.918813 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] URL: file:///etc/hosts
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.918861 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] URL: file:///eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.918903 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918933 +0530][Debug ][Utility ] Creating a classic copy job, from file://localhost/etc/hosts to file://localhost/eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.918975 +0530][Debug ][Utility ] Monitor library name not set. No monitoring
[2019-02-07 20:12:02.919072 +0530][Debug ][Poller ] Available pollers: built-in
[2019-02-07 20:12:02.919088 +0530][Debug ][Poller ] Attempting to create a poller according to preference: built-in
[2019-02-07 20:12:02.919102 +0530][Debug ][Poller ] Creating poller: built-in
[2019-02-07 20:12:02.919120 +0530][Debug ][Poller ] Creating and starting the built-in poller…
[2019-02-07 20:12:02.919347 +0530][Debug ][Poller ] Using 1 poller threads
[2019-02-07 20:12:02.919391 +0530][Debug ][TaskMgr ] Starting the task manager…
[2019-02-07 20:12:02.919487 +0530][Debug ][TaskMgr ] Task manager started
[2019-02-07 20:12:02.919511 +0530][Debug ][JobMgr ] Starting the job manager…
[2019-02-07 20:12:02.919631 +0530][Debug ][JobMgr ] Job manager started, 3 workers
[2019-02-07 20:12:02.919654 +0530][Debug ][TaskMgr ] Registering task: “FileTimer task” to be run at: [2019-02-07 20:12:02 +0530]
[2019-02-07 20:12:02.919674 +0530][Debug ][Utility ] Opening file://localhost/etc/hosts for reading
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] URL: file://localhost/etc/hosts
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.919721 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] URL: file://localhost/etc/hosts
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.919787 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.919825 +0530][Debug ][File ] [0x1e33c70@file://localhost/etc/hosts] Sending an open command
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] URL: file://localhost/etc/hosts
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.919860 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] URL: file://localhost/etc/hosts
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.919931 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.920107 +0530][Debug ][File ] [0x1e33c70@file://localhost/etc/hosts] Open has returned with status [SUCCESS]
[2019-02-07 20:12:02.920146 +0530][Debug ][File ] [0x1e33c70@file://localhost/etc/hosts] successfully opened at localhost, handle: 0x9, session id: 1
[2019-02-07 20:12:02.920230 +0530][Debug ][Utility ] Opening file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400 for writing
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] URL: file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.920278 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] URL: file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.920334 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.920374 +0530][Debug ][File ] [0x1e386d0@file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400] Sending an open command
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] URL: file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.920408 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.923046 +0530][Error ][File ] Open: open failed: /eos/kolkataalice/grid/hosts5: Permission denied
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] URL: file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.923124 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/hosts5
[2019-02-07 20:12:02.923566 +0530][Debug ][File ] [0x1e386d0@file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400] Open has returned with status [ERROR] Server responded with an error: [3010] Permission denied
[2019-02-07 20:12:02.923611 +0530][Debug ][File ] [0x1e386d0@file://localhost/eos/kolkataalice/grid/hosts5?oss.asize=400] Error while opening at localhost: [ERROR] Server responded with an error: [3010] Permission denied
[2019-02-07 20:12:02.923667 +0530][Debug ][File ] [0x1e33c70@file://localhost/etc/hosts] Sending a close command for handle 0x9 to localhost
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] URL: file://localhost/etc/hosts
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] Protocol: file
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] User Name:
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] Password:
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] Port: 1094
[2019-02-07 20:12:02.923735 +0530][Dump ][Utility ] Path: /etc/hosts
[2019-02-07 20:12:02.923809 +0530][Debug ][File ] [0x1e33c70@file://localhost/etc/hosts] Close returned from localhost with: [SUCCESS]
[2019-02-07 20:12:02.923840 +0530][Dump ][File ] [0x1e33c70@file://localhost/etc/hosts] Items in the fly 0, queued for recovery 0
[0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3010] Permission denied

[2019-02-07 20:12:02.924001 +0530][Debug ][JobMgr ] Stopping the job manager…
[2019-02-07 20:12:02.924021 +0530][Dump ][JobMgr ] Stopping worker #0
[2019-02-07 20:12:02.924181 +0530][Dump ][JobMgr ] Worker #0 stopped
[2019-02-07 20:12:02.924197 +0530][Dump ][JobMgr ] Stopping worker #1
[2019-02-07 20:12:02.924246 +0530][Dump ][JobMgr ] Worker #1 stopped
[2019-02-07 20:12:02.924259 +0530][Dump ][JobMgr ] Stopping worker #2
[2019-02-07 20:12:02.924300 +0530][Dump ][JobMgr ] Worker #2 stopped
[2019-02-07 20:12:02.924312 +0530][Debug ][JobMgr ] Job manager stopped
[2019-02-07 20:12:02.924322 +0530][Debug ][TaskMgr ] Stopping the task manager…
[2019-02-07 20:12:02.924510 +0530][Debug ][TaskMgr ] Task manager stopped
[2019-02-07 20:12:02.924532 +0530][Debug ][Poller ] Stopping the poller…
[root@eos ~]#
+++++++++++++

Now we copy any file from eos to /de/null by xrdcp, it’s fail. But eoscp is ok.

[root@eos ~]# xrdcp “root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c” /dev/null -f
[0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3010] Unable to open file /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c; Operation not permitted

[root@eos ~]# eoscp -b 1000000 /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c /dev/null
[eoscp] Total 148.01 MB |====================| 100.00 % [39.5 MB/s]
[eoscp] #################################################################
[eoscp] # Date : ( 1549550579 ) Thu Feb 7 20:12:59 2019
[eoscp] # auth forced= krb5= gsi=
[eoscp] # Source Name [00] : /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[eoscp] # Destination Name [00] : /dev/null
[eoscp] # Data Copied [bytes] : 155204001
[eoscp] # Realtime [s] : 3.933000
[eoscp] # Eff.Copy. Rate[MB/s] : 39.461988
[eoscp] # Write Start Position : 0
[eoscp] # Write Stop Position : 155204001
[root@eos ~]#


Some time frequently xrdlog has shown " …IP46 login as alienmaster…". Is it use dual stack network?
#####################
c> sec=unix uid=10367 gid=1395 name=alienmaster geo="" msg=“deleted” can-recycle=0 path=/eos/kolkataalice/grid/14/27466/8c0577f2-f417-11e7-9a83-bb2712efa2a1 owner.uid=10367 owner.gid=1395 vid.uid=10367 vid.gid=1395
190207 20:32:23 21744 XrootdXeq: alienmas.1156:120@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 21335 XrootdXeq: alienmas.1164:112@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 21741 XrootdXeq: alienmas.1171:113@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 21938 XrootdXeq: alienmas.1179:114@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 21739 XrootdXeq: alienmas.1135:123@pcaliendb06a.cern.ch disc 0:00:00
190207 20:32:23 21740 XrootdXeq: alienmas.1186:116@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 21521 XrootdXeq: alienmas.1201:118@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 21742 XrootdXeq: alienmas.1194:117@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:32:23 time=1549551743.832813 func=IdMap level=INFO logid=static…
#####################

Last query i.e. “With your current setting as who is the process suppose to connect? and using which authentication?”, I am not understand.

Kindly suggest accordingly.

Thanks

Dear Luca,

I also add last snaps of xrdlog of mgm:-
###############################
190207 20:29:11 time=1549551551.163364 func=BroadcastRefreshFromExternal level=INFO logid=static… unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b151fe700 source=FuseServer:1230 tident= sec=(null) uid=99 gid=99 name=- geo="" id=6af8 pid=35
190207 20:29:11 time=1549551551.163456 func=PurgeVersion level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b151fe700 source=Version:178 tident= sec= uid=0 gid=0 name= geo="" version-dir=/eos/kolkataalice/grid/13/38322/.sys.v#.a6df27fc-afcf-11e8-b7fe-97782329c3e6/ max-versions=0
190207 20:29:11 time=1549551551.163513 func=PurgeVersion level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b590fc700 source=Version:207 tident= sec= uid=0 gid=0 name= geo="" listrc=-1 max-version=0
190207 20:29:11 time=1549551551.163572 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b590fc700 source=Rm:425 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" msg=“deleted” can-recycle=0 path=/eos/kolkataalice/grid/12/39832/99295f7c-9451-11e8-9adb-77d01fe0f2ea owner.uid=10367 owner.gid=1395 vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.163610 func=PurgeVersion level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0d3ff700 source=Version:207 tident= sec= uid=0 gid=0 name= geo="" listrc=-1 max-version=0
190207 20:29:11 time=1549551551.163681 func=PurgeVersion level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b591fd700 source=Version:207 tident= sec= uid=0 gid=0 name= geo="" listrc=-1 max-version=0
190207 20:29:11 time=1549551551.163785 func=PurgeVersion level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b151fe700 source=Version:207 tident= sec= uid=0 gid=0 name= geo="" listrc=-1 max-version=0
190207 20:29:11 time=1549551551.163838 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0d3ff700 source=Rm:425 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" msg=“deleted” can-recycle=0 path=/eos/kolkataalice/grid/02/26715/fdd136c2-a1e7-11e8-92ab-cfc45a4177a2 owner.uid=10367 owner.gid=1395 vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.163896 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b591fd700 source=Rm:425 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" msg=“deleted” can-recycle=0 path=/eos/kolkataalice/grid/09/38544/2b1f41e8-a0bf-11e8-92bc-bb7e4ba80788 owner.uid=10367 owner.gid=1395 vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.163944 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b151fe700 source=Rm:425 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" msg=“deleted” can-recycle=0 path=/eos/kolkataalice/grid/13/38322/a6df27fc-afcf-11e8-b7fe-97782329c3e6 owner.uid=10367 owner.gid=1395 vid.uid=10367 vid.gid=1395
190207 20:29:11 21741 XrootdXeq: alienmas.25809:78@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:29:11 21743 XrootdXeq: alienmas.25795:116@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:29:11 21740 XrootdXeq: alienmas.25810:112@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:29:11 21744 XrootdXeq: alienmas.25796:117@pcaliendb06a.cern.ch pub IP46 login as alienmaster
190207 20:29:11 21336 XrootdXeq: alienmas.25726:114@pcaliendb06a.cern.ch disc 0:00:01
190207 20:29:11 21745 XrootdXeq: alienmas.25717:119@pcaliendb06a.cern.ch disc 0:00:01
190207 20:29:11 21739 XrootdXeq: alienmas.25725:115@pcaliendb06a.cern.ch disc 0:00:01
190207 20:29:11 21335 XrootdXeq: alienmas.25724:113@pcaliendb06a.cern.ch disc 0:00:01
190207 20:29:11 time=1549551551.453449 func=IdMap level=INFO logid=static… unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Mapping:879 tident= sec=(null) uid=99 gid=99 name=- geo="" sec.prot=unix sec.name=“alienmaster” sec.host=“pcaliendb06a.cern.ch” sec.vorg="" sec.grps=“alienmaster” sec.role="" sec.info="" sec.app="" sec.tident=“alienmas.25809:78@pcaliendb06a.cern.ch”
190207 20:29:11 time=1549551551.453668 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:104 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" path=/eos/kolkataalice/grid/09/36970/27423d50-9624-11e8-997b-af49fa499096 vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.457800 func=IdMap level=INFO logid=static… unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Mapping:879 tident= sec=(null) uid=99 gid=99 name=- geo="" sec.prot=unix sec.name=“alienmaster” sec.host=“pcaliendb06a.cern.ch” sec.vorg="" sec.grps=“alienmaster” sec.role="" sec.info="" sec.app="" sec.tident=“alienmas.25795:116@pcaliendb06a.cern.ch”
190207 20:29:11 time=1549551551.457951 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Rm:104 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" path=/eos/kolkataalice/grid/00/55497/82de3408-938f-11e8-96d0-67ed2b1cc7a6 vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.464177 func=IdMap level=INFO logid=static… unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0f7ff700 source=Mapping:879 tident= sec=(null) uid=99 gid=99 name=- geo="" sec.prot=unix sec.name=“alienmaster” sec.host=“pcaliendb06a.cern.ch” sec.vorg="" sec.grps=“alienmaster” sec.role="" sec.info="" sec.app="" sec.tident=“alienmas.25810:112@pcaliendb06a.cern.ch”
190207 20:29:11 time=1549551551.464330 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0f7ff700 source=Rm:104 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" path=/eos/kolkataalice/grid/08/16713/bded8b3c-93f5-11e8-b465-9fed112fa41c vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.507945 func=IdMap level=INFO logid=static… unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0d9fe700 source=Mapping:879 tident= sec=(null) uid=99 gid=99 name=- geo="" sec.prot=unix sec.name=“alienmaster” sec.host=“pcaliendb06a.cern.ch” sec.vorg="" sec.grps=“alienmaster” sec.role="" sec.info="" sec.app="" sec.tident=“alienmas.25796:117@pcaliendb06a.cern.ch”
190207 20:29:11 time=1549551551.508131 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0d9fe700 source=Rm:104 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" path=/eos/kolkataalice/grid/03/61154/d5ff7c70-95e5-11e8-9754-c70ec17cb713 vid.uid=10367 vid.gid=1395
190207 20:29:11 time=1549551551.740921 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:153 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" got fmd=140164174383248
190207 20:29:11 time=1549551551.741043 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:180 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" got container=140161073432080
190207 20:29:11 time=1549551551.741241 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:187 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" acl= mutable=1
190207 20:29:11 time=1549551551.741288 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:265 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" got quota node=140167767636992
190207 20:29:11 time=1549551551.741318 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:283 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" unlinking from view /eos/kolkataalice/grid/09/36970/27423d50-9624-11e8-997b-af49fa499096
190207 20:29:11 time=1549551551.741359 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0ebfe700 source=Rm:292 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" msg=“no workflow defined for delete”
190207 20:29:11 time=1549551551.741410 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Rm:153 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" got fmd=140164137245968
190207 20:29:11 time=1549551551.741480 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Rm:180 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" got container=140161025039184
190207 20:29:11 time=1549551551.741592 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Rm:187 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" acl= mutable=1
190207 20:29:11 time=1549551551.741634 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Rm:265 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" got quota node=140167767636992
190207 20:29:11 time=1549551551.741680 func=_rem level=INFO logid=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx unit=mgm@eos.tier2-kol.res.in:1094 tid=00007f7b0e9fc700 source=Rm:283 tident= sec=unix uid=10367 gid=1395 name=alienmaster geo="" unlinking from view /eos/kolkataalice/grid/00/55497/82de3408-938f-11e8-96d0-67ed2b1cc7
#########################
Suggest accordingly.

Hi Prasun,

I believe that your problem comes from the fact that you are trying to write as root into one of the directories e.g. /eos/kolkataalice/grid/ which are owned by aliprod and don’t have write permissions for anyone else. Therefore, try running this command below where you request to be mapped as aliprod:

xrdcp -f -d 1 “root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367” /dev/null

Please let me know if this works for you.

Thank you,
Elvin

Dear Elvin,

Thanks Elvin for your suggestion.

I run the command which has suggest by you. Output is below:-

==========
[root@eos ~]# xrdcp -f -d 1 “root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367” /dev/null
xrdcp: No such file or directory processing “root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367”
[root@eos ~]#

It say that no such files or directory. But I check this file path, it’s exist.
+++++++++++++
[root@eos ~]# eos -b ls -la /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
-rw-rw-r-- 6 10367 1395 155204001 Nov 25 2017 b793d378-d17b-11e7-8ef0-fb9b42643b0c
[root@eos ~]# eos -b file info /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
File: ‘/eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c’ Flags: 0664
Size: 155204001
Modify: Sat Nov 25 06:28:16 2017 Timestamp: 1511571496.852547000
Change: Sat Nov 25 06:28:15 2017 Timestamp: 1511571495.904413952
CUid: 10367 CGid: 1395 Fxid: 0026ecdc Fid: 2551004 Pid: 4087 Pxid: 00000ff7
XStype: adler XS: 90 3e 1c 1c ETAGs: “684779921997824:903e1c1c”
raid6 Stripes: 6 Blocksize: 1M LayoutId: 20640542
#Rep: 6
┌───┬──────┬────────────────────────┬────────────────┬────────────────┬──────────┬──────────────┬────────────┬────────┬────────────────────────┐
│no.│ fs-id│ host│ schedgroup│ path│ boot│ configstatus│ drainstatus│ active│ geotag│
└───┴──────┴────────────────────────┴────────────────┴────────────────┴──────────┴──────────────┴────────────┴────────┴────────────────────────┘
0 6 eos01.tier2-kol.res.in default.2 /edata3 booted rw nodrain online Kolkata-EOS
1 18 eos02.tier2-kol.res.in default.2 /edata3 booted rw nodrain online Kolkata-EOS
2 30 eos03.tier2-kol.res.in default.2 /edata3 booted rw nodrain online Kolkata-EOS
3 5 eos01.tier2-kol.res.in default.2 /edata2 booted rw nodrain online Kolkata-EOS
4 17 eos02.tier2-kol.res.in default.2 /edata2 booted rw nodrain online Kolkata-EOS
5 29 eos03.tier2-kol.res.in default.2 /edata2 booted rw nodrain online Kolkata-EOS


[root@eos ~]# xrdcp -f -d 1 “root://eos.tier2-kol.res.in//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367” /dev/null
xrdcp: No such file or directory processing “root://eos.tier2-kol.res.in//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367”
[root@eos ~]#

++++++++++++++++++++++

I try with hostname instead of localhost, but problem is same.
eos cp is give error and eoscp is Ok.


[root@eos ~]# eos cp /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c /dev/null
[eoscp] b793d378-d17b-11e7-8ef0-fb9b42643b0c Total 148.01 MB |====================| 100.00 % [217.1 MB/s]
error: file size difference between source and target file source=root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.app=eoscp&eos.ruid=0&eos.rgid=0 [155.20 MB] target=/dev/null [0 B]
#WARNING [eos-cp] copied 0/1 files and 0 B in 0.75 seconds with 0 B/s
[root@eos ~]# eoscp /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c /dev/null
[eoscp] Total 148.01 MB |====================| 100.00 % [266.2 MB/s]
[eoscp] #################################################################
[eoscp] # Date : ( 1550835943 ) Fri Feb 22 17:15:43 2019
[eoscp] # auth forced= krb5= gsi=
[eoscp] # Source Name [00] : /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[eoscp] # Destination Name [00] : /dev/null
[eoscp] # Data Copied [bytes] : 155204001
[eoscp] # Realtime [s] : 0.584000
[eoscp] # Eff.Copy. Rate[MB/s] : 265.760281
[eoscp] # Write Start Position : 0
[eoscp] # Write Stop Position : 155204001
[root@eos ~]#

It has notice that permission of map folder inside /eos/kolkataalice/grid are contain sticky bit (s):- (In Bold letter)

[root@eos ~]# eos -b ls -la /eos/kolkataalice/grid/
drwxr-x–+ 1 10367 1395 0 Feb 21 19:44 .
drwxr-xr-x 1 root root 0 Feb 18 17:10 …
drwxr-s–+ 1 10367 1395 0 Oct 25 13:47 00
drwxr-s–+ 1 10367 1395 0 Oct 19 08:17 01
drwxr-s–+ 1 10367 1395 0 Feb 16 11:30 02
drwxr-s–+ 1 10367 1395 0 Oct 28 04:12 03
drwxr-s–+ 1 10367 1395 0 Feb 18 23:30 04
drwxr-s–+ 1 10367 1395 0 Oct 30 10:41 05
drwxr-s–+ 1 10367 1395 0 Feb 9 20:43 06
drwxr-s— 1 10367 1395 0 Feb 14 19:30 07
drwxr-s–+ 1 10367 1395 0 Feb 16 02:31 08
drwxr-s–+ 1 10367 1395 0 Feb 10 13:02 09
drwxr-s–+ 1 10367 1395 0 Feb 10 05:08 10
drwxr-s–+ 1 10367 1395 0 Sep 8 11:14 11
drwxr-s–+ 1 10367 1395 0 Feb 20 22:30 12
drwxr-s–+ 1 10367 1395 0 Feb 20 20:30 13
drwxr-s–+ 1 10367 1395 0 Feb 18 09:30 14
drwxr-s–+ 1 10367 1395 0 Feb 17 00:30 15
-rw-r–r-- 0 root root 0 Feb 21 19:42 eos_env1

Is’t right.

Update accordingly.

Regards
Prasun

Hi Prasun,

Did you run the xrdcp command on the MGM node?
Can you paste the output of:
echo $EOS_MGM_URL

Thanks,
Elvin

Also please do:
rpm -qa | grep xrootd
rpm -qa | grep eos

Thanks,
Elvin

Dear Elvin

Yes, I executed the xrdcp command on the MGM node.

Output of “echo $EOS_MGM_URL” and rpm -qa | grep xrootd ; rpm -qa | grep eos are below:-

==============
[root@eos ~]# echo $EOS_MGM_URL

[root@eos ~]#
++++++++++
[root@eos ~]# rpm -qa | grep xrootd
xrootd-server-4.8.5-1.el7.x86_64
xrootd-libs-4.8.5-1.el7.x86_64
xrootd-4.8.5-1.el7.x86_64
xrootd-client-libs-4.8.5-1.el7.x86_64
xrootd-private-devel-4.8.5-1.el7.x86_64
xrootd-alicetokenacc-1.3.1-1.x86_64
xrootd-client-4.8.5-1.el7.x86_64
xrootd-server-libs-4.8.5-1.el7.x86_64
xrootd-selinux-4.8.5-1.el7.noarch
[root@eos ~]#
++++++++++++++
[root@eos ~]# rpm -qa | grep eos
eos-fuse-core-4.4.23-1.el7.cern.x86_64
eos-fuse-sysv-4.4.23-1.el7.cern.x86_64
eos-test-4.4.23-1.el7.cern.x86_64
libmicrohttpd-0.9.38-eos.yves.el7.cern.x86_64
eos-nginx-1.12.2-5.x86_64
eos-cleanup-4.4.23-1.el7.cern.x86_64
eos-apmon-1.1.8-1.el7.cern.x86_64
eos-server-4.4.23-1.el7.cern.x86_64
eos-fuse-4.4.23-1.el7.cern.x86_64
eos-client-4.4.23-1.el7.cern.x86_64
eos-folly-2017.09.18.00-4.el7.cern.x86_64
[root@eos ~]#
++++++++++++++++

Thanks
Prasun

Hi Prasun,

The xrootd-4.8.5-1 is broken. You need to either install version 4.8.5-2 or downgrade to 4.8.4.
Please re-run the xrdcp command after you modify the xrootd-* packages.

Thanks,
Elvin

Can you explain how it is broken? We’ve been running it here for a month with EOS 4.4.10 and have seen no issues. I’m concerned we may be having issues because I keep hearing it is broken, but we’ve had no complaints. I got the RPMs directly from the XROOTD repo.

# rpm -qa | grep xroot
xrootd-client-4.8.5-1.el7.x86_64
xrootd-server-4.8.5-1.el7.x86_64
xrootd-libs-4.8.5-1.el7.x86_64
xrootd-selinux-4.8.5-1.el7.noarch
xrootd-client-libs-4.8.5-1.el7.x86_64
xrootd-4.8.5-1.el7.x86_64
xrootd-private-devel-4.8.5-1.el7.x86_64
xrootd-server-libs-4.8.5-1.el7.x86_64

I can run the command that is failing for him just fine.

# xrdcp -f -d1 root://localhost//eos/uscms/store/user/dszkola/mybashrc /dev/null
190222 08:41:16 9677 secgsi_InitProxy: cannot access private key file: /root/.globus/userkey.pem
[971B/971B][100%][==================================================][971B/s]  

Still can’t get rid of that pesky secgsi warning though, very annoying.


Dan

Hi Dan,

The client does not properly handle server disconnects and can hang in various scenarios.
The commits which fixes this and is cherry-picked in 4.8.5-2 is the following:

Release 4.8.5-2 was only done in epel, there was no xrootd release for this since we agreed to stay on 4.8.4 until 4.9.0 is released. You can see the changelog and the packages here:
https://centos.pkgs.org/6/epel-i386/xrootd-4.8.5-2.el6.i686.rpm.html

I did not say his error is strictly connected to the xrootd package but I would prefer debugging something that I know works fine.

Cheers,
Elvin

Dear Elvin,

As per your suggestion, I downgrade the xrootd i.e. xrootd-4.8.4-1.

=====
[root@eos ~]# rpm -qa | grep xrootd
xrootd-client-libs-4.8.4-1.el7.x86_64
xrootd-selinux-4.8.4-1.el7.noarch
xrootd-client-4.8.4-1.el7.x86_64
xrootd-server-libs-4.8.4-1.el7.x86_64
xrootd-4.8.4-1.el7.x86_64
xrootd-libs-4.8.4-1.el7.x86_64
xrootd-server-4.8.4-1.el7.x86_64
xrootd-private-devel-4.8.4-1.el7.x86_64
xrootd-alicetokenacc-1.3.1-1.x86_64
[root@eos ~]#

Then again run xrdcp command. Output is below:-
+++++++++++++
[root@eos ~]# xrdcp -f -d 1 root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367 /dev/null

[root@eos ~]# xrdcp -f -d 1 root://eos.tier2-kol.res.in//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367 /dev/null
[0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3010] Unable to open file /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c; Operation not permitted

[root@eos ~]#

(xrdcp with localhost is wait long time and no output.)

Regards
Prasun

Hi Prasun,

You must quote the first argument of the xrdcp when using opaque information with “?”. Therefore, please run:

xrdcp -f -d 3 “root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367” /dev/null

And paste here the whole output.

Thanks,
Elvin

Dear Elvin,

Output of xrdcp:

================

[root@eos ~]# xrdcp -f -d 3 root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367 /dev/null
[2019-02-25 18:20:07.598302 +0530][Dump ][App ] Chunk size: 16777216, parallel chunks 4, streams: 1
[2019-02-25 18:20:07.598475 +0530][Dump ][App ] Processing source entry: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, type xroot, target file: /dev/null
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] URL: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.598586 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-25 18:20:07.598839 +0530][Dump ][Utility ] Adding job with properties: ‘checkSumMode’ = ‘none’, ‘checkSumPreset’ = ‘’, ‘checkSumType’ = ‘’, ‘chunkSize’ = ‘16777216’, ‘coerce’ = ‘0’, ‘dynamicSource’ = ‘0’, ‘force’ = ‘1’, ‘initTimeout’ = ‘600’, ‘makeDir’ = ‘0’, ‘parallelChunks’ = ‘4’, ‘posc’ = ‘0’, ‘source’ = ‘root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367’, ‘target’ = ‘/dev/null’, ‘thirdParty’ = ‘none’, ‘tpcTimeout’ = ‘1800’, ‘xcp’ = ‘0’, ‘xcpBlockSize’ = ‘134217728’, ‘zipArchive’ = ‘0’
[2019-02-25 18:20:07.598902 +0530][Debug ][Utility ] CopyProcess: 2 jobs to prepare
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] URL: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.598952 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] URL: /dev/null
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] Protocol: file
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.599049 +0530][Dump ][Utility ] Path: /dev/null
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] URL: root://localhost//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.599151 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] URL: /dev/null
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] Protocol: file
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.599245 +0530][Dump ][Utility ] Path: /dev/null
[2019-02-25 18:20:07.599333 +0530][Debug ][Utility ] Creating a classic copy job, from root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367 to file://localhost/dev/null
[2019-02-25 18:20:07.599392 +0530][Debug ][Utility ] Monitor library name not set. No monitoring
[2019-02-25 18:20:07.599530 +0530][Debug ][Poller ] Available pollers: built-in
[2019-02-25 18:20:07.599555 +0530][Debug ][Poller ] Attempting to create a poller according to preference: built-in
[2019-02-25 18:20:07.599575 +0530][Debug ][Poller ] Creating poller: built-in
[2019-02-25 18:20:07.599602 +0530][Debug ][Poller ] Creating and starting the built-in poller…
[2019-02-25 18:20:07.599788 +0530][Debug ][Poller ] Using 1 poller threads
[2019-02-25 18:20:07.599820 +0530][Debug ][TaskMgr ] Starting the task manager…
[2019-02-25 18:20:07.599875 +0530][Debug ][TaskMgr ] Task manager started
[2019-02-25 18:20:07.599900 +0530][Debug ][JobMgr ] Starting the job manager…
[2019-02-25 18:20:07.600006 +0530][Debug ][JobMgr ] Job manager started, 3 workers
[2019-02-25 18:20:07.600039 +0530][Debug ][TaskMgr ] Registering task: “FileTimer task” to be run at: [2019-02-25 18:20:07 +0530]
[2019-02-25 18:20:07.600071 +0530][Debug ][Utility ] Opening root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367 for reading
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] URL: root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.600142 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] URL: root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.600247 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-25 18:20:07.600336 +0530][Debug ][File ] [0x8702c0@root://localhost:1094//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367] Sending an open command
[2019-02-25 18:20:07.600399 +0530][Dump ][XRootD ] [localhost:1094] Sending message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] URL: localhost:1094
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] Host Name: localhost
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] Port: 1094
[2019-02-25 18:20:07.600460 +0530][Dump ][Utility ] Path:
[2019-02-25 18:20:07.600551 +0530][Debug ][PostMaster ] Creating new channel to: localhost:1094 1 stream(s)
[2019-02-25 18:20:07.600598 +0530][Debug ][PostMaster ] [localhost:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800
[2019-02-25 18:20:07.600653 +0530][Debug ][TaskMgr ] Registering task: “TickGeneratorTask for: localhost:1094” to be run at: [2019-02-25 18:20:22 +0530]
[2019-02-25 18:20:07.600694 +0530][Dump ][PostMaster ] [localhost:1094 #0] Sending message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x86f420) through substream 0 expecting answer at 0
[2019-02-25 18:20:07.600868 +0530][Debug ][PostMaster ] [localhost:1094] Found 1 address(es): [::ffff:127.0.0.1]:1094
[2019-02-25 18:20:07.600921 +0530][Debug ][AsyncSock ] [localhost:1094 #0.0] Attempting connection to [::ffff:127.0.0.1]:1094
[2019-02-25 18:20:07.601032 +0530][Debug ][Poller ] Adding socket 0x8755a0 to the poller
[2019-02-25 18:20:07.601190 +0530][Debug ][AsyncSock ] [localhost:1094 #0.0] Async connection call returned
[2019-02-25 18:20:07.601278 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Sending out the initial hand shake + kXR_protocol
[2019-02-25 18:20:07.601384 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: (0xf4000950), 44 bytes
[2019-02-25 18:20:07.601420 +0530][Dump ][XRootDTransport ] [msg: 0xf4000950] Expecting 8 bytes of message body
[2019-02-25 18:20:07.601433 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.601448 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 16 bytes
[2019-02-25 18:20:07.601467 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 310)
[2019-02-25 18:20:07.601486 +0530][Dump ][XRootDTransport ] [msg: 0xf4000950] Expecting 8 bytes of message body
[2019-02-25 18:20:07.601497 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.601510 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 16 bytes
[2019-02-25 18:20:07.601524 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 310)
[2019-02-25 18:20:07.601610 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Sending out kXR_login request, username: root, cgi: ?xrd.cc=in&xrd.tz=5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=eos.tier2-kol.res.in&xrd.rn=v4.8.4, dual-stack: false, private IPv4: false, private IPv6: false
[2019-02-25 18:20:07.601660 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: (0xf4000a60), 119 bytes
[2019-02-25 18:20:07.601762 +0530][Dump ][XRootDTransport ] [msg: 0xf4000950] Expecting 50 bytes of message body
[2019-02-25 18:20:07.601800 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.601816 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 58 bytes
[2019-02-25 18:20:07.601838 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Logged in, session: f7000000a44400001c010000f7000000
[2019-02-25 18:20:07.601850 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Authentication is required: &P=sss,0.13:/etc/eos.keytab&P=unix
[2019-02-25 18:20:07.601869 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Sending authentication data
[2019-02-25 18:20:07.603725 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Trying to authenticate using sss
[2019-02-25 18:20:07.603937 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: (0xf4000da0), 175 bytes
[2019-02-25 18:20:07.604138 +0530][Dump ][XRootDTransport ] [msg: 0xf4000e10] Expecting 0 bytes of message body
[2019-02-25 18:20:07.604158 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.604169 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received a message of 8 bytes
[2019-02-25 18:20:07.604189 +0530][Debug ][XRootDTransport ] [localhost:1094 #0.0] Authenticated with sss.
[2019-02-25 18:20:07.604206 +0530][Debug ][PostMaster ] [localhost:1094 #0] Stream 0 connected.
[2019-02-25 18:20:07.604281 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Wrote a message: kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x86f420), 107 bytes
[2019-02-25 18:20:07.604301 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Successfully sent message: kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x86f420).
[2019-02-25 18:20:07.604323 +0530][Dump ][XRootD ] [localhost:1094] Message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) has been successfully sent.
[2019-02-25 18:20:07.604343 +0530][Dump ][PostMaster ] [localhost:1094 #0.0] All messages consumed, disable uplink
[2019-02-25 18:20:07.606076 +0530][Dump ][XRootDTransport ] [msg: 0xf4000a40] Expecting 1102 bytes of message body
[2019-02-25 18:20:07.606113 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message header for 0xf4000a40 size: 8
[2019-02-25 18:20:07.606144 +0530][Dump ][AsyncSock ] [localhost:1094 #0.0] Received message 0xf4000a40 of 1110 bytes
[2019-02-25 18:20:07.606162 +0530][Dump ][PostMaster ] [localhost:1094 #0] Handling received message: 0xf4000a40.
[2019-02-25 18:20:07.606294 +0530][Dump ][XRootD ] [localhost:1094] Got kXR_redirect response to message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): eos02.tier2-kol.res.in?&cap.sym=Wz4+zXZwayMSWiWMc2ExXh+4n/I=&cap.msg=RQbdBBmTUXOXOkP9U+oMQo2LZ1D8GcHc/zAELNsubUb0hOeX9EI36p0xoAFkcFW+JbH8y64Qc0nHhGb5dsIIWDluF0b7r9oTMnhzNqh5lbYjIFqy1kWHNq+j3qfspBMUrYv17fu+a7JM7TGBLLXKP6Yld++l3H0q1A26ay4+IvgozAIPis+9jDNsNCQfeYhdwaaVi8khqPI9kLeGT/dGN+M5xLksp7HPTbosqEOO8UYw18lypj/V9TEVOCW07KarOxgS3O2kedzH2s50lhallyhmiysuNYtgUfQFn2PgUz0L93GGKleAasin5suOpKy3flzvsZv7CyYAprobIxsT7ySFn58o9UUqzBY1J9RUbFvAi3nHdMl1ya17k1yu52ZzCEwfrfsi/LNBZ/uDy/K0KvbuOGqqpGkpsaKEoj5Niy0dGb7x7Qvg2dcKfmllrhXS1FDZn035+ZLcM6FZOV3YvFXr9C7HI9WETy34ipFYejt+TEXUS/LyZ+Mth9CKCIvWy68WaqnU24Ikc7GGT9wxJ+aBWvr264UvLIEzMVSoXqpySB5zHeWbhgwszYceTlQH2hdipTdN17XSKXjrWbGCfj+h7OOes+XEajLz1IEAmhFLt/o0/ASrF4C9KvgHgvRwKj4NMUwZceMKR5lrqP5QNhgLC+RJKb77HuvzSuPIpuWVzOeoJ//QalJUg8XKnBhOL976EqVh3sc/fdSSQvBqDMfIu/7iUg7LoU+7/qC5AH9Rs0arPHkpUaYapJO6By0BsCjWFvSFEo/QaWkV09Eorc2TyDplyZ2+zqx90MiOvxChj6DSWwKq1RzaBZhsnvUc9acWGS7XrH6MgZSw40zMgHA9ygalXWYjbG7rAkN7JMVrZTmQhGRJgzd7eTud9oiEbD1CroiYpyU=&mgm.logid=e11a1f7a-38fb-11e9-af79-405cfd9195c1&mgm.replicaindex=1&mgm.replicahead=1&mgm.id=0026ecdc&mgm.mtime=1511571496, port 1095
[2019-02-25 18:20:07.606354 +0530][Dump ][XRootD ] [localhost:1094] Current server has been assigned as a load-balancer for message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] URL: eos02.tier2-kol.res.in:1095/
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] Host Name: eos02.tier2-kol.res.in
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] Port: 1095
[2019-02-25 18:20:07.606396 +0530][Dump ][Utility ] Path:
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] URL: fake://fake:111//fake?&cap.sym=Wz4+zXZwayMSWiWMc2ExXh+4n/I=&cap.msg=RQbdBBmTUXOXOkP9U+oMQo2LZ1D8GcHc/zAELNsubUb0hOeX9EI36p0xoAFkcFW+JbH8y64Qc0nHhGb5dsIIWDluF0b7r9oTMnhzNqh5lbYjIFqy1kWHNq+j3qfspBMUrYv17fu+a7JM7TGBLLXKP6Yld++l3H0q1A26ay4+IvgozAIPis+9jDNsNCQfeYhdwaaVi8khqPI9kLeGT/dGN+M5xLksp7HPTbosqEOO8UYw18lypj/V9TEVOCW07KarOxgS3O2kedzH2s50lhallyhmiysuNYtgUfQFn2PgUz0L93GGKleAasin5suOpKy3flzvsZv7CyYAprobIxsT7ySFn58o9UUqzBY1J9RUbFvAi3nHdMl1ya17k1yu52ZzCEwfrfsi/LNBZ/uDy/K0KvbuOGqqpGkpsaKEoj5Niy0dGb7x7Qvg2dcKfmllrhXS1FDZn035+ZLcM6FZOV3YvFXr9C7HI9WETy34ipFYejt+TEXUS/LyZ+Mth9CKCIvWy68WaqnU24Ikc7GGT9wxJ+aBWvr264UvLIEzMVSoXqpySB5zHeWbhgwszYceTlQH2hdipTdN17XSKXjrWbGCfj+h7OOes+XEajLz1IEAmhFLt/o0/ASrF4C9KvgHgvRwKj4NMUwZceMKR5lrqP5QNhgLC+RJKb77HuvzSuPIpuWVzOeoJ//QalJUg8XKnBhOL976EqVh3sc/fdSSQvBqDMfIu/7iUg7LoU+7/qC5AH9Rs0arPHkpUaYapJO6By0BsCjWFvSFEo/QaWkV09Eorc2TyDplyZ2+zqx90MiOvxChj6DSWwKq1RzaBZhsnvUc9acWGS7XrH6MgZSw40zMgHA9ygalXWYjbG7rAkN7JMVrZTmQhGRJgzd7eTud9oiEbD1CroiYpyU=&mgm.logid=e11a1f7a-38fb-11e9-af79-405cfd9195c1&mgm.replicaindex=1&mgm.replicahead=1&mgm.id=0026ecdc&mgm.mtime=1511571496
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] Protocol: fake
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] Host Name: fake
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] Port: 111
[2019-02-25 18:20:07.606503 +0530][Dump ][Utility ] Path: /fake
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] URL: eos02.tier2-kol.res.in:1095
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] Protocol: root
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] Host Name: eos02.tier2-kol.res.in
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] Port: 1095
[2019-02-25 18:20:07.606563 +0530][Dump ][Utility ] Path:
[2019-02-25 18:20:07.606596 +0530][Debug ][PostMaster ] Creating new channel to: eos02.tier2-kol.res.in:1095 1 stream(s)
[2019-02-25 18:20:07.606623 +0530][Debug ][PostMaster ] [eos02.tier2-kol.res.in:1095 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800
[2019-02-25 18:20:07.606659 +0530][Debug ][TaskMgr ] Registering task: “TickGeneratorTask for: eos02.tier2-kol.res.in:1095” to be run at: [2019-02-25 18:20:22 +0530]
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] URL: fake://fake:111//eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?eos.ruid=10367
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] Protocol: fake
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] User Name:
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] Password:
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] Host Name: fake
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] Port: 111
[2019-02-25 18:20:07.606701 +0530][Dump ][Utility ] Path: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c
[2019-02-25 18:20:07.606808 +0530][Dump ][PostMaster ] [eos02.tier2-kol.res.in:1095 #0] Sending message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?cap.msg=RQbdBBmTUXOXOkP9U+oMQo2LZ1D8GcHc/zAELNsubUb0hOeX9EI36p0xoAFkcFW+JbH8y64Qc0nHhGb5dsIIWDluF0b7r9oTMnhzNqh5lbYjIFqy1kWHNq+j3qfspBMUrYv17fu+a7JM7TGBLLXKP6Yld++l3H0q1A26ay4+IvgozAIPis+9jDNsNCQfeYhdwaaVi8khqPI9kLeGT/dGN+M5xLksp7HPTbosqEOO8UYw18lypj/V9TEVOCW07KarOxgS3O2kedzH2s50lhallyhmiysuNYtgUfQFn2PgUz0L93GGKleAasin5suOpKy3flzvsZv7CyYAprobIxsT7ySFn58o9UUqzBY1J9RUbFvAi3nHdMl1ya17k1yu52ZzCEwfrfsi/LNBZ/uDy/K0KvbuOGqqpGkpsaKEoj5Niy0dGb7x7Qvg2dcKfmllrhXS1FDZn035+ZLcM6FZOV3YvFXr9C7HI9WETy34ipFYejt+TEXUS/LyZ+Mth9CKCIvWy68WaqnU24Ikc7GGT9wxJ+aBWvr264UvLIEzMVSoXqpySB5zHeWbhgwszYceTlQH2hdipTdN17XSKXjrWbGCfj+h7OOes+XEajLz1IEAmhFLt/o0/ASrF4C9KvgHgvRwKj4NMUwZceMKR5lrqP5QNhgLC+RJKb77HuvzSuPIpuWVzOeoJ//QalJUg8XKnBhOL976EqVh3sc/fdSSQvBqDMfIu/7iUg7LoU+7/qC5AH9Rs0arPHkpUaYapJO6By0BsCjWFvSFEo/QaWkV09Eorc2TyDplyZ2+zqx90MiOvxChj6DSWwKq1RzaBZhsnvUc9acWGS7XrH6MgZSw40zMgHA9ygalXWYjbG7rAkN7JMVrZTmQhGRJgzd7eTud9oiEbD1CroiYpyU=&cap.sym=Wz4+zXZwayMSWiWMc2ExXh+4n/I=&eos.ruid=10367&mgm.id=0026ecdc&mgm.logid=e11a1f7a-38fb-11e9-af79-405cfd9195c1&mgm.mtime=1511571496&mgm.replicahead=1&mgm.replicaindex=1, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x86f420) through substream 0 expecting answer at 0
[2019-02-25 18:20:07.606873 +0530][Debug ][PostMaster ] [eos02.tier2-kol.res.in:1095] Found 1 address(es): [::ffff:144.16.112.26]:1095
[2019-02-25 18:20:07.606903 +0530][Debug ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Attempting connection to [::ffff:144.16.112.26]:1095
[2019-02-25 18:20:07.606948 +0530][Debug ][Poller ] Adding socket 0xec001e90 to the poller
[2019-02-25 18:20:07.607187 +0530][Debug ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Async connection call returned
[2019-02-25 18:20:07.607239 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Sending out the initial hand shake + kXR_protocol
[2019-02-25 18:20:07.607303 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Wrote a message: (0xf4000950), 44 bytes
[2019-02-25 18:20:07.607422 +0530][Dump ][XRootDTransport ] [msg: 0xf4000950] Expecting 8 bytes of message body
[2019-02-25 18:20:07.607444 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.607457 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received a message of 16 bytes
[2019-02-25 18:20:07.607471 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Got the server hand shake response (type: server [], protocol version 400)
[2019-02-25 18:20:07.607489 +0530][Dump ][XRootDTransport ] [msg: 0xf4000950] Expecting 8 bytes of message body
[2019-02-25 18:20:07.607499 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.607513 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received a message of 16 bytes
[2019-02-25 18:20:07.607525 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] kXR_protocol successful (type: server [], protocol version 400)
[2019-02-25 18:20:07.607587 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Sending out kXR_login request, username: root, cgi: ?xrd.cc=in&xrd.tz=5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=eos.tier2-kol.res.in&xrd.rn=v4.8.4, dual-stack: false, private IPv4: false, private IPv6: false
[2019-02-25 18:20:07.607629 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Wrote a message: (0xf4002b60), 119 bytes
[2019-02-25 18:20:07.607727 +0530][Dump ][XRootDTransport ] [msg: 0xf4000950] Expecting 50 bytes of message body
[2019-02-25 18:20:07.607746 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.607760 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received a message of 58 bytes
[2019-02-25 18:20:07.607778 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Logged in, session: b1030000c42c0000d0000000b1030000
[2019-02-25 18:20:07.607789 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Authentication is required: &P=sss,0.13:/etc/eos.keytab&P=unix
[2019-02-25 18:20:07.607801 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Sending authentication data
[2019-02-25 18:20:07.607836 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Trying to authenticate using sss
[2019-02-25 18:20:07.607972 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Wrote a message: (0xf40031c0), 175 bytes
[2019-02-25 18:20:07.608201 +0530][Dump ][XRootDTransport ] [msg: 0xf40031c0] Expecting 0 bytes of message body
[2019-02-25 18:20:07.608220 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received message header, size: 8
[2019-02-25 18:20:07.608231 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Received a message of 8 bytes
[2019-02-25 18:20:07.608247 +0530][Debug ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Authenticated with sss.
[2019-02-25 18:20:07.608274 +0530][Debug ][PostMaster ] [eos02.tier2-kol.res.in:1095 #0] Stream 0 connected.
[2019-02-25 18:20:07.608333 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Wrote a message: kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?cap.msg=RQbdBBmTUXOXOkP9U+oMQo2LZ1D8GcHc/zAELNsubUb0hOeX9EI36p0xoAFkcFW+JbH8y64Qc0nHhGb5dsIIWDluF0b7r9oTMnhzNqh5lbYjIFqy1kWHNq+j3qfspBMUrYv17fu+a7JM7TGBLLXKP6Yld++l3H0q1A26ay4+IvgozAIPis+9jDNsNCQfeYhdwaaVi8khqPI9kLeGT/dGN+M5xLksp7HPTbosqEOO8UYw18lypj/V9TEVOCW07KarOxgS3O2kedzH2s50lhallyhmiysuNYtgUfQFn2PgUz0L93GGKleAasin5suOpKy3flzvsZv7CyYAprobIxsT7ySFn58o9UUqzBY1J9RUbFvAi3nHdMl1ya17k1yu52ZzCEwfrfsi/LNBZ/uDy/K0KvbuOGqqpGkpsaKEoj5Niy0dGb7x7Qvg2dcKfmllrhXS1FDZn035+ZLcM6FZOV3YvFXr9C7HI9WETy34ipFYejt+TEXUS/LyZ+Mth9CKCIvWy68WaqnU24Ikc7GGT9wxJ+aBWvr264UvLIEzMVSoXqpySB5zHeWbhgwszYceTlQH2hdipTdN17XSKXjrWbGCfj+h7OOes+XEajLz1IEAmhFLt/o0/ASrF4C9KvgHgvRwKj4NMUwZceMKR5lrqP5QNhgLC+RJKb77HuvzSuPIpuWVzOeoJ//QalJUg8XKnBhOL976EqVh3sc/fdSSQvBqDMfIu/7iUg7LoU+7/qC5AH9Rs0arPHkpUaYapJO6By0BsCjWFvSFEo/QaWkV09Eorc2TyDplyZ2+zqx90MiOvxChj6DSWwKq1RzaBZhsnvUc9acWGS7XrH6MgZSw40zMgHA9ygalXWYjbG7rAkN7JMVrZTmQhGRJgzd7eTud9oiEbD1CroiYpyU=&cap.sym=Wz4+zXZwayMSWiWMc2ExXh+4n/I=&eos.ruid=10367&mgm.id=0026ecdc&mgm.logid=e11a1f7a-38fb-11e9-af79-405cfd9195c1&mgm.mtime=1511571496&mgm.replicahead=1&mgm.replicaindex=1, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x86f420), 1182 bytes
[2019-02-25 18:20:07.608367 +0530][Dump ][AsyncSock ] [eos02.tier2-kol.res.in:1095 #0.0] Successfully sent message: kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?cap.msg=RQbdBBmTUXOXOkP9U+oMQo2LZ1D8GcHc/zAELNsubUb0hOeX9EI36p0xoAFkcFW+JbH8y64Qc0nHhGb5dsIIWDluF0b7r9oTMnhzNqh5lbYjIFqy1kWHNq+j3qfspBMUrYv17fu+a7JM7TGBLLXKP6Yld++l3H0q1A26ay4+IvgozAIPis+9jDNsNCQfeYhdwaaVi8khqPI9kLeGT/dGN+M5xLksp7HPTbosqEOO8UYw18lypj/V9TEVOCW07KarOxgS3O2kedzH2s50lhallyhmiysuNYtgUfQFn2PgUz0L93GGKleAasin5suOpKy3flzvsZv7CyYAprobIxsT7ySFn58o9UUqzBY1J9RUbFvAi3nHdMl1ya17k1yu52ZzCEwfrfsi/LNBZ/uDy/K0KvbuOGqqpGkpsaKEoj5Niy0dGb7x7Qvg2dcKfmllrhXS1FDZn035+ZLcM6FZOV3YvFXr9C7HI9WETy34ipFYejt+TEXUS/LyZ+Mth9CKCIvWy68WaqnU24Ikc7GGT9wxJ+aBWvr264UvLIEzMVSoXqpySB5zHeWbhgwszYceTlQH2hdipTdN17XSKXjrWbGCfj+h7OOes+XEajLz1IEAmhFLt/o0/ASrF4C9KvgHgvRwKj4NMUwZceMKR5lrqP5QNhgLC+RJKb77HuvzSuPIpuWVzOeoJ//QalJUg8XKnBhOL976EqVh3sc/fdSSQvBqDMfIu/7iUg7LoU+7/qC5AH9Rs0arPHkpUaYapJO6By0BsCjWFvSFEo/QaWkV09Eorc2TyDplyZ2+zqx90MiOvxChj6DSWwKq1RzaBZhsnvUc9acWGS7XrH6MgZSw40zMgHA9ygalXWYjbG7rAkN7JMVrZTmQhGRJgzd7eTud9oiEbD1CroiYpyU=&cap.sym=Wz4+zXZwayMSWiWMc2ExXh+4n/I=&eos.ruid=10367&mgm.id=0026ecdc&mgm.logid=e11a1f7a-38fb-11e9-af79-405cfd9195c1&mgm.mtime=1511571496&mgm.replicahead=1&mgm.replicaindex=1, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x86f420).
[2019-02-25 18:20:07.608398 +0530][Dump ][XRootD ] [eos02.tier2-kol.res.in:1095] Message kXR_open (file: /eos/kolkataalice/grid/01/65264/b793d378-d17b-11e7-8ef0-fb9b42643b0c?cap.msg=RQbdBBmTUXOXOkP9U+oMQo2LZ1D8GcHc/zAELNsubUb0hOeX9EI36p0xoAFkcFW+JbH8y64Qc0nHhGb5dsIIWDluF0b7r9oTMnhzNqh5lbYjIFqy1kWHNq+j3qfspBMUrYv17fu+a7JM7TGBLLXKP6Yld++l3H0q1A26ay4+IvgozAIPis+9jDNsNCQfeYhdwaaVi8khqPI9kLeGT/dGN+M5xLksp7HPTbosqEOO8UYw18lypj/V9TEVOCW07KarOxgS3O2kedzH2s50lhallyhmiysuNYtgUfQFn2PgUz0L93GGKleAasin5suOpKy3flzvsZv7CyYAprobIxsT7ySFn58o9UUqzBY1J9RUbFvAi3nHdMl1ya17k1yu52ZzCEwfrfsi/LNBZ/uDy/K0KvbuOGqqpGkpsaKEoj5Niy0dGb7x7Qvg2dcKfmllrhXS1FDZn035+ZLcM6FZOV3YvFXr9C7HI9WETy34ipFYejt+TEXUS/LyZ+Mth9CKCIvWy68WaqnU24Ikc7GGT9wxJ+aBWvr264UvLIEzMVSoXqpySB5zHeWbhgwszYceTlQH2hdipTdN17XSKXjrWbGCfj+h7OOes+XEajLz1IEAmhFLt/o0/ASrF4C9KvgHgvRwKj4NMUwZceMKR5lrqP5QNhgLC+RJKb77HuvzSuPIpuWVzOeoJ//QalJUg8XKnBhOL976EqVh3sc/fdSSQvBqDMfIu/7iUg7LoU+7/qC5AH9Rs0arPHkpUaYapJO6By0BsCjWFvSFEo/QaWkV09Eorc2TyDplyZ2+zqx90MiOvxChj6DSWwKq1RzaBZhsnvUc9acWGS7XrH6MgZSw40zMgHA9ygalXWYjbG7rAkN7JMVrZTmQhGRJgzd7eTud9oiEbD1CroiYpyU=&cap.sym=Wz4+zXZwayMSWiWMc2ExXh+4n/I=&eos.ruid=10367&mgm.id=0026ecdc&mgm.logid=e11a1f7a-38fb-11e9-af79-405cfd9195c1&mgm.mtime=1511571496&mgm.replicahead=1&mgm.replicaindex=1, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) has been successfully sent.
[2019-02-25 18:20:07.608422 +0530][Dump ][PostMaster ] [eos02.tier2-kol.res.in:1095 #0.0] All messages consumed, disable uplink
[2019-02-25 18:20:08.600023 +0530][Dump ][TaskMgr ] Running task: “FileTimer task”
[2019-02-25 18:20:08.600078 +0530][Dump ][TaskMgr ] Will rerun task “FileTimer task” at [2019-02-25 18:20:23 +0530]
[2019-02-25 18:20:22.601430 +0530][Dump ][TaskMgr ] Running task: “TickGeneratorTask for: localhost:1094”
[2019-02-25 18:20:22.601477 +0530][Dump ][TaskMgr ] Will rerun task “TickGeneratorTask for: localhost:1094” at [2019-02-25 18:20:37 +0530]
[2019-02-25 18:20:22.601490 +0530][Dump ][TaskMgr ] Running task: “TickGeneratorTask for: eos02.tier2-kol.res.in:1095”
[2019-02-25 18:20:22.601504 +0530][Dump ][TaskMgr ] Will rerun task “TickGeneratorTask for: eos02.tier2-kol.res.in:1095” at [2019-02-25 18:20:37 +0530]
[2019-02-25 18:20:22.623494 +0530][Dump ][XRootDTransport ] [localhost:1094 #0.0] Stream inactive since 15 seconds, TTL: 1200, allocated SIDs: 0, open files: 0
[2019-02-25 18:20:22.623539 +0530][Dump ][XRootDTransport ] [localhost:1094 #0.0] Stream inactive since 15 seconds, stream timeout: 60, allocated SIDs: 0, wait barrier: 2019-02-25 18:20:07 +0530
[2019-02-25 18:20:22.623557 +0530][Dump ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Stream inactive since 15 seconds, TTL: 300, allocated SIDs: 1, open files: 0
[2019-02-25 18:20:22.623573 +0530][Dump ][XRootDTransport ] [eos02.tier2-kol.res.in:1095 #0.0] Stream inactive since 15 seconds, stream timeout: 60, allocated SIDs: 1, wait barrier: 1970-01-01 05:30:00 +0530
[2019-02-25 18:20:23.601585 +0530][Dump ][TaskMgr ] Running task: “FileTimer task”
[2019-02-25 18:20:23.601630 +0530][Dump ][TaskMgr ] Will rerun task “FileTimer task” at [2019-02-25 18:20:38 +0530]
[2019-02-25 18:20:37.602969 +0530][Dump ][TaskMgr ] Running task: “TickGeneratorTask for: localhost:1094”
.

=========================

Unable to paste full output as there has limitations of 32000 characters.

Any alternatives.
Please suggest.

Regards
Prasun

Hi Prasun,

Could you upload the entire log to dropbox or something similar and share the link?
I’m missing the most important info from the log.

Thanks,
Elvin