georgep
(George Patargias)
March 3, 2021, 1:07pm
1
Hi,
I am trying to xrdcp file into a small EOS instance by specifying the master MGM node
in root:////eos/tier1dev/cta/testfiile. I have set the three registered filesystems of this node to read-only. However EOS doesnt appear to redirect to the FSTs of the other nodes which have filesystems in read-write mode.
Can you please tell me which flag(s) I need to set?
Many thanks,
George
apeters
(Andreas Joachim Peters)
March 3, 2021, 1:20pm
2
Ah sorry,
that framework does not show URLs, if they are not properly quoted …
Do you use URLs like
root://hostname//eos/dir/path
georgep
(George Patargias)
March 3, 2021, 1:26pm
3
HI Andreas,
Thanks. Yes, I use the URL like root://hostname//eos/dir/path which works if the node’s fs is in rw but not when it is in ro or off.
George
apeters
(Andreas Joachim Peters)
March 3, 2021, 1:28pm
4
Your filesystems have also to be shown as online:
┌────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host │port│ id│ path│ schedgroup│ geotag│ boot│ configstatus│ drain│ active│ health│
└────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
eos5dev.cern.ch 1095 1 /data/01 default.0 local::geo booted rw nodrain **online** no smartctl
Then you have to make sure, that you set the nominalsize for your space and that all the nodes/filesystems are enabled and each filesystem has a geotag definition.
eos space set default on
eos space config default space.nominalsize=1T
apeters
(Andreas Joachim Peters)
March 3, 2021, 1:29pm
5
Ah sorry,
didn’t see your reply.
I don’t understand really the question. If you have a filesystem in ro, then it cannot write there.
Do you say, if you have one in ro, it does not select another one in rw mode?
apeters
(Andreas Joachim Peters)
March 3, 2021, 1:30pm
6
The simplest is, if you paste:
eos geoshed show tree
eos fs ls
georgep
(George Patargias)
March 3, 2021, 2:08pm
7
I am basically trying to test the case when an FST node is down, i.e. its filesystems unreachable. Presumably EOS has a way to redirect the xrootd write to another FST node.
I am trying to figure out what flags are needed to enable this. Pleasee the pasted output from the two commands
eos geosched show tree
┌─────────┬──────┬────┬────────────────────────────────────┬────────┬─────┬───┬──────┐
│group │geotag│fsid│ node│branches│leavs│sum│status│
└─────────┴──────┴────┴────────────────────────────────────┴────────┴─────┴───┴──────┘
default.0 2 3 5
└───▶ rack1 1 3 4
├──▶ 1 host-172-16-112-243.nubes.stfc.ac.uk 0 1 1 DinRW
├──▶ 4 host-172-16-103-55.nubes.stfc.ac.uk 0 1 1 DinRW
└──▶ 7 host-172-16-112-247.nubes.stfc.ac.uk 0 1 1 DinRW
default.2 2 3 5
└───▶ rack1 1 3 4
├──▶ 3 host-172-16-112-243.nubes.stfc.ac.uk 0 1 1 DinRW
├──▶ 6 host-172-16-103-55.nubes.stfc.ac.uk 0 1 1 DinRW
└──▶ 9 host-172-16-112-247.nubes.stfc.ac.uk 0 1 1 DinRW
eos fs ls
┌────────────────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host │port│ id│ path│ schedgroup│ geotag│ boot│ configstatus│ drain│ active│ health│
└────────────────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
host-172-16-112-243.nubes.stfc.ac.uk 1095 1 /data01 default.0 rack1 booted off nodrain online N/A
host-172-16-112-243.nubes.stfc.ac.uk 1095 2 /data02 default.1 rack1 booted off nodrain online N/A
host-172-16-112-243.nubes.stfc.ac.uk 1095 3 /data03 default.2 rack1 booted off nodrain online N/A
host-172-16-103-55.nubes.stfc.ac.uk 1095 4 /data01 default.0 rack1 booted rw nodrain online N/A
host-172-16-103-55.nubes.stfc.ac.uk 1095 5 /data02 default.1 rack1 booted rw nodrain online N/A
host-172-16-103-55.nubes.stfc.ac.uk 1095 6 /data03 default.2 rack1 booted rw nodrain online N/A
host-172-16-112-247.nubes.stfc.ac.uk 1095 7 /data01 default.0 rack1 booted rw nodrain online N/A
host-172-16-112-247.nubes.stfc.ac.uk 1095 8 /data02 default.1 rack1 booted rw nodrain online N/A
host-172-16-112-247.nubes.stfc.ac.uk 1095 9 /data03 default.2 rack1 booted rw nodrain online N/A
georgep
(George Patargias)
March 3, 2021, 2:21pm
8
Show also as captures for clarity