CERN Accelerating science

Enable redirection to another node's FST

Hi,

I am trying to xrdcp file into a small EOS instance by specifying the master MGM node
in root:////eos/tier1dev/cta/testfiile. I have set the three registered filesystems of this node to read-only. However EOS doesnt appear to redirect to the FSTs of the other nodes which have filesystems in read-write mode.

Can you please tell me which flag(s) I need to set?

Many thanks,

George

Ah sorry,
that framework does not show URLs, if they are not properly quoted …

Do you use URLs like

root://hostname//eos/dir/path

HI Andreas,

Thanks. Yes, I use the URL like root://hostname//eos/dir/path which works if the node’s fs is in rw but not when it is in ro or off.

George

Your filesystems have also to be shown as online:

┌────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host                    │port│    id│                            path│      schedgroup│          geotag│        boot│  configstatus│       drain│  active│          health│
└────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
 eos5dev.cern.ch          1095      1                         /data/01        default.0       local::geo       booted             rw      nodrain   **online**      no smartctl 

Then you have to make sure, that you set the nominalsize for your space and that all the nodes/filesystems are enabled and each filesystem has a geotag definition.

eos space set default on 
eos space config default space.nominalsize=1T

Ah sorry,
didn’t see your reply.

I don’t understand really the question. If you have a filesystem in ro, then it cannot write there.
Do you say, if you have one in ro, it does not select another one in rw mode?

The simplest is, if you paste:

eos geoshed show tree
eos fs ls 

I am basically trying to test the case when an FST node is down, i.e. its filesystems unreachable. Presumably EOS has a way to redirect the xrootd write to another FST node.
I am trying to figure out what flags are needed to enable this. Pleasee the pasted output from the two commands

eos geosched show tree
┌─────────┬──────┬────┬────────────────────────────────────┬────────┬─────┬───┬──────┐
│group │geotag│fsid│ node│branches│leavs│sum│status│
└─────────┴──────┴────┴────────────────────────────────────┴────────┴─────┴───┴──────┘
default.0 2 3 5
└───▶ rack1 1 3 4
├──▶ 1 host-172-16-112-243.nubes.stfc.ac.uk 0 1 1 DinRW
├──▶ 4 host-172-16-103-55.nubes.stfc.ac.uk 0 1 1 DinRW
└──▶ 7 host-172-16-112-247.nubes.stfc.ac.uk 0 1 1 DinRW

default.1 2 3 5
└───▶ rack1 1 3 4
├──▶ 2 host-172-16-112-243.nubes.stfc.ac.uk 0 1 1 DinRW
├──▶ 5 host-172-16-103-55.nubes.stfc.ac.uk 0 1 1 DinRW
└──▶ 8 host-172-16-112-247.nubes.stfc.ac.uk 0 1 1 DinRW

default.2 2 3 5
└───▶ rack1 1 3 4
├──▶ 3 host-172-16-112-243.nubes.stfc.ac.uk 0 1 1 DinRW
├──▶ 6 host-172-16-103-55.nubes.stfc.ac.uk 0 1 1 DinRW
└──▶ 9 host-172-16-112-247.nubes.stfc.ac.uk 0 1 1 DinRW

eos fs ls
┌────────────────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host │port│ id│ path│ schedgroup│ geotag│ boot│ configstatus│ drain│ active│ health│
└────────────────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
host-172-16-112-243.nubes.stfc.ac.uk 1095 1 /data01 default.0 rack1 booted off nodrain online N/A
host-172-16-112-243.nubes.stfc.ac.uk 1095 2 /data02 default.1 rack1 booted off nodrain online N/A
host-172-16-112-243.nubes.stfc.ac.uk 1095 3 /data03 default.2 rack1 booted off nodrain online N/A
host-172-16-103-55.nubes.stfc.ac.uk 1095 4 /data01 default.0 rack1 booted rw nodrain online N/A
host-172-16-103-55.nubes.stfc.ac.uk 1095 5 /data02 default.1 rack1 booted rw nodrain online N/A
host-172-16-103-55.nubes.stfc.ac.uk 1095 6 /data03 default.2 rack1 booted rw nodrain online N/A
host-172-16-112-247.nubes.stfc.ac.uk 1095 7 /data01 default.0 rack1 booted rw nodrain online N/A
host-172-16-112-247.nubes.stfc.ac.uk 1095 8 /data02 default.1 rack1 booted rw nodrain online N/A
host-172-16-112-247.nubes.stfc.ac.uk 1095 9 /data03 default.2 rack1 booted rw nodrain online N/A

Show also as captures for clarity