Mgm node setup

gbiro · September 22, 2020, 8:19pm

Dear All!

I’m trying to initialize an ALICE eos setup from scratch at KFKI with no luck so far. As a first step I would like to start the mgm node and then add some fst nodes later. I tried to put together the config according to different sources (including this forum) and I believe that the answer for my problems is pretty trivial so please excuse me for asking such beginner questions.

Currently I’m trying to start the eos mgm service as master. The machine has CentOS 7-8.2003, and I try to run the service with the command systemctl start eos@master.

The status of the services:

# systemctl status eos@mgm -l
    ● eos@mgm.service - EOS mgm
       Loaded: loaded (/usr/lib/systemd/system/eos@.service; disabled; vendor preset: disabled)
       Active: active (running) since Thu 2020-09-17 17:20:39 UTC; 3min 47s ago
      Process: 24263 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
     Main PID: 24297 (sh)
       CGroup: /system.slice/system-eos.slice/eos@mgm.service
               ├─24297 /bin/sh -c XRDPROG=/usr/bin/xrootd; test -e /opt/eos/xrootd/bin/xrootd && XRDPROG=/opt/eos/xrootd/bin/xrootd; echo $XRDPROG ; $XRDPROG -n mgm -c /etc/xrd.cf.mgm -l /var/log/eos/xrdlog.mgm -s /tmp/xrootd.mgm.pid -Rdaemon
               ├─24299 /opt/eos/xrootd/bin/xrootd -n mgm -c /etc/xrd.cf.mgm -l /var/log/eos/xrdlog.mgm -s /tmp/xrootd.mgm.pid -Rdaemon
               ├─24412 /opt/eos/xrootd/bin/xrootd -n mgm -c /etc/xrd.cf.mgm -l /var/log/eos/xrdlog.mgm -s /tmp/xrootd.mgm.pid -Rdaemon
               └─24510 eos -b console log _MGMID_

    Sep 17 17:20:39 eos-mgm1.alice-af.wigner.hu sh[24297]: /opt/eos/xrootd/bin/xrootd
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: Register objects provide by NsInMemoryPlugin ...
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Public key in use is EXPORT   PATH:/ VO:*     ACCESS:ALLOW CERT:*
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Cannot load public key !
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Public key in use is RULE     PATH:/ AUTHZ:delete|read|write|write-once| NOAUTHZ:| VO:*| CERT:IGNORE
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Cannot load public key !
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Public key in use is RULE     PATH:/eos/alicekfki/grid/ AUTHZ:| NOAUTHZ:delete|read|write|write-once| VO:*| CERT:IGNORE
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Cannot load public key !
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Public key in use is KEY VO:* PRIVKEY:/etc/grid-security/xrootd/privkey.pem PUBKEY:/etc/grid-security/xrootd/pubkey.pem
    Sep 17 17:20:40 eos-mgm1.alice-af.wigner.hu sh[24297]: =====> XrdAliceTokenAcc: Cannot load public key !

#systemctl status eos@master -l
● eos@master.service - EOS Master
   Loaded: loaded (/usr/lib/systemd/system/eos@master.service; disabled; vendor preset: disabled)
   Active: inactive (dead)

Sep 17 16:35:45 eos-mgm1.alice-af.wigner.hu systemd[1]: Started EOS Master.
Sep 17 16:41:49 eos-mgm1.alice-af.wigner.hu systemd[1]: Starting EOS Master...
Sep 17 16:41:49 eos-mgm1.alice-af.wigner.hu echo[22106]: Configured   on localhost as master
Sep 17 16:41:49 eos-mgm1.alice-af.wigner.hu systemd[1]: Started EOS Master.
Sep 17 16:45:16 eos-mgm1.alice-af.wigner.hu systemd[1]: Starting EOS Master...
Sep 17 16:45:16 eos-mgm1.alice-af.wigner.hu echo[22373]: Configured   on localhost as master
Sep 17 16:45:16 eos-mgm1.alice-af.wigner.hu systemd[1]: Started EOS Master.
Sep 17 16:46:34 eos-mgm1.alice-af.wigner.hu systemd[1]: Starting EOS Master...
Sep 17 16:46:34 eos-mgm1.alice-af.wigner.hu echo[22467]: Configured   on localhost as master
Sep 17 16:46:34 eos-mgm1.alice-af.wigner.hu systemd[1]: Started EOS Master.

Some output of xrdlog.mgm:

....
200917 17:23:30 time=1600363410.761590 func=Recycler                 level=INFO  logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94573fb700 source=Recycle:99                     tident= sec=(null) uid=99 gid=99 name=- geo="" snooze-time=30
200917 17:23:30 time=1600363410.786900 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:32 time=1600363412.676406 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:32 time=1600363412.787787 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:34 time=1600363414.677352 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:34 time=1600363414.788693 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:36 time=1600363416.678341 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:36 time=1600363416.789539 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:38 time=1600363418.679123 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:38 time=1600363418.790373 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:40 time=1600363420.680030 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:40 time=1600363420.791211 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:42 time=1600363422.681025 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:42 time=1600363422.792145 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:44 time=1600363424.681865 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:44 time=1600363424.792988 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"
200917 17:23:46 time=1600363426.682523 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f9478f0f700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/mgm_mq_test?xmqclient.advisory.flushbacklog=1&xmqclient.advisory.query=1&xmqclient.advisory.status=1"
200917 17:23:46 time=1600363426.793828 func=RefreshBrokersEndpoints  level=ERROR logid=static.............................. unit=mgm@eos-mgm1.alice-af.wigner.hu:1094 tid=00007f94637fd700 source=XrdMqClient:498                tident= sec=(null) uid=99 gid=99 name=- geo="" msg="failed to contact broker" url="root://daemon@localhost:1097//eos/eos-mgm1.alice-af.wigner.hu/report_mq_test?xmqclient.advisory.flushbacklog=0&xmqclient.advisory.query=0&xmqclient.advisory.status=0"

The relevant part of /etc/sysconfig/eos_env:

#-------------------------------------------------------------------------------
# EOS roles - Systemd Services
#-------------------------------------------------------------------------------
XRD_ROLES="mq mgm fed sync"

#-------------------------------------------------------------------------------
# EOS Configuration
#-------------------------------------------------------------------------------

# The fully qualified hostname of current MGM
EOS_MGM_HOST=mgm-master.localdomain

# The fully qualified hostname of target MGM
EOS_MGM_HOST_TARGET=mgm-slave.localdomain

# The EOS instance name
EOS_INSTANCE_NAME=eosalicekfki

# The EOS configuration to load after daemon start
EOS_AUTOLOAD_CONFIG=default

# The EOS broker URL
EOS_BROKER_URL=root://localhost:1097//eos/

# The EOS host geo location tag used to sort hosts into geographical (rack) locations
EOS_GEOTAG=""

# The alias which selects master 1 or 2
EOS_MGM_ALIAS="eos-mgm1.alice-af.wigner.hu"

# The fully qualified hostname of MGM master1
EOS_MGM_MASTER1="${EOS_MGM_ALIAS}"

# The fully qualified hostname of MGM master2
EOS_MGM_MASTER2="${EOS_MGM_ALIAS}"

I’m really stucked, so any help is more than welcome.

Thanks,
Gabor

asevcenc · September 22, 2020, 9:17pm

Hi Gabor! I started to write down some notes and configuration here:

i did not have time yet to script the configurations in a more flexible way …
take note that we run 3 quarkdbs and only one mgm on the same host, and in the configuration files from repository the quarkdb password is deleted

gbiro · October 7, 2020, 4:21pm

Hi Adrian!

Sorry for the late reply, and thanks for the help - with that now I finally managed to start the mgm node, start one fst node and even connect it to the mgm (neither node’s log show any errors). Now, on the mgm I also enabled the fst node, but something is clearly wrong on the fst:

# eos      
---------------------------------------------------------------------------
EOS  Copyright (C) 2011-2019 CERN/Switzerland
This program comes with ABSOLUTELY NO WARRANTY; for details type `license'.
This is free software, and you are welcome to redistribute it 
under certain conditions; type `license' for details.
---------------------------------------------------------------------------
error: MGM root://localhost not online/reachable

However:

# eos root://eos-mgm1.alice-af.wigner.hu        
---------------------------------------------------------------------------
EOS  Copyright (C) 2011-2019 CERN/Switzerland
This program comes with ABSOLUTELY NO WARRANTY; for details type `license'.
This is free software, and you are welcome to redistribute it 
under certain conditions; type `license' for details.
---------------------------------------------------------------------------
EOS_INSTANCE=eosalice
EOS_SERVER_VERSION=4.7.7 EOS_SERVER_RELEASE=1
EOS_CLIENT_VERSION=4.7.7 EOS_CLIENT_RELEASE=1
EOS Console [root://eos-mgm1.alice-af.wigner.hu] |/>

In the /etc/xrd.cf.fst file I have:

fstofs.broker root://eos-mgm1.alice-af.wigner.hu:1097//eos/

and in the eos_env file:

#-------------------------------------------------------------------------------
# EOS Configuration
#-------------------------------------------------------------------------------
# The fully qualified hostname of current MGM
EOS_MGM_HOST='eos-mgm1.alice-af.wigner.hu'

# The fully qualified hostname of target MGM
# EOS_MGM_HOST_TARGET=mgm-slave.localdomain

# The EOS instance name
EOS_INSTANCE_NAME='eosalice'

# The EOS configuration to load after daemon start
EOS_AUTOLOAD_CONFIG=default

# The EOS host geo location tag used to sort hosts into geographical (rack) locations
EOS_GEOTAG="::KFKI"

# The fully qualified hostname of MGM master1
EOS_MGM_MASTER1='eos-mgm1.alice-af.wigner.hu'

# The fully qualified hostname of MGM master2
EOS_MGM_MASTER2='eos-mgm1.alice-af.wigner.hu'

# The alias which selects master 1 or 2
EOS_MGM_ALIAS='eos-mgm1.alice-af.wigner.hu'
EOS_FUSE_MGM_ALIAS='eos-mgm1.alice-af.wigner.hu'

# The EOS broker URL
EOS_BROKER_URL=root://eos-mgm1.alice-af.wigner.hu:1097//eos/

Could you please help me what I’m missing?

Gabor

asevcenc · October 8, 2020, 6:49pm

so, there are 2 different issues: mgm should work no matter if there are any working fsts…
So, on the mgm (which is first to solve):

which services you are running? the XRD_ROLES should have at most mq mgm (i run both quarkdb and mgm on the same host)
i have

[root@mgm ~]# grep BROKER /etc/sysconfig/eos_env
EOS_BROKER_URL="root://localhost:1097//eos/"

and i do have this on fst

[root@fst01 ~]# grep broker /etc/xrd.cf.fst
fstofs.broker root://mgm.spacescience.ro:1097//eos/

so … i would assert that using fqdn in EOS_BROKER_URL should work, so i would suspect that the 1097 port is not open … try a nc -vz eos-mgm1.alice-af.wigner.hu 1097 and see if it works

gbiro · October 8, 2020, 10:41pm

Hi Adrian,

well, okay… my mistake. When I read your answer I just realized that the FQDN is probably not resolved correctly. I fixed it in /etc/hosts and now it seems to work – up to a point:

[root@eos-fst01 ~]# eosfstregister -r eos-mgm1.alice-af.wigner.hu /data default:24
###########################
# <eosfstregister> v1.0.0
###########################
/data01 : uuid=514ab241-6d9f-407c-ad70-cf32af4810ca fsid=undef
success:   mapped '514ab241-6d9f-407c-ad70-cf32af4810ca' <=> fsid=2
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data01
/data02 : uuid=a425ced5-7219-4ff8-92e4-6ed962ba082a fsid=undef
success:   mapped 'a425ced5-7219-4ff8-92e4-6ed962ba082a' <=> fsid=3
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data02
/data03 : uuid=a4fa49a5-af45-42ad-ade2-1086e59764a0 fsid=undef
success:   mapped 'a4fa49a5-af45-42ad-ade2-1086e59764a0' <=> fsid=4
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data03
/data04 : uuid=88fffb85-1f80-4424-b3e3-fe84a713c058 fsid=undef
success:   mapped '88fffb85-1f80-4424-b3e3-fe84a713c058' <=> fsid=5
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data04
/data05 : uuid=d350ccdb-9962-4c41-ad8b-222d7bb64667 fsid=undef
success:   mapped 'd350ccdb-9962-4c41-ad8b-222d7bb64667' <=> fsid=6
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data05
/data06 : uuid=b08dea0a-2dcc-42b0-8f94-5924f3ba1363 fsid=undef
success:   mapped 'b08dea0a-2dcc-42b0-8f94-5924f3ba1363' <=> fsid=7
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data06
/data07 : uuid=d6f69c0b-312f-4285-bc78-70fe8d822c2a fsid=undef
success:   mapped 'd6f69c0b-312f-4285-bc78-70fe8d822c2a' <=> fsid=8
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data07
/data08 : uuid=7c9a9e9f-bb9a-4ccc-ba21-6c36ec188050 fsid=undef
success:   mapped '7c9a9e9f-bb9a-4ccc-ba21-6c36ec188050' <=> fsid=9
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data08
/data09 : uuid=594bf8a0-bc77-4040-8d45-27c789e2ba99 fsid=undef
success:   mapped '594bf8a0-bc77-4040-8d45-27c789e2ba99' <=> fsid=10
success: boot message sent to eos-fst01.alice-af.wigner.hu:/data09
/data10error: filesystem /data10 is already labeled with fsid=3 - remove the file /data10/.eosfsid if you want to register with new fsid

Though, with this last part I don’t know what is the problem - in total there are 24 filesystems mounted.

From the mgm side I can see this:

[root@eos-mgm1 ~]# eos space ls
┌──────────┬────────────────┬────────────┬────────────┬──────┬─────────┬───────────────┬──────────────┬─────────────┬─────────────┬──────┬──────────┬───────────┬───────────┬──────┬────────┬───────────┬──────┬────────┬───────────┐
│type      │            name│   groupsize│    groupmod│ N(fs)│ N(fs-rw)│ sum(usedbytes)│ sum(capacity)│ capacity(rw)│ nom.capacity│ quota│ balancing│  threshold│  converter│   ntx│  active│        wfe│   ntx│  active│ intergroup│
└──────────┴────────────────┴────────────┴────────────┴──────┴─────────┴───────────────┴──────────────┴─────────────┴─────────────┴──────┴──────────┴───────────┴───────────┴──────┴────────┴───────────┴──────┴────────┴───────────┘
 spaceview           default            0           24      9         8       849.72 MB       26.58 TB      23.63 TB           0 B    off        off          20         off      2        0         off      1        0         off 
 spaceview        default:24            0           24      1         0             0 B            0 B           0 B           0 B    off        off          20         off      2        0         off      1        0         off

Is this normal?

Btw, in XRD_ROLES I have also sync defined - is it unnecessary then?

Thank you very much for the help!

asevcenc · October 9, 2020, 8:01am

so, the last message for /data10 tells you that it is/was already registered in eos once … so you have cleanup completely the content if you want to re-register

for XRD_ROLES i do not have sync enabled … i do not know what is used for (i do not have replication or any other type of pools)

as the output of eos space ls i will let experts to give on expert advice/troubleshooting … @esindril do you have any idea what is going on with that default:24 space name?

CERN Accelerating science

Mgm node setup