All the eos disk are shown "no xattr for file" in FSTs. Also, on MGM, eos -b fs ls show "booting" for some disks and more disks are shown blank

Site Administrators
1

Hi EOS Team,

We had upgrade the OS from CentOS 7.x to AlmaLinux 9.5 and EOS to v5.3.12. After that we facing inconsistency of Mount Point i.e. mount point of disks are arbitrary changing with reboot.

Then inconsistency issues are fixed and disks are mapping to their respective mount point.
( Link:- Inconsistency of Mount Point in AlmaLinux 9.x on FST's OS upgradation - #2 by asevcenc )

Now it seem that eos -b fs ls show “booting” for few fst disks and more disks are shown blank. Due to it, may be “eos space ls” has shown zero(0) space. However all disks are shown online and assign correct permisson i.e. daemon:daemon.
++++++++++++++++++++++
[root@eos-mgm ~]# eos -b fs ls | grep booting
eos04.tier2-kol.res.in 1095 1 /xdata0 default.0 booting rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 2 /xdata0 default.0 booting rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 3 /xdata0 default.0 booting rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 4 /xdata0 default.0 booting rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 5 /xdata0 default.0 booting rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 6 /xdata0 default.0 booting rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 8 /xdata1 default.1 booting rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 9 /xdata1 default.1 booting rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 10 /xdata1 default.1 booting rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 11 /xdata1 default.1 booting rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 12 /xdata1 default.1 booting rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 13 /xdata1 default.1 booting rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 113 /xdata0 default.0 booting rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 114 /xdata1 default.1 booting rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 129 /xdata0 default.0 booting rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 130 /xdata1 default.1 booting rw nodrain 0.00 online
[root@eos-mgm ~]#

[root@eos-mgm ~]# eos -b fs ls
┌────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬──────┬────────┬────────────────┐
│host │port│ id│ path│ schedgroup│ geotag│ boot│ configstatus│ drain│ usage│ active│ health│
└────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴──────┴────────┴────────────────┘
eos04.tier2-kol.res.in 1095 1 /xdata0 default.0 booting rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 2 /xdata0 default.0 booting rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 3 /xdata0 default.0 booting rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 4 /xdata0 default.0 booting rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 5 /xdata0 default.0 booting rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 6 /xdata0 default.0 booting rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 8 /xdata1 default.1 booting rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 9 /xdata1 default.1 booting rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 10 /xdata1 default.1 booting rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 11 /xdata1 default.1 booting rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 12 /xdata1 default.1 booting rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 13 /xdata1 default.1 booting rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 15 /xdata10 default.2 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 16 /xdata10 default.2 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 17 /xdata10 default.2 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 18 /xdata10 default.2 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 19 /xdata10 default.2 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 20 /xdata10 default.2 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 22 /xdata11 default.3 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 23 /xdata11 default.3 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 24 /xdata11 default.3 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 25 /xdata11 default.3 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 26 /xdata11 default.3 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 27 /xdata11 default.3 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 29 /xdata12 default.4 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 30 /xdata12 default.4 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 31 /xdata12 default.4 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 32 /xdata12 default.4 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 33 /xdata12 default.4 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 34 /xdata12 default.4 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 36 /xdata13 default.5 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 37 /xdata13 default.5 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 38 /xdata13 default.5 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 39 /xdata13 default.5 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 40 /xdata13 default.5 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 41 /xdata13 default.5 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 43 /xdata14 default.6 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 44 /xdata14 default.6 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 45 /xdata14 default.6 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 46 /xdata14 default.6 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 47 /xdata14 default.6 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 48 /xdata14 default.6 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 50 /xdata15 default.7 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 51 /xdata15 default.7 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 52 /xdata15 default.7 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 53 /xdata15 default.7 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 54 /xdata15 default.7 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 55 /xdata15 default.7 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 56 /xdata15 default.7 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 57 /xdata2 default.8 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 58 /xdata2 default.8 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 59 /xdata2 default.8 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 60 /xdata2 default.8 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 61 /xdata2 default.8 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 62 /xdata2 default.8 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 64 /xdata3 default.9 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 65 /xdata3 default.9 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 66 /xdata3 default.9 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 67 /xdata3 default.9 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 68 /xdata3 default.9 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 69 /xdata3 default.9 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 71 /xdata4 default.10 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 72 /xdata4 default.10 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 73 /xdata4 default.10 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 74 /xdata4 default.10 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 75 /xdata4 default.10 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 76 /xdata4 default.10 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 78 /xdata5 default.11 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 79 /xdata5 default.11 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 80 /xdata5 default.11 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 81 /xdata5 default.11 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 82 /xdata5 default.11 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 83 /xdata5 default.11 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 85 /xdata6 default.12 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 86 /xdata6 default.12 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 87 /xdata6 default.12 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 88 /xdata6 default.12 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 89 /xdata6 default.12 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 90 /xdata6 default.12 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 92 /xdata7 default.13 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 93 /xdata7 default.13 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 94 /xdata7 default.13 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 95 /xdata7 default.13 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 96 /xdata7 default.13 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 97 /xdata7 default.13 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 99 /xdata8 default.14 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 100 /xdata8 default.14 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 101 /xdata8 default.14 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 102 /xdata8 default.14 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 103 /xdata8 default.14 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 104 /xdata8 default.14 rw nodrain 0.00 online
eos04.tier2-kol.res.in 1095 106 /xdata9 default.15 rw nodrain 0.00 online
eos08.tier2-kol.res.in 1095 107 /xdata9 default.15 rw nodrain 0.00 online
eos05.tier2-kol.res.in 1095 108 /xdata9 default.15 rw nodrain 0.00 online
eos07.tier2-kol.res.in 1095 109 /xdata9 default.15 rw nodrain 0.00 online
eos06.tier2-kol.res.in 1095 110 /xdata9 default.15 rw nodrain 0.00 online
eos10.tier2-kol.res.in 1095 111 /xdata9 default.15 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 113 /xdata0 default.0 booting rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 114 /xdata1 default.1 booting rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 115 /xdata10 default.2 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 116 /xdata11 default.3 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 117 /xdata12 default.4 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 118 /xdata13 default.5 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 119 /xdata14 default.6 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 120 /xdata15 default.7 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 121 /xdata2 default.8 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 122 /xdata3 default.9 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 123 /xdata4 default.10 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 124 /xdata5 default.11 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 125 /xdata6 default.12 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 126 /xdata7 default.13 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 127 /xdata8 default.14 rw nodrain 0.00 online
eos11.tier2-kol.res.in 1095 128 /xdata9 default.15 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 129 /xdata0 default.0 booting rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 130 /xdata1 default.1 booting rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 131 /xdata10 default.2 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 132 /xdata11 default.3 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 133 /xdata12 default.4 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 134 /xdata13 default.5 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 135 /xdata14 default.6 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 137 /xdata2 default.8 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 138 /xdata3 default.9 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 139 /xdata4 default.10 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 140 /xdata5 default.11 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 141 /xdata6 default.12 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 142 /xdata7 default.13 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 143 /xdata8 default.14 rw nodrain 0.00 online
eos09.tier2-kol.res.in 1095 144 /xdata9 default.15 rw nodrain 0.00 online

[root@eos-mgm ~]#

We had check the xrdlog.fst log thoroughly on all 8 FSTs and seems an error i.e. “no xattr for file” and " please convert your file systems to drop LeveDB and use xattrs".
I have not clear view for it.
Please suggest us how to resolve it.

Another query, are the /etc/sysconfig/eos and /etc/sysconfig/eos env environment file work on on EOS v5.3.12.? Because, parameters like EOS_FST_NETWORK_INTERFACE, EOS_GEOTAG, EOS_MGM_ALIAS, APMON_STORAGEPATH, etc are not functioning.

So, as per eos support page, I have understand that above function should defined in /etc/eos/config/generic/all. Suggest accordingly.

Regards
Prasun

2

Hi! More precise details can give @esindril but up to a EOS version (5.2.9???) one should have fstofs.filemd_handler attr in xrd.cf.fst and then a migration process will take place. Then, after the migration, one can update the EOS to higher version.

As for the environment setup, i still use eos_env and this works as expected.

3

Hi Adrian,

Thank Adrian.

You are right that the conversion process has not run over 5.2.0.

So, we has going to downgrade the eos to 5.1.28 on fst and mgm. Then try to run conversion.

Thank again.