Difference between eos quota and du -sh

General Discussion
1

Hello,
I’m trying to get the breakdown of a specific folder on /eos, and I’m noticing differences between:

eos quota /eos/atlas/atlascerngroupdisk/phys-top

By group:
┏━> Quota Node: /eos/atlas/atlascerngroupdisk/phys-top/
┌──────────┬──────────┬──────────┬──────────┬──────────┬──────────┬──────────┬──────────┬──────────┬──────────┐
│group     │used bytes│logi bytes│used files│aval bytes│aval logib│aval files│ filled[%]│vol-status│ino-status│
└──────────┴──────────┴──────────┴──────────┴──────────┴──────────┴──────────┴──────────┴──────────┴──────────┘
 zp          101.73 TB   50.87 TB     1.33 M  110.00 TB   55.00 TB     2.00 M    92.49 %    warning         ok
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛

and the output of du -sh /eos/atlas/atlascerngroupdisk/phys-top that returns 47.40TB, instead of 50.87TB.

So, if I try to du -sh /eos/atlas/atlascerngroupdisk/phys-top/* to get the breakdown of the different subdirs and their size, I won’t be able to match the eos quota total. While I do du -sh, I do not get any permission denied error.

Is there a way to get the actual size of each subdirectory? Is it possible that I lack some rights?

Thank you very much,
Giovanni

2

Hi Giovanni,
this is the usual problem with ‘du’ repoting 1024 units vs. eos quota reporting 1000 units:

root@eosatlas-ns-ip563 (mgm:master mq:master) ~]$ ls -lrt /tmp/apeters/1G
-rw-r--r--. 1 root root 1048576000 Feb 15 10:50 /tmp/apeters/1G
[root@eosatlas-ns-ip563 (mgm:master mq:master) ~]$ du -b -s /tmp/apeters/1G
1048576000	/tmp/apeters/1G
[root@eosatlas-ns-ip563 (mgm:master mq:master) ~]$ du -hs /tmp/apeters/1G
1000M	/tmp/apeters/1G

46 * 1024 * 1024 * 1024 * 1024  = 46 TiB
50577534877696 = 50.5 TB

You can see the size of each tree like this using the eos shell (the directory size is the size of the directory tree!):

[root@eosatlas-ns-ip563 (mgm:master mq:master) ~]$ eos ls -lh /eos/atlas/atlascerngroupdisk/phys-top
drwxr-xr-+   1 6766     zp           704.99 M Jun 23  2021 4tops
drwxr-xr-+   1 jkempste zp             3.54 T Aug 24  2021 4tops2019
drwxr-xr-+   1 jkempste zp               8688 Jan  9  2020 QuotaManagement
drwxr-xr-+   1 jkempste zp            16.85 G Jan 11  2020 dileptonsharedntuples
-rw-r--r--   2 jkempste zp                567 Mar 20  2019 id_script.sh~
drwxr-xr-+   1 jkempste zp                  0 Jan 17  2019 quota_test
drwxr-xr-+   1 jkempste zp             3.55 T Jun  1  2022 rb_dilepdiff
drwxr-xr-+   1 6766     zp           380.21 G Jul  9  2018 sgtop_fakes
drwxr-sr-+   1 cescobar zp             9.94 T Feb 13 14:30 singletop
-rw-r--r--   2 jkempste zp               1286 Oct 21  2019 sizeA.txt
-rw-r--r--   2 jkempste zp                524 Oct 21  2019 sizeA_toproperties.txt
-rw-r--r--   2 jkempste zp                200 Oct 21  2019 sizeA_topxs.txt
drwxr-xr-+   1 root     root          18.23 G Feb  3  2015 test-data
-rw-r--r--   2 jkempste zp           988.75 k Aug 29  2019 tmp.txt
-rw-r--r--   2 jkempste zp           988.74 k Aug 29  2019 tmp.txt~
drwxrwxr-+   1 gguerrie zp            11.32 T May 12  2022 topplusx
drwxr-sr-+   1 dellasta zp             1.10 T Mar 26  2021 toppropertiesandmass
drwxr-xr-+   1 dellasta zp           168.84 G Jul 17  2020 topreco
drwxr-xr-+   1 dellasta zp            10.25 T Sep  7  2020 toproperties
drwxr-xr-+   1 iconnell zp             8.31 T Jun  5  2019 topxs
drwxr-xr-+   1 jkempste zp             1.02 T Feb 10 10:48 ttZ
drwxr-sr-+   1 tpelzer  zp             2.38 M Feb 15  2021 ttjets
drwxr-xr-+   1 6766     zp             1.18 T Mar  6  2018 upgrade
drwxr-xr-+   1 root     zp                  0 Feb  3  2015 user
3

Great, thank you very much!

Giovanni