Dear All,
Presently at Kolkata Tier-2, Data transfers are going on from Kolkata::EOS and Kolkata::SE to Kolkata::EOS2.
Few query and comments related to these:-
- Time to time one or more FSTs are hanging. For the remedy we are rebooting the particular FST as did not seen any unusual behavior (or we are missing something). Kolkata::EOS2 has 7 FSTs with RAIN-6 configuration, (each FST contain 16 disks.)
==================================
[root@eos-mgm ~]# eos -b attr ls /eos/alicekolkata/grid/
sys.forced.blockchecksum=“crc32c”
sys.forced.blocksize=“1M”
sys.forced.checksum=“adler”
sys.forced.layout=“raid6”
sys.forced.nstripes=“7”
sys.forced.space=“default”
sys.forced.stripes=“7”
[root@eos-mgm ~]#
[root@eos-mgm ~]# eos -b node ls --sys
┌────────────────────────────────┬────────────────┬────────────┬────────────┬────────────┬──────────┬────────────┬────────────┬──────────────────────────────┬────────────────────────────────┬────────────────────────────────────────────────────────────────────────────────┐
│hostport │ geotag│ vsize│ rss│ threads│ sockets│ eos│ xrootd│ kernel version│ start│ uptime│
└────────────────────────────────┴────────────────┴────────────┴────────────┴────────────┴──────────┴────────────┴────────────┴──────────────────────────────┴────────────────────────────────┴────────────────────────────────────────────────────────────────────────────────┘
eos04.tier2-kol.res.in:1095 Kolkata:EOS2 83.61 G 1.91 G 138 13 4.4.23-1 v4.8.5 3.10.0-957.10.1.el7.x86_64 Mon Apr 1 05:34:31 2019 12:23:34 up 1 day, 13:32, 0 users, load average: 0.04, 0.05, 0.10
eos05.tier2-kol.res.in:1095 0 0 0
eos06.tier2-kol.res.in:1095 0 0 0
eos07.tier2-kol.res.in:1095 0 0 0
eos08.tier2-kol.res.in:1095 0 0 0
eos09.tier2-kol.res.in:1095 0 0 0
eos10.tier2-kol.res.in:1095 0 0 0
[root@eos-mgm ~]# eos -b node ls -b
┌──────────┬────────────────────────────────┬────────────────┬──────────┬────────────┬──────┬──────────┬────────┬────────┬────────────────┬─────┐
│type │ hostport│ geotag│ status│ status│ txgw│ gw-queued│ gw-ntx│ gw-rate│ heartbeatdelta│ nofs│
└──────────┴────────────────────────────────┴────────────────┴──────────┴────────────┴──────┴──────────┴────────┴────────┴────────────────┴─────┘
nodesview eos04.tier2-kol.res.in:1095 Kolkata:EOS2 online on off 0 10 120 1 16
nodesview eos05.tier2-kol.res.in:1095 unknown on off 0 10 120 ~ 16
nodesview eos06.tier2-kol.res.in:1095 unknown on off 0 10 120 ~ 16
nodesview eos07.tier2-kol.res.in:1095 unknown on off 0 10 120 ~ 16
nodesview eos08.tier2-kol.res.in:1095 unknown on off 0 10 120 ~ 16
nodesview eos09.tier2-kol.res.in:1095 unknown on off 0 10 120 ~ 16
nodesview eos10.tier2-kol.res.in:1095 unknown on off 0 10 120 ~ 16
[root@eos-mgm ~]# systemctl status eossync
[root@eos-mgm ~]# for fst in eos{04…10};do ( ssh $fst ‘systemctl status eos@fst’ );done
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2019-04-01 05:34:31 IST; 6h ago
Process: 86317 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 86335 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 86364 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─86364 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─86408 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 09:20:12 eos04.tier2-kol.res.in scandir[86364]: corrupted block checksum: localpath=/xdata11/000001f9/004d1b4a blockxspath=/xdata11/000001f9/004d1b4a.xsmap lfn=/13/15643/44159d68-fd3a-11df-b183-0018fe730ae5
Apr 01 09:24:26 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata11, files=121680 scanduration=1579.27 [s] scansize=73221853240 [Bytes] [ 73221 MB ] scannedfiles=16000 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=105680
Apr 01 10:03:10 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata8, files=116752 scanduration=34.07 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=116752
Apr 01 10:46:57 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata0, files=124527 scanduration=50.42 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=124527
Apr 01 10:49:17 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata10, files=121891 scanduration=32.36 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=121891
Apr 01 10:59:56 eos04.tier2-kol.res.in scandir[86364]: skipping scan w-open file: localpath=/xdata6/000001fd/004dcfbc fsid=85 fid=4dcfbc
Apr 01 10:59:56 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata6, files=114143 scanduration=30.49 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=114142
Apr 01 11:24:25 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata3, files=108938 scanduration=27.66 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=108938
Apr 01 12:07:35 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata1, files=136912 scanduration=36.81 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=136912
Apr 01 12:12:36 eos04.tier2-kol.res.in scandir[86364]: Directory: /xdata4, files=112971 scanduration=32.35 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=112971
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2019-04-01 04:16:32 IST; 8h ago
Process: 121664 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 121671 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 121701 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─121701 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─121745 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 09:53:02 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata9, files=112226 scanduration=32.88 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=112226
Apr 01 09:58:13 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata11, files=120368 scanduration=86.80 [s] scansize=2303934749 [Bytes] [ 2303 MB ] scannedfiles=497 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=119871
Apr 01 10:00:02 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata2, files=110290 scanduration=33.01 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110290
Apr 01 10:30:56 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata10, files=119281 scanduration=35.20 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=119281
Apr 01 10:39:44 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata5, files=110534 scanduration=33.76 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110534
Apr 01 11:16:39 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata0, files=116326 scanduration=34.60 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=116326
Apr 01 12:10:37 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata12, files=110229 scanduration=32.15 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110229
Apr 01 12:19:03 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata8, files=111658 scanduration=32.60 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=111658
Apr 01 12:23:46 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata14, files=110399 scanduration=32.01 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110399
Apr 01 12:27:32 eos05.tier2-kol.res.in scandir[121701]: Directory: /xdata3, files=110062 scanduration=34.13 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110062
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2019-04-01 07:34:36 IST; 4h 54min ago
Process: 130002 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 130009 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 130039 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─130039 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─130081 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 10:35:14 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata12, files=110108 scanduration=33.32 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110108
Apr 01 10:50:27 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata5, files=109632 scanduration=495.68 [s] scansize=22018136662 [Bytes] [ 22018 MB ] scannedfiles=4058 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=105574
Apr 01 10:59:20 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata14, files=110263 scanduration=51.04 [s] scansize=423772160 [Bytes] [ 423 MB ] scannedfiles=36 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110227
Apr 01 11:00:05 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata1, files=142505 scanduration=2753.76 [s] scansize=130014158350 [Bytes] [ 130014 MB ] scannedfiles=25199 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=117306
Apr 01 11:18:00 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata7, files=136617 scanduration=3103.76 [s] scansize=146700602919 [Bytes] [ 146700 MB ] scannedfiles=27935 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=108680
Apr 01 11:51:36 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata6, files=110693 scanduration=33.68 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110693
Apr 01 11:54:33 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata13, files=109073 scanduration=33.16 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=109073
Apr 01 11:58:41 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata8, files=113016 scanduration=33.67 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=113016
Apr 01 12:13:49 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata0, files=116557 scanduration=34.24 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=116557
Apr 01 12:19:30 eos06.tier2-kol.res.in scandir[130039]: Directory: /xdata11, files=119093 scanduration=34.15 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=119093
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Sun 2019-03-31 22:28:29 IST; 14h ago
Process: 17785 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 17792 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 17821 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─17821 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─17867 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 09:36:45 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata7, files=136903 scanduration=2900.07 [s] scansize=137142940611 [Bytes] [ 137142 MB ] scannedfiles=27069 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=109832
Apr 01 09:45:30 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata12, files=111014 scanduration=33.79 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=111014
Apr 01 09:49:21 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata1, files=143093 scanduration=2733.80 [s] scansize=128932169637 [Bytes] [ 128932 MB ] scannedfiles=25659 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=117432
Apr 01 09:55:58 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata13, files=110921 scanduration=32.59 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110921
Apr 01 10:21:50 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata3, files=110430 scanduration=32.14 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110430
Apr 01 10:36:51 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata10, files=119314 scanduration=34.69 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=119314
Apr 01 10:53:36 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata2, files=109937 scanduration=33.65 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=109937
Apr 01 11:30:29 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata9, files=111589 scanduration=34.33 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=111589
Apr 01 12:04:54 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata8, files=112497 scanduration=33.75 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=112497
Apr 01 12:05:35 eos07.tier2-kol.res.in scandir[17821]: Directory: /xdata0, files=117626 scanduration=34.56 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=117626
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2019-04-01 02:23:35 IST; 10h ago
Process: 87909 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 87919 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 87948 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─87948 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─87994 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: skipping scan w-open file: localpath=/xdata7/00000211/0050c66c fsid=93 fid=50c66c
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: skipping scan w-open file: localpath=/xdata7/00000211/0050c665 fsid=93 fid=50c665
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: skipping scan w-open file: localpath=/xdata7/00000211/0050c676 fsid=93 fid=50c676
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: skipping scan w-open file: localpath=/xdata7/00000211/0050c66d fsid=93 fid=50c66d
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: skipping scan w-open file: localpath=/xdata7/00000211/0050c67a fsid=93 fid=50c67a
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: skipping scan w-open file: localpath=/xdata7/00000211/0050c622 fsid=93 fid=50c622
Apr 01 11:37:37 eos08.tier2-kol.res.in scandir[87948]: Directory: /xdata7, files=136995 scanduration=802.75 [s] scansize=37195691641 [Bytes] [ 37195 MB ] scannedfiles=6679 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=129258
Apr 01 11:40:06 eos08.tier2-kol.res.in scandir[87948]: Directory: /xdata14, files=110454 scanduration=31.91 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110454
Apr 01 11:48:19 eos08.tier2-kol.res.in scandir[87948]: Directory: /xdata9, files=111734 scanduration=33.11 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=111734
Apr 01 12:26:20 eos08.tier2-kol.res.in scandir[87948]: Directory: /xdata8, files=112478 scanduration=32.49 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=112478
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2019-04-01 05:34:32 IST; 6h ago
Process: 71964 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 71975 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 72005 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─72005 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─72048 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c721 fsid=14 fid=50c721
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c657 fsid=14 fid=50c657
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c6eb fsid=14 fid=50c6eb
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c673 fsid=14 fid=50c673
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c679 fsid=14 fid=50c679
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c675 fsid=14 fid=50c675
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: skipping scan w-open file: localpath=/xdata1/00000211/0050c61a fsid=14 fid=50c61a
Apr 01 12:03:27 eos09.tier2-kol.res.in scandir[72005]: Directory: /xdata1, files=145010 scanduration=831.68 [s] scansize=37885245001 [Bytes] [ 37885 MB ] scannedfiles=8133 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=135892
Apr 01 12:04:33 eos09.tier2-kol.res.in scandir[72005]: Directory: /xdata10, files=121064 scanduration=34.41 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=121064
Apr 01 12:11:51 eos09.tier2-kol.res.in scandir[72005]: Directory: /xdata14, files=113304 scanduration=32.96 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=113304
● eos@fst.service - EOS fst
Loaded: loaded (/usr/lib/systemd/system/eos@.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2019-04-01 01:29:46 IST; 10h ago
Process: 18062 ExecStop=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-stop %i (code=exited, status=0/SUCCESS)
Process: 18076 ExecStartPre=/bin/sh -c /usr/sbin/eos_start_pre.sh eos-start-pre %i (code=exited, status=0/SUCCESS)
Main PID: 18126 (xrootd)
CGroup: /system.slice/system-eos.slice/eos@fst.service
├─18126 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
└─18173 /usr/bin/xrootd -n fst -c /etc/xrd.cf.fst -l /var/log/eos/xrdlog.fst -s /tmp/xrootd.fst.pid -Rdaemon
Apr 01 11:07:57 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata15, files=109116 scanduration=32.20 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=109116
Apr 01 11:08:30 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata11, files=119781 scanduration=35.77 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=119781
Apr 01 11:09:14 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata13, files=109682 scanduration=33.38 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=109682
Apr 01 11:12:33 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata12, files=110333 scanduration=32.74 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110333
Apr 01 11:17:28 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata4, files=109871 scanduration=32.44 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=109871
Apr 01 11:23:38 eos10.tier2-kol.res.in scandir[18126]: skipping scan w-open file: localpath=/xdata6/000001fd/004dcfbc fsid=90 fid=4dcfbc
Apr 01 11:23:38 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata6, files=110556 scanduration=32.90 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110555
Apr 01 11:34:18 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata14, files=110346 scanduration=33.44 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=110346
Apr 01 11:46:36 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata10, files=119164 scanduration=35.29 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=119164
Apr 01 12:23:26 eos10.tier2-kol.res.in scandir[18126]: Directory: /xdata0, files=117303 scanduration=32.64 [s] scansize=0 [Bytes] [ 0 MB ] scannedfiles=0 corruptedfiles=0 hwcorrupted=0 nochecksumfiles=0 skippedfiles=117303
[root@eos-mgm ~]#
=======================
- How to increase transfer speed? We have 10Gbps backbone and EOS2 is configured as RAIN-6. Each FST contain 16 disk means 16 EOS Groups configured. Will it possible to have 16 parallel file transfers? if yes what will be configuration parameters.
Regards
Vikas