Network is unreachable

Site Administrators
1

Hi all,

I do not know why eos started to have network problems recently. In /var/log/eos/mgm/Clients.log I have following errors now:

200218 11:38:35 ERROR [10367/00099] monalisa ::Emsg Unable to open file /eos/aliceicm/grid/04/25368/f7200c20-522d-11ea-b828-0242790999e0; Network is unreachable

but everything is online and working:
$eos node ls
┌──────────┬────────────────────────────────┬────────────────┬──────────┬────────────┬──────┬──────────┬────────┬────────┬────────────────┬─────┐
│type │ hostport│ geotag│ status│ status│ txgw│ gw-queued│ gw-ntx│ gw-rate│ heartbeatdelta│ nofs│
└──────────┴────────────────────────────────┴────────────────┴──────────┴────────────┴──────┴──────────┴────────┴────────┴────────────────┴─────┘
nodesview a-fst1.grid.icm.edu.pl:1095 ALICE::ICM::EOS online on off 0 10 120 0 3

$eos space ls
│type │ name│ groupsize│ groupmod│ N(fs)│ N(fs-rw)│ sum(usedbytes)│ sum(capacity)│ capacity(rw)│ nom.capacity│ quota│ balancing│ threshold│ converter│ ntx│ active│ wfe│ ntx│ active│ intergroup│
└──────────┴────────────────┴────────────┴────────────┴──────┴─────────┴───────────────┴──────────────┴─────────────┴─────────────┴──────┴──────────┴───────────┴───────────┴──────┴────────┴───────────┴──────┴────────┴───────────┘
spaceview default 0 24 3 3 441.36 GB 864.02 TB 864.00 TB 0 B off off 20 off 2 0 off 1 0 off

Any tips where can be the problem?

EDIT:
$eos -v
EOS 4.4.23 (CERN)

Regards,
Karol

2

hi,

just out of curiosity, did you check output of fs ls? in the only cases I have seen the ‘network is unreachable’ error, from memory it was due to fs down rather than fst node down specifically.

3

Hi,

thank you for the answer. Yes I did check fs and they are online:

$ eos fs ls
┌────────────────────────┬────┬──────┬────────────────────────────────┬────────────────┬────────────────┬────────────┬──────────────┬────────────┬────────┬────────────────┐
│host │port│ id│ path│ schedgroup│ geotag│ boot│ configstatus│ drainstatus│ active│ health│
└────────────────────────┴────┴──────┴────────────────────────────────┴────────────────┴────────────────┴────────────┴──────────────┴────────────┴────────┴────────────────┘
a-fst1.grid.icm.edu.pl 1095 1 /alice/gpfs0 default.0 ALICE::ICM::EOS booted rw nodrain online no smartctl
a-fst1.grid.icm.edu.pl 1095 2 /alice/gpfs1 default.1 ALICE::ICM::EOS booted rw nodrain online no smartctl
a-fst1.grid.icm.edu.pl 1095 3 /alice/gpfs2 default.2 ALICE::ICM::EOS booted rw nodrain online no smartctl

Regards,
Karol