StorageGRID Services don't come up after shutdown
Applies to
NetApp StorageGRID
Issue
- All nodes have been shutdown for maintenance, at power up, no node is able to start all services
- StorageGRID UI reports
Node not locked with NTP server
on all Admin Nodes and Storage Nodes. storagegrid-status
output showsTime Synchronization
stuck inStarting...
state on all nodes.service ntp status
output showsntp up but not ready. check /var/local/log/servermanager.log
servermanager.log
output showsntp not locked
- Pings are successful to the NTP sources but no information is syncing.
- NTP time offset and jitter using command
ntpq -p
shows significant time drift:
remote refid st t when poll reach delay offset jitter
==============================================================================
ntpserver.local init 1 u 0 0 0 1.045 +2846.3 0.260
ntpserver.local init 1 u 0 0 0 0.626 +3903.3 0.520
pa_nodename init 16 u 0 0 0 0.000 0.000 0.000
nodename1 init 16 u 0 0 0 0.000 0.000 0.000
nodename2 init 16 u 0 0 0 0.000 0.000 0.000
nodename3 init 16 u 0 0 0 0.000 0.000 0.000
- Syncing the NTP clocks using
ntpd -q
produces no changes to the offset and jitter when running the command.