StorageGRID Services don't come up after shutdown
Applies to
NetApp StorageGRID
Issue
- All nodes have been shutdown for maintenance, at power up, no node is able to start all services
- StorageGRID UI reports
Node not locked with NTP serveron all Admin Nodes and Storage Nodes. storagegrid-statusoutput showsTime Synchronizationstuck inStarting...state on all nodes.service ntp statusoutput showsntp up but not ready. check /var/local/log/servermanager.logservermanager.logoutput showsntp not locked- Pings are successful to the NTP sources but no information is syncing.
- NTP time offset and jitter using command
ntpq -pshows significant time drift:
remote refid st t when poll reach delay offset jitter
==============================================================================
ntpserver.local init 1 u 0 0 0 1.045 +2846.3 0.260
ntpserver.local init 1 u 0 0 0 0.626 +3903.3 0.520
pa_nodename init 16 u 0 0 0 0.000 0.000 0.000
nodename1 init 16 u 0 0 0 0.000 0.000 0.000
nodename2 init 16 u 0 0 0 0.000 0.000 0.000
nodename3 init 16 u 0 0 0 0.000 0.000 0.000
- Syncing the NTP clocks using
ntpd -qproduces no changes to the offset and jitter when running the command.
