How to perform health-check on CVO clusters
Applies to
- Cloud Volumes ONTAP (CVO)
- High Availability (HA)
- Cloud Manager
- OnCommand Cloud Manager (OCCM/Connector)
Description
How to perform health-check on CVO clusters
Procedure
Commands to run in the CLI
- Login to cluster via SSH.
- Prepare to save the SSH output as there may be many lines of scroll or consider the process for recording a CLI session.
- Enter advanced mode:
set -privilege advanced
- You can choose to run this health-check against a CVO cluster prior to any scheduled maintenance. Copy and paste the following commands into the SSH session (they can all be copied and pasted at once).
- All commands below, outside of the 'storage disk show' command, should report back either "There are no entries matching your query" or This table is currently empty"; if a command outputs anything other than what's expected, review the output and make the necessary changes to resolve the issue. Afterwards, run the effected command from the script again to verify the issue has been resolved.
- The 'storage disk show' should only report back the mediator disks in the cluster. If other disks are listed/present, work with NetApp technical support to identify and/or resolve the status of the disk prior to beginning any CVO upgrade or maintenance task.
- Not all commands are available in all versions of ONTAP, refer to ONTAP documentation for the release in use for the cluster. Commands that require a specific ONTAP release have a comment added to the end of the command line and will show in your SSH output but will not impact the execution of the command.
|
Notice These commands only perform checks and do not implement any changes. |
### START OF SCRIPT ### set -rows 0 ### GENERAL ### cluster kernel-service show -status-quorum out-of-quorum cluster kernel-service show -status-avail !true cluster kernel-service show -status-oper !operational cluster peer health show -bypass-cache true -availability false cluster ring show -online offline cluster show -eligibility false cluster show -health false job show -state Failure|Error|Quit|Dead|Unknown security key-manager key query -restored false #Requires ONTAP 9.6+ system health alert show system health subsystem show -health !ok ### STORAGE ### storage aggregate show -state !online storage aggregate show -raidstatus !*normal* storage aggregate object-store show -object-store-availability unavailable #Requires ONTAP 9.2+ storage disk show -state !spare,!present #verify the mediator disks are present storage errors show storage failover show -enabled false storage failover show -possible false ### NETWORK ### network interface show -is-home false network interface show -status-oper down -status-extended !"This LIF is down because its Vserver is stopped"* network port ifgrp show -mode !singlemode -activeports !full network port ifgrp show -mode singlemode -activeports !partial network port show -health-status degraded network port show -link !up -up-admin true ### DATA ### lun show -state !online snapmirror show -healthy false volume show -in-nvfailed-state true volume show -is-inconsistent true volume show -state !online,!restricted vserver cifs check -status down #Requires ONTAP 9.5+ vserver cifs show -status-admin down vserver iscsi show -status-admin down vserver nfs show -access !true vserver show -type data -operational-state !running -subtype !dp-destination,!sync-destination set -privilege admin ### END OF SCRIPT ###
ActiveIQ ARS Signature Review
Additional steps should be taken to review your cluster in ActiveIQ for up-to-date ARS signatures that may be impacting the system.