Upgrade ONTAP failed with "Error: command failed: Validation checks failed with errors."
Applies to
- ONTAP 9.3
- ONTAP upgrade
Issue
In an 8 node cluster, upgrading ONTAP from 9.3 to 9.5 failed on the first 2 nodes during validation checks.
::*> cluster image update -version 9.5P15 -nodes N01,N02 -force-rolling true
Starting validation for this update... It can take several minutes to complete validation... WARNING: There are additional manual upgrade validation checks that must be performed after these automated validation checks have completed successfully. Refer to the Upgrade Advisor Plan or "Performing manual checks before an automated cluster upgrade" section in the "Clustered Data ONTAP Upgrade Express Guide" for the remaining manual validation checks that need to be performed before update. Failing to do so can result in an update failure or an I/O disruption. Pre-update Check Status Error-Action -------------------- ---------- -------------------------------------------- CIFS status Warning Warning: CIFS is currently in use. Any unprotected sessions may be affected with possible loss of data. Action: Stop all unprotected CIFS workloads before performing the update. To list the unprotected CIFS workloads, run the command: vserver cifs session show -continuously-available No, Partial Cluster/management Warning Warning: Ensure that the NX-OS (cluster switch support network switches), IOS (management network switches), and reference configuration file (RCF) software versions are compatible with the target Data ONTAP release. Action: Refer to http://mysupport.netapp.com/NOW/download/software/cm_switches/ and http://mysupport.netapp.com/NOW/download/software/cm_switches_ntap/ for more details. Disk status Warning Warning: There are failed disks in the cluster. Action: To check for failed disks run the command: disk show -container-type broke LIFs on home node Error Error: One or more LIFs are not on the home status node, verify that all LIFs are on the home node before attempting NDU. Action: To check for LIFs which are not on their home node, use the command: network interface show -is-home false Manual checks Warning Warning: Manual validation checks need to be performed. Refer to the Upgrade Advisor Plan or "Performing manual checks before an automated cluster upgrade" section in the "Clustered Data ONTAP Upgrade Express Guide" for the remaining validation checks that need to be performed before update. Failing to do so can result in an update failure or an I/O disruption. Action: Refer to the Upgrade Advisor Plan or "Performing manual checks before an automated cluster upgrade" section in the "Clustered Data ONTAP Upgrade Express Guide" for the remaining validation checks that need to be performed before update. NFS mounts Warning Warning: This cluster is serving NFS clients. If NFS soft mounts are used, there is a possibility of frequent NFS timeouts and race conditions that can lead to data corruption during the upgrade. Action: Use NFS hard mounts, if possible. To list Vservers running NFS, run the following command: vserver nfs show Name Service Warning Warning: None of the configured DNS servers Configuration DNS are reachable for the following Vservers: Check vserver2. There might be other Vservers for which DNS servers are not reachable. Action: Delete the DNS server, or verify that the DNS status is "up". To verify the status, use the "vserver services name-service dns check" command. Delete the DNS configuration for the Vservers which do not have "dns" listed as a configured source in the output of the "vserver services name-service ns-switch show" command. Openssh 7.2 upgrade Warning Warning: "hmac-ripemd160" and validation check "hmac-ripemd160-etm" are considered weak keyed-hash message authentication code(HMAC) algorithms and support for the same will be removed after upgrading to Data ONTAP 9.3. Action: Before retrying the upgrade, remove the above weak algorithms using "security ssh remove" command. To list all Vservers configured with one or both the above HMAC algorithms, run "security ssh show -mac-algorithms hmac-ripemd160* -vserver * -fields vserver". SAN compatibility Warning Warning: Since this cluster is configured for SAN, manually confirm that the SAN configuration is fully supported. Action: Refer to the NetApp Interoperability Matrix Tool for interoperability information. SnapMirror status Warning Warning: DP SnapMirror relationships detected. Action: For inter-cluster DP SnapMirror relationships, upgrade the following destination clusters first before upgrading the current cluster: AA. If the current cluster is upgraded first, you will lose protection until the destination clusters are upgraded, too. Overall Status Error 11 entries were displayed. Validation has reported problems. Please address errors and retry update. Error: command failed: Validation checks failed with errors.
::> system image show -node N02 Node Image Is Default Is Current Version Install Date -------- ----------- ---------------- ------------- -------------- ------------- N02 image1 false false 9.5P15 11/6/2021 16:22:44 image2 true true 9.3P15 11/6/2021 10:56:02