Skip to main content
NetApp Knowledge Base

Cloud Volumes ONTAP HA Degraded in AWS Due to Network degradation alerts

  1. Last updated
  2. Save as PDF
Views:
72
Visibility:
Public
Votes:
0
Category:
cloud-volumes-ontap-cvo
Specialty:
amazon_web_service
Last Updated:

Applies to

NetApp Cloud Volumes ONTAP (CVO) in AWS

Issue

Cloud Volumes ONTAP (CVO) HA pair in AWS showed as Degraded in NetApp console (formally NetApp Console) and System Manager. Node 2 was not reachable and appeared “off” in the System Manager, with only node 1 and the mediator reported as “on.” The following log outputs were observed:

EMS.logs :
[CVO-02: vifmgr: callhome.clus.net.degraded:alert]: Call home for CLUSTER NETWORK DEGRADED: Total Packet Loss - Ping failures detected between CVO-02_clus_2 ( X.X.X.X ) on CVO-02 and CVO-01_clus_1 ( X.X.X.X ) on CVO-01
[CVO-02: ctrl_hb_port_e0c: ctrl.rdma.heartBeat:info]: HA interconnect: Missed heartbeat to X.X.X.X.

Server.logs :
[Send Daily Notification       ] [kUJCmqhd] [             ] [System         ] (oncloud-akka.actor.default-dispatcher-1293) [AwsHaDescribeFlowExecutor:44] Status of Vsa Working Environment [id: VsaWorkingEnvironment-XXXX, name: CVOXX, ip: X.X.X.X,X.X.X.X] is DEGRADED

Serial Console.logs :
RC NIC fw update error is :0
NIC FW update from kernel error is :0
sp_set_dev_updt_progress call failed and return value is : 103
Boot argument NfsRdmaOk not specified.  Default (set) is in effect.
Boot argument NfsIpOk not specified.  Default (set) is in effect.
FWU 2nd trigger point
FWU has no post firmware update action registered.
pnso provider init started.
Notice : pnso card not detected.
QAT provider init started.
QAT service data size is [328]
Notice : QAT card not detected.
hwo: Node is using hardware provider : 1.
cryptomod_fips: Cryptomod FIPS version: Cryptomod FIPS 3.0
cryptomod_fips: Executing Crypto FIPS Self Tests.
cryptomod_fips: Crypto FIPS self-test: 'CPU COMPATIBILITY' passed.
cryptomod_fips: Crypto FIPS self-test: 'AES-128 ECB, AES-256 ECB' passed.
cryptomod_fips: Crypto FIPS self-test: 'AES-128 CBC, AES-256 CBC' passed.
cryptomod_fips: Crypto FIPS self-test: 'AES-128 GCM, AES-256 GCM' passed.
cryptomod_fips: Crypto FIPS self-test: 'AES-128 CCM' passed.
cryptomod_fips: Crypto FIPS self-test: 'AES-128, AES-256 CMAC' passed.
cryptomod_fips: Crypto FIPS self-test: 'CTR_DRBG' passed.
cryptomod_fips: Crypto FIPS self-test: 'KDF' passed.
cryptomod_fips: Crypto FIPS self-test: 'SHA1, SHA256, SHA512' passed.
cryptomod_fips: Crypto FIPS self-test: 'SHA3-256' passed.
cryptomod_fips: Crypto FIPS self-test: 'HMAC-SHA1, HMAC-SHA256, HMAC-SHA512' passed.
cryptomod_fips: Crypto FIPS self-test: 'PBKDF2' passed.
cryptomod_fips: Crypto FIPS self-test: 'AES-XTS 128, AES-XTS 256' passed.
cryptomod_fips: Crypto FIPS self-test: 'Self-integrity' passed.
fm_run0: no local disks found & OFW channel is not up.
Waiting for requisite number of local mailboxes... (Press Ctrl-C to abort wait)

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.