Skip to main content
NetApp Knowledge Base

ONTAP SAN lost access to VMware datastore

  1. Last updated
    Jul 1, 2024
  2. Save as PDF
Views:
171
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
san
Last Updated:
7/1/2024, 11:17:05 AM

Applies to

  • ONTAP 9.8 and above
  • VMware ESXi 8 u2
  • Brocade FC switch

Issue

  • Soon after updating ONTAP from 9.7  VMware vSphere reports "Lost access to volume 1234 due to connectivity issues. Recovery attempt is in progress and outcome will be reported shortly"
  • Reported lost access to VMware datastore periodically during times when  other service have a high workload
  • Fabric and multipathing paths are healthy
  • Very high LUN latency spike which coincides with a ramp up of another workload while volume latency is very low
  • Perf archive for workload indicates very high QoS min throughput latency
Examples:
 
ONTAP:
EMS log:
qos_vd_window_manager: qos.VioDet.maxThrottle:notice]: QoS violation limit for NODE xy is 1000 IOPS
 
VMWare:
Vobd.log:
vobd[2098027]:  [vmfsCorrelator] 3596269549259us: [vob.vmfs.heartbeat.timedout] xyz  SVM_abc
vobd[2098027]:  [vmfsCorrelator] 3596244876022us: [esx.problem.vmfs.heartbeat.timedout] xyz SVM_abc
 
vmkernel.log:
vmkernel: cpu9:2097307)NMP: nmp_ThrottleLogForDevice:3863: Cmd 0x89 (0x4, 8) to dev "naa.600a01234
17251" on path "vmhba4:C0:T13:L13" Failed:
vmkernel: cpu9:2097307)NMP: nmp_ThrottleLogForDevice:3863: Cmd 0x89 (0x4, 8) to naa.600a01234
 
ATS command failing on storage path:
vmkernel: cpu9:2097307)NMP: nmp_ThrottleLogForDevice:3863: Cmd 0x89 (0x45ba0179a3c0, 2097288) to dev "naa.600a01234" on path "vmhba4:C0:T13:L13" Failed:

 

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.