Skip to main content
NetApp Knowledgebase

How VMware Atomic Test and Set (ATS) heartbeats can impact connectivity to storage

Views:
356
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
virt
Last Updated:

Applies to

  • Data ONTAP    
  • SAN Protocol 
  • VMware vSphere 5.5U2 and up
     

Issue

ESXi hosts running ESXi 5.5U2 or higher experience repeated "power-on resets" and intermittently lose connectivity to storage.  From vmkernel.log:

2017-12-21T16:16:55.152Z: [scsiCorrelator] 21936524546985us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012
2017-12-21T16:17:04.152Z: [scsiCorrelator] 21936533546948us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012
2017-12-21T16:17:51.359Z: [scsiCorrelator] 21936580752955us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012
2017-12-21T16:17:56.439Z: [scsiCorrelator] 21936585832602us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012
2017-12-21T16:18:37.155Z: [scsiCorrelator] 21936626546967us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012
2017-12-21T16:19:22.156Z: [scsiCorrelator] 21936671546996us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012
2017-12-21T16:20:02.973Z: [scsiCorrelator] 21936712362105us: [vob.scsi.scsipath.por] Power-on Reset occurred on naa.600a0980123456789b2b123456789012

In addition to the power-on resets seen every few seconds, there is also evidence of heart beat timeouts:

2017-12-20T16:07:54.109Z cpu28:54342051)HBX: 2958: Waiting for timed out [HB state abcdef02 offset 4071424 gen 851 stampUS 20118772698201 uuid 12345cd2-9876e8c0-1234-1234b1234a01 jrnl <FB 5125600> drv 14.60] on vol 'datastore_07'
2017-12-20T16:08:25.654Z cpu10:34381)HBX: 2958: Waiting for timed out [HB state abcdef02 offset 4071424 gen 861 stampUS 20118644347319 uuid 98765cd2-9876e8c0-1234-1234b1234a01 jrnl <FB 5646784> drv 14.60] on vol 'datastore_08'
2017-12-20T16:08:58.942Z cpu30:55981416)HBX: 2958: Waiting for timed out [HB state abcdef02 offset 4071424 gen 851 stampUS 20118908335068 uuid 12345cd2-9876e8c0-1234-1234b1234a01 jrnl <FB 5125600> drv 14.60] on vol 'datastore_07'
2017-12-20T16:09:05.657Z cpu10:34381)HBX: 2958: Waiting for timed out [HB state abcdef02 offset 4071424 gen 861 stampUS 20118644347319 uuid 98765cd2-9876e8c0-1234-1234b1234a01 jrnl <FB 5646784> drv 14.60] on vol 'datastore_08'

 

 

CUSTOMER EXCLUSIVE CONTENT

Registered NetApp customers get unlimited access to our dynamic Knowledge Base.

New authoritative content is published and updated each day by our team of experts.

Current Customer or Partner?

Sign In for unlimited access

New to NetApp?

Learn more about our award-winning Support