IO errors observed on ESXi host end where FC LUNs are mapped
Applies to
- ONTAP 9
- FC
- VMware ESXi
- Brocade
Issue
- Disk IO errors observed on ESXi host end where FC LUNs are mapped
2022-11-24T18:09:31.421Z cpu49:2098497)WARNING: HBX: 3680: 'NETAPP-A700_XXX_WIN_PROD5_LUN_05_08APR2022': HB at offset 3276800 - Reclaiming timed out HB failed: Timeout:
2022-11-24T18:36:42.078Z cpu50:2098497)WARNING: HBX: 3680: 'NETAPP-A700_XXX_WIN_PROD5_LUN_06_08APR2022': HB at offset 3276800 - Reclaiming timed out HB failed: Timeout:
2022-11-24T20:08:39.270Z cpu52:2098497)WARNING: HBX: 3680: 'NETAPP-A700_XXX_WIN_PROD5_LUN_04_08APR2022': HB at offset 3276800 - Reclaiming timed out HB failed: Timeout:
- Application hosted on VMs went down intermittently
- IO WQE errors observed on storage port where LUNs are hosted
Fri Nov 25 05:31:00 +0530 [Storagenode-01: fct_tpd_work_thread_0: fcp.io.status:debug]: STIO Adapter:10a IO WQE failure, Handle 0xc, Type 8, S_ID: 67A8C1, VPI: 3, OX_ID: 1FD, Status 0x3 Ext_Status 0x2
Fri Nov 25 05:31:12 +0530 [Storagenode-01: fct_tpd_work_thread_0: fcp.io.status:debug]: STIO Adapter:10a IO WQE failure, Handle 0xc, Type 8, S_ID: 654760, VPI: 3, OX_ID: FCB, Status 0x3 Ext_Status 0x16
Fri Nov 25 05:31:23 +0530 [Storagenode-01: fct_tpd_work_thread_0: fcp.io.status:debug]: STIO Adapter:10a IO WQE failure, Handle 0xc, Type 8, S_ID: 67E5C1, VPI: 3, OX_ID: E02, Status 0x3 Ext_Status 0x16
Fri Nov 25 05:31:34 +0530 [Storagenode-01: fct_tpd_work_thread_0: fcp.io.status:debug]: STIO Adapter:10a IO WQE failure, Handle 0xc, Type 8, S_ID: 67D952, VPI: 3, OX_ID: 8EC, Status 0x3 Ext_Status 0x1d
- Disc C3 and c3 timeout tx errors observed on switch port in large number which is connected to storage port where WQE errors were observed
frames enc crc crc too too bad enc disc link loss loss frjt fbsy c3timeout pcs uncor
tx rx in err g_eof shrt long eof out c3 fail sync sig tx rx err err
307: 270.2g 511.1g 0 58 58 0 0 0 0 183.5k 1 1 1 0 0 183.5k 0 0 0