ONTAP SAN data corruption after power and environmental issue
Applies to
- ONTAP SAN
- VMware vSphere cluster
Issue
- Periodically after an environmental failure ( power and cooling ) has been resolved
- VMware datastore becomes corrupt and must be recovered from backup
- Host initiator logging into storage frequently with FCP SRAM dump
EMS Event Log:
fct_tpd_work_thread_0: scsitarget.fct.portLogin:notice]: Login at target FC port: '0h' by initiator port: 'abc' address 0x123. The target virtual port is: 'NetApp FC Target Port (LPe16000) lif1'.fct_tpd_work_thread_0: scsitarget.fct.portLogin:notice]: Login at target FC port: '0f' by initiator port: 'abc' address 0x123. The target virtual port is: 'NetApp FC Target Port (LPe16000) lif2'.fct_tpd_work_thread_0: scsitarget.fct.portLogin:notice]: Login at target FC port: '0h' by initiator port: 'abc' address 0x123. The target virtual port is: 'NetApp FC Target Port (LPe16000) lif1'.fct_tpd_thread_1: fcp.io.status:debug]: STIO Adapter:0h, found hung cmd:0xfffff809bc03cfc0(state=10, flags=0x2, ctio_sent=2/2,RecvExAddr=0x1628, OX_ID=0x1b4, RX_ID=0xffff,SID=0x10800, Cmd[89], req_q_free:0)fct_tpd_thread_3: scsitarget.fcp.dump:debug]: FCP target SRAM dump generated for adapter 0f, fct_tpd_check_hung_commands: Command termination hung. cmd:0xfffff809c129dec0 (state=0xa, flags=0x2,ctio_sent=2/2, RecvExAddr=0x123, OX_ID=0x1c1, RX_ID=0xffff, SID=0x123)fct_tpd_thread_1: scsitarget.fcp.dump:debug]: FCP target SRAM dump generated for adapter 0h, fct_tpd_check_hung_commands: Command termination hung. cmd:0xfffff809bc03cfc0 (state=0xa, flags=0x2,ctio_sent=2/2, RecvExAddr=0x123, OX_ID=0x1b4, RX_ID=0xffff, SID=0x123)fct_tpd_thread_3: callhome.fcp.sram.dump:error]: Call home for FCP SRAM DUMP.