Pod state error with "multipath device not found when it is expected"
Applies to
- NetApp Astra Trident 22.10.0
- Using the software iSCSI initiator
- Multipathing is configured
Issue
time="2023-08-01T00:49:31Z" level=debug msg="<<<< devices.waitForMultipathDeviceForDevices" devices="[sdba sdax sday sdaz]" requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
time="2023-08-01T00:49:31Z" level=debug msg="<<<< devices.waitForMultipathDeviceForLUN" iSCSINodeName="iqn.1992-08.com.netapp:sn.30cac1b2f05511eb8f83d039ea33732c:vs.5" lunID=498 requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
time="2023-08-01T00:49:31Z" level=debug msg="<<<< iscsi.AttachISCSIVolume" requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
time="2023-08-01T00:49:31Z" level=debug msg="<<<< iscsi.AttachISCSIVolumeRetry" requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
time="2023-08-01T00:49:31Z" level=debug msg="<<<< NodeStageVolume" Method=NodeStageVolume Type=CSI_Node requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
time="2023-08-01T00:49:31Z" level=debug msg="Released shared lock (NodeStageVolume-pvc-408ea1fc-5d90-428a-8157-d57b060bd9e1)." lock=csi_node_server requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
time="2023-08-01T00:49:31Z" level=error msg="GRPC error: rpc error: code = Internal desc = failed to stage volume: multipath device not found when it is expected" requestID=a399266d-7225-4451-afb9-10e6fd971587 requestSource=CSI
$ multipath -ll
3600a098038314766475d52646652726a dm-6 ##,##
size=500G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 alua' wp=rw
|-+- policy='service-time 0' prio=0 status=enabled
| |- #:#:#:# - #:# failed undef unknown
| `- #:#:#:# - #:# failed undef unknown
`-+- policy='service-time 0' prio=0 status=enabled
|- #:#:#:# - #:# failed undef unknown
`- #:#:#:# - #:# failed undef unknown