Volume mount fails with the error "failed to stage volume: multipath device 'dm-xx' serial check failed"
Applies to
- Astra Trident
- ONTAP-SAN
- RedHat
Issue
Volume mount fails with following error and there is LUN Serial Number (Hex) discrepancy between the storage and hosts during the mount.
Trident Log:
level=error msg="Failed to verify multipath device serial." logLayer=csi_frontend lunSerialNumber="818kK$V-9HdE" lunSerialNumberHex=3831386b4b24562d39486445 multipathDevice=dm-xx multipathDeviceUUID="mpath-3600a09803831386b455d562d51686279\n" requestID=a973efbe-94b4-4705-be37-246bba8deff8 requestSource=CSI workflow="node_server=stage"
level=debug msg="<<<< iscsi.AttachISCSIVolume" logLayer=csi_frontend requestID=a973efbe-94b4-4705-be37-246bba8deff8 requestSource=CSI workflow="node_server=stage"
level=debug msg="Attach iSCSI volume is not complete, waiting." error="multipath device 'dm-xx' serial check failed" increment=946.402806ms logLayer=csi_frontend requestID=a973efbe-94b4-4705-be37-246bba8deff8 requestSource=CSI workflow="node_server=stage"
level=error msg="GRPC error: rpc error: code = Internal desc = rpc error: code = Internal desc = failed to stage volume: multipath device 'dm-xx' serial check failed" logLayer=csi_frontend requestID=a973efbe-94b4-4705-be37-246bba8deff8 requestSource=CSI
LUN output from Storage:
::> lun show /vol/<vol_name>/lun0 -fields serial-hex
vserver path serial-hex
-------------------- ------------------------------------------------------------------- ------------------------
SVM_Name /vol/<vol_name>/lun0 3831386b4b24562d39486445