Skip to main content
NetApp Knowledge Base

TRID-20726: [iSCSI/multipath] 26.06 regression: NodeUnstageVolume flushes a reused dm device of a concurrently staged volume

  1. Last updated
  2. Save as PDF
Views:
12
Visibility:
Public
Votes:
0
Category:
trident-kubernetes
Specialty:
SNAPX
Last Updated:

Issue

  • On Trident 26.06.0 (ontap-san, iSCSI, multipath), a NodeUnstageVolume for one PVC that runs at the same time as a NodeStageVolume for a different PVC on the same node can remove the multipath map of the volume being staged.
  • The stage of that volume then keeps failing with failed to stage volume: multipath device not found when it is expected and its pod stays in ContainerCreating.
  • The iSCSI sessions are up and the LUN's SCSI devices are present; only the dm-multipath map is missing.
  • Un-staging errors seen

level=debug msg="Found multipath device by serial." LunSerial=<LUN_Serial> workflow="node_server=unstage"
level=warning msg="Failed to remove ghost multipath device." devicePath=/dev/dm-2 error="refusing to remove \"dm-2\": device still has 1 slave(s)" workflow="node_server=unstage"
level=debug msg=">>>> devices.RemoveMultipathDevicemapping" devicePath=/dev/dm-2 workflow="node_server=unstage"
level=error msg="Error encountered in multipath flush(remove) mapping command." devicePath=/dev/dm-2 error="exit status 1" workflow="node_server=unstage"
level=debug msg=">>>> devices.RemoveMultipathDevicemapping" devicePath=/dev/dm-2 workflow="node_server=unstage"
level=debug msg="<<<< NodeUnstageVolume" Force=false Method=NodeUnstageVolume Type=CSI_Node workflow="node_server=unstage"
 
  • Staging errors seen:

level=debug msg="Could not find multipath device for device." device=sdo workflow="node_server=stage"
level=debug msg="Could not find multipath device for device." device=sdp workflow="node_server=stage"
level=error msg="GRPC error: rpc error: code = Internal desc = rpc error: code = Internal desc = failed to stage volume: multipath device not found when it is expected" requestID=<Request_ID>
 

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.