Pod creation is stuck at ContainerCreating due to FailedMount
Applies to
Astra Data Store
Issue
Pod creation is in stuck and see FailedMount
events with kubectl describe pod <pod> -n <namespace>.
Example:
# kubectl get pod -n testapp
NAME READY STATUS RESTARTS AGE
testapp-mongodb-596f595859-6b75l 0/1 ContainerCreating 0 85s
# kubectl describe pod testapp-mongodb-596f595859-6b75l -n testapp
..
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 19m (x3 over 19m) default-scheduler 0/5 nodes are available: 5 pod has unbound immediate PersistentVolumeClaims.
Normal Scheduled 18m default-scheduler Successfully assigned testapp/testapp-mongodb-596f595859-6b75l to hk-k8s4-w2
Normal SuccessfulAttachVolume 18m attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-14da216a-d480-4a43-8101-bdd841345a41"
Warning FailedMount 3m23s (x3 over 12m) kubelet Unable to attach or mount volumes: unmounted volumes=[datadir], unattached volumes=[kube-api-access-6kxc6 datadir]: timed out waiting for the condition
Warning FailedMount 2m28s (x16 over 18m) kubelet MountVolume.SetUp failed for volume "pvc-14da216a-d480-4a43-8101-bdd841345a41" : rpc error: code = Internal desc = error mounting NFS volume 10.216.43.186:/pvc-14da216a-d480-4a43-8101-bdd841345a41 on mountpoint /var/lib/kubelet/pods/7f944c15-b8b0-4c52-860a-e79f0380981d/volumes/kubernetes.io~csi/pvc-14da216a-d480-4a43-8101-bdd841345a41/mount: exit status 32
Warning FailedMount 66s (x5 over 16m) kubelet Unable to attach or mount volumes: unmounted volumes=[datadir], unattached volumes=[datadir kube-api-access-6kxc6]: timed out waiting for the condition