Volume creation fails with error "checking for existing volume"

Applies to

Astra Trident

Issue

Volume creation failis with following error message.

level=error msg="GRPC error: rpc error: code = Unknown desc = encountered error(s) in creating the volume: [Failed to create volume <PV-Name> on storage pool <Aggr_Name> from backend <backend_Name>: error checking for existing volume: API status: , Reason: , Code: ]; [Failed to create volume <PV-Name> on storage pool <Aggr_Name> from backend <backend_Name>: error checking for existing volume: API status: , Reason: , Code: ]" logLayer=csi_frontend requestID=2ff674cb-2d18-4084-acbf-1c4758c6a4ea requestSource=CSI

Backend is on failed state.

[root@rhel1 ~]# ./tridentctl get backend
+--------------------------------------------------------+----------------+--------------------------------------+--------+------------+---------+
|                          NAME                          | STORAGE DRIVER |                 UUID                 | STATE  | USER-STATE | VOLUMES |
+--------------------------------------------------------+----------------+--------------------------------------+--------+------------+---------+
| <backend_name> | ontap-nas      | 5beb64ba-29ba-4f84-aec3-13031b072797 | failed | normal     |       8 |
+--------------------------------------------------------+----------------+--------------------------------------+--------+------------+---------+ 

Updating the backend fails with the following error.

[root@rhel1 ~]# ./tridentctl  update backend <backend_name> -f new-backend.yaml -n trident
Error: could not update backend <backend_name>: problem initializing storage driver 'ontap-nas': error initializing ontap-nas driver; could not create Data ONTAP API client: error creating ONTAP API client: error reading SVM details: API status: , Reason: , Code:  (400 Bad Request)
command terminated with exit code 1
Error: exit status 1

Trident log:

level=debug msg="Attempting volume create." backend=<backend_name> backendUUID=5beb64ba-29ba-4f84-aec3-13031b072797 logLayer=core requestID=bdfaca65-72e3-4182-a3ac-99857547e875 requestSource=CSI size=1073741824 storage_class=trident-csi-delete storage_pool=<Aggr_Name> volume=<PV-Name> volumeInternal=<volume_name> workflow="volume=create"

level=warning msg="Error unmarshaling response body. EOF" body= ​

​