Unable to cleanup object store for Cloud Backup

Applies to

• ONTAP 9
• Cloud Backup
• Cloud Manager    

Issue

• When trying to remove the object store associated with the Cloud Backup, you receive one of the following below errors. 

Failed to unregister working environment. Failed to remove object store configuration during config delete for

Vserver , object store. (Cannot delete object store configuration as there are objects in the store.),Please try again after some time.

Error: command failed: Failed to remove object store configuration during config delete for Vserver, object store . (Cannot delete object store configuration as there are objects in the store.)

• Delete snapshots job fails:

Error:Failed to delete some of the volumes snapshots. Deleting snapshots failed for Volume with id <UUID>, Cluster Job Status failed. Timed out while waiting for Cluster Job status

• The SnapMirror object-store configuration was deleted but the storage account entry is still referenced on the dblade of one node:

cluster1::*> storage aggregate object-store dblade show -node cluster1-02 -bin-uuid 1234567-1234-1234-1234-002233445566 -config-id 2 -instance

                                                       Node: cluster1-02
                                      Uuid of the Aggregate: 1234567-1234-1234-1234-002233445566
                                                   Bin UUID: 1234567-1234-1234-1234-002233445566
                           Object Store Config Id in Dblade: 2
                                   Object Store Mirror Type: primary
                                                 Bin Number: -
                 Amount of Bin Space the Aggregate Can Take: -
      Aggregate Nearly Full Threshold for this Object Store: -
             Aggregate Full Threshold for this Object Store: -
                                   S3 Client Handle in Cbin: -
                           Availability of the Object Store: unavailable

• EMS log shows events:

Time                Node             Severity      Event
------------------- ---------------- ------------- ---------------------------
3/14/2023 11:25:15  cluster1-02   EMERGENCY object.store.unavailable: Unable to connect to the object store "netappbackup" from node 1234567-1234-1234-1234-002233445566. Reason: Not found.
3/14/2023 11:24:06  cluster1-02   ERROR objstore.host.unresolvable: Object-store server host name "netappbackup.blob.core.windows.net" cannot be resolved to an IP address on node 1234567-1234-1234-1234-002233445566