Oracle backups with replication are failing after SC 5.0 to 6.0 upgrade

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 225

Visibility:: Public

Votes:: 0

Category:: snapcenter

Specialty:: snapx

Last Updated:

Applies to

SnapCenter Server (SC) 6.0
SnapCenter Plug-in for Oracle databases (SCO) 6.0

Issue

After upgrading SC and SCO from 5.0 to 6.0, all Oracle backup jobs with Snapmirror / Snapvault replication enabled are failing with the following errors:

SnapCenter UI:

Activity 'Cloning Resources' failed with error: Failed to clone resources, error isMount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone.

Object reference not set to an instance of an object.

Activity 'Cleanup Post Cataloging' failed with error: Exception of type 'System.Exception' was thrown.

Activity 'Post Cataloging' failed with error: Exception of type 'System.Exception' was thrown.

Activity 'Preparing for Cataloging' failed with error: Failed to clone resources, error isMount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone.

Object reference not set to an instance of an object.

SMCore_<JobID>_<Date_Time>.log:

DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] Command: Invoke-NcCli. Storage System: <Storage_Name_IP>. Version: NetApp Release 9.13.1P6: Tue Dec 05 16:06:25 UTC 2023. Connection Mode: ZAPI. Username: vsadmin. Storage added as <VServer_Name>. DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] ex.Message : The running command stopped because the preference variable "ErrorActionPreference" or common parameter is set to Stop: [400]: Specified Vserver not found

DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] Invoking Invoke-NcCli command-done ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] Volume clone create Failed, Exception: Failed to create the volume clone. Object reference not set to an instance of an object. ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] Volume clone create Failed, Inner Exception: DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] --VolumeManagementServiceProvider::CreateVolumeClone ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] Failed to create the volume clone. Object reference not set to an instance of an object. DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] --NFSMountStrategy::CloneResources ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] Failed to create the volume clone. Object reference not set to an instance of an object.

ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] mount snapshot failed Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] Exception in clone storage Mount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] ErrorCode (-1), ErrorMessage (Mount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] Activity name: Cloning snapshot <Snapshot_Name>: -1 - Mount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] Storage cloning failed ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] Exception in PerformClone Mount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] STACKTRACE at SnapMgrCoreService.Workflows.Activities.CloneStorageAndVirtualResource.performClone(Dictionary`2 backupMap, Dictionary`2 storageFootPrintMap, SmWorkflowContext workflowContext, SmRequest request, Dictionary`2 backupToSnapshotMap) inner exception DEBUG SMCore_<JobID> PID=[xxxx] TID=[xxxx] PerformClone exit ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] Exception in CloneVirtualandStorageResource Failed to clone resources, error isMount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] STACKTRACE at SnapMgrCoreService.Workflows.Activities.CloneStorageAndVirtualResource.performClone(Dictionary`2 backupMap, Dictionary`2 storageFootPrintMap, SmWorkflowContext workflowContext, SmRequest request, Dictionary`2 backupToSnapshotMap) at SnapMgrCoreService.Workflows.Activities.CloneStorageAndVirtualResource.Execute(SmWorkflowContext workflowContext, SmRequest request) Inner exception ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] ErrorCode (-1), ErrorMessage (Failed to clone resources, error isMount operation failed with error Failed to mount storage resource, error is Failed to create the volume clone. Object reference not set to an instance of an object.

spl_<JobID>_<Date_Time>.log:

DEBUG: SCUPlugin: SCU::HostStorage::Device::Linux::SCSIDevice::_get_iscsi_initiators(): Retrieving iSCSI initiators of this host ERROR: SCUPlugin: 87: SCU::Utils::Logger::set_and_log_error(): Failed to open the file '/etc/iscsi/initiatorname.iscsi': No such file or directory. DEBUG: SCUPlugin: 87: SCU::Utils::GenericUtil::log_and_throw_with_log_level(): Failed to open the file '/etc/iscsi/initiatorname.iscsi': No such file or directory. DEBUG: SCUPlugin: SCU::HostStorage::Device::Linux::SCSIDevice::_get_fc_initiators(): Retrieving FC Initiators of this host DEBUG: SCUPlugin: 129: SCU::Utils::GenericUtil::log_and_throw_with_log_level(): Failed to open the directory '/sys/class/fc_host': No such file or directory.