SCO backups failing after upgrade to 4.8
Applies to
- SnapCenter Plug-in for Oracle (SCO) 4.8
- Post-upgrade
Issue
After upgrading SCO to 4.8, backups are failing with one of the following two error messages:
Error seen for job in SC UI:
"Activity 'Discovering Oracle Database Files' failed with error: Discovery failed for object <SID> with error PL-SCO-20006: Discovery of database files failed for database <SID> on host <HOSTNAME> with error Operation Exception occured during oracle databaseconnection, reason: Unexpected Operation occured."
Error seen in spl_<JOBID>.log:
DEBUG DisRes-MAE c.n.c.e.AbstractShellExecutor - EXE-00000: Executing shell command:
0:sudo /opt/NetApp/snapcenter/spl/bin/sc_command_executor oracle export SC_PWD=/opt/NetApp/snapcenter/spl/lib PATH=/oracle/<SID>/19/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ORACLE_SID=<SID> ORACLE_HOME=/oracle/<SID>/19 TNS_ADMIN=/.../profile/oracle LD_LIBRARY_PATH=/oracle/MAE/19/lib:/oracle/<SID>/19/lib32:/oracle/<SID>/19/bin:/oracle/<SID>/19/rdbms/lib;"/opt/NetApp/snapcenter/spl/plugins/sco/.././../plugins/sco/bin/launch-java" "com.netapp.common.remote.RemoteObjectFactoryImpl" "127.0.0.1" "27216" "c1a6b8a039c649dc7fe5f9366390dc88"
1:export SC_PWD=/opt/NetApp/snapcenter/spl/lib PATH=/oracle/MAE/19/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ORACLE_SID=MAE ORACLE_HOME=/oracle/MAE/19 TNS_ADMIN=/usr/sap/MAE/SYS/profile/oracle LD_LIBRARY_PATH=/oracle/MAE/19/lib:/oracle/MAE/19/lib32:/oracle/MAE/19/bin:/oracle/MAE/19/rdbms/lib; /opt/NetApp/snapcenter/spl/plugins/sco/.././../plugins/sco/bin/launch-java com.netapp.common.remote.RemoteObjectFactoryImpl 127.0.0.1 27216 c1a6b8a039c649dc7fe5f9366390dc88
Followed by the actual error - for the launch-java:
DEBUG DisRes-MAE c.n.c.r.RemoteObjectFactoryFactory - Waiting for RemoteObjectFactory to be registered with GUID <UID> ...
DEBUG Execution Monitor Thread [export SC_PWD=/opt/NetApp/snapcenter/spl/lib PATH=/oracle/MAE/19/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ORACLE_SID=<ORA_SID> ORACLE_HOME=/oracle/<ORA_SID>/19 TNS_ADMIN=/.../SYS/profile/oracle LD_LIBRARY_PATH=/oracle/MAE/19/lib:/oracle/MAE/19/lib32:/oracle/MAE/19/bin:/oracle/MAE/19/rdbms/lib;
/opt/NetApp/snapcenter/spl/plugins/sco/.././../plugins/sco/bin/launch-java com.netapp.common.remote.RemoteObjectFactoryImpl 127.0.0.1 27216 <UID>]
c.n.c.e.ShellResult - EXE-00001: Shell result [0:00:00.458] (Exit Value: 1):
export: Command not found.
Error: Could not find or load main class com.netapp.common.remote.RemoteObjectFactoryImpl
ERROR DisRes-MAE c.n.c.r.RemoteObjectFactoryFactory - REMOTE-00001: Unable to connect to spawned helper process. Error: export: Command not found
Error when running srvctl:
ERROR SMCore_15094PID=[3828] TID=[139] ErrorCode (10001), ErrorMessage ( Discovery failed for object
<ORA_SID> with error PL-SCO-20006: Discovery of databasefiles failed for database <ORA_SID> on host <host_name> with error
ORACLE-00300: Error executing srvctl command export LC_ALL=C;srvctl config database -d <ORA_SID>. The command returned: [-bash: srvctl:command not found].)