After upgrading to SCV 5.0P3 from 4.X, SCV backup fails

Applies to

• SnapCenter Plug-in for VMware vSphere (SCV) 5.0 or later
• ONTAP 9.10.1 
• Customer user with custom role is used for SCV and storage communication
• The custom role does not have rest-role and is not included in vserver service web access -name rest
• ONTAP uses different LIFs for NFS and SVM management

Issue

• SCV backup fails after upgrade to SCV 5.0 family.

• Backup fails with the following error:

/netapp/protectionservices/Job-<jobid>.log:

Failed to resolve xxx.xxx.xxx.xxx, Exception:System.Net.Internals.SocketExceptionFactory+ExtendedSocketException (00000005, 0xFFFDFFFF): Name or service not known
   at System.Net.Dns.GetHostEntryOrAddressesCore(IPAddress address, Boolean justAddresses, AddressFamily addressFamily, ValueStopwatch stopwatch)
   at System.Net.Dns.GetHostEntry(String hostNameOrAddress, AddressFamily family)
   at SnapDrive.Nsf.Common.Infrastructure.Storage.NetworkResourceIdCache.ResolveWithDns(String hostName)

Note: The address SCV tried to resolve is NFS data lif, not SVM managemet LIF. 

• protectionservice-<date>.log shows communication errors between ONTAP and SCV.
  • InitializeONTAP() throw exception: Failed to connect to storage system. Please check the connectivity between host and storage system.
Begin GetRESTClientTimeout
InitializeONTAP() ex.InnerException: Invalid credentials. Please check the username or password
  • Failed to connect to storage system xxx.xxx.xxx.xxx. for SDSetStorageConnection for SVM management LIF.
• After SCV upgrade, ONTAP reports http 401 error for requests from SCV 

Apache_access.log :

"GET /api/private/cli/system/node/virtual-machine/instance/show-settings?fields=consumer HTTP/1.1" 401 65 40942 - 0 + - - 
"GET /api/cluster?fields=version HTTP/1.1" 401 65 9007 - 1 + - -