setup-mnode fails with TokenExpiredError during Deploying MNode Assets phase
Applies to
- Element Management node (mNode) version 12.2
- NetApp storage clusters running Element Software
Issue
When configuring a 12.2 mNode with the setup-mnode script, the initial steps complete, but the Deploying MNode Assets phase fails and rolls back after multiple retries and the following errors:
[2020-12-28T23:06:25.431752Z]:[config_util:122] INFO:Retrying 42/45 time...
[2020-12-28T23:06:25.432365Z]:[config_util:125] INFO:Waiting 10 seconds before next attempt.
[2020-12-28T23:06:42.052092Z]:[config_util:122] INFO:Retrying 43/45 time...
[2020-12-28T23:06:42.052717Z]:[config_util:125] INFO:Waiting 10 seconds before next attempt.
[2020-12-28T23:06:58.571998Z]:[config_util:122] INFO:Retrying 44/45 time...
[2020-12-28T23:06:58.572724Z]:[config_util:125] INFO:Waiting 10 seconds before next attempt.
[2020-12-28T23:07:15.101743Z]:[config_util:122] INFO:Retrying 45/45 time...
[2020-12-28T23:07:15.102404Z]:[config_util:125] INFO:Waiting 10 seconds before next attempt.
[2020-12-28T23:07:25.162756Z]:[config_util:119] ERROR:Maximum Retry Attempts (45) Reached. Raising Error.
Traceback (most recent call last):
File "setup_scripts/config_util.py", line 106, in retry_operation
File "setup_scripts/mnode_api_client.py", line 34, in get_root_assets
File "setup_scripts/mnode_api_client.py", line 373, in retry_on_401
File "requests/sessions.py", line 521, in get
File "requests_oauthlib/oauth2_session.py", line 395, in request
File "oauthlib/oauth2/rfc6749/clients/base.py", line 198, in add_token
oauthlib.oauth2.rfc6749.errors.TokenExpiredError: (token_expired)
[2020-12-28T23:07:25.164008Z]:[mnodecfg:68] ERROR:(token_expired)
Traceback (most recent call last):
File "setup_scripts/mnodecfg.py", line 66, in config_pre_networked_mnode
File "setup_scripts/mnodecfg.py", line 173, in _config_mnode
File "setup_scripts/config_util.py", line 573, in launch_mnode_assets
File "setup_scripts/config_util.py", line 640, in _ensure_root_asset
File "setup_scripts/config_util.py", line 120, in retry_operation
File "setup_scripts/config_util.py", line 106, in retry_operation
File "setup_scripts/mnode_api_client.py", line 34, in get_root_assets
File "setup_scripts/mnode_api_client.py", line 373, in retry_on_401
File "requests/sessions.py", line 521, in get
File "requests_oauthlib/oauth2_session.py", line 395, in request
File "oauthlib/oauth2/rfc6749/clients/base.py", line 198, in add_token
oauthlib.oauth2.rfc6749.errors.TokenExpiredError: (token_expired)
[2020-12-28T23:07:25.164833Z]:[mnodecfg:73] ERROR:mNode configuration has failed in a unrecoverable state. Attempting to cleanup docker environment.