Skip to main content
NetApp Knowledge Base

After a planned power outage, root.vol.recovery.reqd:EMERGENCY is displayed, and Giveback cannot be performed

  1. Last updated
  2. Save as PDF
Views:
153
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
core
Last Updated:

Applies to

ONTAP 9

Issue

  • After a planned power outage, root.vol.recovery.reqd:EMERGENCY is displayed
  • Giveback cannot be performed.
  • Before shutdown, vldb.log shows the following log:

[kern_vldb:info:6537] A [src/rdb/sql_local_unit.cc 3671 (0x80985e900)]: checkpointHandler: run 560345 took 20 usec and 0 attempts in IDLE mode (status:0). 0 pages checkpointed out of 6291 in WAL file (0.000 pct). Total pages in WAL file now: 6291.
[kern_vldb:info:6537] A [src/rdb/sql_local_unit.cc 3671 (0x80985ee00)]: checkpointHandler: run 560354 took 20 usec and 0 attempts in IDLE mode (status:0). 0 pages checkpointed out of 6318 in WAL file (0.000 pct). Total pages in WAL file now: 6318.
[kern_vldb:info:6537] A [src/rdb/sql_local_unit.cc 3671 (0x80985ee00)]: checkpointHandler: run 560361 took 19 usec and 0 attempts in IDLE mode (status:0). 0 pages checkpointed out of 6339 in WAL file (0.000 pct). Total pages in WAL file now: 6339.
[kern_vldb:info:6537] A [src/rdb/sql_local_unit.cc 3671 (0x80985e900)]: checkpointHandler: run 560368 took 19 usec and 0 attempts in IDLE mode (status:0). 0 pages checkpointed out of 6360 in WAL file (0.000 pct). Total pages in WAL file now: 6360.

  • After power on, vldb.log shows the following error:

[kern_vldb:info:6523] E [src/rdb/sql_local_unit.cc 1234 (0x808809000)]: _createSqlEnvironment: Error opening SQL_DB_ENV handle: err: (56).
[kern_vldb:info:6523] E [src/rdb/sql_local_stmt.cc 455 (0x808809000)]: error: SQL error 56 (unknown error)
[kern_vldb:info:6523] E [src/rdb/sql_local_unit.cc 1393 (0x808809000)]: open: Failed to open SQLite environment: INTERNAL_ERROR.
[kern_vldb:info:6523] A [src/rdb/cluster_events.cc 88 (0x808809000)]: Report: Cluster event: node-event, epoch 0, site 0 [corrupt replica (see EMS)].
[kern_vldb:info:6523] int RDB::SQL_DB_ENV::close(): Closing SQL_DB_ENV, use_count=0
[kern_vldb:info:6523] int RDB::SQL_DB_ENV::close(): Closing SQL_DB_ENV, use_count=0
[kern_vldb:info:6523] E [src/rdb/unit.cc 376 (0x808809000)]: open: Unable to open replicated unit: INTERNAL_ERROR

  • mgwd.log shows the following error:

[kern_mgwd:info:2673] 0x82b727700: 86ffff0000000021: ERR: VOPL::autoSnapshot: JobId[91] sched=snap_day1 prefix=day createScheduledSnapshot:678 get policy=pol1 error=RPC: Program not registered [from mgwd on node "node1" (VSID: -3) to vldb at 127.0.0.1]
[kern_mgwd:info:2673] 0x82b727700: 86ffff0000000021: WARNING: VOPL::autoSnapshot: JobId[91] Couldn't connect to VLDB
[kern_mgwd:info:2673] 0x82b728b00: 86ffff0000000022: ERR: VOPL::autoSnapshot: JobId[92] sched=snap_day2 prefix=day createScheduledSnapshot:678 get policy=pol2 error=RPC: Program not registered [from mgwd on node "node1" (VSID: -3) to vldb at 127.0.0.1]
[kern_mgwd:info:2673] 0x82b728b00: 86ffff0000000022: WARNING: VOPL::autoSnapshot: JobId[92] Couldn't connect to VLDB
[kern_mgwd:info:2673] 0x82b724f00: 86ffff00000000b0: ERR: Volume::populate_uuid_table: src/tables/volume.cc:18402 Failed to get information from volume_uuid table. Reason: RPC: Program not registered [from mgwd on node "node1" (VSID: -3) to vldb at 127.0.0.1]
[kern_mgwd:info:2673] W [src/rdb/ring_attach_registry.cc 473 (0x824465200)]: register_block: Attach client block RPC wait timed out for ring VLDB, block time 318732, current time 323738
[kern_mgwd:info:2673] A [src/rdb/sql_local_unit.cc 816 (0x82b725400)]: sqlite_logger: SQLite Error: (283) recovered 6366 frames from WAL file /mroot/etc/cluster_config/rdb/VLDB/_sql/rdb.db-wal
[kern_mgwd:info:2673] A [src/rdb/sql_local_unit.cc 816 (0x82b725400)]: sqlite_logger: SQLite Error: (283) recovered 6366 frames from WAL file /mroot/etc/cluster_config/rdb/VLDB/_sql/rdb.db-wal
[kern_mgwd:info:2673] A [src/rdb/sql_local_unit.cc 816 (0x82b725400)]: sqlite_logger: SQLite Error: (283) recovered 6366 frames from WAL file /mroot/etc/cluster_config/rdb/VLDB/_sql/rdb.db-wal
[kern_mgwd:info:2673] 0x820c0bd00: 0: ERR: MGWD::aggr_object_store_config_cap_thread: update_cap_configs:src/tables/object_store_config_cap_thread.cc:144 Vldb is not running. Will try again in 15 seconds.

 

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.