E-Series Controller offline unexpectedly with lockdown OE L3
Applies to
NetApp E-Series E2800
Issue
- Controller offline and unable to boot with lockdown code
OE L3 Major-Event Logdisplays the follow messages:A:2/11/23, 7:10:16 AM (07:10:16) 59865 6107 This controller's alternate is non-functional and is being held in reset - Shelf 99, Bay B <--CRITICAL
A:2/11/23, 7:10:16 AM (07:10:16) 59864 2829 Controller redundancy lost - Shelf 99, Bay A <--CRITICAL
A:2/11/23, 7:10:16 AM (07:10:16) 59863 400f Controller reset by its alternate - Shelf 99, Bay B
----> Reboot Reason : CMGR: REBOOTALT_CMGR_SET_ALT_TO_FAILED
A:2/11/23, 7:10:16 AM (07:10:16) 59862 400c Controller placed offline - Shelf 99, Bay B
----> Reboot Reason : CMGR: REBOOTALT_CMGR_SET_ALT_TO_FAILED
[Status changed from Unassigned to Active]
- Connecting serial cable displays repeating error messages as seen below:
00000000000000 RSI: ffffffff820bcc60 RDI: 0000000000000003
[ 2821.457342] RBP: ffffe8ffffd91fa0 R08: 0000000000000004 R09: 0000000000025d80
[ 2821.464436] R10: 0000002c718cd5dc R11: ffff8880777a5628 R12: 0000000000000004
[ 2821.471531] R13: ffffffff820bcdf8 R14: 0000000000000004 R15: 0000000000000000
[ 2821.478628] cpuidle_enter_state+0x6c/0x310
[ 2821.482786] do_idle+0x218/0x250
[ 2821.485994] cpu_startup_entry+0x6f/0x80
[ 2821.489892] start_secondary+0x186/0x1e0
[ 2821.493790] secondary_startup_64+0xa4/0xb0
[ 2821.497948] bad: scheduling from the idle thread!
[ 2821.502624] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D W O 4.19.0-19-clp-eseries-amd64 #1 Debian 4.19.232-1+clp+40+eseries31
[ 2821.514731] Hardware name: Default string Default string/Default string, BIOS 2.04.0 05/04/2018
[ 2821.523379] Call Trace:
[ 2821.525809] dump_stack+0x66/0x81
[ 2821.529103] dequeue_task_idle+0x24/0x30
[ 2821.533002] __schedule+0x2f2/0x7f0
[ 2821.536468] schedule+0x28/0x80
[ 2821.539587] schedule_timeout+0x262/0x3a0
[ 2821.543572] __down_interruptible+0xba/0xf0
[ 2821.547729] ? msg_print_text+0x70/0x100
[ 2821.551626] down_interruptible+0x42/0x50
[ 2821.555610] pstore_dump+0x9e/0x330
[ 2821.559076] ? vprintk_emit+0x209/0x260
[ 2821.562889] ? printk+0x58/0x6f
[ 2821.566011] kmsg_dump+0xb0/0xd0
[ 2821.569218] oops_end+0x64/0xc0
[ 2821.572339] no_context+0x1bc/0x380
[ 2821.575806] __do_page_fault+0xa2/0x4c0
[ 2821.579617] ? wait_for_xmitr+0x3a/0xa0
[ 2821.583428] ? number+0x320/0x360
[ 2821.586723] ? number+0x320/0x360
[ 2821.590017] page_fault+0x1e/0x30
[ 2821.593309] RIP: 0010:compress_block+0x29d/0x450
[ 2821.597898] Code: 44 89 d1 44 29 e1 d3 fb 41 8d 4c 2c f0 66 89 9f 20 17 00 00 41 89 d8 89 8f 24 17 00 00 42 8b 1c 9d 60 46 c7 81 85 db 0f 84 37 <01> 00 00 42 2b 04 9d e0 c6 5b 82 45 89 d3 41 29 db 41 39 cb 0f 8d