Aggregate aggr0 is inconsistent and Root volume: "aggr0" is corrupt
Applies to
- FAS2554
- Data ONTAP 8.2.3P6 7-Mode
- X477_HMKPX04TA07 running NA00 firmware
Issue
- Node PANICs with:
PANIC: Root volume: "aggr0" is corrupt in SK process config_thread on release 8.2.3P6 on Fri Dec 30 08:34:27 GMT 2022
- WAFL inconsistency:
[localhost:wafl.inconsistent.vol:error]: WAFL inconsistent: Aggregate aggr0 is inconsistent. Note: Any new Snapshot copies might contain this inconsistency
- Aggregate status in maintenance mode:
*> aggr status
Aggr State Status Options
aggr0 online raid_dp, aggr root, raidsize=12
degraded
wafl inconsistent
64-bit
*> aggr status -r
Aggregate aggr0 (online, raid_dp, degraded, wafl inconsistent) (block checksums)
Plex /aggr0/plex0 (online, normal, active)
RAID group /aggr0/plex0/rg0 (double degraded, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.1 0a 0 1 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
parity 0b.01.0 0b 1 0 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.3 0a 0 3 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.2 0b 1 2 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data FAILED N/A 3807816/ -
data 0b.01.4 0b 1 4 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data FAILED N/A 3807816/ -
data 0b.01.6 0b 1 6 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.9 0a 0 9 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.8 0b 1 8 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.23 0a 0 23 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.10 0b 1 10 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
RAID group /aggr0/plex0/rg1 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.13 0a 0 13 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
parity 0b.01.12 0b 1 12 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.15 0a 0 15 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.14 0b 1 14 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.17 0a 0 17 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.16 0b 1 16 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.19 0a 0 19 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.18 0b 1 18 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0a.00.21 0a 0 21 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.20 0b 1 20 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0b.01.22 0b 1 22 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
Pool1 spare disks (empty)
Pool0 spare disks (empty)