Aggregate alternating between normal and degraded status during background disk firmware update

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 577

Visibility:: Public

Votes:: 0

Category:: disk-drives

Specialty:: hw

Last Updated:

Applies to

ONTAP 9

Issue

Aggregates on the system intermittently report a degraded status and then return to normal a short time later
The messages can be observed on the CLI

Cluster::> event log show -event raid.rg.degraded -severity notice

Time Node Severity Event

------------------- ---------------- ------------- ---------------------------

10/13/2021 16:56:32 node-01          NOTICE        raid.rg.degraded: : Raid group /aggr_01/plex0/rg* is degraded

10/13/2021 16:56:32 node-02          NOTICE        raid.rg.degraded: : Raid group /aggr_02_ROOT/plex0/rg* is degraded

10/13/2021 16:56:32 node-02          NOTICE        raid.rg.degraded: : Raid group /aggr_02/plex0/rg* is degraded

10/13/2021 16:53:58 node-01          NOTICE        raid.rg.degraded: : Raid group /aggr_01/plex0/rg* is degraded

10/13/2021 16:53:58 node-02          NOTICE        raid.rg.degraded: : Raid group /aggr_02_ROOT/plex0/rg* is degraded

10/13/2021 16:53:58 node-02          NOTICE        raid.rg.degraded: : Raid group /aggr_02/plex0/rg* is degraded

10/13/2021 16:51:29 node-01          NOTICE        raid.rg.degraded: : Raid group /aggr_01/plex0/rg* is degraded

The EMS log shows the following information.

[config_thread: raid.disk.offline:notice]: Marking Disk e0c.00.0.11 Shelf 0 Bay 11 [NETAPP X4014S173315TNTE NA51] S/N [XXXXXXXXXXXXXX] UID offline. [bg_disk_fw_update_admin: bdfu.selected:info]: Disk e5b.00.3.11 [NETAPP X4014S173315TNTE NA51] S/N [XXXXXXXXXXXXXX] selected for background disk firmware update. [dynamic_dev_qual_admin: dfu.fwDownloaded:debug]: Firmware downloaded to disk e0c.00.0.11 [NETAPP X4014S173315TNTE NA53] S/N [XXXXXXXXXXXXXX] successfully. [config_thread: raid.disk.online:notice]: Onlining Disk /aggr_01/plex0/rg0/e0c.00.0.11P1 Shelf 0 Bay 11 [NETAPP X4014S173315TNTE NA51] S/N [XXXXXXXXXXXXXX] UID [XXXXXXXX:XXXXXXXX:XXXXXXXXX:XXXXXXXX:XXXXXXXX:XXXXXXXX:00000000:00000000:00000000:00000000]. [config_thread: raid.disk.online:notice]: Onlining Disk /aggr_01_ROOT/plex0/rg0/e0c.00.0.11P3 Shelf 0 Bay 11 [NETAPP X4014S173315TNTE NA51] S/N [XXXXXXXXXXXXXX] UID [XXXXXXXX:XXXXXXXX:XXXXXXXXX:XXXXXXXX:XXXXXXXX:XXXXXXXX:00000000:00000000:00000000:00000000]. [config_thread: raid.rg.optrecons.start:debug]: /aggr_01/plex0/rg0: starting optimized reconstruction, using disk e0c.00.0.11P1, disk block 5248 [config_thread: raid.rg.normal:notice]: : raid group /aggr_01/plex0/rg0 is in normal state.

"Aggregate Degraded" alert was raised in Unified Manager

Alert from Active IQ Unified Manager: Aggregate Degraded (State: New) A risk was generated by ****.jp.kworld.kpmg.com that requires your attention. Risk - Aggregate Degraded Impact Area - Availability Severity - Warning State - New Source - Node_name:aggr_name Cluster Name - Node_name Cluster FQDN - Node_name.jp.kworld.kpmg.com Trigger Condition - Aggregate aggr_name's RAID status is degraded because of broken disks - . (Only performance tier is affected.)