Site power issues leads to multiple failed disks on DS4246
Applies to
- FAS/AFF systems
- DS4246 with 2 of 4 PSUs installed
Issue
- There are 2 of 4 PSUs installed on the DS4246 shelf
- There is power maintenance leading to fluctuation and instability on one or both of the PSUs
- Disks on the affected shelf fail for being unresponsive and errors about disk spinning up can be seen
Wed Apr 27 06:44:25 EDT [node01: label_thread: raid.label.io.writeError:notice]: Label write on Disk /aggr1/plex0/rg0/0a.03.10 Shelf 3 Bay 10 [NETAPP X306_HMARK02TSSM NA04] S/N [YFHRLMNA] UID [500605BA:008FD048:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] failed with storage error no valid path to disk. The system will stop using the disk for I/O operations.
Wed Apr 27 06:45:02 EDT [node01: config_thread: raid.config.filesystem.disk.missing:info]: File system Disk /aggr1/plex0/rg0/0a.03.10 Shelf 3 Bay 10 [NETAPP X306_HMARK02TSSM NA04] S/N [ABCDEFGH] UID [12345AAA:000BB000:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] is missing.
Wed Apr 27 08:47:36 EDT [node01: scsi_cmdblk_strthr_admin: scsi.cmd.notReadyCondition:notice]: Disk device 0a.03.10: Device returns not yet ready: CDB 0x28:703c78f8:0009: Sense Data SCSI:not ready - Drive spinning up (0x2 - 0x4 0x1 0x28)(60869).
Wed Apr 27 08:47:36 EDT [node01: scsi_cmdblk_strthr_admin: disk.timeout.flush.start:debug]: Aggressive timeout flush started on disk 0a.03.10.
Wed Apr 27 08:47:36 EDT [node01: scsi_cmdblk_strthr_admin: scsi.cmd.notReadyCondition:notice]: Disk device 0a.03.10: Device returns not yet ready: CDB 0x28:52e2ccd3:0009: Sense Data SCSI:not ready - Drive spinning up (0x2 - 0x4 0x1 0x28)(60870).
Wed Apr 27 08:47:36 EDT [node01: scsi_cmdblk_strthr_admin: scsi.cmd.notReadyCondition:notice]: Disk device 0a.03.10: Device returns not yet ready: CDB 0x28:52e2c997:0009: Sense Data SCSI:not ready - Drive spinning up (0x2 - 0x4 0x1 0x28)(60871).
Wed Apr 27 08:47:36 EDT [node01: scsi_cmdblk_strthr_admin: scsi.cmd.notReadyCondition:notice]: Disk device 0a.03.10: Device returns not yet ready: CDB 0x28:9a02d9e9:0009: Sense Data SCSI:not ready - Drive spinning up (0x2 - 0x4 0x1 0x28)(60871).