[node01: disk_latency_monitor: shm.threshold.ioLatency:debug]: Disk 9a.02.4 has exceeded the expected IO latency in the current window with average latency of 72 msecs and average utilization of 85 pe...[node01: disk_latency_monitor: shm.threshold.ioLatency:debug]: Disk 9a.02.4 has exceeded the expected IO latency in the current window with average latency of 72 msecs and average utilization of 85 percent. [node01: disk_latency_monitor: shm.threshold.ioLatency:debug]: Disk 9a.02.4 has exceeded the expected IO latency in the current window with average latency of 120 msecs and average utilization of 92 percent.
8/11/2022 19:00:02 node-02 ERROR diskown.errorDuringIO: error 3 (disk failed) on disk 0b.26 (S/N disk1) while reading entire disk ownership area 8/11/2022 18:55:13 node-01 ERROR raid.config.filesystem...8/11/2022 19:00:02 node-02 ERROR diskown.errorDuringIO: error 3 (disk failed) on disk 0b.26 (S/N disk1) while reading entire disk ownership area 8/11/2022 18:55:13 node-01 ERROR raid.config.filesystem.disk.failed: File system Disk /aggr1/plex1/rg0/0d.30 S/N [disk1] UID [disk1] failed. Disk 0d.30 S/N [disk1] UID [disk1] was unfailed, and is now being reassimilated
The major event log (MEL) found in Support bundle and AutoSupport reports the following event: Timeout on drive side of controller. A:8/7/22, 6:51:31 AM (06:51:31) 9300 100d Timeout on drive side of c...The major event log (MEL) found in Support bundle and AutoSupport reports the following event: Timeout on drive side of controller. A:8/7/22, 6:51:31 AM (06:51:31) 9300 100d Timeout on drive side of controller - Shelf 99, Bay 2 A:8/7/22, 6:51:27 AM (06:51:27) 9299 100d Timeout on drive side of controller - Shelf 99, Bay 2 A:8/7/22, 6:51:24 AM (06:51:24) 9298 100d Timeout on drive side of controller - Shelf 99, Bay 2
[node_name: config_thread: raid.disk.assign.offline_ref:debug]: aggregate /data_aggregate/plex0/rg0/0a.01.1 assigned as an offline reference storage for /data_aggregate/plex0/rg0/0a.01.5. [node_name: ...[node_name: config_thread: raid.disk.assign.offline_ref:debug]: aggregate /data_aggregate/plex0/rg0/0a.01.1 assigned as an offline reference storage for /data_aggregate/plex0/rg0/0a.01.5. [node_name: config_thread: raid.disk.assign.offline_ref:debug]: aggregate /data_aggregate/plex0/rg0/0a.01.3 assigned as an offline reference storage for /data_aggregate/plex0/rg0/0a.01.5.
Sat Oct 26 18:47:30 +0900 [node2: disk_server_1: shm.threshold.consecutiveTimeouts:error]: shm: Disk 0a.10.1 has exceeded the threshold of 11 consecutive timeouts; the system will fail the disk if pos...Sat Oct 26 18:47:30 +0900 [node2: disk_server_1: shm.threshold.consecutiveTimeouts:error]: shm: Disk 0a.10.1 has exceeded the threshold of 11 consecutive timeouts; the system will fail the disk if possible. Sat Nov 09 19:13:17 +0900 [node2: disk_server_1: shm.threshold.consecutiveTimeouts:error]: shm: Disk 0a.10.9 has exceeded the threshold of 11 consecutive timeouts; the system will fail the disk if possible.
Disk Qualification Package (DQP) Disk failed and replaced. Listed in sysconfig -a output. The replaced disk is listed as spare and not replaced in the RAID group. RAID group /aggr4/plex0/rg0 (normal, ...Disk Qualification Package (DQP) Disk failed and replaced. Listed in sysconfig -a output. The replaced disk is listed as spare and not replaced in the RAID group. RAID group /aggr4/plex0/rg0 (normal, block checksums) RAID group /aggr4/plex0/rg1 (degraded, block checksums) RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks) data FAILED N/A 7486157/ - Disk Qualification Package Details: Package Date: Unable to load any package (Package version not supported)