IO Error reported on host end due to thin lun going out of space

Applies to

• Ontap 9
• Linux Host
• RHEL

Issue

• I/O Error logged on Linux host:

May 21 17:35:31 xxxxxx Kernel: blk_update_request: I/O error, dev dm-117, sector 128
May 21 17:35:31 xxxxxx Kernel: blk_update_request: I/O error, dev dm-117, sector 0

 

•  On the storage Ems logs, lun out of space error logged and then it was taken offline.

<LR d="21May2023 08:31:10" n="Cluster2-02" t="1684638070" id="1684482535/50317" p="0" s="Ok" o="VdomFSMThr_19" vf="" type="0" seq="8804922" >
<LUN_out_of_space_1
        lun_path="/vol/vol1/lun"
        volume_name="vol1"
        volume_dsid="12xx"
        object_uuid="9aa04a39-bdda-4ffc-a092-213b23dxxxyyy"
        object_type="LUN"/>

<LR d="21May2023 08:31:10" n="Cluster2-02" t="1684638070" id="1684482535/50316" p="3" s="Ok" o="scsit_lu_0" vf="" type="0" seq="8804921" >
<scsiblade_lun_offline_system_1
        lunSerial="80BVxxKxyxyx"
        volumeMSID="21597xxxyy"
        vserver="SVM1"/>
 

• The lun and its underlying volume both are thin.

Volume Parameters as per Vol-Status-v in ASUP :
guarantee=none   
fractional_reserve=0,
try_first=volume_grow
Volume autosize settings: mode=grow_shrink
maximum-size=100 TB, minimum-size=10 TB
grow-threshold-percent=98%, shrink-threshold-percent=50%

Lun Parameters as per Lun.Xml in ASUP:

Space reservatiion Disabled

Space alloctaion is disabled

 

• The underlying aggregate  hosting the affected volume is also full and reached 100% as per DF -A log in ASUP:

DF -A
Aggr          102645668760 102411565948  234102812     100%