Skip to main content
NetApp Knowledge Base

ESXi host failure results in ONTAP Tools rook-ceph pod corruption

  1. Last updated
  2. Save as PDF
Views:
17
Visibility:
Public
Votes:
0
Category:
virtual-storage-console-for-vmware-vsphere
Specialty:
virt
Last Updated:

Applies to

  • NetApp ONTAP Tools for VMware vSphere (OTV) 10.x
  • VMware vSphere

Issue

  • After an unplanned ESXi host shutdown or crash, the OTV plugin fails to connect to the NetApp storage system. 
  • The vCenter plugin displays a no healthy upstream error, and both the OTV plugin UI and Swagger interface are inaccessible. 
  • Multiple OTV-related pods, including rook-ceph components (mgr, mon, osd), are observed in CrashLoopBackOff or error states.
    • From OTV diag shell running kr get pod command: 

root@otv1:/home/diag# kr get pods
NAME                                                       READY   STATUS             RESTARTS          AGE
csi-rbdplugin-provisioner-57fb48c589-k76f8                 5/5     Running            30 (133m ago)     103d
csi-rbdplugin-rgngl                                        3/3     Running            18 (133m ago)     103d
rook-ceph-crashcollector-atlmavotvnode1-7865857b4f-b4c92   1/1     Running            6 (133m ago)      103d
rook-ceph-mgr-a-779c5fbcc-rxkfk                            1/2     CrashLoopBackOff   432 (114s ago)    103d
rook-ceph-mon-a-665989c77b-qfshh                           1/2     CrashLoopBackOff   314 (4m7s ago)    103d
rook-ceph-operator-79cc9bfb75-wsq2w                        1/1     Running            8 (133m ago)      103d
rook-ceph-osd-0-7766d89c6f-h6nx9                           0/2     Init:0/3           153 (2m10s ago)   57d
rook-ceph-osd-prepare-atlmavotvnode1-l5tls                 0/1     Completed          0                 57d
rook-ceph-tools-699f655bb7-tjnbd                           1/1     Running            5 (133m ago)      103d

  • Example log output from rook-ceph-mon pod:

2026-06-09T16:33:15.428641389Z stderrF [db/db_impl/db_impl_compaction_flush.cc:3496] Compaction error: Corruption: block checksum mismatch: stored=3922177252, computed=190925503, type=4 in /var/lib/ceph/mon/ceph-a/store.db/225181.sst offset 216990 size 6082
2026-06-09T16:33:15.423996324Z stderrF MonitorDBStore.h:355: ceph_abort_msg("failed to write to db")
2026-06-09T16:33:15.424069239Z stderrF *** Caught signal (Aborted) ***

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.