Skip to main content
NetApp Knowledge Base

CONTAP-777838: ONTAP node disruption after BSD wired memory grows with fix for CONTAP-520139

Views:
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
hw
Last Updated:

Issue

An ONTAP node may experience a disruption after a userspace process such as mgwd, secd, or bcomd remains unresponsive and cannot recover:
PANIC: Process <process_name> unresponsive for <seconds> seconds ... in process nodewatchdog

A generic node watchdog signature is not sufficient to match this issue. The disruption event must also have the FreeBSD memory-exhaustion signature:

  • FreeBSD wired memory consumes nearly all of the BSD memory partition.
    All known field hits show approximately 94% or more wired memory.
  • Available BSD memory is reduced to a few hundred MB or less.
  • Systemshell top -bS output shows high Wired and little free memory usage.

Systemshell access requires diagnostic privilege. Use systemshell commnd only with NetApp Support guidance to determine current MHOST memory usage using the top command, example:
cluster::> set -privilege diagnostic
cluster::*> systemshell -node <node_name> -command "top -bS | head -n 5"
last pid: 78952; load averages: 29.70, 28.44, 26.02 up 138+18:44:26
3339 processes:72 running, 282 sleeping, 2 zombie, 2983 waiting
CPU: 2.3% user, 0.0% nice, 36.9% system, 0.1% interrupt, 60.7% idle
Mem: 62M Active, 1132K Inact, 3532K Laundry, 15G Wired, 905M Buf, 253M Free
Swap: 8192M Total, 1400M Used, 6792M Free, 17% Inuse

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.