Skip to main content
NetApp Knowledge Base

Unable to access StorageGRID through the S3 API due to RSM is down

Views:
157
Visibility:
Public
Votes:
0
Category:
storagegrid
Specialty:
sgrid
Last Updated:

Applies to

StorageGRID 11.2.0.5 and earlier

Issue

  • Unable to access StorageGRID through the S3 API.
  • SVST(Status - Replicated State Machine Service (RSM)) alarm is detected due to Not Running.

Example:

91d79ed3-6b1c-4120-ac58-907da8aece8e.png

  • bycast-err.log on the ADC node shows "rsm: rsm panic" repeatedly.

Example:

<HOST> rsm: rsm panic

  • servermanager.log shows that Replicated State Machine (RSM) service run into error state as the result of repeated failures for trying to start.

Example:

rsm                       | start initiated
rsm                       | rsm starting
rsm                       | rsm ended
rsm                       | rsm starting
rsm                       | rsm ended
rsm                       | rsm starting
rsm                       | rsm ended
..
rsm                       | rsm starting
rsm                       | rsm ended
rsm                       | Too many failed attempts, entering error state
rsm                       | rsm ended

 

  • rsm.errlog shows RSM gets PANIC with SIGSEGV.

Example:

panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x10 pc=0xa4cf23]

goroutine 150 [running]:
storagegrid/rsm/client.(*ESClient).Execute(0xc42038a6a0, 0xd21d40, 0xc420c2c1e0, 0x0)
    /build/go/src/storagegrid/rsm/client/search.go:198 +0x603
main.requestExecutor(0xc420520360, 0xc420512000, 0xc420514200, 0xc420d43f98, 0xc420514300)
    /build/go/src/storagegrid/rsm/request_runner.go:159 +0x6e8
main.run.func5(0xc4203ba3f0, 0xc420514200, 0xc420512000, 0xc42021c000, 0xc420514300)
    /build/go/src/storagegrid/rsm/run.go:162 +0x92
created by main.run
    /build/go/src/storagegrid/rsm/run.go:160 +0x899

 

 

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.