Skip to main content

NetApp_Insight_2020.png 

NetApp Knowledgebase

How to provide a read performance workaround for StorageGRID Webscale integration with AltaVault

Views:
65
Visibility:
Public
Votes:
0
Category:
storagegrid-webscale
Specialty:
sgrid
Last Updated:

Applies to

  • StorageGRID Webscale
  • NetApp Cloud Backup (AltaVault)

Description

INTRODUCTION:
The purpose of this document is to provide a workaround to address the performance issue when integrating a StorageGRID Webscale (SGWS) system with an AltaVault system. Refer to the Issue section for more details.
 
The audience of this document is expected to have sufficient knowledge on how to configure a SGWS grid using the Network Management System (NMS) Web application. In addition, the audience should have a basic understanding on how the Information Lifecycle Management (ILM) works in a SGWS system. For more information on ILM, see Information lifecycle management
 
Notes:

  • This workaround only applies to SGWS 10.1.x and 10.2.x. This workaround is not required once the SGWS system is upgraded to version 10.3.0 or later.
  • This workaround is not required for SGWS system that starts with version 10.3.0 or later.
  • This workaround will not impact ongoing grid operations. Maintenance downtime is optional.
 
THE ISSUE
 
As part of the AltaVault backup workflow, the stats.dat and rbt_oids.dat are being overwritten multiple times a day to the cloud storage (SGWS). The number of overwrite could range from a few hundred to tens of thousand times per day depending on the data replication rate from AltaVault to SGWS. This increases the read latency for these files.
 
For more information, see the StorageGRID Webscale issue 25130.

THE WORKAROUND EXPLAINED
 

The workaround involves adding an ILM rule to avoid deleting the stats.dat and rbt_oids.dat files when the files are overwritten. Consequently, all old copies of the files will be stored in the grid until the grid is upgraded to version 10.3.0. or later. The consumed storage will be automatically reclaimed over time when the system is upgraded to version 10.4


The typical size of a:
  • stats.dat file is 1032 bytes
  • rbt_oids.dat file is 64 bytes  

Since each file size is less than the block size of 4096 bytes, the minimum space consumed per file is 4096 bytes.
 
Estimate the storage space consumed per month for both the files by using the following formula:
Monthly storage space consumed =
2 objects x 4096 bytes/object
x (number of ILM copy per objects) x (number of overwrite per day)
x 30 days

 

CUSTOMER EXCLUSIVE CONTENT

Registered NetApp customers get unlimited access to our dynamic Knowledge Base.

New authoritative content is published and updated each day by our team of experts.

Current Customer or Partner?

Sign In for unlimited access

New to NetApp?

Learn more about our award-winning Support