Skip to main content
NetApp Knowledge Base

What are the performance considerations of deduplication in ONTAP systems?

Views:
332
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
perf
Last Updated:

Applies to

  • ONTAP 9
  • FAS
  • AFF
  • Cloud Volumes ONTAP

Answer

  • Avoid deduplication of datasets with a high rate of change. I.e data that is overwritten every few days
  • Avoid running deduplication operations on vols where efficiency gains are less than ~10%.

Example: The datastore volume has an efficiency gain well above 10%, in this case 55% using the df -s command

::> df -s datastor​e​​​​
Filesystem                used      saved       %saved  Vserver
/vol/datastore/      289150724  356485168          55%  svmtest​​​
  • Inline efficiencies also have a latency penalty for each read or write to hard drive systems (FAS)
    • FAS systems are designed for inline efficiencies to be off by default due to a severe cost of latency from disk.
    • AFF or Capacity Flash are built around this as required
  • Ensure monitoring of performance is enabled so performance when deduplication runs can be monitored on CPU/disk latencies compared to when it is idle.
    1. ActiveIQ Unified Manager is a free product and can be deployed in the same network as your storage.
    2. The ActiveIQ portal does have performance graphs, but are very high level.

Additional Information

TR-3966 has more information about deduplication in FAS and AFF systems

 

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.