Skip to main content
NetApp Knowledge Base

What contributes to the duration of NetApp XCP File Scanning?

Views:
98
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
nas
Last Updated:

Applies to

  • NetApp XCP
  • CIFS/SMB

Answer

  • File Scanning duration is mainly affected by the number of directories and files
  • This can be improved:
  • Parallelization:
    • parallel <N>: This option allows you to specify the number of parallel threads to use for data transfer.
      • Increasing the value of <N> can improve performance by enabling multiple concurrent transfers.
    • tparallel <N>: This option controls the number of parallel threads for transferring files within a directory.
      • Adjusting this value can optimize the transfer of files within a directory structure.
  • Optimization:
-cutover <N>: This option sets the number of files to be transferred before performing a cutover. A cutover involves committing the transferred files to the destination storage system. Specifying an appropriate value for <N> can optimize the balance between transfer speed and cutover frequency.
 
-snapdiff: This option enables the use of Netapp Snapshot Differential technology to optimize the transfer process. It allows XCP to determine and transfer only the changed or modified files since the last snapshot, reducing the amount of data transferred.
 
-resume: This option enables resumable transfers, allowing XCP to resume from where it left off in case of interruptions or failures. It helps optimize the migration process by avoiding retransferring already copied data.
 
-md5: By default, XCP calculates MD5 checksums for each file during the transfer. Disabling this option with -nomd5 can improve performance, but it eliminates the ability to verify file integrity during the transfer.
 

Note: These options can be combined and adjusted based on the specific requirements and environment to achieve optimal performance during the migration process. 

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.