XCP final sync task hang with Directory mod time changed reading anyway
Applies to
XCP NFS 1.9.4P1
Issue
XCP final sync does not make progress with directory mod time changed; reading anyway
Example:
2025-11-17 15:19:00,346 - INFO - 403303 xcp xcp Command: sync {-id: 'SYNC_Final'}2025-11-17 15:19:00,408 - INFO - 403303 xcp xcp Job ID: Job_SYNC_Final_2025-11-17_15.19.00.279305_sync2025-11-17 15:19:00,421 - INFO - 403303 xcp xcp Index: SYNC_Final {source: source_IP:/source_vol, target: target_IP:/target_vol}2025-11-17 15:19:00,582 - WARNING - 403303 xcp read trailer index target_IP:/catalog/catalog/indexes/SYNC_Final/sync/sync.index error loading index trailer: invalid load key, '\x00'.2025-11-17 15:19:00,582 - INFO - 403303 xcp new sync for id 'SYNC_Final' Removing incomplete sync index 'target_IP:/catalog/catalog/indexes/SYNC_Final/sync/sync.index'.2025-11-17 15:19:00,600 - INFO - 403303 xcp xcp created replication index file 'target_IP:/catalog/catalog/indexes/SYNC_Final/sync/sync.index'2025-11-17 15:19:00,605 - WARNING - 403303 xcp xcp Unable to read file 'SYNC_Final.moves_renames' : nfs3 LOOKUP 'SYNC_Final.moves_renames' in 'target_IP:/catalog/catalog/indexes/SYNC_Final': nfs3 error 2: no such file or directory2025-11-17 15:19:00,607 - WARNING - 403303 xcp xcp Unable to read file 'SYNC_Final.timechange' : nfs3 LOOKUP 'SYNC_Final.timechange' in 'target_IP:/catalog/catalog/indexes/SYNC_Final': nfs3 error 2: no such file or directory2025-11-17 15:19:05,352 - INFO - 403303 xcp xcp 147,800 reviewed, 211,446 checked at source, 147,800 reindexed, 40.0 MiB in (7.99 MiB/s), 33.3 MiB out (6.66 MiB/s), 5s2025-11-17 15:19:15,430 - INFO - 403303 xcp xcp 981,437 reviewed, 1.03M checked at source, 981,437 reindexed, 164 MiB in (12.0 MiB/s), 167 MiB out (12.9 MiB/s), 15s2025-11-17 15:19:45,666 - INFO - 403303 xcp xcp 3.66M reviewed, 3.66M checked at source, 2 modifications, 3.66M reindexed, 560 MiB in (13.1 MiB/s), 594 MiB out (14.1 MiB/s), 45s2025-11-17 15:20:46,051 - INFO - 403303 xcp xcp 8.82M reviewed, 8.84M checked at source, 2 modifications, 8.82M reindexed, 1.30 GiB in (13.1 MiB/s), 1.39 GiB out (14.1 MiB/s), 1m46s2025-11-17 15:21:07,884 - INFO - 403303 xcp compare batches 405386 xcp Validate FH Validating...405386 xcp nfs3 LOOKUP '4395607855.jpg' in 'target_IP:/target_vol/path/file_name' Traceback (most recent call last):File "sched.pyx", line 651, in sched.Engine._runTasksFile "sched.pyx", line 1696, in sched.Task.runFile "sched.pyx", line 1023, in gRequestnfs3.ENoent: nfs3 LOOKUP '4395607855.jpg' in 'target_IP:/target_vol/path/file_name': nfs3 error 2: no such file or directory405386 xcp Validate FH Lookup failed: nfs3 LOOKUP 'file_name1' in 'target_IP:/target_vol/path/file_name1': nfs3 error 2: no such file or directory407134 xcp Validate FH Lookup failed: nfs3 LOOKUP 'file_name2' in 'target_IP:/target_vol/path/file_name2': nfs3 error 2: no such file or directory2025-11-17 15:25:00,590 - WARNING - 403303 xcp target_IP tcp 2049 nfs3 c0 948 recv: [Errno 104] Connection reset by peer2025-11-17 15:25:00,591 - WARNING - 403303 xcp Reopener (403303 isChild False) 'target_IP tcp 2049 nfs3 c0 948' reconnecting (1)... 0(0 pending) requests2025-11-17 15:25:00,593 - WARNING - 403303 xcp Reopener (403303 isChild False) 'target_IP tcp 2049 nfs3 c0 948' reconnected in 0.001s after 1 try during 0s2025-11-17 15:25:08,912 - INFO - 403303 xcp compare batches 409151 xcp Validate FH Validating...2025-11-17 17:17:46,732 - INFO - 403303 xcp compare batches 494173 xcp Validate FH Validating...2025-11-17 17:18:18,285 - INFO - 403303 xcp diff 'SYNC_Final' 466M reviewed, 466M checked at source, 19,622 gone, 19,622 file.gone, 1 change, 7,641 modifications, 19,596 removed, 466M reindexed, 66.9 GiB in (9.57 MiB/s), 72.7 GiB out (10.4 MiB/s), 1h59m.2025-11-17 17:18:18,287 - INFO - 403303 xcp sync 'SYNC_Final' Starting search pass for 1909 modified directories...2025-11-17 21:37:39,226 - INFO - 403303 xcp rd 'source_IP:/source_vol/path/file_name3' fileid 3500680060 directory mod time changed; reading anyway2025-11-17 21:40:00,947 - INFO - 403303 xcp rd 'source_IP:/source_vol/path/file_name4' fileid 3957698826 directory mod time changed; reading anyway