Cloud sync fails with EIO error for operations like lstat or read during copy
Applies to
- Cloud sync
- NFS
Issue
- Sync Completes but with lots of failures.
- When cloud sync tries to mount the source NFS server, it throws below error intermittently:
[ERROR] [REPORTER] [18] [22296] Failed to execute command Error: Command failed: sudo umount -f mnt/6xxxxxxxx/xxxxxxxx_src umount.nfs: /opt/netapp/databroker/mnt/6xxxxxxxxxxxxxxxxxx/54xxx-xxxx-xxxx-xxxxxxxxxx__src: device is busy
- Failed logs show operations like lstat, mkdir , read etc are failing with I/O error
[INFO] [SCANNER] [8] [20953] [6xxxxxxxxxxxxxxxxxx] [LIST] FAILED source { nfs: { host: '10.xx.xx.xx', export: '/cloud1', version: '3', provider: 'nfs', path: 'path/path1/Path2/path3/API/dir1', inode: 81015072 } } and target: { nfs: { host: '10.xx.xx.xx', export: '/lab1', version: '3', provider: 'cvo', path: 'path/path1/Path2/path3/API/dir1', inode: 6xxxxxx} } [Error: EIO: i/o error, lstat 'mnt/6xxxxxxxxxxxx/xxxxxxxxxxxxxxxxx_src/path/path1/path2/path3/API/dir1'] { errno: -5, code: 'EIO', syscall: 'lstat', path: 'mnt/6xxxxxxxxxxxxxxxxxx/54xxx-xxxx-xxxx-xxxxxxxxxx/path/path1/Path2/path3/API/dir1' }
[INFO] [TRANSFERRER] [1] [20912] [6xxxxxxxxxxxxxxxxxx] [COPY] FAILED: source { nfs: { host: '10.xxx.xx.xx', export: '/exportlab', version: '3', provider: 'nfs', path: 'path4/path5/path6/dir2', inode: 67004445 } } target: { nfs: { host: '10.xxx.xx.xx', export: '/exportlab', version: '3', provider: 'cvo', path: 'path4/path5/path6/dir2', inode: 6xxxxxxx } } entry: { path: 'myfile.vmdk', type: 'FILE', size: 1525415936, mode: 33279, uid: 0, gid: 0, mtimeSec: 1378996330, creationTimeSec: 0, inode: 6xxxxxxx, tempEntryName: '.myfile.vmdk_nCwneT6_netapp' } [Error: EIO: i/o error, read] { errno: -5, code: 'EIO', syscall: 'read' }
[INFO] [TRANSFERRER] [3] [20919] [6xxxxxxxxxxxxxxxxxx] [COPY] FAILED: source { nfs: { host: '10.xxx.xx.xx', export: '/exportlab1', version: '3', provider: 'nfs', path: 'lab1/lab2/lab3/dir3', inode: 7xxxxxxx } } target: { nfs: { host: '10.xx.xx.xx', export: '/lab1', version: '3', provider: 'cvo', path: 'lab1/lab2/lab3/dir3', inode: 7xxxxxxx } } entry: { path: 'lab.ova', type: 'FILE', size: 14533575168, mode: 33279, uid: 0, gid: 0, mtimeSec: 1439289656, creationTimeSec: 0, inode: 7xxxxxxx, tempEntryName: 'lab.ova_PdkFk28_netapp' } [Error: EIO: i/o error, read] { errno: -5, code: 'EIO', syscall: 'read' }