AltaVault Optimization Service is stopped, and Status is 'not ready'
Applies to
- AltaVault virtual appliance
- AVA-v32
- VMware vCenter
Issue
Optimization Service is in stopped state and attempts to restart the service fail as well.
- Attempts to start the Optimization Service fail with below errors:
Jul 8 00:23:51 ava-v32 rfsd[3263]: [metadata_db.INFO] (3263) Invalid inodes cleanup took 14 seconds
Jul 8 00:23:51 ava-v32 rfsd[3263]: [slab_container.ERR] (3263) buffer too short to contain header (buffer is 0 bytes, ContainerHeader is 32 bytes)
Jul 8 00:23:51 ava-v32 rfsd[3263]: [slab_impl.ERR] (3263) Failed to read format of Slab: invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [slab_impl.ERR] (3263) Failed to read data file: invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [slab_impl.ERR] (3263) Failed to load datasection for slabid=0xfefffab311c60000 : invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [megastore.ERR] (3263) Failed to load slab: invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [megastore.ERR] (3263) Failed to load partial slabs: invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [megastore.ERR] (3263) Component Initialization Failed: invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [megastore.ERR] (3263) Failed to initialize the Megastore: invalid argument
Jul 8 00:23:51 ava-v32 rfsd[3263]: [megastore.ERR] (3263) Error in starting megastore
Jul 8 00:23:51 ava-v32 rfsd[3263]: [evict.INFO] (3263) Processor EvictProcessor shutting down 129 threads
Jul 8 00:23:51 ava-v32 rfsd[3263]: [replication_mgr.INFO] (3263) Shutting down replication manager thread
- Running complete MFSCK also encountered errors:
Jul 27 11:50:30 ava-v32 mgmtd[2337]: [mgmtd.INFO]: Forking then execing binary "/opt/rbt/bin/mfsck" with argv "/opt/rbt/bin/mfsck -M /data -S /var/tmp/mfsck -C COMPLETE -R -r".
Jul 27 11:50:54 ava-v32 mfsck[16467]: [slab_impl.ERR] (16469) Failed to read format of Slab: invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [slab_impl.ERR] (16469) Failed to read data file: invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [slab_impl.ERR] (16469) Failed to load datasection for slabid=0xfefffab311c60000 : invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [megastore.ERR] (16469) Failed to load slab: invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [megastore.ERR] (16469) Failed to load partial slabs: invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [megastore.ERR] (16469) Component Initialization Failed: invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [megastore.ERR] (16469) Failed to initialize the Megastore: invalid argument
Jul 27 11:50:54 ava-v32 mfsck[16467]: [megastore.ERR] (16469) Error in starting megastore
Jul 27 12:03:23 ava-v32 mgmtd[2337]: [mgmtd.INFO]: Mfsck run completed
Jul 27 12:03:23 ava-v32 mgmtd[2337]: [mgmtd.NOTICE]: Mfsck run encountered an error: [12:02:57.611831 21495 (21495) /run_mfsck info] nproc cur: 395558 [12:02:57.611886 21495 (21495) /run_mfsck info] nproc max: 395558 [12:02:57.611940 21495 (21495) /run_mfsck info] system thread max: 791116 tcmalloc: large alloc 2955681792 bytes == 0x37a0000 @ 0x7f005226bb8a 0x74f604 0x74c2e6 0x8578fb 0x6ec636 0x6ec80a 0x6eea47 0x62dd3f 0x61f0aa 0x625d58 0x629e11 0x5883cd 0x5891f2 0x57b854 0xa46446 0x7f004f63c064 0x7f004e3fa62d (nil)
- Complete MFSCK failed and logged the following message "
mfsck run encountered an error. Contact NetApp Support for assistance.
"