poor upload performance on StorageGRID cause by acpi_pad
Applies to
- StorageGRID container
- Bare metal host CentOS 8
Issue
- Poor upload performance.
- Running diagnostic tests found no issues.
- Checking the CPU, memory, disk IO utilization in Grid Manager are normal.
- Some storage nodes in the ping test have high latency, but network utilization is low, no error in
ifconfig -a
. - Check the host CPU utilization and find that the acpi_pad process accounts for a high amount of CPU.
[root@sn01 ~]# top -b -n 1
top - 12:07:37 up 35 days, 22:44, 2 users, load average: 42.41, 42.63, 42.73
Tasks: 807 total, 29 running, 777 sleeping, 0 stopped, 1 zombie
%Cpu(s): 3.9 us, 53.9 sy, 0.0 ni, 40.4 id, 0.1 wa, 1.2 hi, 0.4 si, 0.0 st
MiB Mem : 63936.6 total, 4035.7 free, 36641.3 used, 23259.6 buff/cache
MiB Swap: 12208.0 total, 11868.5 free, 339.5 used. 19465.7 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1546 root -2 0 0 0 0 R 95.2 0.0 50317:00 acpi_pad/5
1547 root -2 0 0 0 0 R 95.2 0.0 50317:47 acpi_pad/6
1550 root -2 0 0 0 0 R 95.2 0.0 50316:29 acpi_pad/7
1551 root -2 0 0 0 0 R 95.2 0.0 50317:18 acpi_pad/8
1552 root -2 0 0 0 0 R 95.2 0.0 50316:46 acpi_pad/9
1553 root -2 0 0 0 0 R 95.2 0.0 50317:16 acpi_pad/10
1555 root -2 0 0 0 0 R 95.2 0.0 50317:05 acpi_pad/12
1329 root -2 0 0 0 0 R 90.5 0.0 50317:55 acpi_pad/0
1331 root -2 0 0 0 0 R 90.5 0.0 50317:08 acpi_pad/1
1528 root -2 0 0 0 0 R 90.5 0.0 50317:42 acpi_pad/2
1531 root -2 0 0 0 0 R 90.5 0.0 50317:09 acpi_pad/3
1542 root -2 0 0 0 0 R 90.5 0.0 50317:20 acpi_pad/4
1554 root -2 0 0 0 0 R 90.5 0.0 50317:15 acpi_pad/11
1556 root -2 0 0 0 0 R 90.5 0.0 50316:16 acpi_pad/13
1565 root -2 0 0 0 0 R 90.5 0.0 50318:15 acpi_pad/14
1566 root -2 0 0 0 0 R 90.5 0.0 50316:27 acpi_pad/15
10128 1015 20 0 29.0g 24.6g 972976 S 81.0 39.5 40949:56 java
17882 1002 20 0 7794768 859096 21092 S 47.6 1.3 23286:58 ldr
2675 root 20 0 66928 5696 4256 R 19.0 0.0 0:00.06 top
5091 1006 20 0 2960584 179700 14740 S 9.5 0.3 5660:40 ssm
8900 1001 20 0 3546620 652360 14564 S 9.5 1.0 5468:02 adc
10687 1005 20 0 3347360 507348 14216 S 9.5 0.8 5248:31 ams
12401 1008 20 0 2950068 171416 13940 S 9.5 0.3 5321:49 cmn
17256 1004 20 0 3004452 191084 14204 S 9.5 0.3 5299:42 nms
17707 1013 20 0 4213144 266092 16928 S 9.5 0.4 5746:44 dds
19432 1004 20 0 9531996 464616 18200 S 4.8 0.7 613:31.87 jsvc
20627 1021 20 0 3384852 44756 7636 S 4.8 0.1 3036:01 rsm
21711 1006 20 0 3014228 238824 14852 S 4.8 0.4 5597:06 ssm
27227 root 20 0 581372 51984 8940 S 4.8 0.1 375:22.70 dynip-daemon.py
1 root 20 0 245000 8780 5932 S 0.0 0.0 0:26.13 systemd