FabricPool object storage has poor GET throughput with ONTAP firewall services enabled
Applies to
- ONTAP 9
- FabricPool
Issue
- Low throughput and high latency is noted using the object-store profiler benchmark test and it is noted Nwk_Lg CPU domain is 100% during this
Cluster::> set advanced
Cluster::*> object-store profiler start -node node08
Cluster::*> object-store profiler show -node node08
(storage aggregate object-store profiler show)
Object store config name: objectstore01
Node name: node08
Status: Done
Start time: 9/5/2020 23:29:57
Op Size Total Failed Latency(ms) Throughput
min max avg
-------------------------------------------------------------------------------
PUT 4MB 2500 0 59 3793 487 396.9MB
GET 4KB 284371 0 2 4961 127 24.57MB
GET 8KB 282249 0 3 1314 133 48.84MB
GET 32KB 97395 0 4 1113 389 66.95MB
GET 256KB 13409 14 413 10024 1988 72.75MB
5 entries were displayed.
Cluster::*> node run -node node08 sysstat -M 10
(some columns removed for readability)
ANY1+ AVG Nwk_Lg Nwk_Exmpt Raid_Ex Xor_Ex Kahuna WAFL_Ex(Kahu) SM_Exempt Exempt SSAN_Ex Intr Host Ops/s CP
99% 18% 92% 95% 4% 2% 0% 104%( 5%) 0% 222% 21% 13% 97% 3981 22%
100% 19% 99% 95% 3% 2% 0% 104%( 5%) 0% 236% 17% 13% 104% 3264 11%
99% 20% 92% 83% 3% 2% 0% 99%( 5%) 0% 231% 22% 12% 180% 2519 19%
100% 16% 98% 92% 0% 0% 0% 80%( 4%) 0% 189% 22% 12% 70% 2735 2%
100% 17% 80% 84% 3% 2% 0% 95%( 5%) 0% 166% 57% 11% 90% 3621 18%
100% 16% 99% 87% 3% 2% 0% 97%( 5%) 0% 171% 20% 11% 76% 2395 17%
100% 17% 99% 87% 4% 2% 0% 91%( 5%) 0% 175% 20% 11% 103% 2402 20%
100% 17% 99% 88% 4% 2% 0% 91%( 5%) 0% 175% 20% 12% 99% 2394 23%
100% 18% 99% 87% 3% 2% 0% 103%( 5%) 0% 176% 59% 11% 93% 3381 17%
98% 13% 82% 84% 1% 0% 0% 94%( 5%) 0% 97% 26% 10% 83% 3111 5%
100% 12% 99% 86% 1% 1% 0% 79%( 4%) 0% 80% 40% 11% 25% 3316 9%
100% 13% 99% 93% 3% 2% 0% 97%( 5%) 0% 92% 17% 11% 34% 2576 16%
100% 13% 99% 90% 4% 2% 0% 92%( 5%) 0% 95% 23% 11% 31% 2850 22%
ANY1+ AVG Nwk_Lg Nwk_Exmpt Raid_Ex Xor_Ex Kahuna WAFL_Ex(Kahu) SM_Exempt Exempt SSAN_Ex Intr Host Ops/s CP
100% 15% 92% 89% 3% 2% 0% 91%( 5%) 0% 87% 97% 11% 55% 5301 18%
99% 13% 93% 93% 4% 2% 0% 106%( 5%) 0% 61% 84% 12% 18% 4927 22%
100% 14% 100% 90% 3% 2% 0% 109%( 6%) 0% 64% 100% 12% 10% 5501 15%
100% 11% 100% 55% 1% 1% 0% 98%( 5%) 0% 58% 48% 11% 11% 2994 5%
100% 10% 100% 59% 4% 2% 0% 96%( 5%) 0% 59% 25% 11% 10% 2608 22%