Wazuh API performance

[AdriiiPRodri]

Hi team,

In this issue we will make a performance benchmark between Wazuh API version 3.13.2 and Wazuh API version 4.0.0. To perform this test we will use an open source load testing tool called Locust. We look for the average response time, requests per second, the drop rate value and the maximum number of concurrent users.

For these tests we will use GET /agents

Computer stats

• Intel Core i7-6700HQ
• 20GB RAM DDR4 (2400Hz)
• SSD M.2 (Read: Up to 3500MB/second)

Environment setup

• Wazuh 4.0.0:
  • 1 master (master)
  • 2 workers (worker1 and worker2)
  • 12 agents (001 to 008 are Active, 009 and 010 are Disconnected, 011 and 012 are Never connected)
• Wazuh 3.13.2:
  • 1 master (master)
  • 2 workers (worker1 and worker2)
  • 8 agents (001 to 008 are Active, reduced due to 500 and 1000 simultaneous users tests)

Test cases

• 5 simultaneous users
• 100 simultaneous users
• 500 simultaneous users
• 1000 simultaneous users

Regards

[AdriiiPRodri]

5 simultaneous users / 500 requests

[4.0.0] Response time stats

Average response time -> 77.298 ms
Minimum response time -> 32 ms
Maximun response time -> 231 ms
Median response time -> 79 ms

[3.13.2] Response time stats

Average response time -> 335.636 ms
Minimum response time -> 297 ms
Maximun response time -> 409 ms
Median response time -> 340 ms

[4.0.0] Requests per second

[3.13.2] Requests per second

[4.0.0] Response time (ms)

[3.12.2] Response time (ms)

[4.0.0] Number of users

[3.12.2] Number of users

[AdriiiPRodri]

100 simultaneous users / 1000 requests

[4.0.0] Response time stats

Average response time -> 220 ms
Minimum response time -> 42 ms
Maximun response time -> 4066 ms
Median response time -> 220 ms

[3.13.2] Response time stats

Average response time -> 1191.384 ms
Minimum response time -> 294 ms
Maximun response time -> 7153 ms
Median response time -> 660 ms

[4.0.0] Requests per second

[3.13.2] Requests per second

[4.0.0] Response time (ms)

[3.12.2] Response time (ms)

[4.0.0] Number of users

[3.12.2] Number of users

[AdriiiPRodri]

500 simultaneous users / 4300 requests

[4.0.0] Response time stats

Average response time -> 18311.547 ms
Minimum response time -> 44 ms
Maximun response time -> 23736 ms
Median response time -> 20000 ms

[3.13.2] Response time stats

Average response time -> 33018.602 ms
Minimum response time -> 1633 ms
Maximun response time -> 48579 ms
Median response time -> 33000 ms

[4.0.0] Requests per second

[3.13.2] Requests per second

[4.0.0] Response time (ms)

[3.12.2] Response time (ms)

[4.0.0] Number of users

[3.12.2] Number of users

[AdriiiPRodri]

1000 simultaneous users / 10000 requests

[4.0.0] Response time stats

Average response time -> 40454.017 ms
Minimum response time -> 2645 ms
Maximun response time -> 85526 ms
Median response time -> 40000 ms

[3.13.2] Response time stats

Average response time -> 70362.425 ms
Minimum response time -> 3002 ms
Maximun response time -> 146011 ms
Median response time -> 72000 ms

[4.0.0] Requests per second

[3.13.2] Requests per second (98 fails)

[4.0.0] Response time (ms)

[3.12.2] Response time (ms)

[4.0.0] Number of users

[3.12.2] Number of users