Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disk read increased for syscollector test in 4.8.0-beta4 #22600

Closed
Rebits opened this issue Mar 19, 2024 · 9 comments
Closed

Disk read increased for syscollector test in 4.8.0-beta4 #22600

Rebits opened this issue Mar 19, 2024 · 9 comments
Assignees
Labels
level/task type/bug Something isn't working

Comments

@Rebits
Copy link
Member

Rebits commented Mar 19, 2024

Wazuh version Component Install type Install method Platform
4.8.0-beta4 Syscollector Manager Packages centOS 7

Description

During the investigation of #22547, it has been observed that disk reads are occurring across all modules. This behavior appears to have been altered since version 4.8.0 alpha1.

4.8.0 4.7.3
IMAGE IMAGE
@sebasfalcone
Copy link
Member

This test should be repeated in 4.7.3

It is not possible that 0 disk reads were performed:

  • Wazuh-db
  • Syscollector
  • Logcollector

All of those modules should report some disk reads

@Rebits
Copy link
Member Author

Rebits commented Apr 10, 2024

I reopened this issue due to the zero disk read behavior does not occur only in 4.7.3 but in all the previous footprint tests:


All of those modules should report some disk reads

Logcollector is not enabled in this test. However, the wazuh-db and the syscollector indeed should report disk read. Further research is required

@Rebits Rebits reopened this Apr 10, 2024
@sebasfalcone
Copy link
Member

sebasfalcone commented Apr 10, 2024

Hi @Rebits!

Given that 4.8.0 didn't present changes on the syscollector module or the associated configurations, I have a question:

  • Did the tests or their configurations change in some way?

@rafabailon
Copy link
Member

rafabailon commented Apr 12, 2024

Update

Hi @sebasfalcone,

I've reviewed the changes in v4.8.0-alpha1 and there doesn't seem to be anything relevant that could have caused the change. The next step is to create a local environment similar to the one used in Footprints and pass the tests (4.7.3) to be able to manually check if there is activity on the disk or not.

@rafabailon
Copy link
Member

Update

Hi @sebasfalcone,

I have reviewed the pipeline code again along with the scripts that runs the pipeline. There are some changes in the pipeline but nothing that justifies a change in performance. They are, basically, refactoring. The scripts, for their part, have not changed. The most recent commits are from 7 months ago.

I have tried setting up a local environment with a manager (centos) and an agent (ubuntu). I have run the Footprint scripts and monitored the system resources.

In 4.7.3 there is less activity than in 4.8.0. I have checked the memory usage, CPU usage and disk operations.

4.7.3

image

image

image

4.8.0

image

image

image

In 4.7.3 I have only occasionally seen almost negligible disk read access. In 4.8.0 there is reading and writing activity in addition to the rest of the processes having greater activity. I have also tried increasing the load but the result is the same.

@sebasfalcone
Copy link
Member

It won't be possible for us to analyse this issue further, we still believe that is not possible that 0 disk reads are performed over the use of the module, just reading the configuration files should have some impact on this metric

Also, in the images shown we don't see modulesd on the list which is the one required for us to analyse

I will close this issue, please re-open it when comparable metrics of modulesd are obtained

@sebasfalcone sebasfalcone closed this as not planned Won't fix, can't repro, duplicate, stale Apr 16, 2024
@sebasfalcone
Copy link
Member

EDPS are 0 on the tests performed on 4.7.3:

image

image

This could explain this behaviour

@rafabailon
Copy link
Member

During the footprint Release 4.8.0 - RC 1 - Footprint Metrics - ROOTCHECK (2.5d) I detected an increase in wazuh-syscheckd in the plot Disk_Read. There is also a minimal increase in wazuh-db.

I reopen the issue to investigate the increase and compare the configurations used.

4.8.0-rc1 4.7.4-rc2
image image

@Dwordcito
Copy link
Member

@rafabailon This issue is for syscollector, not for syscheck.

Please open another issue for the correct module.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
level/task type/bug Something isn't working
Projects
Status: Done
Development

No branches or pull requests

4 participants