Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change: openvasd: stream responses #1566

Merged
merged 4 commits into from
Feb 14, 2024
Merged

Conversation

nichtsfrei
Copy link
Member

@nichtsfrei nichtsfrei commented Feb 6, 2024

Instead of collecting various sources before combining and changing them
this will get the source, return an iterator so that the using calls can
decide if they want to combine various iterator before map them into the
target struct.

This does reduce the memory footprint when gathering nvt data from e.g.
redis.

Additionally openvasd imports the whole feed instead of just nvts.

To get meta information call:

curl localhost:3000/vts?information=true

Jira: SC-1018

@nichtsfrei nichtsfrei force-pushed the openvasd-reduce-buffering branch 4 times, most recently from d519026 to 8ec7217 Compare February 7, 2024 18:48
@nichtsfrei nichtsfrei changed the title WIP: Change: openvasd: stream responses Change: openvasd: stream responses Feb 7, 2024
@nichtsfrei nichtsfrei marked this pull request as ready for review February 7, 2024 18:50
@nichtsfrei nichtsfrei requested a review from a team as a code owner February 7, 2024 18:50
@nichtsfrei nichtsfrei force-pushed the openvasd-reduce-buffering branch 2 times, most recently from 64b9044 to 06a7a24 Compare February 7, 2024 18:53
Instead of collecting various sources before combining and changing them
this will get the source, return an iterator so that the using calls can
decide if they want to combine various iterator before map them into the
target struct.

This does reduce the memory footprint when gathering nvt data from e.g.
redis.

Additionally openvasd imports the whole feed instead of just nvts.

To get meta information call:
```
curl localhost:3000/vts?information=true
```
jjnicola added a commit that referenced this pull request Feb 12, 2024
This module gets a scan config and prepare the data to be stored in redis as openvas-scanner expected.
The data is stored in redis as well. For that, a new module openvas_redis was added as well, which adds an implements
the RedisHelper struct.

Depends on #1566
jjnicola added a commit that referenced this pull request Feb 12, 2024
This module gets a scan config and prepare the data to be stored in redis as openvas-scanner expected.
The data is stored in redis as well. For that, a new module openvas_redis was added as well, which adds an implements
the RedisHelper struct.

Depends on #1566
jjnicola added a commit that referenced this pull request Feb 12, 2024
This module gets a scan config and prepare the data to be stored in redis as openvas-scanner expected.
The data is stored in redis as well. For that, a new module openvas_redis was added as well, which adds an implements
the RedisHelper struct.

Depends on #1566
jjnicola added a commit that referenced this pull request Feb 13, 2024
This module gets a scan config and prepare the data to be stored in redis as openvas-scanner expected.
The data is stored in redis as well. For that, a new module openvas_redis was added as well, which adds an implements
the RedisHelper struct.

Depends on #1566
rust/redis-storage/src/connector.rs Outdated Show resolved Hide resolved
jjnicola
jjnicola previously approved these changes Feb 14, 2024
Kraemii
Kraemii previously approved these changes Feb 14, 2024
@nichtsfrei nichtsfrei dismissed stale reviews from Kraemii and jjnicola via 5664341 February 14, 2024 12:07
@nichtsfrei nichtsfrei enabled auto-merge (squash) February 14, 2024 12:10
@nichtsfrei nichtsfrei merged commit 11fe4cd into main Feb 14, 2024
26 checks passed
@nichtsfrei nichtsfrei deleted the openvasd-reduce-buffering branch February 14, 2024 12:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants