Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize node memory consumption #1398

Open
5 of 11 tasks
fyrchik opened this issue May 19, 2022 · 1 comment
Open
5 of 11 tasks

Optimize node memory consumption #1398

fyrchik opened this issue May 19, 2022 · 1 comment
Labels
epic A collection of related issues I3 Minimal impact performance More of something per second S3 Minimally significant U3 Regular

Comments

@fyrchik
Copy link
Contributor

fyrchik commented May 19, 2022

There is a number of cases where we can optimize the memory consumption.

Anything else?

Related #1319 .

@cthulhu-rider cthulhu-rider added the epic A collection of related issues label May 19, 2022
@carpawell
Copy link
Member

carpawell commented Jul 4, 2022

Anything else?

Optimize GetRange of the FSTree? Now the blobstor reads the whole object via Get method, decompresses it, and only after that cuts the desired part of an object. Get method reads all the payload in the memory even if only a small part is required.

Optimization may require moving compression on the blobovnicza and FSTree levels and decompressing the object only if it was really compressed.

There is already some kind of thoughts about compression on the bloboznicza side:

// we don't use GetRange call for now since blobovnicza
// stores data that is compressed on BlobStor side.
// If blobovnicza learns to do the compression itself,
// we can start using GetRange.

@nspcc-dev/neofs-core

@alexchetaev alexchetaev added the U3 Regular label Aug 23, 2022
@roman-khimov roman-khimov added performance More of something per second S3 Minimally significant I3 Minimal impact labels Dec 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
epic A collection of related issues I3 Minimal impact performance More of something per second S3 Minimally significant U3 Regular
Projects
None yet
Development

No branches or pull requests

5 participants