Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Parallel Decomp - Global pool in separate class and... #3556

Open
wants to merge 8 commits into
base: devel
Choose a base branch
from
Open

WIP: Parallel Decomp - Global pool in separate class and... #3556

wants to merge 8 commits into from

Commits on Apr 15, 2024

  1. add parallel decompression support

    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    28fca19 View commit details
    Browse the repository at this point in the history

  2. move all data processing from CallbackCurlData

    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    59d4ae2 View commit details
    Browse the repository at this point in the history

  3. have a global queue in downloadmanager to reuse/prealloc tube element… 

    …s for the callbackcurldata

for tube element data size: use CURL_MAX_WRITE_SIZE
  Use GetUnusedDataTubeElement for all cases instead of malloc
    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    e0adb2d View commit details
    Browse the repository at this point in the history

  4. WIP global pool but encapsulated in its own class; memory footprint c… 

    …ontrollable by cvmfs params

add asserts and class documentation
    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    7b304d4 View commit details
    Browse the repository at this point in the history

  5. try to optimize sequential download

    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    c353d82 View commit details
    Browse the repository at this point in the history

  6. Split VerifyAndFinalize into multiple funcs and use the split version… 

    … for parallel decomp
    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    24b2a4f View commit details
    Browse the repository at this point in the history

  7. small fixes + add correct logoutput to parallel download code sections

    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    0e2c64c View commit details
    Browse the repository at this point in the history

  8. fix typos

    @HereThereBeDragons
    HereThereBeDragons committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    092bcf1 View commit details
    Browse the repository at this point in the history