Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add weight calculations for repo scheduling in repo collection #2316

Merged
merged 51 commits into from
Apr 18, 2023
Merged

Add weight calculations for repo scheduling in repo collection #2316

merged 51 commits into from
Apr 18, 2023

Commits on Mar 17, 2023

  1. RedisScalar class 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Mar 17, 2023
    Configuration menu
    Copy the full SHA
    5b13861 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. libyear fix 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    1fd6ffb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dev' into collection-hooks-with-weight

    @IsaacMilarky
    IsaacMilarky committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    2b4ea45 View commit details
    Browse the repository at this point in the history

  3. Implement redhat weight changes 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    77dc04d View commit details
    Browse the repository at this point in the history

  4. subtract weights 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    b103acb View commit details
    Browse the repository at this point in the history

  5. dumb python type cast 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    83417bd View commit details
    Browse the repository at this point in the history

  6. fix no return and more clear logging 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    4222d60 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. merge with dev 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    0614f72 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. Scrap hard limit idea 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    2f47a02 View commit details
    Browse the repository at this point in the history

  2. add weights to collection_status 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    a952d55 View commit details
    Browse the repository at this point in the history

  3. add columns for collection status in alembic 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    85212cf View commit details
    Browse the repository at this point in the history

  4. Update 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    b4b0cea View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. merge with dev 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    6b630e0 View commit details
    Browse the repository at this point in the history

  2. print 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    45326c8 View commit details
    Browse the repository at this point in the history

  3. vscode 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    c49471e View commit details
    Browse the repository at this point in the history

  4. fix schema 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    74d79f2 View commit details
    Browse the repository at this point in the history

  5. fill in weight 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    638925d View commit details
    Browse the repository at this point in the history

  6. Complete sort logic for collection weight 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    61f41fd View commit details
    Browse the repository at this point in the history

  7. syntax 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    25e3ac8 View commit details
    Browse the repository at this point in the history

  8. make sure that commit weight is updated 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    fc18923 View commit details
    Browse the repository at this point in the history

  9. core repo update weight logic 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    b66f2c4 View commit details
    Browse the repository at this point in the history

  10. try to get celery chord working 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    eb4c544 View commit details
    Browse the repository at this point in the history

  11. syntax 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    4477429 View commit details
    Browse the repository at this point in the history

  12. syntax 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    deb7c8e View commit details
    Browse the repository at this point in the history

  13. apply date factor for core repo weight 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    ecdffa2 View commit details
    Browse the repository at this point in the history

  14. add time_factor calculation to facade weight logic 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    f6afabb View commit details
    Browse the repository at this point in the history

  15. repo added is a value that doesn't get updated when it gets introduce… 

    …d to a new database

Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    b894bc2 View commit details
    Browse the repository at this point in the history

  16. deal with if the record doesn't have collection yet 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    2172aaa View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. Merge branch 'dev' into collection-hooks-with-weight

    @IsaacMilarky
    IsaacMilarky committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    7b6e953 View commit details
    Browse the repository at this point in the history

  2. add periodic task to update repo weights on midnight during even numb… 

    …ered days

Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    8b64cff View commit details
    Browse the repository at this point in the history

  3. add command to reset repo age 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    a75ab1c View commit details
    Browse the repository at this point in the history

  4. Un-needed import 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    e9cc16f View commit details
    Browse the repository at this point in the history

  5. replace sql with orm query 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    c5bd0f4 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. adjust date weight 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    e358c43 View commit details
    Browse the repository at this point in the history

  2. change update weight to not schedule per repo 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    35201af View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. Add offset for 30 day collection restriction 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    0357be3 View commit details
    Browse the repository at this point in the history

  2. prelim tweaks from meeting with Andrew 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    209ad2a View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. Merge branch 'dev' into collection-hooks-with-weight

    @IsaacMilarky
    IsaacMilarky committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    0f5d669 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2023

  1. schema changes following meeting with Andrew Brain 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    820e1aa View commit details
    Browse the repository at this point in the history

  2. downgrade logic in alembic 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    5d94dd3 View commit details
    Browse the repository at this point in the history

  3. update weight logic 

    Signed-off-by: Isaac Milarsky <krabs@tilde.team>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    bfbe438 View commit details
    Browse the repository at this point in the history

  4. fix update logic 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    3164692 View commit details
    Browse the repository at this point in the history

  5. make secondary weight differant 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    18acf48 View commit details
    Browse the repository at this point in the history

  6. implement new/old repo hierarchy as discussed 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    4ebc2c8 View commit details
    Browse the repository at this point in the history

  7. move reset-repo-age to augur db 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    e01c1d6 View commit details
    Browse the repository at this point in the history

  8. move reset-repo-age to augur db 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    dccb7c1 View commit details
    Browse the repository at this point in the history

  9. stop alembic from adding repos to collection_status 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    01919fd View commit details
    Browse the repository at this point in the history

  10. typo 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    d44c894 View commit details
    Browse the repository at this point in the history

  11. use default repo_added 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    9102ce9 View commit details
    Browse the repository at this point in the history

  12. limit check before old repo schedule 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    241ae72 View commit details
    Browse the repository at this point in the history

  13. alembic changes 

    Signed-off-by: Isaac Milarsky <imilarsky@gmail.com>
    @IsaacMilarky
    IsaacMilarky committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    c02068f View commit details
    Browse the repository at this point in the history