Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Merged by Bors] - Support poet certificates #5221

Closed
wants to merge 71 commits into from
Closed

[Merged by Bors] - Support poet certificates #5221

wants to merge 71 commits into from

Commits on Nov 10, 2023

  1. Support for poet certificates WIP

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    d16cbe7 View commit details
    Browse the repository at this point in the history

  2. Support for poet certificates cont

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    08677b3 View commit details
    Browse the repository at this point in the history

  3. Initial certification using existing ATX or initial POST

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    d68a562 View commit details
    Browse the repository at this point in the history

  4. Improve poet HTTP client coverage

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    535dfcf View commit details
    Browse the repository at this point in the history

  5. Bump certifier

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    513c29a View commit details
    Browse the repository at this point in the history

  6. Use the right post challenge to certify

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    2bf4807 View commit details
    Browse the repository at this point in the history

  7. Fixed POST metadata sent to certifier

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    54f915b View commit details
    Browse the repository at this point in the history

  8. Bump certifier image

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    6cc3971 View commit details
    Browse the repository at this point in the history

  9. Migrate certifier store to localdb

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    f79232c View commit details
    Browse the repository at this point in the history

  10. Remove CertifierInfo struct

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    a2893dc View commit details
    Browse the repository at this point in the history

  11. Add systest for poet registrations with PoW and cert

    @poszu
    poszu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    ffd77d0 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. Configurable certifier retry options

    @poszu
    poszu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    326bde0 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    f2ec6f7 View commit details
    Browse the repository at this point in the history

  3. Increase systest CI job timeout

    @poszu
    poszu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    e0a6f89 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Keep POST proof in localDB for certification

    @poszu
    poszu committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    0054df7 View commit details
    Browse the repository at this point in the history

  2. Take optional poet certificates in config

    @poszu
    poszu committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    50fa30f View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Bump poet to v0.10.0

    @poszu
    poszu committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    2a9210e View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. Apply suggestions from code review 

    Co-authored-by: Matthias Fasching <5011972+fasmat@users.noreply.github.com>
    @poszu @fasmat
    poszu and fasmat committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    111576b View commit details
    Browse the repository at this point in the history

  2. update nipost_test.go

    @poszu
    poszu committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    678e2c6 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    29118cd View commit details
    Browse the repository at this point in the history

  4. fixup ProofToCertifyMetadata struct name

    @poszu
    poszu committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    ca0fcf0 View commit details
    Browse the repository at this point in the history

  5. Run poet systests in parallel

    @poszu
    poszu committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    f80eb4a View commit details
    Browse the repository at this point in the history

  6. Add NodeID to certs passed in config

    @poszu
    poszu committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    4302d65 View commit details
    Browse the repository at this point in the history

  7. Fix certifier config in systests

    @poszu
    poszu committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    cb33ecf View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Rename NewCertifierOption

    @poszu
    poszu committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    604bd51 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    0a86126 View commit details
    Browse the repository at this point in the history

  3. Apply localdb code migrations on checkpoint recovery

    @poszu
    poszu committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    ce012ca View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. Remove importing certificates

    @poszu
    poszu committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    97df610 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. Build initial post if post cannot be found

    @poszu
    poszu committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    18e8f23 View commit details
    Browse the repository at this point in the history

  2. Remove sourcegraph/conc dep

    @poszu
    poszu committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    98defe3 View commit details
    Browse the repository at this point in the history

  3. Bump certifier-service in systests to v0.6.0

    @poszu
    poszu committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    4eaa867 View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    4270563 View commit details
    Browse the repository at this point in the history

  2. Don't update post in localdb 

    Persist POST extracted from existing ATX
    @poszu
    poszu committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    c1ccfa8 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    b37a705 View commit details
    Browse the repository at this point in the history

  2. Fix UT

    @poszu
    poszu committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    8439433 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2023

  1. Autoscale post verifying workers (#5354) 

    Verifying POST proofs is CPU-intensive. By default, it uses 3/4 CPU cores. It is a problem during the cycle gap for the nodes that take longer to generate the POST proof than the others - new ATXs start to drop in and verifying them fights for CPU with the proving process. In such a situation, proving is more important so sacrificing ATX verification speed is an acceptable tradeoff.

Added a way to scale the number of workers that verify POST proofs (in incoming ATXs) up and down.

There is an auto scaler that reacts to POST events (started/finished) by scaling the number of workers down/up respectively.

The minimum and maximum number of workers is configurable with `smeshing-opts-verifying-min-workers` and `smeshing-opts-verifying-workers` respectively.

Added unit tests.

- [ ] Update [changelog](../CHANGELOG.md) as needed
    @poszu
    poszu committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    5cca828 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. Fix default value of challenge in initial_post table

    @poszu
    poszu committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    00edbc3 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    c61e32d View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    9b9f881 View commit details
    Browse the repository at this point in the history

  2. Fix flaky TestNIPostBuilder_Close

    @poszu
    poszu committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    e81a4c1 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    7e3961b View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    210c3e1 View commit details
    Browse the repository at this point in the history

  2. Fixes

    @poszu
    poszu committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    c053552 View commit details
    Browse the repository at this point in the history

  3. Bump post and certifier services in systests

    @poszu
    poszu committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    7319d84 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    314e921 View commit details
    Browse the repository at this point in the history

  2. Support for poet certs with expiration

    @poszu
    poszu committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    97f0ff1 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Use cert verification shared from poet

    @poszu
    poszu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    7e35d3f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    59f45a0 View commit details
    Browse the repository at this point in the history

  3. Fix linting issues

    @poszu
    poszu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    bd3130d View commit details
    Browse the repository at this point in the history

  4. Bump certifier service in systests

    @poszu
    poszu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    87c9284 View commit details
    Browse the repository at this point in the history

  5. Rename local sql migration

    @poszu
    poszu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f347e3d View commit details
    Browse the repository at this point in the history

  6. Fix staticcheck

    @poszu
    poszu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    377a5d5 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    342eee9 View commit details
    Browse the repository at this point in the history

  2. Use nipost.Post

    @poszu
    poszu committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    459f453 View commit details
    Browse the repository at this point in the history

  3. More review fixes

    @poszu
    poszu committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    601df9d View commit details
    Browse the repository at this point in the history

  4. Update poet and post-rs

    @poszu
    poszu committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    af1e89a View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. update test

    @poszu
    poszu committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    b7426fa View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    d72d416 View commit details
    Browse the repository at this point in the history

  2. Fix UTs

    @poszu
    poszu committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    af29624 View commit details
    Browse the repository at this point in the history

  3. Refactor certifier to lookup PoST on its own

    @poszu
    poszu committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    0ec2d97 View commit details
    Browse the repository at this point in the history

  4. Fix systest

    @poszu
    poszu committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    845c12d View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Merge remote-tracking branch 'origin/develop' into support-poet-certi… 

    …ficates
    @poszu
    poszu committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    30e322f View commit details
    Browse the repository at this point in the history

  2. Review feedback

    @poszu
    poszu committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    c0b306c View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Optimize searching for positioning ATX (#5952) 

    Searching for positioning ATX is slow because:
- the SQL query is slow
- it usually happens at the same time as many ATXs are being inserted into the DB (the poet CG)
    @poszu
    poszu committed May 22, 2024
    Configuration menu
    Copy the full SHA
    84c1800 View commit details
    Browse the repository at this point in the history

  2. Move certification to the poet client

    @poszu
    poszu committed May 22, 2024
    Configuration menu
    Copy the full SHA
    f4c358d View commit details
    Browse the repository at this point in the history

  3. Extend E2E activation test to use poet certificates with expiration

    @poszu
    poszu committed May 22, 2024
    Configuration menu
    Copy the full SHA
    d1d597a View commit details
    Browse the repository at this point in the history

  4. Parallelize certifying initial post

    @poszu
    poszu committed May 22, 2024
    Configuration menu
    Copy the full SHA
    377c62d View commit details
    Browse the repository at this point in the history

  5. Avoid redundant certifications for (nodeID, pubkey) pairs

    @poszu
    poszu committed May 22, 2024
    Configuration menu
    Copy the full SHA
    62ea324 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Review feedback

    @poszu
    poszu committed May 23, 2024
    Configuration menu
    Copy the full SHA
    879db03 View commit details
    Browse the repository at this point in the history

  2. Fix remaining UTs

    @poszu
    poszu committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c9f3f96 View commit details
    Browse the repository at this point in the history

  3. Fix remaining UTs

    @poszu
    poszu committed May 23, 2024
    Configuration menu
    Copy the full SHA
    7f83cab View commit details
    Browse the repository at this point in the history