Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add S3 http2 toggle flag #604

Merged
merged 1 commit into from
Jan 17, 2024
Merged

Add S3 http2 toggle flag #604

merged 1 commit into from
Jan 17, 2024

Conversation

adam-singer
Copy link
Member

@adam-singer adam-singer commented Jan 11, 2024

Description

Add S3 TLS configuration to disable http2 in favor for http.

Fixes # (issue)

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to
    not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

Please also list any relevant details for your test configuration

Checklist

  • Updated documentation if needed
  • Tests added/amended
  • bazel test //... passes locally
  • PR is contained in a single commit, using git amend see some docs

This change is Reviewable

Copy link

vercel bot commented Jan 11, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
nativelink-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 17, 2024 1:27am

Copy link
Member

@aaronmondal aaronmondal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Should this be tested? I'm not sure how complex a test setup for this would be though. I'd be fine with just keeping it this way.

:lgtm:

Reviewed 2 of 2 files at r1, all commit messages.
Reviewable status: 1 of 1 LGTMs obtained


-- commits line 2 at r1:
nit: Maybe use something like "Add S3 http2 toggle flag" or similar so that this doesn't look like we're permanently disabling http2.


nativelink-config/src/stores.rs line 469 at r1 (raw file):

    pub insecure_allow_http: bool,

    /// Disable http2 connections and rely on http1 only.

nit: Might make sense to elaborate the usecases for this.

Copy link
Member Author

@adam-singer adam-singer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aaronmondal I looked into this a bit before with another S3 client change, the challenge for unit tests is being able to dump the internal state of the client to know what configurations it holds. I did do something simple in a small example with the aws client by printing out the structure and it did serialize to something that contained structured information, what was clear is how to tease that information out in a testable way. Generally speaking testing client configuration sets aren't super useful, also testing them can catch silly configuration fails, so not completely against it. Testing this would generally be better in integration test settings or something where a fully binded client could be executed. I'll noodle a bit here, if doesn't seem fruitful will punt it for now.

Reviewable status: 1 of 1 LGTMs obtained


-- commits line 2 at r1:

Previously, aaronmondal (Aaron Siddhartha Mondal) wrote…

nit: Maybe use something like "Add S3 http2 toggle flag" or similar so that this doesn't look like we're permanently disabling http2.

Will do, need to get in the habit of assuming this is the commit message that lands and not an updated one from the github squash/merge dialog


nativelink-config/src/stores.rs line 469 at r1 (raw file):

Previously, aaronmondal (Aaron Siddhartha Mondal) wrote…

nit: Might make sense to elaborate the usecases for this.

Will do, see how elaborate this can be expanded

Copy link
Member

@aaronmondal aaronmondal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: 1 of 1 LGTMs obtained

Copy link
Member Author

@adam-singer adam-singer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: 1 of 1 LGTMs obtained, and pending CI: Analyze (javascript-typescript), Analyze (python), Bazel Dev / ubuntu-22.04, Cargo Dev / ubuntu-22.04, Local / ubuntu-22.04, Remote / large-ubuntu-22.04, Vercel, asan / ubuntu-22.04, docker-compose-compiles-nativelink (20.04), docker-compose-compiles-nativelink (22.04), integration-tests (20.04), integration-tests (22.04), pre-commit-checks, publish-image, ubuntu-20.04, ubuntu-20.04 / stable, ubuntu-22.04, ubuntu-22.04 / stable, windows-2022 / stable


-- commits line 2 at r1:

Previously, adam-singer (Adam Singer) wrote…

Will do, need to get in the habit of assuming this is the commit message that lands and not an updated one from the github squash/merge dialog

Done.


nativelink-config/src/stores.rs line 469 at r1 (raw file):

Previously, adam-singer (Adam Singer) wrote…

Will do, see how elaborate this can be expanded

Done.

@adam-singer adam-singer changed the title S3 disable http2 flag Add S3 http2 toggle flag Jan 12, 2024
Copy link
Member

@allada allada left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 1 of 1 files at r2.
Reviewable status: 2 of 1 LGTMs obtained, and pending CI: Remote / large-ubuntu-22.04

Copy link
Member Author

@adam-singer adam-singer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewable status: 3 of 1 LGTMs obtained, and pending CI: Remote / large-ubuntu-22.04

@adam-singer adam-singer merged commit 8c433cd into main Jan 17, 2024
22 checks passed
@adam-singer adam-singer deleted the adams/s3-disable-http2 branch January 17, 2024 06:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants