Skip to content

Fix windows ci squid env #62353

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

zhouzhuojie
Copy link
Contributor

@zhouzhuojie zhouzhuojie commented Jul 28, 2021

This is a re-land of #62244, noticeable changes are

  • Use jinja2 variables to DRY the settings
  • Added no_proxy for common destinations that don't fit into proxy (e.g. the magic settings from aws link)
  • Try to trigger windows GHA CI flows
  • Also went through the actionlint for github action linting errors

@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jul 28, 2021

🔗 Helpful links

💊 CI failures summary and remediations

As of commit 1de23a2 (more details on the Dr. CI page):


💚 💚 Looks good so far! There are no failures yet. 💚 💚


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@facebook-github-bot
Copy link
Contributor

@zhouzhuojie has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

Copy link
Contributor

@driazati driazati left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, some trivial nits

@@ -37,12 +40,12 @@ env:
VS_VERSION: "16.8.6"
VC_YEAR: "2019"
ALPINE_IMAGE: "308535385114.dkr.ecr.us-east-1.amazonaws.com/tool/alpine"
no_proxy: !{{ squid_no_proxy }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any reason we don't set http_proxy at the workflow level too?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm trying to simulate what linux CI is doing is to limit the proxy to only build and test jobs, linux CI runs those in docker, windows CI runs in plain steps, thus the differences.

@@ -60,6 +60,7 @@ name: Bazel Linux CI (!{{ build_environment }})
-e CUSTOM_TEST_ARTIFACT_BUILD_DIR \
-e SKIP_SCCACHE_INITIALIZATION=1 \
-e TORCH_CUDA_ARCH_LIST \
-e http_proxy="!{{squid_proxy}}" -e https_proxy="!{{squid_proxy}}" -e no_proxy="!{{squid_no_proxy}}" \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These (squid_proxy, etc.) look like they're not defined for this workflow? Since they're duplicated across templates anyways it makes sense to pull them out into generate_ci_workflows.py so they're more consolidated

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this bazel workflow is an extension of linux workflow, but with combined build + test jobs into one, so many environment setup are defined in linux jinja2.

@zhouzhuojie zhouzhuojie force-pushed the fix-windows-ci-squid-env branch 2 times, most recently from 794583c to 8a606e5 Compare July 29, 2021 00:09
@facebook-github-bot
Copy link
Contributor

@zhouzhuojie has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@zhouzhuojie zhouzhuojie force-pushed the fix-windows-ci-squid-env branch from 8a606e5 to 1de23a2 Compare July 29, 2021 00:13
@@ -1,4 +1,8 @@
{%- set exclude_test = exclude_test|default(false) -%}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

exclude_test is already set as False by default, so no need to set again here

@facebook-github-bot
Copy link
Contributor

@zhouzhuojie has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@zhouzhuojie merged this pull request in 7157ad4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants