Skip to content

Conversation

@driazati
Copy link
Contributor

@driazati driazati commented Sep 7, 2021

Stack from ghstack:

This adds a filter option rather than an all-or-nothing so it's easier to iterate on a specific job.

python tools/testing/explicit_ci_jobs.py --filter-gha '*generated-linux-*gcc5.4*'

See #64600 for an example usage

NB: If you regenerate the worfklows you will need to re-run that command to re-delete everything.

Differential Revision: D30788850

This adds a filter option rather than an all-or-nothing so it's easier to iterate on a specific job.

```bash
python tools/testing/explicit_ci_jobs.py --filter-gha '*generated-linux-*gcc5.4*'
```

NB: If you regenerate the worfklows you will need to re-run that command to re-delete everything.

[ghstack-poisoned]
@pytorch-probot
Copy link

pytorch-probot bot commented Sep 7, 2021

CI Flow Status

⚛️ CI Flow

Ruleset - Version: v1
Ruleset - File: https://github.com/pytorch/pytorch/blob/74896aefdee044431368a259887bd7e64436cbea/.github/generated-ciflow-ruleset.json
PR ciflow labels: ciflow/default

Workflows Labels (bold enabled) Status
Triggered Workflows
linux-bionic-py3.6-clang9 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/noarch, ciflow/xla ✅ triggered
linux-bionic-py3.8-gcc9-coverage ciflow/all, ciflow/coverage, ciflow/cpu, ciflow/default, ciflow/linux ✅ triggered
linux-xenial-cuda11.3-py3.6-gcc7 ciflow/all, ciflow/cuda, ciflow/default, ciflow/linux ✅ triggered
linux-xenial-py3.6-gcc5.4 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux ✅ triggered
linux-xenial-py3.6-gcc7-bazel-test ciflow/all, ciflow/bazel, ciflow/cpu, ciflow/default, ciflow/linux ✅ triggered
win-vs2019-cpu-py3 ciflow/all, ciflow/cpu, ciflow/default, ciflow/win ✅ triggered
win-vs2019-cuda10.1-py3 ciflow/all, ciflow/cuda, ciflow/default, ciflow/win ✅ triggered
Skipped Workflows
libtorch-linux-xenial-cuda10.2-py3.6-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux 🚫 skipped
libtorch-linux-xenial-cuda11.3-py3.6-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux 🚫 skipped
linux-bionic-cuda10.2-py3.9-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/slow 🚫 skipped
linux-xenial-cuda10.2-py3.6-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/slow 🚫 skipped
parallelnative-linux-xenial-py3.6-gcc5.4 ciflow/all, ciflow/cpu, ciflow/linux 🚫 skipped
periodic-libtorch-linux-xenial-cuda11.1-py3.6-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-linux-xenial-cuda11.1-py3.6-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-win-vs2019-cuda11.1-py3 ciflow/all, ciflow/cuda, ciflow/scheduled, ciflow/win 🚫 skipped
puretorch-linux-xenial-py3.6-gcc5.4 ciflow/all, ciflow/cpu, ciflow/linux 🚫 skipped
win-vs2019-cuda11.3-py3 ciflow/all, ciflow/cuda, ciflow/win 🚫 skipped

You can add a comment to the PR and tag @pytorchbot with the following commands:
# ciflow rerun, "ciflow/default" will always be added automatically
@pytorchbot ciflow rerun

# ciflow rerun with additional labels "-l <ciflow/label_name>", which is equivalent to adding these labels manually and trigger the rerun
@pytorchbot ciflow rerun -l ciflow/scheduled -l ciflow/slow

For more information, please take a look at the CI Flow Wiki.

@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Sep 7, 2021

🔗 Helpful links

💊 CI failures summary and remediations

As of commit 74896ae (more details on the Dr. CI page):


  • 2/2 failures introduced in this PR

🕵️ 2 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

See GitHub Actions build linux-xenial-cuda11.3-py3.6-gcc7 / test (default, 1, 2, linux.8xlarge.nvidia.gpu) (1/2)

Step: "Unknown" (full log | diagnosis details | 🔁 rerun)

2021-09-07T21:23:07.9479458Z CONTINUE_THROUGH_ERROR: false
2021-09-07T21:23:07.9473322Z   PR_LABELS: [
  "cla signed",
  "ciflow/default"
]
2021-09-07T21:23:07.9475081Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-xenial-cuda11.3-cudnn8-py3-gcc7:3fb4365799993abcfc83e51d42c137e89cb2459a
2021-09-07T21:23:07.9476836Z   JOB_BASE_NAME: linux-xenial-cuda11.3-py3.6-gcc7-test
2021-09-07T21:23:07.9477576Z   TEST_CONFIG: default
2021-09-07T21:23:07.9478018Z   SHARD_NUMBER: 1
2021-09-07T21:23:07.9478417Z   NUM_TEST_SHARDS: 2
2021-09-07T21:23:07.9478912Z   PYTORCH_IGNORE_DISABLED_ISSUES: 
2021-09-07T21:23:07.9479458Z   CONTINUE_THROUGH_ERROR: false
2021-09-07T21:23:07.9479924Z   GPU_FLAG: --gpus all
2021-09-07T21:23:07.9480333Z   SHM_SIZE: 2g
2021-09-07T21:23:07.9480704Z   PR_NUMBER: 64598
2021-09-07T21:23:07.9481109Z ##[endgroup]
2021-09-07T21:23:31.4540546Z Processing ./dist/torch-1.10.0a0+gitbaccd1a-cp36-cp36m-linux_x86_64.whl
2021-09-07T21:23:31.4930043Z Requirement already satisfied: typing-extensions in /opt/conda/lib/python3.6/site-packages (from torch==1.10.0a0+gitbaccd1a) (3.10.0.0)
2021-09-07T21:23:31.4940448Z Requirement already satisfied: dataclasses in /opt/conda/lib/python3.6/site-packages (from torch==1.10.0a0+gitbaccd1a) (0.8)
2021-09-07T21:23:31.9081840Z Installing collected packages: torch
2021-09-07T21:23:41.9941931Z Successfully installed torch-1.10.0a0+gitbaccd1a
2021-09-07T21:23:42.3649032Z ++++ dirname .jenkins/pytorch/common.sh

See GitHub Actions build win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (2/2)

Step: "Run test scripts" (full log | diagnosis details | 🔁 rerun)

2021-09-07T21:42:01.7497058Z ERROR [0.016s]: test_poisson_sample (__main__.TestDistributions)
2021-09-07T21:42:01.7491088Z   File "distributions/test_distributions.py", line 812, in _check_sampler_discrete
2021-09-07T21:42:01.7491799Z     chisq, p = scipy.stats.chisquare(counts[msk], pmf[msk] * num_samples)
2021-09-07T21:42:01.7492548Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6852, in chisquare
2021-09-07T21:42:01.7493218Z     return power_divergence(f_obs, f_exp=f_exp, ddof=ddof, axis=axis,
2021-09-07T21:42:01.7493955Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6694, in power_divergence
2021-09-07T21:42:01.7494561Z     raise ValueError(msg)
2021-09-07T21:42:01.7495387Z ValueError: For each axis slice, the sum of the observed frequencies must agree with the sum of the expected frequencies to a relative tolerance of 1e-08, but the percent differences are:
2021-09-07T21:42:01.7496150Z 0.008265582255680495
2021-09-07T21:42:01.7496328Z 
2021-09-07T21:42:01.7496593Z ======================================================================
2021-09-07T21:42:01.7497058Z ERROR [0.016s]: test_poisson_sample (__main__.TestDistributions)
2021-09-07T21:42:01.7497609Z ----------------------------------------------------------------------
2021-09-07T21:42:01.7498062Z Traceback (most recent call last):
2021-09-07T21:42:01.7498656Z   File "distributions/test_distributions.py", line 1352, in test_poisson_sample
2021-09-07T21:42:01.7499241Z     self._check_sampler_discrete(Poisson(rate),
2021-09-07T21:42:01.7499883Z   File "distributions/test_distributions.py", line 812, in _check_sampler_discrete
2021-09-07T21:42:01.7500588Z     chisq, p = scipy.stats.chisquare(counts[msk], pmf[msk] * num_samples)
2021-09-07T21:42:01.7501328Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6852, in chisquare
2021-09-07T21:42:01.7502011Z     return power_divergence(f_obs, f_exp=f_exp, ddof=ddof, axis=axis,
2021-09-07T21:42:01.7502747Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6694, in power_divergence
2021-09-07T21:42:01.7503339Z     raise ValueError(msg)

This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@driazati driazati marked this pull request as ready for review September 7, 2021 20:17
@driazati driazati requested a review from a team September 7, 2021 20:17
@driazati
Copy link
Contributor Author

driazati commented Sep 7, 2021

@driazati has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

This adds a filter option rather than an all-or-nothing so it's easier to iterate on a specific job.

```bash
python tools/testing/explicit_ci_jobs.py --filter-gha '*generated-linux-*gcc5.4*'
```

See #64600 for an example usage

NB: If you regenerate the worfklows you will need to re-run that command to re-delete everything.

[ghstack-poisoned]
@pytorch-probot pytorch-probot bot assigned pytorchbot and unassigned pytorchbot Sep 7, 2021
@driazati
Copy link
Contributor Author

driazati commented Sep 7, 2021

@driazati has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@driazati merged this pull request in 7e88d0b.

@facebook-github-bot facebook-github-bot deleted the gh/driazati/93/head branch September 11, 2021 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants