Skip to content

Conversation

rohan-varma
Copy link
Contributor

@rohan-varma rohan-varma commented Jul 26, 2021

We don't iterate over model replicas anymore.

Differential Revision: [D29918760](https://our.internmc.facebook.com/intern/diff/D29918760/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jul 26, 2021

🔗 Helpful links

💊 CI failures summary and remediations

As of commit 4da89eb (more details on the Dr. CI page):


  • 2/2 failures possibly* introduced in this PR
    • 1/2 non-scanned failure(s)

🕵️ 1 new failure recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

See CircleCI build pytorch_xla_linux_bionic_py3_6_clang9_test (1/1)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Jul 28 03:18:38 2021-07-28 03:18:38.300366: E t...w/compiler/xla/service/slow_operation_alarm.cc:55]
Jul 28 03:01:36   test_AvgPool3d_backward_after_cat_dim1_device_xla (__main__.TestNNDeviceTypeXLA) ... skip (0.002s)
Jul 28 03:01:36   test_BatchNorm_empty_xla (__main__.TestNNDeviceTypeXLA) ... ok (0.139s)
Jul 28 03:01:36   test_Bilinear_empty_xla (__main__.TestNNDeviceTypeXLA) ... skip (0.002s)
Jul 28 03:01:36   test_CTCLoss_cudnn_xla (__main__.TestNNDeviceTypeXLA) ... skip (0.008s)
Jul 28 03:01:37   test_CTCLoss_empty_target_xla (__main__.TestNNDeviceTypeXLA) ... ok (0.876s)
Jul 28 03:03:48   test_Conv2d_backward_depthwise_xla_float64 (__main__.TestNNDeviceTypeXLA) ... 2021-07-28 03:03:48.734391: E tensorflow/compiler/xla/service/slow_operation_alarm.cc:55] 
Jul 28 03:03:48 ********************************
Jul 28 03:03:48 Very slow compile?  If you want to file a bug, run with envvar XLA_FLAGS=--xla_dump_to=/tmp/foo and attach the results.
Jul 28 03:03:48 Compiling module SyncTensorsGraph.30789
Jul 28 03:03:48 ********************************
Jul 28 03:18:38 2021-07-28 03:18:38.300366: E tensorflow/compiler/xla/service/slow_operation_alarm.cc:55] 
Jul 28 03:18:38 ********************************
Jul 28 03:18:38 Very slow compile?  If you want to file a bug, run with envvar XLA_FLAGS=--xla_dump_to=/tmp/foo and attach the results.
Jul 28 03:18:38 Compiling module SyncTensorsGraph.35441
Jul 28 03:18:38 ********************************


Too long with no output (exceeded 1h30m0s): context deadline exceeded


1 job timed out:

  • pytorch_xla_linux_bionic_py3_6_clang9_test

ci.pytorch.org: 1 failed


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

We don't iterate over model replicas anymore.

Differential Revision: [D29918760](https://our.internmc.facebook.com/intern/diff/D29918760/)

[ghstack-poisoned]
We don't iterate over model replicas anymore.

Differential Revision: [D29918760](https://our.internmc.facebook.com/intern/diff/D29918760/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in c76daa6.

@facebook-github-bot facebook-github-bot deleted the gh/rohan-varma/364/head branch August 1, 2021 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed Merged oncall: distributed Add this issue/PR to distributed oncall triage queue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants