Autograd functional API should enable_grad

[iramazanli]

Fixes #44640

[dr-ci]

💊 CI failures summary and remediations

As of commit 3833c39 (more details on the Dr. CI page):

---

✅ None of the CI failures appear to be your fault 💚

---

• 1/1 tentatively recognized as flaky ❄️
  • Click here to rerun these jobs

---

❄️ 1 failure tentatively classified as flaky

but reruns have not yet been triggered to confirm:

pytorch_xla_linux_bionic_py3_6_clang9_test (1/1)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun) ❄️

Mar 11 02:42:13 RuntimeError: tensorflow/compiler/xla/xla_client/xrt_local_service.cc:56 : Check failed: tensorflow::NewServer(server_def, &server_) == ::tensorflow::Status::OK() (Unknown: Could not start gRPC server vs. OK)

Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch_xla-1.9-py3.6-linux-x86_64.egg/torch_xla/distributed/xla_multiprocessing.py", line 314, in _setup_replication
Mar 11 02:42:13     device = xm.xla_device()
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch_xla-1.9-py3.6-linux-x86_64.egg/torch_xla/core/xla_model.py", line 231, in xla_device
Mar 11 02:42:13     devkind=devkind if devkind is not None else None)
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch_xla-1.9-py3.6-linux-x86_64.egg/torch_xla/core/xla_model.py", line 136, in get_xla_supported_devices
Mar 11 02:42:13     xla_devices = _DEVICES.value
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch_xla-1.9-py3.6-linux-x86_64.egg/torch_xla/utils/utils.py", line 32, in value
Mar 11 02:42:13     self._value = self._gen_fn()
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch_xla-1.9-py3.6-linux-x86_64.egg/torch_xla/core/xla_model.py", line 18, in <lambda>
Mar 11 02:42:13     _DEVICES = xu.LazyProperty(lambda: torch_xla._XLAC._xla_get_devices())
Mar 11 02:42:13 RuntimeError: tensorflow/compiler/xla/xla_client/xrt_local_service.cc:56 : Check failed: tensorflow::NewServer(server_def, &server_) == ::tensorflow::Status::OK() (Unknown: Could not start gRPC server vs. OK)
Mar 11 02:42:13 Traceback (most recent call last):
Mar 11 02:42:13   File "/var/lib/jenkins/workspace/xla/test/test_mp_collective_permute.py", line 34, in <module>
Mar 11 02:42:13     xmp.spawn(_mp_fn, args=())
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch_xla-1.9-py3.6-linux-x86_64.egg/torch_xla/distributed/xla_multiprocessing.py", line 394, in spawn
Mar 11 02:42:13     start_method=start_method)
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch/multiprocessing/spawn.py", line 188, in start_processes
Mar 11 02:42:13     while not context.join():
Mar 11 02:42:13   File "/opt/conda/lib/python3.6/site-packages/torch/multiprocessing/spawn.py", line 144, in join
Mar 11 02:42:13     exit_code=exitcode
Mar 11 02:42:13 torch.multiprocessing.spawn.ProcessExitedException: process 0 terminated with exit code 17

---

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

[iramazanli]

More efficient implementation creating graphs only when its necessary

[albanD]

I don't think you wanted to commit the .nojekyll file right?

[iramazanli]

yes I don't want :) so i removed the file

[albanD]

LGTM
You need to fix the lint though
And you can rebase on top of the viable/strict branch to make sure you don't get any CI failures due to a broken master.

[albanD]

LGTM thanks for removing the jekyll file.

[albanD]

btw the jekyll file is back in the PR and should be removed before merging.

[codecov]

Codecov Report

Merging #47543 (4dde815) into master (53c77e7) will decrease coverage by 0.00%.
The diff coverage is 97.10%.

@@            Coverage Diff             @@
##           master   #47543      +/-   ##
==========================================
- Coverage   77.65%   77.64%   -0.01%     
==========================================
  Files        1869     1869              
  Lines      182327   182348      +21     
==========================================
+ Hits       141583   141591       +8     
- Misses      40744    40757      +13     

[albanD]

Just a small update to reduce code duplication, good to go otherwise.

Thanks for the rebase.

[facebook-github-bot]

@iramazanli has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[facebook-github-bot]

@iramazanli merged this pull request in f364e49.