Add new tutorial: Multi-Objective NAS with Ax (#2006)

* Add Ax multi-objective NAS optimization tutorial

* F
Fix reading local file path. Add nbformat to reqs

* Use sphinx-gallery built-in support for plotly

* Remove weights_summary arg from Trainer (removed in ptl 1.7.0)

* changes as recommended in task + pin lightning

* Fixed broken links and rst warnings; changed CV figure to plotly; added nbformat as dependency; removed weights_format argument to allow newer version of lightning

* Reverted changes recommended in task -- total_trials and downloading data in Makefile

* a single space

* Various updates

* Apply editorial edit suggestions from code review

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Apply suggestions from code review

* Use python builtin component to simplify things

* Apply suggestions from code review

Co-authored-by: Nikita Shulga <nikita.shulga@gmail.com>

* Refactor main loop and guard by `__main__`, print to stdout

* Mark mnist_train_nas.py as dependency for tutorial

* Move tutorial to intermediate directory

Co-authored-by: Elizabeth Santorella <santorella@fb.com>
Co-authored-by: Svetlana Karslioglu <svekars@fb.com>
Co-authored-by: Nikita Shulga <nikita.shulga@gmail.com>
Co-authored-by: Nikita Shulga <nshulga@fb.com>

Author: 4 people

.jenkins/metadata.json

@@ -1,4 +1,7 @@
 {
+  "intermediate_source/ax_multiobjective_nas_tutorial.py": {
+    "extra_files": ["intermediate_source/mnist_train_nas.py"]
+  },
   "beginner_source/dcgan_faces_tutorial.py": {
     "duration": 2000
   },

_static/img/ax_scheduler_illustration.png

@@ -38,6 +38,9 @@
 import distutils.file_util
 import re
 
+import plotly.io as pio
+pio.renderers.default = 'sphinx_gallery'
+
 
 try:
     import torchvision

conf.py

@@ -492,7 +492,7 @@ What's new in PyTorch tutorials?
    :image: _static/img/thumbnails/cropped/60-min-blitz.png
    :link: advanced/static_quantization_tutorial.html
    :tags: Quantization
-   
+
 .. customcarditem::
    :header: Grokking PyTorch Intel CPU Performance from First Principles
    :card_description: A case study on the TorchServe inference framework optimized with Intel® Extension for PyTorch.
@@ -507,6 +507,13 @@ What's new in PyTorch tutorials?
    :link: intermediate/nvfuser_intro_tutorial.html
    :tags: Model-Optimization
 
+.. customcarditem::
+   :header: Multi-Objective Neural Architecture Search with Ax
+   :card_description: Learn how to use Ax to search over architectures find optimal tradeoffs between accuracy and latency.
+   :image: _static/img/ray-tune.png
+   :link: intermediate/ax_multiobjective_nas_tutorial.html
+   :tags: Model-Optimization,Best-Practice,Ax,TorchX
+
 .. Parallel-and-Distributed-Training
 
 .. customcarditem::
@@ -871,6 +878,7 @@ Additional Resources
    advanced/static_quantization_tutorial
    intermediate/torchserve_with_ipex
    intermediate/nvfuser_intro_tutorial
+   intermediate/ax_multiobjective_nas_tutorial
 
 .. toctree::
    :maxdepth: 2
@@ -902,7 +910,7 @@ Additional Resources
 
    beginner/deeplabv3_on_ios
    beginner/deeplabv3_on_android
-   
+
 .. toctree::
    :maxdepth: 2
    :includehidden: