add optional requirements to setuptools installation

[pmeier]

Closes #2618 and fixes #4917.

Todo

• add documentation of this to the README

cc @seemethere

[facebook-github-bot]

💊 CI failures summary and remediations

As of commit de936ed (more details on the Dr. CI page):

---

• 5/6 failures introduced in this PR
• 1/6 broken upstream at merge base 874581c since Nov 30

---

🕵️ 5 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

unittest_linux_cpu_py3.6 (1/5)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

/root/project/torchvision/io/video.py:399: Runt...log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found

test/test_image.py::test_encode_jpeg[grace_hopper_517x606.jpg]
  /root/project/test/test_image.py:493: UserWarning: The given buffer is not writable, and PyTorch does not support non-writable tensors. This means you can write to the underlying (supposedly non-writable) buffer using the tensor. You may want to copy the buffer to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at  /opt/conda/conda-bld/pytorch_1638432299720/work/torch/csrc/utils/tensor_new.cpp:998.)
    encoded_jpeg_pil = torch.frombuffer(buf.getvalue(), dtype=torch.uint8)

test/test_internet.py::TestDatasetUtils::test_download_url_retry_http
  /root/project/env/lib/python3.6/urllib/request.py:522: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=13, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6>
    for processor in self.process_request.get(protocol, []):

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  /root/project/torchvision/io/video.py:399: RuntimeWarning: Failed to open container for /tmp/tmpzmffz_rl.mp4; Caught error: [Errno 1094995529] Invalid data found when processing input: '/tmp/tmpzmffz_rl.mp4'; last error log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  /root/project/env/lib/python3.6/site-packages/torch/autocast_mode.py:162: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
    warnings.warn('User provided device_type of \'cuda\', but CUDA is not available. Disabling')

test/test_models.py::test_inception_v3_eval

unittest_windows_cpu_py3.7 (2/5)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

c:\users\circleci\project\torchvision\io\video....\\circleci\\AppData\\Local\\Temp\\tmplmxs4yhb.mp4'

test/test_internet.py::TestDatasetUtils::test_download_url_dont_exist
  C:\Users\circleci\project\env\lib\site-packages\pluggy\callers.py:171: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=3008, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    args = [caller_kwargs[argname] for argname in hook_impl.argnames]

test/test_internet.py::TestDatasetUtils::test_download_url_dont_exist
  C:\Users\circleci\project\env\lib\site-packages\pluggy\callers.py:171: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=2616, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    args = [caller_kwargs[argname] for argname in hook_impl.argnames]

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  c:\users\circleci\project\torchvision\io\video.py:399: RuntimeWarning: Failed to open container for C:\Users\circleci\AppData\Local\Temp\tmplmxs4yhb.mp4; Caught error: [Errno 13] Permission denied: 'C:\\Users\\circleci\\AppData\\Local\\Temp\\tmplmxs4yhb.mp4'
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  C:\Users\circleci\project\env\lib\site-packages\torch\autocast_mode.py:162: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
    warnings.warn('User provided device_type of \'cuda\', but CUDA is not available. Disabling')

test/test_models.py::test_inception_v3_eval

unittest_windows_cpu_py3.9 (3/5)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

c:\users\circleci\project\torchvision\io\video....\\circleci\\AppData\\Local\\Temp\\tmpfarg_hmp.mp4'

test/test_internet.py::TestDatasetUtils::test_download_url_retry_http
  C:\Users\circleci\project\env\lib\logging\__init__.py:225: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=2968, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    _lock.acquire()

test/test_internet.py::TestDatasetUtils::test_download_url_retry_http
  C:\Users\circleci\project\env\lib\logging\__init__.py:225: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=2332, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    _lock.acquire()

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  c:\users\circleci\project\torchvision\io\video.py:399: RuntimeWarning: Failed to open container for C:\Users\circleci\AppData\Local\Temp\tmpfarg_hmp.mp4; Caught error: [Errno 13] Permission denied: 'C:\\Users\\circleci\\AppData\\Local\\Temp\\tmpfarg_hmp.mp4'
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  C:\Users\circleci\project\env\lib\site-packages\torch\autocast_mode.py:162: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
    warnings.warn('User provided device_type of \'cuda\', but CUDA is not available. Disabling')

test/test_models.py::test_inception_v3_eval

unittest_windows_cpu_py3.8 (4/5)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

c:\users\circleci\project\torchvision\io\video....\\circleci\\AppData\\Local\\Temp\\tmp697t99pp.mp4'

test/test_image.py::test_decode_png[L-ImageReadMode.GRAY-palette_pytorch.png]
test/test_image.py::test_decode_png[RGB-ImageReadMode.RGB-palette_pytorch.png]
  C:\Users\circleci\project\env\lib\site-packages\PIL\Image.py:975: UserWarning: Palette images with Transparency expressed in bytes should be converted to RGBA images
    warnings.warn(

test/test_internet.py::TestDatasetUtils::test_download_url_dispatch_download_from_google_drive
  C:\Users\circleci\project\env\lib\unittest\mock.py:2030: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=2932, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    setattr(_type, entry, MagicProxy(entry, self))

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  c:\users\circleci\project\torchvision\io\video.py:399: RuntimeWarning: Failed to open container for C:\Users\circleci\AppData\Local\Temp\tmp697t99pp.mp4; Caught error: [Errno 13] Permission denied: 'C:\\Users\\circleci\\AppData\\Local\\Temp\\tmp697t99pp.mp4'
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  C:\Users\circleci\project\env\lib\site-packages\torch\autocast_mode.py:162: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
    warnings.warn('User provided device_type of \'cuda\', but CUDA is not available. Disabling')

test/test_models.py::test_inception_v3_eval

unittest_windows_cpu_py3.6 (5/5)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

c:\users\circleci\project\torchvision\io\video....\\circleci\\AppData\\Local\\Temp\\tmp770ngiw8.mp4'

test/test_internet.py::TestDatasetUtils::test_download_url_dispatch_download_from_google_drive
  C:\Users\circleci\project\env\lib\unittest\mock.py:1857: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=2780, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    setattr(_type, entry, MagicProxy(entry, self))

test/test_io.py::TestVideo::test_read_partial_video[1-0]
  c:\users\circleci\project\torchvision\io\video.py:150: ResourceWarning: unclosed <ssl.SSLSocket [closed] fd=2264, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0>
    gc.collect()

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  c:\users\circleci\project\torchvision\io\video.py:399: RuntimeWarning: Failed to open container for C:\Users\circleci\AppData\Local\Temp\tmp770ngiw8.mp4; Caught error: [Errno 13] Permission denied: 'C:\\Users\\circleci\\AppData\\Local\\Temp\\tmp770ngiw8.mp4'
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  C:\Users\circleci\project\env\lib\site-packages\torch\autocast_mode.py:162: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
    warnings.warn('User provided device_type of \'cuda\', but CUDA is not available. Disabling')

test/test_models.py::test_inception_v3_eval

---

🚧 1 ongoing upstream failure:

These were probably caused by upstream breakages that are not fixed yet.

• unittest_onnx since Nov 30 (65cdaea)
  • 🔁 rerun

---

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

[pmeier]

This is only kept for BC, because previously pip install torchvision[scipy] would also install scipy. Happy to remove it in case we don't want to keep BC here.