Skip to content

google drive downloading errors #688

@wyli

Description

@wyli

Describe the bug
./modules/tcia_csv_processing.ipynb

[2022-05-05T00:11:42.231Z] Running ./modules/tcia_csv_processing.ipynb
[2022-05-05T00:11:42.231Z] Checking PEP8 compliance...
[2022-05-05T00:11:42.795Z] Running notebook...
[2022-05-05T00:11:43.726Z] /opt/conda/lib/python3.8/site-packages/papermill/iorw.py:58: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.
[2022-05-05T00:11:43.726Z]   from pyarrow import HadoopFileSystem
[2022-05-05T00:11:55.776Z] 
Executing:   0%|          | 0/18 [00:00<?, ?cell/s]
Executing:   6%|▌         | 1/18 [00:01<00:26,  1.54s/cell]
Executing:  17%|█▋        | 3/18 [00:06<00:32,  2.16s/cell]
Executing:  28%|██▊       | 5/18 [00:08<00:20,  1.59s/cell]
Executing:  61%|██████    | 11/18 [00:11<00:05,  1.19cell/s]
Executing:  61%|██████    | 11/18 [00:12<00:07,  1.11s/cell]
[2022-05-05T00:11:55.776Z] Traceback (most recent call last):
[2022-05-05T00:11:55.776Z]   File "/opt/conda/bin/papermill", line 8, in <module>
[2022-05-05T00:11:55.776Z]     sys.exit(papermill())
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
[2022-05-05T00:11:55.776Z]     return self.main(*args, **kwargs)
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1053, in main
[2022-05-05T00:11:55.776Z]     rv = self.invoke(ctx)
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
[2022-05-05T00:11:55.776Z]     return ctx.invoke(self.callback, **ctx.params)
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 754, in invoke
[2022-05-05T00:11:55.776Z]     return __callback(*args, **kwargs)
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/click/decorators.py", line 26, in new_func
[2022-05-05T00:11:55.776Z]     return f(get_current_context(), *args, **kwargs)
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/papermill/cli.py", line 250, in papermill
[2022-05-05T00:11:55.776Z]     execute_notebook(
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/papermill/execute.py", line 122, in execute_notebook
[2022-05-05T00:11:55.776Z]     raise_for_execution_errors(nb, output_path)
[2022-05-05T00:11:55.776Z]   File "/opt/conda/lib/python3.8/site-packages/papermill/execute.py", line 234, in raise_for_execution_errors
[2022-05-05T00:11:55.776Z]     raise error
[2022-05-05T00:11:55.776Z] papermill.exceptions.PapermillExecutionError: 
[2022-05-05T00:11:55.776Z] ---------------------------------------------------------------------------
[2022-05-05T00:11:55.776Z] Exception encountered at "In [5]":
[2022-05-05T00:11:55.776Z] ---------------------------------------------------------------------------
[2022-05-05T00:11:55.776Z] RuntimeError                              Traceback (most recent call last)
[2022-05-05T00:11:55.776Z] Input In [5], in <cell line: 1>()
[2022-05-05T00:11:55.776Z] ----> 1 dataset = TCIADataset(
[2022-05-05T00:11:55.776Z]       2     url="https://drive.google.com/uc?id=1HQ7BZvBr1edmi8HIwdG5KBweXWms5Uzk",
[2022-05-05T00:11:55.776Z]       3     filename=os.path.join(root_dir, "ISPY1_Combined.csv"),
[2022-05-05T00:11:55.776Z]       4     img_dir=os.path.join(root_dir, "tcia_images"),
[2022-05-05T00:11:55.776Z]       5     row_indices=[[0, 8]],
[2022-05-05T00:11:55.776Z]       6     transform=LoadImaged(keys="image"),
[2022-05-05T00:11:55.776Z]       7 )
[2022-05-05T00:11:55.776Z] 
[2022-05-05T00:11:55.776Z] Input In [4], in TCIADataset.__init__(self, url, filename, img_dir, row_indices, col_names, col_types, col_groups, transform, **kwargs)
[2022-05-05T00:11:55.776Z]      51 for u, f in zip(url, filename):
[2022-05-05T00:11:55.776Z]      52     if not os.path.exists(f):
[2022-05-05T00:11:55.776Z] ---> 53         download_url(url=u, filepath=f)
[2022-05-05T00:11:55.776Z]      55 super().__init__(
[2022-05-05T00:11:55.776Z]      56     src=filename,
[2022-05-05T00:11:55.776Z]      57     row_indices=row_indices,
[2022-05-05T00:11:55.776Z]    (...)
[2022-05-05T00:11:55.776Z]      62     kwargs=kwargs,
[2022-05-05T00:11:55.776Z]      63 )
[2022-05-05T00:11:55.776Z]      64 self.img_dir = img_dir
[2022-05-05T00:11:55.776Z] 
[2022-05-05T00:11:55.776Z] File /home/jenkins/agent/workspace/Monai-notebooks/MONAI/monai/apps/utils.py:196, in download_url(url, filepath, hash_val, hash_type, progress)
[2022-05-05T00:11:55.776Z]     194     _download_with_progress(url, tmp_name, progress=progress)
[2022-05-05T00:11:55.776Z]     195 if not tmp_name.exists():
[2022-05-05T00:11:55.776Z] --> 196     raise RuntimeError(
[2022-05-05T00:11:55.777Z]     197         f"Download of file from {url} to {filepath} failed due to network issue or denied permission."
[2022-05-05T00:11:55.777Z]     198     )
[2022-05-05T00:11:55.777Z]     199 file_dir = filepath.parent
[2022-05-05T00:11:55.777Z]     200 if file_dir:
[2022-05-05T00:11:55.777Z] 
[2022-05-05T00:11:55.777Z] RuntimeError: Download of file from https://drive.google.com/uc?id=1HQ7BZvBr1edmi8HIwdG5KBweXWms5Uzk to /tmp/tmpvlnwc299/ISPY1_Combined.csv failed due to network issue or denied permission.

./deepgrow/ignite/inference.ipynb

[2022-05-05T01:38:05.853Z] Running ./deepgrow/ignite/inference.ipynb
[2022-05-05T01:38:05.853Z] Checking PEP8 compliance...
[2022-05-05T01:38:06.782Z] Running notebook...
[2022-05-05T01:38:06.782Z] Before:
[2022-05-05T01:38:06.782Z]     "max_epochs = 1\n",
[2022-05-05T01:38:06.782Z] After:
[2022-05-05T01:38:06.782Z]     "max_epochs = 1\n",
[2022-05-05T01:38:07.713Z] /opt/conda/lib/python3.8/site-packages/papermill/iorw.py:58: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.
[2022-05-05T01:38:07.713Z]   from pyarrow import HadoopFileSystem
[2022-05-05T01:38:27.054Z] 
Executing:   0%|          | 0/10 [00:00<?, ?cell/s]
Executing:  10%|█         | 1/10 [00:01<00:13,  1.51s/cell]
Executing:  30%|███       | 3/10 [00:05<00:13,  1.90s/cell]
Executing:  40%|████      | 4/10 [00:08<00:13,  2.25s/cell]
Executing:  60%|██████    | 6/10 [00:15<00:11,  2.78s/cell]
Executing:  70%|███████   | 7/10 [00:17<00:08,  2.76s/cell]
Executing:  90%|█████████ | 9/10 [00:18<00:01,  1.70s/cell]
Executing:  90%|█████████ | 9/10 [00:19<00:02,  2.13s/cell]
[2022-05-05T01:38:27.054Z] Traceback (most recent call last):
[2022-05-05T01:38:27.054Z]   File "/opt/conda/bin/papermill", line 8, in <module>
[2022-05-05T01:38:27.054Z]     sys.exit(papermill())
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
[2022-05-05T01:38:27.054Z]     return self.main(*args, **kwargs)
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1053, in main
[2022-05-05T01:38:27.054Z]     rv = self.invoke(ctx)
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
[2022-05-05T01:38:27.054Z]     return ctx.invoke(self.callback, **ctx.params)
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 754, in invoke
[2022-05-05T01:38:27.054Z]     return __callback(*args, **kwargs)
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/click/decorators.py", line 26, in new_func
[2022-05-05T01:38:27.054Z]     return f(get_current_context(), *args, **kwargs)
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/papermill/cli.py", line 250, in papermill
[2022-05-05T01:38:27.054Z]     execute_notebook(
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/papermill/execute.py", line 122, in execute_notebook
[2022-05-05T01:38:27.054Z]     raise_for_execution_errors(nb, output_path)
[2022-05-05T01:38:27.054Z]   File "/opt/conda/lib/python3.8/site-packages/papermill/execute.py", line 234, in raise_for_execution_errors
[2022-05-05T01:38:27.054Z]     raise error
[2022-05-05T01:38:27.054Z] papermill.exceptions.PapermillExecutionError: 
[2022-05-05T01:38:27.054Z] ---------------------------------------------------------------------------
[2022-05-05T01:38:27.054Z] Exception encountered at "In [5]":
[2022-05-05T01:38:27.054Z] ---------------------------------------------------------------------------
[2022-05-05T01:38:27.054Z] ValueError                                Traceback (most recent call last)
[2022-05-05T01:38:27.054Z] Input In [5], in <cell line: 3>()
[2022-05-05T01:38:27.054Z]       1 # Evaluation
[2022-05-05T01:38:27.054Z]       2 model_path = 'deepgrow_2d.ts'
[2022-05-05T01:38:27.054Z] ----> 3 model = jit.load(model_path)
[2022-05-05T01:38:27.054Z]       4 model.cuda()
[2022-05-05T01:38:27.054Z]       5 model.eval()
[2022-05-05T01:38:27.054Z] 
[2022-05-05T01:38:27.054Z] File /opt/conda/lib/python3.8/site-packages/torch/jit/_serialization.py:151, in load(f, map_location, _extra_files)
[2022-05-05T01:38:27.054Z]     149 if isinstance(f, string_classes):
[2022-05-05T01:38:27.054Z]     150     if not os.path.exists(f):  # type: ignore[type-var]
[2022-05-05T01:38:27.054Z] --> 151         raise ValueError("The provided filename {} does not exist".format(f))  # type: ignore[str-bytes-safe]
[2022-05-05T01:38:27.054Z]     152     if os.path.isdir(f):
[2022-05-05T01:38:27.054Z]     153         raise ValueError("The provided filename {} is a directory".format(f))  # type: ignore[str-bytes-safe]
[2022-05-05T01:38:27.054Z] 
[2022-05-05T01:38:27.054Z] ValueError: The provided filename deepgrow_2d.ts does not exist
[2022-05-05T01:38:27.054Z] 

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions