Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
3677dac
add the initial file for endoscopy inbody classification tutorial
binliunls Sep 28, 2022
90516e5
Merge branch 'Project-MONAI:main' into 960-endoscopy-inbody-classific…
binliunls Sep 29, 2022
99f10a1
Merge branch 'Project-MONAI:main' into 960-endoscopy-inbody-classific…
binliunls Sep 29, 2022
58db22e
add the first version of endoscopy inbody classification tutorial
binliunls Sep 29, 2022
bd1deac
change the import parts
binliunls Sep 29, 2022
a169e00
build the whole pipeline of endoscopy inbody classification
binliunls Sep 30, 2022
0f399c7
update information about endoscopy inbody classification
binliunls Sep 30, 2022
1673078
update the data download part
binliunls Sep 30, 2022
f26c5fd
fix format problems
binliunls Sep 30, 2022
d8d0692
fix format issues
binliunls Sep 30, 2022
f87b04d
fix format issue
binliunls Sep 30, 2022
cee0e29
update the model loading part
binliunls Sep 30, 2022
d38d642
Merge branch 'main' into 960-endoscopy-inbody-classification-tutorial
wyli Oct 11, 2022
8481d79
Merge branch 'Project-MONAI:main' into 960-endoscopy-inbody-classific…
binliunls Oct 12, 2022
4bda14f
add a dataset for checking data
binliunls Oct 12, 2022
3ddc048
Merge branch 'Project-MONAI:main' into 960-endoscopy-inbody-classific…
binliunls Oct 13, 2022
04cd714
change bundle name in this tutorial
binliunls Oct 13, 2022
2760114
change inbody classification tutorial name
binliunls Oct 13, 2022
3745733
Merge branch 'Project-MONAI:main' into 960-endoscopy-inbody-classific…
binliunls Oct 13, 2022
b9e56cf
fix inbody classification code format
binliunls Oct 13, 2022
8c78a89
Merge branch 'Project-MONAI:main' into 960-endoscopy-inbody-classific…
binliunls Oct 14, 2022
98cc0a7
add printouts of train and validation datasets
binliunls Oct 14, 2022
cc90e20
update endoscopic bundle
binliunls Oct 14, 2022
061bcbd
update video seg tutorial with new endoscopic_tool_bundle
binliunls Oct 14, 2022
bb722dd
update endoscopic inbody classification tutorial name
binliunls Oct 14, 2022
9c6acc5
update data url
wyli Oct 14, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -204,6 +204,8 @@ This tutorial shows a straightforward ensemble application to instruct users on
**computer_assisted_intervention**
#### [video segmentation](./computer_assisted_intervention/video_seg.ipynb)
This tutorial shows how to train a surgical tool segmentation model to locate tools in a given image. In addition, it also builds an example pipeline of an end-to-end video tool segmentation, with video input and video output.
#### [endoscopic inbody classification](./computer_assisted_intervention/endoscopic_inbody_classification.ipynb)
Tutorial to show the pipeline of fine tuning an endoscopic inbody classification model based on a corresponding pretrained bundle in monai model zoo.

**modules**
#### [bundle](./bundle)
Expand Down
530 changes: 530 additions & 0 deletions computer_assisted_intervention/endoscopic_inbody_classification.ipynb

Large diffs are not rendered by default.

8 changes: 5 additions & 3 deletions computer_assisted_intervention/video_seg.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -233,7 +233,9 @@
"\n",
"For the dataset, we use two instances of `VideoFileDataset`, one for the input video and the other for the ground truth segmentations. We create a `CombinedVidDataset` that enables us to iterate across these two at the same time.\n",
"\n",
"The data loader is the standard."
"The data loader is a thread dataloader, which is able to accelerate inference and training.\n",
"\n",
"When videos cannot be opened by `VideoFileDataset`, check if python-opencv library is installed with ffmpeg. If not, please uninstall and reinstall python-opencv in your environment."
]
},
{
Expand Down Expand Up @@ -373,7 +375,7 @@
"There is a pretrained bundle for surgical tool segmentation task in the MONAI model-zoo, the model can be automatically downloaded and loaded to the network by adding codes to the block below:\n",
"```\n",
"pretrained_weights = monai.bundle.load(\n",
" name=\"surgical_tool_segmentation\", bundle_dir=\"./\", version=\"0.2.0\"\n",
" name=\"endoscopic_tool_segmentation\", bundle_dir=\"./\", version=\"0.2.0\"\n",
")\n",
"model.load_state_dict(pretrained_weights)\n",
"```"
Expand Down Expand Up @@ -505,7 +507,7 @@
"source": [
"## Generating video\n",
"\n",
"A video with masks will be generated by using the trained model to predict tool segmentation results."
"A video with masks will be generated by using the trained model to predict tool segmentation results. If cannot open video in notebook, please check saved video in local specified directory."
]
},
{
Expand Down