[Tutorials] Anomaly Detection example MVTec PatchSVDD #203

mansishr · 2021-10-07T04:53:51Z

In this PR, the problem of image anomaly detection and segmentation is addressed. Anomaly detection involves making a binary decision as to whether an input image contains an anomaly, and anomaly segmentation aims to locate the anomaly on the pixel level. The deep learning variant of support vector data description (SVDD) algorithm is extended to the patch-based method using self-supervised learning. This extension enables anomaly segmentation and improves detection performance. Industrial dataset is used for this tutorial - MVTec AD dataset.

mansishr · 2021-10-07T05:03:06Z

Jenkins please retry a build

alexey-gruzdev · 2021-10-07T07:20:05Z

@mansishr can we add a README.md describing the example and steps to run it? Like it was done in MNIST for example?

mansishr · 2021-10-07T16:29:56Z

Jenkins please retry a build

mansishr · 2021-10-11T06:01:26Z

Jenkins please retry a build

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/envoy/mvtec_shard_descriptor.py

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/README.md

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb

mansishr · 2021-10-18T16:53:56Z

Jenkins please retry a build

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/README.md

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/envoy/mvtec_shard_descriptor.py

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/data_transf.py

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/envoy/mvtec_shard_descriptor.py

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/envoy/shard_config.yaml

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/envoy/mvtec_shard_descriptor.py

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb

aleksandr-mokrov · 2021-11-02T20:33:39Z

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb

+    "                     device='device', optimizer='optimizer')     \n",
+    "\n",
+    "def train(model, train_loader, optimizer, device, some_parameter=None):\n",
+    "    if not torch.cuda.is_available():\n",


This example doesn't work if the director and the workspace are located on different services or in different virtual environments, because serialisable objects use requirements (torch, ngtpy, at least) that are missing on the director.

@aleksandr-mokrov how should I ensure this?

aleksandr-mokrov · 2021-11-02T20:40:29Z

#206 was merged into develop. Can you rewrite ShardDescriptor using new ShardDescriptor and ShardDataset (https://github.com/intel/openfl/blob/develop/openfl/interface/interactive_api/shard_descriptor.py) like in other tutorials: https://github.com/intel/openfl/blob/develop/openfl-tutorials/interactive_api/PyTorch_Kvasir_UNet, https://github.com/intel/openfl/tree/develop/openfl-tutorials/interactive_api/PyTorch_Market_Re-ID, https://github.com/intel/openfl/tree/develop/openfl-tutorials/interactive_api/PyTorch_TinyImageNet, https://github.com/intel/openfl/tree/develop/openfl-tutorials/interactive_api/Tensorflow_MNIST?

openfl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/README.md

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb

alexey-gruzdev · 2021-11-09T07:36:01Z

@mansishr Can we rebase this branch and get all latest develop updates into it

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb

alexey-gruzdev · 2021-11-17T11:42:33Z

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb

+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "fed_dataset = MVTecSD(train_bs=64, val_bs=64)\n",


This cell producing a bunch of output inside Jupyter notebook, could we avoid this?

alexey-gruzdev · 2021-11-17T11:44:40Z

@mansishr I was able to run the example with director, 1 envoy and API layer on 3 different machines. However, the code of the notebook must be simplified a lot.

alexey-gruzdev · 2021-11-17T11:48:04Z

Also, MVTec dataset once it downloaded has some troubles with permission right. I run an envoy, and after I stopped it, I couldn't remove the data which this envoy downloaded, which would be confusing for end users.

* Fix envoy config in Histology tutorial * Fix listen_host setting in director config

* Set values to default and additional checks if they are unfilled * flake8 * flake8 * Handle exception from get_cuda_version * Handle exception from get_cuda_version * Reduce line's length

* update tutorials configs * Update start_envoy.sh * return listen_host variable back * make .sh files executable Co-authored-by: katerina-merkulova <ekaterina1.merkulova@intel.com> Co-authored-by: Ekaterina Merkulova <87072230+katerina-merkulova@users.noreply.github.com>

…nom_det_tut

alexey-gruzdev · 2021-12-02T21:32:46Z

@mansishr I am closing this due to unnecessary artefacts after rebase, please create a new branch from fresh develop and put on top your changes and re-create the PR.

alexey-gruzdev requested review from aleksandr-mokrov, dmitryagapov and igor-davidyuk October 7, 2021 07:18

alexey-gruzdev changed the title ~~anomaly detection example~~ [Tutorials] Anomaly Detection example MVTec PatchSVDD Oct 7, 2021

alexey-gruzdev added the sample label Oct 7, 2021

mansishr force-pushed the anom_det_tut branch from a9d14c5 to 8e27dd8 Compare October 11, 2021 05:58

dmitryagapov reviewed Oct 12, 2021

View reviewed changes

itrushkin suggested changes Oct 21, 2021

View reviewed changes

alexey-gruzdev added this to the v1.2.1 milestone Nov 1, 2021

aleksandr-mokrov reviewed Nov 2, 2021

View reviewed changes

itrushkin suggested changes Nov 9, 2021

View reviewed changes

mansishr added 10 commits November 10, 2021 01:08

anomaly detection example

9ed6a38

added README

30b0e43

download data func changed

7d78825

removed linter errors

7b1f829

fixed linter errors

1fa372d

fixes in shard descriptor

37bd6a9

shard desc fixes

d424c5b

added bal acc score

697f71b

corrected linters

4d5f8da

rebased to 1.2

50f1c64

mansishr force-pushed the anom_det_tut branch from 74e824f to 50f1c64 Compare November 11, 2021 08:08

split into shard dataset and descriptor

f74f04a

alexey-gruzdev reviewed Nov 17, 2021

View reviewed changes

...fl-tutorials/interactive_api/PyTorch_MVTec_PatchSVDD/workspace/PatchSVDD_with_Director.ipynb Show resolved Hide resolved

alexey-gruzdev reviewed Nov 17, 2021

View reviewed changes

mansishr and others added 22 commits November 18, 2021 19:26

restructured notebook

e493721

Fix envoy config in Histology tutorial (#243)

77fdcad

* Fix envoy config in Histology tutorial * Fix listen_host setting in director config

Set values to default and additional checks if they are unfilled (#244)

c021196

* Set values to default and additional checks if they are unfilled * flake8 * flake8 * Handle exception from get_cuda_version * Handle exception from get_cuda_version * Reduce line's length

Cleaning openfl-tutorials notebooks

91b6d0d

@ViktoriiaRomanova has signed the CLA from Pull Request #247

3f8d2a8

Fix B018 error for latest flake8-bugbear (#249)

c33f7bb

change train function

7e376cf

anomaly detection example

ec8a650

added README

498bc0e

download data func changed

b8b240b

removed linter errors

ced1c6a

fixed linter errors

019dec5

fixes in shard descriptor

4860a25

shard desc fixes

6f28938

added bal acc score

7f73702

corrected linters

96a1da4

rebased to 1.2

919d2dd

split into shard dataset and descriptor

61f29b6

restructured notebook

31347e6

change train function

61da6a8

Merge branch 'anom_det_tut' of https://github.com/intel/openfl into a…

c7182df

…nom_det_tut

alexey-gruzdev closed this Dec 2, 2021

github-actions bot locked and limited conversation to collaborators Dec 2, 2021

alexey-gruzdev deleted the anom_det_tut branch December 3, 2021 06:54

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Tutorials] Anomaly Detection example MVTec PatchSVDD #203

[Tutorials] Anomaly Detection example MVTec PatchSVDD #203

mansishr commented Oct 7, 2021 •

edited

mansishr commented Oct 7, 2021

alexey-gruzdev commented Oct 7, 2021

mansishr commented Oct 7, 2021

mansishr commented Oct 11, 2021

mansishr commented Oct 18, 2021

aleksandr-mokrov Nov 2, 2021

mansishr Nov 11, 2021

aleksandr-mokrov commented Nov 2, 2021

alexey-gruzdev commented Nov 9, 2021

alexey-gruzdev Nov 17, 2021

alexey-gruzdev commented Nov 17, 2021

alexey-gruzdev commented Nov 17, 2021

alexey-gruzdev commented Dec 2, 2021

[Tutorials] Anomaly Detection example MVTec PatchSVDD #203

[Tutorials] Anomaly Detection example MVTec PatchSVDD #203

Conversation

mansishr commented Oct 7, 2021 • edited

mansishr commented Oct 7, 2021

alexey-gruzdev commented Oct 7, 2021

mansishr commented Oct 7, 2021

mansishr commented Oct 11, 2021

mansishr commented Oct 18, 2021

aleksandr-mokrov Nov 2, 2021

Choose a reason for hiding this comment

mansishr Nov 11, 2021

Choose a reason for hiding this comment

aleksandr-mokrov commented Nov 2, 2021

alexey-gruzdev commented Nov 9, 2021

alexey-gruzdev Nov 17, 2021

Choose a reason for hiding this comment

alexey-gruzdev commented Nov 17, 2021

alexey-gruzdev commented Nov 17, 2021

alexey-gruzdev commented Dec 2, 2021

mansishr commented Oct 7, 2021 •

edited