Encoder and decoder as model parameters #98

BerndDoser · 2024-03-19T10:46:14Z

Allows control in config file without coding.

Example: Resnet-50

model:
  class_path: models.RotationalVariationalAutoencoderPower
  init_args:
    encoder:
      class_path: torchvision.models.ResNet
      init_args:
        block: torchvision.models.resnet.BasicBlock
        layers: [3, 4, 6, 3] # ResNet-50
        num_classes: 256
    decoder:
      class_path: models.ConvolutionalDecoder
    h_dim: 256
    z_dim: 3
    image_size: 91
    rotations: 36
    beta: 1.0e-3

https://lightning.ai/docs/pytorch/stable/cli/lightning_cli_advanced_3.html#multiple-models-and-or-datasets

…into encoder class

https://lightning.ai/docs/pytorch/stable/cli/lightning_cli_advanced_3.html#multiple-models-and-or-datasets

Set input_size as argument Test visual transformer

…iprocessing join - Serial execution of create_hips_tile using a single worker - Hipster pytest is using single worker, which is a workaround for HITS-AIN#93 - Use plain python multiprocessing library instead of torch version

- Updating nvidia-nvjitlink-cu12 (12.4.99 -> 12.4.127) - Updating matplotlib (3.8.3 -> 3.8.4) - Updating wandb (0.16.5 -> 0.16.6)

BerndDoser added 27 commits January 14, 2024 21:41

encoder and decoder as model parameter

bf67b25

test resnet encoder

8c789cc

model/data can be any subclass of the given class

7fe358e

https://lightning.ai/docs/pytorch/stable/cli/lightning_cli_advanced_3.html#multiple-models-and-or-datasets

Add convolutional encoder and decoder modules to models package

4a6b6ce

pass instanciated encoder/decoder to model

0c8107e

Update model classes to inherit from LightningModule, move fc1 layer …

21c6cad

…into encoder class

resnet test: add num_classes

59cacea

Import torchvision.models

26438b2

Add resnet exp config

0339445

remove uneeded subclass mode

11bea4a

https://lightning.ai/docs/pytorch/stable/cli/lightning_cli_advanced_3.html#multiple-models-and-or-datasets

vscode python autoImportCompletions

215929a

shapes config resnet-50 and visual transformer

994e123

Merge remote-tracking branch 'origin/main' into resnet

1706421

Merge branch 'main' into resnet

cd11080

cnn weights are not reproducible if default constructed

3a5a4dc

increase tolerance for catalog test t 0.2

aa4df21

set numpy and random seed for reproducible pytest

4cb8533

pytest use_deterministic_algorithms

a901d67

Add ConvolutionalDecoder256

9c62b3a

Set input_size as argument Test visual transformer

Update torch to version 2.2

184f4ad

Merge branch 'HITS-AIN:main' into resnet

d1a0862

Merge branch 'HITS-AIN:main' into resnet

f012f62

Add ConvolutionalDecoder224 and move fc3 into decoder

8b6e215

Remove alefragnani.numbered-bookmarks from recommendations

8238baf

Update test_hipster.py with new coordinates

bb7cbe4

Merge branch 'HITS-AIN:main' into resnet

4b165fe

BerndDoser self-assigned this Mar 19, 2024

This was linked to issues Mar 19, 2024

Evaluate deeper networks (ResNet, Transformer) to improve reconstruction details #72

Closed

Hipster unit test 'test_generate_hips' hangs at multiprocessing join #93

Closed

BerndDoser added 2 commits April 3, 2024 16:17

Merge branch 'HITS-AIN:main' into resnet

dc1ff5c

update poetry

6251bb3

- Updating nvidia-nvjitlink-cu12 (12.4.99 -> 12.4.127) - Updating matplotlib (3.8.3 -> 3.8.4) - Updating wandb (0.16.5 -> 0.16.6)

BerndDoser merged commit 5707b38 into HITS-AIN:main Apr 4, 2024
4 checks passed

BerndDoser deleted the resnet branch April 4, 2024 08:03

BerndDoser mentioned this pull request Apr 16, 2024

Add visual transformer #43

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Encoder and decoder as model parameters #98

Encoder and decoder as model parameters #98

BerndDoser commented Mar 19, 2024

Encoder and decoder as model parameters #98

Encoder and decoder as model parameters #98

Conversation

BerndDoser commented Mar 19, 2024