Skip to content
This repository was archived by the owner on Feb 7, 2025. It is now read-only.

47 - tutorial ldm 3d#63

Merged
Warvito merged 18 commits intomainfrom
47-tutorial-ldm-3D
Dec 10, 2022
Merged

47 - tutorial ldm 3d#63
Warvito merged 18 commits intomainfrom
47-tutorial-ldm-3D

Conversation

@SANCHES-Pedro
Copy link
Copy Markdown
Contributor

Create a LDM 3D tutorial.

I'm thinking about using the BRATs data.

I copied over some WIP from the 2D version which is another pull request (so it might make a weird commit mix).

@SANCHES-Pedro
Copy link
Copy Markdown
Contributor Author

SANCHES-Pedro commented Nov 28, 2022

As of now,

The autoencoder and diffusion models are only being trained for around 30 epochs, so the results are not great (see figure attached). I guess that's enough for a tutorial (??)

Also, I didn't include validation because it looked cleaner and more understandable to me (and we are not even close to overfitting).

dlm_3d_results

Would rather train for longer and include validation for better results? I guess it's a trade-off between having some very quick results or better generation.

Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
@JessyD
Copy link
Copy Markdown
Member

JessyD commented Dec 2, 2022

The tutorial looks very good. I agree with the comment that for the tutorial the generated images looks good enough. @Warvito what is your opinion?

One last point, could you remove all the files that are not part of the 3d_ldm tutorial from the branch so that we can merge it without conflicts?

Copy link
Copy Markdown
Collaborator

@Warvito Warvito left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done, @SANCHES-Pedro The tutorial looks great! I added a few comments regarding the format of the code, some comments left, and regarding the updated networks. Please, perform the merge of the current main into this branch and update the networks initialization and set precommit in your local repo.

Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
Comment thread tutorials/generative/3d_ldm/3d_ldm_tutorial.py Outdated
@Warvito Warvito linked an issue Dec 5, 2022 that may be closed by this pull request
Conflicts:
	generative/networks/nets/patchgan_discriminator.py
	tests/test_latent_diffusion_inferer.py
	tutorials/generative/2d_ddpm/2d_ddpm_compare_schedulers.ipynb
	tutorials/generative/2d_ldm/2d_ldm_tutorial.ipynb
	tutorials/generative/2d_ldm/2d_ldm_tutorial.py
	tutorials/generative/2d_vqgan/2d_vqgan_tutorial.ipynb
	tutorials/generative/2d_vqvae/2d_vqvae_tutorial.ipynb
	tutorials/generative/2d_vqvae/2d_vqvae_tutorial.py
@SANCHES-Pedro
Copy link
Copy Markdown
Contributor Author

Thanks @Warvito and @JessyD for the nice comments. I've solved all your requests and merge the main into this branch and used the latest implementations (LDM inferer) in the tutorial.

@SANCHES-Pedro SANCHES-Pedro requested a review from Warvito December 5, 2022 17:56
Copy link
Copy Markdown
Collaborator

@Warvito Warvito left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks great, @SANCHES-Pedro ! Well done! I will remove the change to the VQGAN tutorial and perform the merge.

Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
@Warvito Warvito merged commit 870706f into main Dec 10, 2022
@Warvito Warvito deleted the 47-tutorial-ldm-3D branch December 12, 2022 19:30
@Warvito Warvito restored the 47-tutorial-ldm-3D branch December 12, 2022 19:30
@Warvito Warvito deleted the 47-tutorial-ldm-3D branch December 12, 2022 19:31
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Create Latent Diffusion Model tutorial using 3D data

3 participants