-
Notifications
You must be signed in to change notification settings - Fork 40
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add notebooks to show internal working on CLAY models #129
Closed
Closed
Changes from all commits
Commits
Show all changes
20 commits
Select commit
Hold shift + click to select a range
1009697
Make the clay model work on lightning cli
bcb1a06
Update Mean & std for larger chunk of data
1a40f56
Update model & trainer to work on multi gpu setup
ced883f
Fix logging images to wandb
071a178
Add specification docs
8498119
Add trainer details
6d431fc
Add streamlit UI to test the embeddings (#108)
srmsoumya 454cc1c
Use rasterio.plot to show images & filter by year, tile & idx
d96a638
Merge main with ddp
785e7d4
Merge with ddp
e926b46
Fix half:0 error by not explicitly setting float16 to cube[pixels]
3ddd4ad
Add documentation to create the pixel reconstruction from the model
4b5712d
Add documention explaining location embeddings
a597347
Add shuffle as an argument to CLAY
f286205
Add documentation to showcase interpolation between images in embeddi…
484328b
Add notebook to visualize the embedding space of model
c503bc0
Fix merge conflicts with main
f7da506
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 03f0679
Add documentation for partial inputs to the model
79d23b0
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Large diffs are not rendered by default.
Oops, something went wrong.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@weiji14 , JupyterBook is executing the notebook every time we make a change, which results in a new version of the
sample.gif
file being saved.This is increasing the repository size unnecessarily. How can we execute the notebooks only when necessary to avoid this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Aren't we gitignoring *.git files here?
model/.gitignore
Line 21 in ae70345
There's a way to prevent execution of certain notebooks following https://jupyterbook.org/en/stable/content/execute.html#exclude-files-from-execution. We could provide a list of notebooks that we know would take a lot of time or resources to run.