Add streamlit UI to test the embeddings #108
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
weiji14
added a commit
that referenced
this pull request
Jan 11, 2024
* Make the clay model work on lightning cli * Update Mean & std for larger chunk of data * Update model & trainer to work on multi gpu setup * Fix logging images to wandb * Add streamlit UI to test the embeddings (#108) UI supports vector search & arithmetic for embeddings generated from CLAY. * Use rasterio.plot to show images & filter by year, tile & idx * Remove redundant code to move tensors across device, use auto accelerator & device * Rename filter variable to tile_filter Avoid the use of a variable name that is the same as Python's built-in filter function. Also wrap the where clause statement to under 88 characters. * Remove some more .to(device) calls --------- Co-authored-by: SRM <soumya@developmentseed.org> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>
yellowcap
added a commit
that referenced
this pull request
Jan 16, 2024
* Make the clay model work on lightning cli * Update Mean & std for larger chunk of data * Update model & trainer to work on multi gpu setup * Fix logging images to wandb * Add specification docs * Add trainer details * Add streamlit UI to test the embeddings (#108) UI supports vector search & arithmetic for embeddings generated from CLAY. --------- Co-authored-by: SRM <soumya@developmentseed.org> * Use rasterio.plot to show images & filter by year, tile & idx * Fix half:0 error by not explicitly setting float16 to cube[pixels] * Add documentation to create the pixel reconstruction from the model * Add documention explaining location embeddings * Add shuffle as an argument to CLAY * Add documentation to showcase interpolation between images in embedding space * Adapt data pipeline to accept custom date range and local path for storing tiles * Add example script to run clay over custom AOI. * add sections to TOC * basic use from root README * Install from root REAMDE * how to build/preview docs * more narrative on release notes * more narrative on intro * rename intro to index, better SEO * reorder for clarity * fixed links * fixed links * renamed file for clarity * added links and consistent title * typo * Closes #64, as much as I can imagine. * results explanation * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * shorter line * Making ruff happy * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Making ruff happy * Moved shuffle to an optional keyword. CHECK * Recovered from 0145e55 * Clearing outputs for notebooks. Should not merge into main been PR is squashed. * tested to run * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * tested to run * Update docs/_toc.yml Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * assume root folder Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * Update src/model_clay.py Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * Update src/model_clay.py Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * Update src/model_clay.py Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * Update docs/README Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * Update docs/installation.md Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> * Let pre-commit enforce 512KB file size limit in entire repo Make sure that large files don't get commited to git. Xref https://github.com/pre-commit/pre-commit-hooks/tree/v4.5.0#check-added-large-files * Remove extra args.update lines * Set execute_notebooks to cache Don't force running all notebooks on the docs build, only run those that don't have output cells already. * Remove PNG files in docs/assets, replace with web version Hosting the PNG images directly via GitHub's UI, instead of in the git repo. * Only build files in toc and rename docs/README to docs/README.md Don't build files that aren't in the Table of Contents (https://jupyterbook.org/en/stable/structure/configure.html#disable-building-files-that-arent-in-the-table-of-contents). Can then rename README to README.md without raising a warning like `WARNING: document isn't included in any toctree`. * Use huggingface ckpt, fix header, and rm sample.gif in interpolation nb Some minor changes to the clay-v0-interpolation.ipynb file, and remove the large sample.gif file. Also gitignoring .gif and .png files. * Fix some link typos and edit wording on main index page * Remove run_region notebook Will be handled in #122 * Fix typos in model specification Should be 10 bands of Sentinel-2, not 13. * Rename tutorial notebooks * Exclude tutorial notebooks from execution during build. * Make tutorial title consistent --------- Co-authored-by: SRM <soumya@developmentseed.org> Co-authored-by: Soumya Ranjan Mohanty <vnn.soumya2@gmail.com> Co-authored-by: Daniel Wiesmann <daniel@wiesmann.pt> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com> Co-authored-by: Daniel Wiesmann <yellowcap@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.