-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. Weβll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Release 2.2 #40
Release 2.2 #40
Commits on Dec 19, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 406d1a7 - Browse repository at this point
Copy the full SHA 406d1a7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5e05bf9 - Browse repository at this point
Copy the full SHA 5e05bf9View commit details
Commits on Dec 20, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 49ff515 - Browse repository at this point
Copy the full SHA 49ff515View commit details -
Configuration menu - View commit details
-
Copy full SHA for ffcfc48 - Browse repository at this point
Copy the full SHA ffcfc48View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e3f695 - Browse repository at this point
Copy the full SHA 2e3f695View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8e0b80c - Browse repository at this point
Copy the full SHA 8e0b80cView commit details
Commits on Apr 5, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 933ceeb - Browse repository at this point
Copy the full SHA 933ceebView commit details
Commits on Apr 6, 2022
-
Configuration menu - View commit details
-
Copy full SHA for c096c3e - Browse repository at this point
Copy the full SHA c096c3eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2bc5c29 - Browse repository at this point
Copy the full SHA 2bc5c29View commit details -
Configuration menu - View commit details
-
Copy full SHA for a02c212 - Browse repository at this point
Copy the full SHA a02c212View commit details
Commits on Apr 12, 2022
-
π¨πβ πβ¬οΈ Add geom_median to env, move favicon assets
ππ¨ Add Bioconda project url to setup.py π¨ Add toast when browser storage limits are reached (issue #11) :art::memo: Move favicon to automappa/assets :arrow_up::art: Add geom-median to environment.yml :art: Add get_clusters_geom_medians(...) to celery tasks :arrow_up::art: Bump VERSION to 2.2.0 :see_no_evil: Add data to .gitignore
Configuration menu - View commit details
-
Copy full SHA for ed8c0d1 - Browse repository at this point
Copy the full SHA ed8c0d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for f79dee0 - Browse repository at this point
Copy the full SHA f79dee0View commit details -
π¨ WIP addition of home tab, celery task-queue and services (redis/rabβ¦
β¦bitmq) for task-queue
Configuration menu - View commit details
-
Copy full SHA for 399c2f0 - Browse repository at this point
Copy the full SHA 399c2f0View commit details
Commits on Apr 14, 2022
-
π¨π WIP beginning of using postgres db
Add TODOs for WIP next steps... To be checked before merge into develop
Configuration menu - View commit details
-
Copy full SHA for 1df246b - Browse repository at this point
Copy the full SHA 1df246bView commit details
Commits on Apr 18, 2022
-
Refactor callback to viz DataTable and store samples-store State
π¨π Prevent samples-store data from being overwritten on initial callback π¨ samples-store data now persistent with local session π¨ Refactor some variables in MAG refinement π¨ WIP
Configuration menu - View commit details
-
Copy full SHA for 8a54e12 - Browse repository at this point
Copy the full SHA 8a54e12View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7b5f2d3 - Browse repository at this point
Copy the full SHA 7b5f2d3View commit details
Commits on Apr 20, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 991a45f - Browse repository at this point
Copy the full SHA 991a45fView commit details
Commits on Apr 21, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 3013b62 - Browse repository at this point
Copy the full SHA 3013b62View commit details
Commits on Apr 22, 2022
-
π¨ WIP now fetching all fileuploads and creating files datatable usingβ¦
β¦ MetaData.table.keys() Should now be able to π₯ remove all of the data stores to track the fileupload table_id... π₯
Configuration menu - View commit details
-
Copy full SHA for ea83e85 - Browse repository at this point
Copy the full SHA ea83e85View commit details -
Configuration menu - View commit details
-
Copy full SHA for d0f943f - Browse repository at this point
Copy the full SHA d0f943fView commit details -
π₯π³π¨π»π Add docker-services, rm environment/
π³π»ππ¨ Add docker-services: celery, flower, prometheus, grafana, redis, rabbitmq π¨π₯ Remove environment/*.env files. Consolidate to .env with corresponding prefixes π¨ Change pydantic models built on BaseSettings in automappa.settings to use only .env with env_prefix π¨π» Add working configuration of celery task-queue with redis backend and rabbitMQ broker π Add resources/references for misc. links used during debugging/troubleshooting β¬οΈ Add flower. Move celery[redis] to pip install section of environment.yml π¨ black formatting to serializers and change server.upload_folder root to server.root_upload_folder π¨ blak formatting to home.py
Configuration menu - View commit details
-
Copy full SHA for cd6d4f8 - Browse repository at this point
Copy the full SHA cd6d4f8View commit details -
Add dbc.Select to home for choosing metagenome annotations (WIP)
π¨ dbc.Select(...) are now populated with values from db tables ππ¨ Investigate whether serializer.get_uploaded_files_table() is functional (TODO) π³ Add commented out arg to create_engine(..., pre_pool_ping: Optional[bool]) and db settings π³ Add PRE_POOL_PING to .env
Configuration menu - View commit details
-
Copy full SHA for 6e92c24 - Browse repository at this point
Copy the full SHA 6e92c24View commit details -
π¨ WIP refinement page reading user uploaded/selected data
π₯ Remove (now deprecated) stores π¨ Add serialization of a hash-refinement table when hash-binning file is uploaded (respective to hash-binning) π¨ Remove --debug arg from parser. Move statement to .env (now handle read with automappa.settings.server.debug π₯ remove unused imports in index.py π¨ Move samples stores from home.py to index.py Add dbc.InputGroup(...) with selects for binning, markers and metagenome π¨ Add dbc.Button(...) to save table-ids in 'selected-tables-store' to be read from mag_refinement.py π¨π Continue refactor of get_scatterplot_2d(...) to use other embedding methods π¨ Add get_marker_symbols(...) to tasks.py and automappa.utils.markers (WIP currently being used to *expensively* generate symbols during 2d scatterplot creation
Configuration menu - View commit details
-
Copy full SHA for c6fd9da - Browse repository at this point
Copy the full SHA c6fd9daView commit details -
π¨ Move port and host argparse args to .env
π₯ Remove unused (commented out) argparse args π₯π¨π³ Update automappa-web service command to not use removed argparse args
Configuration menu - View commit details
-
Copy full SHA for dc5665d - Browse repository at this point
Copy the full SHA dc5665dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e54108c - Browse repository at this point
Copy the full SHA e54108cView commit details
Commits on Apr 23, 2022
-
π³πΊ provisioned Grafana within docker-compose.
Will still need to ensure this is working once celery tasks are implemented
Configuration menu - View commit details
-
Copy full SHA for d35a6cc - Browse repository at this point
Copy the full SHA d35a6ccView commit details
Commits on Apr 25, 2022
-
π¨π Connect mag_summary.layout callbacks to postgres db
ππ₯ Fix sankey diagram subsetting bug where selections would not render π¨ Change MAG-specific completeness/purity boxplot to barplot π¨ Rename save_to_db(...) to file_to_db(...) in serializer π¨ Add metric_barplot(...) func to automappa.utils.figures
Configuration menu - View commit details
-
Copy full SHA for ec9989b - Browse repository at this point
Copy the full SHA ec9989bView commit details -
π¨ Beginning of celery task-queue implementation
- π³π¨ Add mem_limit: 4GB to automappa-web service - π¨π Remove ability for user to navigate to other tabs when no data has been uploaded/selected - π¨ Disable 'Refine mags' button if data has not been selected - π¨ Add DataTable(...) to visualize the currently loaded datasets - π¨ Change server settings import so it is clear that the server setting are imported and not the server - π¨π₯ Silence numba and h5py loggers in mag_refinement.py (beginnings of celery task-queue tasks implementation) - π¨ Add logger to automappa.tasks - π Fix logger emitted message during refinement data serialization to postgres db
Configuration menu - View commit details
-
Copy full SHA for bbc93e9 - Browse repository at this point
Copy the full SHA bbc93e9View commit details
Commits on Apr 26, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 9917443 - Browse repository at this point
Copy the full SHA 9917443View commit details
Commits on May 5, 2022
-
π¨ WIP Working task-queue with scatterplot-2d views including embeddinβ¦
β¦g methods π¨π Need to replace kmers.embed(...) method in tasks.py to include n_jobs=1 when autometa 2.0.4 release is out π¨π₯¦ Add celeryconfig π¨π₯¦ Add working kmer freq. analysis parallelize pipeline for use in task-queue π¨ Add use of pydantic.BaseModel in models.py of SampleTables, KmerTable, AnnotationTable and misc. others (WIP) π¨ Add construction of SeqIO.SeqRecords when retrieving metagenome from table using new func, get_metagenome_seqrecords(...) π¨ Refactor get_contig_marker_counts(...) π¨ Refactor get_marker_symbols(...) in markers.py π¨π₯ Remove hard-coded values in automappa.utils.figures.get_embedding_traces_df(...) π¨ Parse selected_data_tables as SampleTables.parse_raw(selected_data_tables) for shared data π¨ Add tasks button to home.py π¨ Replace typehints for selected_data_tables to Json[SampleTables]
Configuration menu - View commit details
-
Copy full SHA for 731ffc1 - Browse repository at this point
Copy the full SHA 731ffc1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 977dbbf - Browse repository at this point
Copy the full SHA 977dbbfView commit details
Commits on May 16, 2022
-
π¨π WIP for fetching/visualizing data using services
π¨ Fetch data from postgres service π¨π₯¦ Retrieve scatterplot-2d coordinates from celery task-queue results (selected from auto-generated dropdown) π¨π» Add flower configuration env variable to settings.py π¨ generate product of all combinations of kmer pipeline params (kmer_size, norm_method, embed_method) for 2d-coords retrieval π¨ππ Retrieve mag summary data from SampleTables properties instead of using get_table(...) π₯π Remove default value of 'cluster' for mag_summary_cluster_col_dropdown π¨π₯ Remove unnecessary nested lists of Input(...) in mag_summary callbacks π¨ Add long_callback_manager to app (WIP: currently not being used) π¨ Add handling of kmer param titles and metagenome annotation titles to format_axis_title(...) in figures.py π¨π³π° Change rabbitmq image from latest to 3.10.1-management-alpine (w/port) to use amqp management UI
Configuration menu - View commit details
-
Copy full SHA for 4810ba2 - Browse repository at this point
Copy the full SHA 4810ba2View commit details
Commits on May 18, 2022
-
π Add test SampleTables model instance
π Move misc. markdown docs to docs directory
Configuration menu - View commit details
-
Copy full SHA for ef3f205 - Browse repository at this point
Copy the full SHA ef3f205View commit details
Commits on May 20, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 2a83bfa - Browse repository at this point
Copy the full SHA 2a83bfaView commit details
Commits on Aug 2, 2022
-
π³ Ignore .vscode for docker context π³ Install mamba and prune prior to env update
Configuration menu - View commit details
-
Copy full SHA for 90494cd - Browse repository at this point
Copy the full SHA 90494cdView commit details -
π¨π³π Add dash-extensions
ππ Add dash-extensions to enable caching π₯ Reduce kmer tasks to am_clr norm method and kmer_size of 5 (bhsne, densmap and umap embeddings)
Configuration menu - View commit details
-
Copy full SHA for 90b2990 - Browse repository at this point
Copy the full SHA 90b2990View commit details
Commits on Aug 3, 2022
-
Configuration menu - View commit details
-
Copy full SHA for df22b6e - Browse repository at this point
Copy the full SHA df22b6eView commit details -
π₯ Change clone of `home-tab` branch to `develop` branch
Configuration menu - View commit details
-
Copy full SHA for ebaccf4 - Browse repository at this point
Copy the full SHA ebaccf4View commit details -
Merge pull request #35 from WiscEvan/home-tab
π³πΊπ¨ Automappa web app with home tab for data upload - π₯¦ Add task-queue for pre/post-processing tasks with celery - π₯ Add Redis service for celery backend - π° Add RabbitMQ service for celery broker - π Add PostgreSQL for data ingestion - π· Add Flower for celery task-queue monitoring - ππ¨ Add Pydantic for data models - π³ Add docker-compose file to orchestrate Automappa services
Configuration menu - View commit details
-
Copy full SHA for c245bc2 - Browse repository at this point
Copy the full SHA c245bc2View commit details -
Configuration menu - View commit details
-
Copy full SHA for be091f9 - Browse repository at this point
Copy the full SHA be091f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 31ab494 - Browse repository at this point
Copy the full SHA 31ab494View commit details -
Configuration menu - View commit details
-
Copy full SHA for 27fea70 - Browse repository at this point
Copy the full SHA 27fea70View commit details -
Configuration menu - View commit details
-
Copy full SHA for bc82dd4 - Browse repository at this point
Copy the full SHA bc82dd4View commit details
Commits on Jul 21, 2023
-
Refactor with fixes, features and improved directory structure (#39)
* π¨ Apply black formatting * π¨β¬οΈπ€ refactor to use dash-extensions DashBlueprints * Significantly simplified code base with modular components that are each passed their own page's app (DashBlueprint) * components and layouts are standardized to use render function that may receive the app with or without arguments * π₯ Remove (now) unnecessary index.py * β¬οΈ Pin dash-extensions to first major release * β¬οΈ Pin dash to 2.10 * β¬οΈ Add dash-mantine-components * β¬οΈ Add dash-iconify * π Add contributing docs * π¨πππ³ Fix docs, prop id and docker specs * π³ Add quotes around ports per docker-compose spec * ππ¨π₯ add Development resources π¨π₯ Add icons to not found page and remove unnecessary text * π¨ Refactor mag refinement page components * π¨ Refactor marker symbols legend to use icons rather than naming shapes * π¨ Restyle save selections and settings buttons * π¨ Refactor mag-refinement offsettings canvas components * π¨ Add minimum example contig_cytoscape component * π¨ Add specific backend configurations * π¨ Add REDIS_BACKEND details to .env * π¨ Add specific backend params to Serverside(..., backend=...) from automappa.data.db import {redis,file_system}_backend * ππ₯ Refactor dash components to DashProxy components * β¬οΈ pin dash-mantine-components to 0.12 in env using pip rather than conda * π¨ Add icons in page registry with blueprints * π¨ Add coverage range slider component * π¨ Add Refinement model to track contig cluster refinements * π¨ Implement data source to connect MAG refinements table * π¨ Add methods to get latest user refinements contig headers * π¨ Add interaction b/w coverage range slider and scatterplot2d * π¨ Connect download refinements button to data source * π¨ Hide MAG refinements switch is now disabled when there are no user refinements that have been made * π¨ Refinements table has been styled with new timestamp string and removed 'initial_cluster' column * π¨ Refinements table now only retrieves user refinements (i.e. excludes initial clusters) * π¨ Add refinements clear button * Add working data source for completeness/purity boxplot * π¨ Add minimal working AgGrid for MAG Summary * π¨ Replace dbc.Offcanvas with dmc.Drawer * π¨ Replace many of the Dropdowns in Offcanvas with RadioGroup Radio options (less clicks for the user) * π₯π° Add logic for modular task-queue * π Add documentation for tasks in CONTRIBUTING and reference tasks README.md * π₯ Add minimum working example for task submission, progress display for a task status badge * π₯ Add task discovery for home page task in celeryconfig.py * π³π Replace base image of miniforge with mambaforge * π₯π¨ Notification system tells user of current state of tasks processing * ππ¨ Move dcc.Store(...) within respective du.Upload component * π¨ Add tasks store for getting tasks statuses * π°π₯ Add tasks in home for handling sample data ingestion * π¨ Add mag length sum computations * π¨ Add MIMAG cluster count computations * π¨ Add metadata to sample data card info * π Replace na values from cluster col during contig loader pre-processing * π¨π₯ Add sample removal feature * π¨ Affix settings and save mag buttons
Configuration menu - View commit details
-
Copy full SHA for 763ec7c - Browse repository at this point
Copy the full SHA 763ec7cView commit details
Commits on Jul 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 1509298 - Browse repository at this point
Copy the full SHA 1509298View commit details -
Configuration menu - View commit details
-
Copy full SHA for eafc892 - Browse repository at this point
Copy the full SHA eafc892View commit details