Skip to content

2023-Q2
Compare
Choose a tag to compare
@shapiromatron shapiromatron released this 09 Aug 18:55
· 138 commits to main since this release
2023-Q2
51177c6
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

August 9th, 2023

We're proud to release 2023-Q2. Over the last few quarters, we've been internally developing new data extraction and visualization components in partnership with our scientists, and with this release, those features are made generally available. Specifically:

  • Last year we released new data extraction modules for Epidemiology. This update integrates data extraction with existing data visualizations in HAWC, such as exploratory heatmaps and data pivots.
  • We've released ecological data extraction, which, like epidemiology, is now fully integrated with our exploratory heatmap and data pivot visualizations.
  • We've added an assessment metadata module to add high level project data to assessments (assessment type, current status, related documentation), as well as adding assessment values, if a HAWC assessment results in quantitative values as a conclusion.

In addition to these changes, we've overhauled searching and filtering throughout HAWC; filters should be faster and more intuitive. We added new customizations to assessments to show/hide items on the sidebar, to make it easier to only have links throughout an assessment to pages which have content.

The complete changelog is described below (features marked with the lab icon 🧪 indicate they're not yet available and are behind feature flags):

New Features:

  • General improvements
    • Redesigned search/filters to include an inline search bar and expandable 'advanced search' filter form #817 #838
    • Improve styling for Excel-based tabular exports #816
    • 🧪 New REST API endpoints for searching assessments by chemical and reference (admin only) #826
  • Literature screening
    • Add wildcard keyword searching for literature screening #833
    • Remove ability to change source on already executed literature import #849
    • Steer users to importing references from PubMed/HERO instead of manual extraction #819
  • Assessment configuration
    • Assessment sidebar customization allows users to show/hide all sidebar links #827
    • Restyled Assessment Downloads page which includes multiple different export types #807
    • Improve flexibility for searching and filtering assessments #839 #857
  • Study Evaluation
    • Add new study evaluation judgment choice: Minor/Critical concerns (sensitivity) #848
    • Improve display of study evaluation criteria when empty #821
  • Data Extraction: Animal Bioassay
    • Update export for bioassay data to include diagnostics field #850
    • Added Pubertal and Juvenile to animal constants #864
  • Data Extraction: Epidemiology
    • Added the ability to create data pivots and exploratory heatmaps using extracted data #832 #869
    • Add REST API endpoints for epiv2 data extraction (create, read, update, delete) #820 #866
    • Added bulk-cleanup features to clean manually extracted data #855
  • Data Extraction: Ecology
    • Added ecological data pivots and exploratory heatmap visualizations using extracted data #845
    • Make ecological data extraction generally available #868
    • Added schema to developer and API documentation #841 #866
  • Assessment Values and Details
    • Additional revisions to assessment values and details per scientist feedback #792 #831
    • New REST API endpoints for CRUD operations of assessment values and details #858 #862
    • Make values and details generally available #868
  • Summary Tables and Visualizations
    • Streamline exploratory heatmap user interface #846
    • Update Evidence Profile Table language per scientist recommendation #837
    • 🧪 New visualization types using plotly (admin only) #804
  • Assorted User Requests
    • Assorted UI improvements #818 #823 #824 #822 #863
    • Updated notifications to streamline interactions with pages #819 #821 #844 #843 #855
    • Rebuild mgmt views to use templates instead of JS #808
    • Update CCTE Dashboard API to newly release version for chemical information #828

Software upgrades/security/stability:

  • Updated to Python 3.11 and assorted python packages #769 #847
  • Update Django from 3.2 to 4.2 LTS #806
  • Removed Blog, topic models, MyST-parser, and R client #851 #852 #853
  • Remove FIPS mode monkeypatch; fixed with upgrade to Django 4.2 #825
  • Fixed bug in migration dependency orders #842
  • Fixed bug in epiv2 data export failing with no adjustment factors #840
  • Fixed bug when searching bioassay results by invalid dose units #856
  • Fixed bug in bulk tagging when an Excel file has boolean tag fields #829
  • Fixed bug in user-interface when a permission error looked like a loading error #813
  • Fixed bugs in view logic resulting in page rendering failure #811 #812
  • Rewrite how large exports are generated using ORM more effectively #865
  • Handle exceptions triggered by security scans #871

Developer experience:

  • Updated black, replaced flake + isort with ruff #778
  • Update build tool to flit; migrate to pyproject.toml #854
  • Created CI/CD coverage report with all pull requests #859
  • Rename Views and ViewSets for clarity and consistency #814 #815
  • Rewrite DataPivotExtension to more generic Interactivity module #861
  • Update yarn v1 to v3, and then rollback #806 #867
Assets 2