README.md

Microplastics Data Portal

Welcome! Navigate the Microplastics Data Portal with this tutorial.

We are innovating what government open data can be by creating an open source data portal where all aspects of data ingestion, analysis, visualization, and sharing are transparent and collaboratable by the open source community. This project is a collaboration with California Water Boards, Moore Institute for Plastic Pollution Research, The Gray Lab @ UCR, San Francisco Estuary Institue, California 100, Possibility Lab and the open source community at large.

This data portal supports the implementation of Senate Bill No. 1422 which mandates sharing of microplastic data from drinking water, policy SAM 5160 which mandates that state data be open access, and policy SAM 4984 which mandates that software be open by default. Our vision is to use this project as a framework for future open software development by state agencies in California. All engagement on this open repo will be the subject of future policy research on how government and open source communities can better collaborate on software development projects.

Connect

If you want to discuss anything with the developers, you can email wincowger@gmail.com

Contributing

Contributions of all kinds are welcome!

• Some ideas on How to Contribute.
• Please adhere to this project's Code of Conduct.

Installation

Data Validator

Data validation is essential before sharing data widely. We have created the data validator package and app .

If using the R Package:

  install.package("One4All")
  library(One4All)

If using the web app:

• Go to openanalysis.org/one4all.
• The code for the app is in /code/validator.

Data Visualization

Once you have data, you may want to analyze it, microplastic data has some unique ways to interpret it so we made a tool that can take all the data from the validator app and make use of it. The code for the app is in /code/data_visualization.

• To get started with the tool, go to openanalysis.org/microplastic_analysis.

Microplastic Image Explorer

Microplastic data is unique because it includes unstructured data, like images, which can be difficult to query. This is why we created the image explorer. The code for the app is in /code/microplastic_image_explorer.

• To get started with the tool, go to openanalysis.org/microplastic_image_explorer.

Data

Looking for data? Download the files supporting the apps /data.

Helpful Resources

• California Microplastics Policy
• California Open Data Portal Sharing
• Califonia Open Source Policy
• California Open Data Policy
• Success Story Cal DMV
• California Open Source Code
• Overview of Government Open Source Software
• Government on Github
• Open Source Institute
• Best Practices for Government Open Source
• CKAN Data Portal Framework
• HUBKIT Data Portal Framework

Microplastic Policy

• 2018 Require developing methods for microplastics in drinking water policy
  • https://www.waterboards.ca.gov/drinking_water/certlic/drinkingwater/documents/microplastics/mcrplstcs_ir.pdf

Open Data Policy

• 2019 Establishes Open Data Portal for Whole State policy
  • https://data.ca.gov/
  • https://fastdemocracy.com/bill-search/ca/20192020/bills/CAB00017185/
  • https://handbook.data.ca.gov/introduction/
  • https://www.govops.ca.gov/caldata/

Open Source Policy

• 2010 Open Source is Allowed policy
• 2018 Open Source is Strongly Encouraged Unless Security Risk policy
  • https://code.ca.gov/
  • https://go.code.ca.gov/
  • https://github.com/CA-CODE-Works/codecagov
  • https://codecagov-playbook.readthedocs.io/en/latest/policy
  • https://alpha.ca.gov/
  • https://digital.ca.gov/blog/posts/working-in-the-open-on-the-california-design-system/
  • https://github.com/cagov/design-system
  • https://github.com/cagov
  • https://github.com/CAWaterBoardDataCenter
  • https://medium.com/code-california/how-civic-engagement-is-unlocking-californias-dmv-web-services-e71339879bf0

Meeting Videos

We have meetings every two weeks at 3PM California Time on Thursday for anyone interested in being involved. Contact wincowger@gmail.com to get added to the virtual meeting invite.

• Check in: December 1, 2023
• Check in: November 12, 2023
• Check in: September 29, 2023
• Check in: September 1, 2023
• Check in: July 7, 2023
• Check in: April 14, 2023
• Check in: March 3, 2023
• Check in: February 3, 2023
• Check in: January 20, 2023
• 3 Month Update: January 6, 2023
• Upcoming conference practice and app updates: October 28, 2022
• Bugs in validation app and schema updates: October 14, 2022
• Overview of project status: September 28, 2022
• Update on Validation and Wikidata: August 18 2022
• Github Demo: July 21 2022