ICP Waters

Data cleaning and analysis for the ICP Waters Programme.

TOC trends (1990 - 2012)

Getting to grips with the ICPW database and recoding/extending Tore's original work on TOC trends.

Database clean-up. Identifying and fixing issues with the ICPW database identified during 2016
- Part 1
- Part 2
- Part 3.
Trend analyses. Estimate trends using data from 1990 to 2012
- Part 1
- Part 2
- Part 3

TOC trends (1990 - 2016)

A major review of the ICPW database was undertaken during 2018/19. The work can be divided into two components: (i) a expanded analysis comprising 430 "TOC trends" stations, with the aim of updating the work published in 2007; and (ii) a clean-up of the ~260 "core" ICP Waters stations, with the aim of writing a more general "Thematic Report" on TOC trends during 2019.

TOC trends paper

For the broader "TOC Trends" work, a new project was created, site selections were reviewed and datasets expanded to cover the period 1990 to 2016. Trends were then recalculated using the improved datasets.

A selection of tidied/processed datasets used in the subsequent analysis is here.

Thematic report

Data for the "core" ICP Waters project(s) was first reviewed and tidied, and then checked for consistency with the data provided for the broader trends paper (above). Corrections were made as necessary, including replacing/substituting stations in some countries in order to make use of the best long-term monitoring datasets currently available.

Update "trends" dataset. The latest work using the "trends" dataset is documented above under the heading "TOC Trends paper"
Update "core" dataset. Adding recent data for the "core" stations and dealing with data issues
Combining the "core" and "trends" datasets. An overview of the unified ICPW dataset of 556 stations
Scatterplots of annual data. A high-level overview of the raw data, aggregated to annual medians
Stations with high frequency monitoring. Ten stations have substantially more detailed monitoring than the others (approximately 25 to 100 samples per year from 1990 to 2016). This notebook performs trend and change point analyses based on monthly data, using algorithms that are too "data hungry" to be applied elsewhere
Stations with "standard" monitoring. Trend and change point analyses using annually aggregated data
Summary of work for Task Force meeting. An overview of the analysis prior to the Task Force meeting in Helsinki in June 2019

Name		Name	Last commit message	Last commit date
Latest commit History 74 Commits
trends_paper_datasets		trends_paper_datasets
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
check_core_icpw.ipynb		check_core_icpw.ipynb
check_resa2_timeseries.ipynb		check_resa2_timeseries.ipynb
check_sweden_no3_lod.ipynb		check_sweden_no3_lod.ipynb
check_trend_signif.ipynb		check_trend_signif.ipynb
correct_toc_elev.ipynb		correct_toc_elev.ipynb
data_vis.ipynb		data_vis.ipynb
extract_norway_icpw_data.ipynb		extract_norway_icpw_data.ipynb
icpw_annual_time_series.ipynb		icpw_annual_time_series.ipynb
icpw_climate_data_proc_py32.ipynb		icpw_climate_data_proc_py32.ipynb
icpw_climate_trends.ipynb		icpw_climate_trends.ipynb
icpw_norway_chem.csv		icpw_norway_chem.csv
ireland_seasalt_correction.ipynb		ireland_seasalt_correction.ipynb
mvm_python.py		mvm_python.py
prophet_test.ipynb		prophet_test.ipynb
rolling_sens_slope.ipynb		rolling_sens_slope.ipynb
sweden_missing_ca_data.ipynb		sweden_missing_ca_data.ipynb
toc_report_feb_2019_part1.ipynb		toc_report_feb_2019_part1.ipynb
toc_report_feb_2019_part2.ipynb		toc_report_feb_2019_part2.ipynb
toc_report_feb_2019_part3.ipynb		toc_report_feb_2019_part3.ipynb
toc_report_feb_2019_part4_wge_plots.ipynb		toc_report_feb_2019_part4_wge_plots.ipynb
toc_report_feb_2019_part5_hi_freq.ipynb		toc_report_feb_2019_part5_hi_freq.ipynb
toc_report_feb_2019_part6.ipynb		toc_report_feb_2019_part6.ipynb
toc_report_feb_2019_part6b.ipynb		toc_report_feb_2019_part6b.ipynb
toc_report_feb_2019_part7.ipynb		toc_report_feb_2019_part7.ipynb
toc_trends_2015_data_cleaning.ipynb		toc_trends_2015_data_cleaning.ipynb
toc_trends_2015_data_cleaning2.ipynb		toc_trends_2015_data_cleaning2.ipynb
toc_trends_2015_data_cleaning3.ipynb		toc_trends_2015_data_cleaning3.ipynb
toc_trends_analysis.py		toc_trends_analysis.py
toc_trends_map.ipynb		toc_trends_map.ipynb
toc_trends_oct_2016.ipynb		toc_trends_oct_2016.ipynb
toc_trends_oct_2016_part2.ipynb		toc_trends_oct_2016_part2.ipynb
toc_trends_oct_2016_part3.ipynb		toc_trends_oct_2016_part3.ipynb
toc_trends_oct_2018_extract_all_data.ipynb		toc_trends_oct_2018_extract_all_data.ipynb
toc_trends_oct_2018_part1.ipynb		toc_trends_oct_2018_part1.ipynb
toc_trends_oct_2018_part2.ipynb		toc_trends_oct_2018_part2.ipynb
toc_trends_oct_2018_part3.ipynb		toc_trends_oct_2018_part3.ipynb
toc_trends_oct_2018_part4.ipynb		toc_trends_oct_2018_part4.ipynb
updated_toc_trends_analysis.ipynb		updated_toc_trends_analysis.ipynb
updated_toc_trends_analysis2.ipynb		updated_toc_trends_analysis2.ipynb
upload_icpw_template.ipynb		upload_icpw_template.ipynb
upload_sweden_icpw_data.ipynb		upload_sweden_icpw_data.ipynb

License

JamesSample/icpw

Folders and files

Latest commit

History

Repository files navigation

ICP Waters

TOC trends (1990 - 2012)

TOC trends (1990 - 2016)

TOC trends paper

Thematic report

About

Resources

License

Stars

Watchers

Forks

Languages