PaleoSTeHM - A modern, scalable Spatio-Temporal Hierarchical Modeling framework for paleo-environmental data
By Rutgers Earth System Science & Policy Lab
This repository contains the Jupyter Notebook based tutorials for PaleoSTeHM project, which will develop a framework for spatiotemporal hierarchical modeling of paleodata that builds upon modern, scalable software infrastructure for machine learning. By leveraging an existing, widely used machine-learning framework at the base level, PaleoSTeHM will be built to take advantage of current and future computational advances without modifications to the user-facing product. It will facilitate the incorporation of complex likelihood structures, including the embedding of physical simulation models, and thus pave the way for further advances in paleo-modeling.
PaleoSTeHM is a paleo-environmental modelling faced API based upon pyro, a universal probabilistic programming language supported by PyTorch on the backend. Therefore, it not only supports probabilistic programming not also the auto-differentiation and GPU acceleration. This API will provide easy-to-use models to infer the spatio or spatio-temporal variation of environmental change from geological data, with tutorials that cover the background theories and hand-on practicals.
Please note that this repository is under active development by Yucheng Lin, Alex Reedy and Robert Kopp. If you have any questions please contact Yucheng: yc.lin@rutgers.edu.
- Clone the PaleoSTeHM repository.
git clone https://github.com/radical-collaboration/PaleoSTeHM.git
- Create and activate a Python virtual environment, and install PaleoSTeHM's Python dependencies in it. Using conda:
cd PaleoSTeHM/
conda env create -f environment.yml
conda activate ve3PaleoSTeHM
- Load Jupyter Lab (or Jupyter Notebook) and navigate to the tutorial of interest.
jupyter-lab
- PaleoSTeHM background and data level modelling - Introduction to Bayesian Hierachical modelling, which consist of data level, process level and parameter level modelling. This notebook will cover data level modelling with an illustrative example of building data level model for coral-based sea-level records from the Great Barrier Reef.
- Process level and parameter level modelling - Process level and parameter level modelling tutorial, which will cover a range of process level model for paleo-environmental research, including hand-drawn model, linear model, change-point model, Gaussian Process model, physical model, and mixed physical and statistical model.
- Analysis Choice - Analysis choice tutorial, which will cover the difference between a deterministic model and a probablistic model (we will mostly use a Bayesian model), the optimization methods for deterministic model (least sqaures and gradient-based optimization) and inference method for Bayesian model, including Markov Chain Monte Carlo, Variational Bayes and Empirical Bayes.
- Gaussian Process background - Gaussian Process background tutorial, which covers the basics of Gaussian Process, including calculating squared distance matrix and covariance matrix, hyperparameter definitions and their impact, conditional probability and hyperparameter optimization.
- Gaussian Process kernels and kernel operations - Gaussian Process kernel tutorial, which introduces some popular GP kernels and instructions on how to combine different kernels.
- Incorporate temporal uncertainty in Gaussian Process - This tutorial introduce two commonly-used methods for Gaussian Process: noisy-input Gaussian Process and errors-in-variable Gaussian Process.
- Holocene sea-level analysis in New Jersey and Northern North Carolina - This tutorial will use the contents covered above in order to replicate Gaussian Process modelling results in New Jersey and Northern North Carolina as in Ashe et al., 2019.
- Spatio-temporal Gaussian Process Background - Background of building a Spatio-temporal Gaussian Process model.
- Spatio-temporal Gaussian Process with multiple kernels - Spatio-temporal Gaussian Process with multiple kernels with instructions on kernel decomposition.
- Spatio-temporal Gassusian Process with Physical Models - Spatio-temporal Gaussian Process in combination with one or multiple physical models.
- Common Era Sea-Level Reconstruction - Reconstructing Common Era global sea-level change using method introduced in Kopp et al., 2016.
This project is licensed under the MIT License - see the LICENSE file for details
This work is supported by the National Science Foundation under awards 2002437 and 2148265. The opinions, findings, and conclusions or recommendations expressed are those of the authors and do not necessarily reflect the views of the National Science Foundation.