Leeds Institute for Fluid Dynamics (LIFD) has teamed up with the Centre for Environmental Modelling and Computation (CEMAC) team to create Jupyter notebook tutorials on the following topics.
- ConvolutionalNeuralNetworks
- Physics_Informed_Neural_Networks
- GaussianProcesses
- RandomForests
- GenerativeAdversarialNetworks
- AutoEncoders
- DimensionalityReduction
- XGBoost
PLEASE NOTE YOU MUST CLONE RECURSIVELY (SEE BELOW)
These notebooks require very little previous knowledge on a topic and will include links to further reading where necessary. Each notebook will take about two hours to run through and should run out of the box on home installations of Jupyter notebooks. These notebooks are designed with automatic checking of Python environment files to remain easy to set up into the future.
As this resource grows, in order to not make the repository unwieldy this repository is made up of submodules that can be cloned individually.
Some tutorials are so lightweight you can run them on binder. The others we recommend running on your local machine. To get started, either clone this repository (LARGE SIZE) or select a tutorial to clone and run each tutorial separately.
bash git clone --recursive git@github.com:cemac/LIFD_ENV_ML_NOTEBOOKS.git
then follow the individual README.md instructions.
git clone --recursive git@github.com:cemac/LIFD_ConvolutionalNeuralNetworks.gitgit clone --recursive git@github.com:cemac/LIFD_RandomForests.gitgit clone --recursive git@github.com:cemac/LIFD_GaussianProcesses.gitgit clone --recursive git@github.com:cemac/LIFD_Physics_Informed_Neural_Networks.gitgit clone --recursive git@github.com:cemac/LIFD_GenerativeAdversarialNetworks.gitgit clone --recursive git@github.com:cemac/LIFD_AutoEncoders.gitgit clone --recursive git@github.com:cemac/LIFD_DimensionalityReduction.gitgit clone --recursive git@github.com:cemac/XGBoost-notebook.git
These notebooks can run with the resources provided and the Anaconda environment setup. If you are familiar with Anaconda, Jupyter notebooks and GitHub then simply clone this repository and run it within your Jupyter notebook setup. Otherwise, please read the how to run guide. Individual notebooks have bespoke instructions.
git clone --recursive git@github.com:cemac/LIFD_ENV_ML_NOTEBOOKS.git
cd LIFD_ENV_ML_NOTEBOOKSPython
It is recommended you use Anaconda to manage the Python packages required. Some machine-learning libraries are large and if you only wish to run one notebook consider installing the environment provided for that specific notebook. Otherwise, you can install all required packages running the following commands.
conda env create -f <env-file>.yml
conda activate <env-name>
# save yourself some space with one extra command
conda clean -aWhat if I forgot to clone recursively?
Not to worry. In your cloned folder simply run:
git submodule init
git submodule update --init --recursiveHardware
These notebooks are designed to run on a personal computer. Although please note the techniques demonstrated can be very computationally intensive, so there may be options to skip steps depending on the hardware available, e.g. use pre-trained models.
Knowledge
No background knowledge of the environmental-science or machine-learning concepts is required. We have assumed some foundational knowledge but links are provided to in-depth information on the fundamentals of each concept.
We hope that this resource can be built upon to provide a wealth of training material for Earth-science machine-learning topics at Leeds.
LIFD_ENV_ML_NOTEBOOKS by cemac is licensed under a Creative Commons Attribution 4.0 International License.
Leeds Institute of Fluid Dynamics, CEMAC, Helen Burns, Matthew Gaddes, Oliver Pollard, Chetan Deva, Fergus Shone, Michael MacRaild, Phil Livermore, Giulia Fedrizzi, Eszter Kovacs, Ana Reyna Flores, Francesca Morris, Emma Pearce, Maeve Murphy Quinlan, Sara Osman, Jonathan Coney, Eilish O'grady, Leif Denby, Sandra Piazolo, Caitlin Howarth, Claire Bartholomew, Anna Hogg, Ali Gooya, Tamora James and Donald Cummins.