Skip to content

RichardScottOZ/mineral-exploration-machine-learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

mineral-exploration-machine-learning

This page lists resources for mineral exploration and machine learning, generally with useful code and examples. ML and Data Science is a huge field, these are resources I have found useful and/or interesting to me in practice. Links currently to a fork of a repository are because I have changed something to use and put in a list for reference. Resources are also given for data analysis, transformation and visualisation as that is most of the work.

Suggestions welcome: open a discussion, issue or pull request.

Table of Contents

Map

Frameworks

Pipelines

  • geotargts -> Extension of targts to terra and stars

Prospectivity

Australia

Explorer Challenge

South Australia

Explore SA - South Australian Department of Energy and Mining Competition

South America

Brazil

China

Sudan

Norway

Geology

Training Data

Lithology

Drilling

  • Heterogenous Drilling - Nicta/Data61 project report for looking at modelling using drillholes that don't go far enough
  • corel -> smart computer vision model that identifies facies and performs rock typing on core images

Paleovalleys

Stratigraphy

  • Predicatops -> Stratigraphic predication designed for hydrocarbon

Geophysics

Foundation Models

Australia

Regolith Depth

AEM Interpolation

Electromagnetics

Inversion

Structure

  • Lineament Learning -> Fault prediction and mapping via potential field deep learning and clustering

Gravity

Magnetics

Petrophysics

Tectonics

  • Colab notebook -> Google Colab input file for benchmark results of ML-SEISMIC publication
  • paper

Geochemistry

Natural Language Processing

Word Embeddings

Named Entity Recognition

Ontology

Large Language Models

Chatbots

  • GeoGPT -> Deep Time Digital Earth Research Group from China project

Remote Sensing

Processing

  • ASTER Conversion -> Conversion from ASTER hd5 to geotiff NASA github
  • HLS Data Resources -> Harmonized Landsat Sentinel wrangling
  • sarsen -> xarray based SAR image processing and correction
  • openEO -> openEO develops an open API to connect R, Python, JavaScript and other clients to EO cloud back-ends

Spectral Unmixing

Hyperspectral

Visualisation

Texture

Simulation

Geometry

  • Deep Angle -> Fast calculation of contact angles in tomography images using deep learning

Other

Platforms

Guides

Data Quality

Machine Learning

  • Geospatial-ml -> Install multiple common packages at once
  • Dask-ml -> Distributed versions of some common ML algorithms

Probabilistic

Clustering

Self Organising Maps

Bayesian

  • Bayseg -> Spatial segmentation

Explainability

Deep Learning

Data

  • Xbatcher -> Xarray based data reading for deep learning
  • zen3geo -> Xbatcher style data science with pytorch

Explainability

Self-supervised learning

Hyperparameters

Coding Environments

Community

Cloud Providers

AWS

Overviews

Domains

Web Services

If listed it is assumed they are generally data, if just pictures like WMS it will say so.

Australia

Geology

Geophysics

Other

New South Wales

Queensland

South Australia

Northern Territory

  • NTGS -> Northern Territory Geological Survey

Tasmania

Victoria

Western Australia

New Zealand

  • GNS -> List of web services

South America

Brazil

Peru

Mexico

Argentina

Colombia

Uruguay

Other

Europe

EGDI -> EGDI Minerals

Sweden

Finland

Portgual

Spain

Ukraine

Ireland

Britain

  • BGS -> British Geological Survey
  • Geoindex -> mineral occurrence example
  • Rest -> BGS Rest services

Germany

Czech Republic

Slovakia

Hungary

Romania

Poland

North America

Canada

USA

Asia

Africa

General

Other

APIs

Data Portals

World

  • Earth Model Collaboration -> access to various Earth models, visualization tools for model preview, facilities to extract model data/metadata and access to the contributed processing software and scripts.

Australia

Geoscience Australia

CSIRO

AuScope

TERN

Bureau of Meteorology

Foundational Spatial Data

South Australia

Northern Territory

Queensland

Western Australia

NSW

  • MINVIEW -> New South Wales Geological Survey
  • DiGS -> Publications and Geotechnical collections

Tasmania

Victoria

New Zealand

South America

Brazil

  • CPRM -> Brazil Geological Survey
  • Downloads -> Brazil Geological Survey Downloads
  • Rigeo -> Institutional Repository of Geosciences

Peru

Mexico

Argentina

Colombia

Uruguay

Chile

Europe

Denmark

Finland

Sweden

  • SGU -> Swedish Geological Survey

Spain

  • IGME -> Spanish Geological Survey

Portugal

Ireland

  • GSI -> Geological Survey of Ireland
  • GSI - Map viewer
  • Goldmine -> Map and document search
  • data.gov.ie -> National portal view
  • isde -> Irish Spatial Data Exchange

Norway

Britain

Ukraine

Russia

Germany

France

Croatia

Czech Republic

  • GS -> Czech Geological Survey

Slovenia

Slovakia

Hungary

Romania

Poland

United Kingdom

North America

Canada

USA

Africa

Asia

China

India

  • Bhukosh -> India Geological Survey
  • Note Rajasthan geology doesn't work except piecemeal which is painful - if you want it, let me know

Other

Geology

General

Reports

Australia

Canada

USA

Other

Tools

GIS

  • QGIS -> GIS Data Visualisation and Analysis Open Source desktop application, has some ML tools : Indispensible for some quick and easy viewing
  • GRASS
  • saga -> mirror of sourceforge

3D

Geospatial General

Vector Data

Python

R

  • SF
  • terra -> terra provides methods to manipulate geographic (spatial) data in "raster" and "vector" form.

Raster Data

C

R

  • Raster -> R library
  • terra -> terra provides methods to manipulate geographic (spatial) data in "raster" and "vector" form.
  • stars -> stars: spatiotemporal Arrays: Raster and Vector Datacubes

Python

  • Rasterio -> python base library for raster data handling
  • Rasterstats -> summarising geospatial raster datasets based on vector geometries
  • Xarray -> Multidimensional Labelled array handling and analysis
    • Rioxarray -> Fabulous high level api for xarray handling of raster data
    • Geocube -> Rasterisation of vector data api
    • ODC-GEO -> Tools for remote sensing based raster handling with many extremely tools like colorisation, grid workflows
    • COG Validator -> checking format of cloud optimised geotiffs
    • serverless-datacube-demo -> xarray via lithops / Coiled / Modal
    • Xarray Spatial -> Statistical analysis of raster data such as classification like natural breaks
    • xdggs -> Other types of grids
    • xgcm -> Histograms with labels
    • xrft -> Xarray based Fourier Transforms
    • xvec -> Vector data cubes for Xarray
    • xarray-einstats -> Stats, linear algebra and einops for xarray

Benchmarks

Gui

  • Whitebox Tools -> python api, gui, etc. have used for topographical wetness index calculation

Data Collection

  • PiAutoStage -> 'An Open-Source 3D Printed Tool for the Automatic Collection of High-Resolution Microscope Imagery;' designed for mineral samples.

Data Conversion

Geochemistry

Geostatistics

Geochronology

Geology

Geophysics

Electromagnetic

Gravity and Magnetics

Seismic

Magnetotellurics

Gridding

Inversion

Geochemistry

Drilling

  • dh2loop -> Drilling Interval assistance
  • paper
  • drilldown -> Drilling visualisation in notebooks via geoh5py -> note desurveying
  • PyGSLib -> Downhole surveying and interval normalising
  • pyborehole -> Processing and visualizing borehole data
  • dhcomp -> composites geophysical data to a set of intervals

Remote Sensing

Serverless

  • Kerchunk -> Serverless access to cloud based data via Zarr
  • Kerchunk geoh5 -> Access to Geoscient Analyst/geoh5 projects serverlessly via kerchunk

Stac catalogues

Statistics

Visualisation

Mineral Potential

Mining Economics

  • Bluecap -> Framework from Monash University for assessing mine viability
  • Zipfs Law -> Curve fitting the distribution of Mineral Depositions
  • PyASX -> ASX Data Feed scraping
  • Metal Price API -> Containerised Microservice

Visualisation

Colormaps

Geospatial

Technology Stacks

C

  • GDAL -> Absolutely crucial data transformation and analysis framework
    • Tools -> Note has many command line tools that are very useful as well

Julia

Python - PyData

Rust - GeoRust

  • GeoRust -> Collection of geospatial utilities in rust

Data Science

Science

Docker

Ontologies

Books

Python

Other

Other

  • GXPy -> Geosoft Python API
  • EarthArxiv -> Download papers from the preprint archive
  • Essoar -> Preprint paper archive

Datasets

World

Geology

  • Bedrock -> Generalised geology of the world
  • Sedimentary Layers -> Global 1-km Gridded Thickness of Soil, Regolith, and Sedimentary Deposit Layers
  • Paleogeology An Atlas of Phanerozoic Paleogeographic Maps

Geophysics

Gravity

Magnetics

  • EAMG2V3 _> Earth Magnetic Anomaly Grid
  • WDMAM -> World Digital Magnetic Anomaly Map
  • EMC -> global 3D inverse model of electrical conductivity

Seismic

Thermal

General

Australia

Geochemistry

Geology

Geophysics

  • Gravity -> 2019 Australian National Gravity Grids

Magnetics

  • TMI -> Magnetic Anomaly Map of Australia, Seventh Edition, 2019 TMI
  • 40m -> 40m version
  • VRTP -> Total Magnetic Intensity (TMI) Grid of Australia with Variable Reduction to Pole (VRTP) 2019
  • 1VD -> Total Magnetic Intensity Grid of Australia 2019 - First Vertical Derivative (1VD)

Radiometrics

  • Radiometrics -> Complete Radiometric Grid of Australia (Radmap) v4 2019 with modelled infill
  • K -> Radiometric Grid of Australia (Radmap) v4 2019 filtered pct potassium grid
  • U -> Radiometric Grid of Australia (Radmap) v4 2019 filtered ppm uranium
  • Th -> Radiometric Grid of Australia (Radmap) v4 2019 filtered ppm thorium
  • Th/K -> Radiometric Grid of Australia (Radmap) v4 2019 ratio thorium over potassium
  • U/K -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium over potassium
  • U/Th -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium over thorium
  • U squared/Th -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium squared over thorium
  • Dose Rate-> Radiometric Grid of Australia (Radmap) v4 2019 filtered terrestrial dose rate
  • Ternary Picture -> Radiometric grid of Australia (Radmap) v4 2019 - Ternary image (K, Th, U)

AusAEM

  • AusAEM 1 -> AusAEM Year 1 NT/QLD Airborne Electromagnetic Survey; GA Layered Earth Inversion Products
  • AusAEM 1 -> AusAEM Year 1 NT/QLD: TEMPEST® airborne electromagnetic data and Em Flow® conductivity estimates
  • AusAEM 1 -> AusAEM1 Interpretation Data Package
  • AusAEM 2 -> AusAEM 02 WA/NT 2019-20 Airborne Electromagnetic Survey
  • AusAEM–WA -> AusAEM–WA, Murchison Airborne Electromagnetic Survey Blocks
  • AusAEM–WA -> AusAEM-WA, Southwest-Albany Airborne Electromagnetic Survey Blocks
  • AusAEM–WA -> AusAEM WA 2020-21, Eastern Goldfields & East Yilgarn Airborne
  • AusAEM–WA -> AusAEM (WA) 2020-21, Earaheedy & Desert Strip
  • AusAEM ERC -> AusAEM Eastern Resources Corridor
  • AusAEM WRC -> AusAEM Western Resources Corridor
  • interp overview
  • National surface and near-surface conductivity grids -> National ML interpolation for AusEM in similar fashion to Northern Australia

AusLAMP

Moho

Mineral Deposits

Mineral Potential

Mine Waste

Native Title

Remote Sensing

Topography

Northern

South Australia

Geology

Geophysics

Gawler
  • Gawler MPP -> Gawler Mineral Promotion Project - Data

Queensland

Cloncurry

  • Toolkit -> Multielement toolkit and laboratory

Northern Territory

  • Arunta IOCG -> Iron oxide-copper-gold potential of the southern Arunta Region
  • South Uranium -> Southern Northern Territory uranium and geothermal energy systems assessment digil data package
  • Tennant Creek -> Conductivity Model Derived from Magnetotelluric Data in the East Tennant Region, Northern Territory

New South Wales

Geology

  • Seamless Geology -> NSW Seamless Geology Data Package (older version also on this page)

Mineral Potential Data Packages

Western Australia

Geochemistry

Geology

Mineral Potential

Prospectivity

  • Capricorn-> Prospectivity analysis using a mineral systems approach - Capricorn case study project
  • King Leopold -> Mineral prospectivity of the King Leopold Orogen and Lennard Shelf: analysis of potential field data in the west Kimberley region
  • Yilgarn Gold
  • Yilgarn 2 -> Predictive mineral discovery in the eastern Yilgarn Craton: an example of district-scale targeting of an orogenic gold mineral system
  • [Shop note] -> WA has a few prospectivity packages available to purchase on USB drive for 50-60AU type prices - see in geospaital maps section

Tasmania

Geology

Victoria

New Zealand

North Americia

Canada

Geology

  • Map
  • Geology -> Updated Bedrock geology map
  • Geology -> Bedrock geology compilation and regional synthesis of south Rae and parts of Hearne domains, Churchill Province, Northwest Territories, Saskatchewan, Nunavut, Manitoba and Alberta
  • Moho -> National database of Moho depth estimates estimates from seismic refraction and teleseismic surveys

Geophysics

  • Dap Search -> Geoportal search - note annoyingly these are in Geosoft grids - see elsewere for conversion possibilties
  • [Gravity, Magnetics, Radiometrics] -> Mostly country scale

Europe

Finland

  • FODD -> Fennoscandian Mineral Deposits

Ireland

  • MPM -> Mineral Potentinal Mapping project

Papers with Code

NLP

Geochemistry

Geology

Mineral

Papers with Features Data

  • These you can reproduce the output geospatially from the data given.

Mineral Prospectivity

England

Geochemistry

Geology

Geophysics

Geospatial Output - No Code

Journals

Papers

  • Generally Not ML, or no Code/Data and sometimes no availability at all
  • Eventually will separate out into things that have data packages or not like NSW Zone studies.
  • However, if interested in an area you can often georeference a picture if nothing else as a rough guide.
  • Generally these are not reproducible - a few like the NSW prospectivity zone studies and NWQMP are with some work.
  • The occasional paper in this section may be listed above

New to File

General

Mineral Prospectivity

Australia

Argentina

Brazil

Fuzzy

Canada

Central Africa

Chile

China

Egypt

England

Eritrea

Finland

Finland

Ghana

Greenland

India

Indonesia

Iran

Ireland

India

Norway

South Korea

Phillipines

Russia

South Africa

Spain

Sweden

Uganda

USA

Zambia

Zimbabwe

Overviews

Deposits

Geochemistry

Geology

Depth

Drill Core

General

Geochronology

Geomorphology

Mineralogy

Structure

Geophysics

Foundation

EM

Gravity

Hyperspectral

Magnetotellurics

Passive Seismic

Surface Resistivity

Geothermal

Maps

Mineral

NLP

Petrography

Last edited: 29/09/2020 The below are a collection of works from when I was doing a review

Public Mineral Prospectivity Mapping

Overview

Geochemistry

Fuzzy

Uncertainty

Geospatial Maps

Australia

South Australia

NT

WA

Brazil

Australia

SA

WA

NT

NSW

Brazil

Carajas

Gurupi

Australia

South Australia

Queensland

New South Wales

Tasmania

Victoria

Western Australia

Endowment Modelling

World Models

Financial Forecasting

Agent based Modelling

Spectral Unmixing

  • Overviews and examples, with some focus on neural network approaches.

Neural Networks

General

Africa

Brazil

China

Greenland

India

Iran

Peru

Spain

Other

NLP

General-Interest