Skip to content

This page lists resources for mineral exploration and machine learning, generally with useful code and examples.

Notifications You must be signed in to change notification settings

AbuobidaYousif/mineral-exploration-machine-learning

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

mineral-exploration-machine-learning

This page lists resources for mineral exploration and machine learning, generally with useful code and examples. ML and Data Science is a huge field, these are resources I have found useful and/or interesting to me in practice. Links currently to a fork of a repository are because I have changed something to use and put in a list for reference. Resources are also given for data analysis, transformation and visualisation as that is most of the work.

Suggestions welcome: open a discussion or issue.

Table of Contents

Map

Frameworks

Prospectivity

Australia

Explorer Challenge

South Australia

Explore SA - South Australian Department of Energy and Mining Competition

South America

Brazil

China

Sudan

Norway

Geology

Lithology

Drilling

  • Heterogenous Drilling - Nicta/Data61 project report for looking at modelling using drillholes that don't go far enough

Paleovalleys

Stratigraphy

  • Predicatops -> Stratigraphic predication designed for hydrocarbon

Geophysics

Australia

Regolith Depth

AEM Interpolation

Electromagnetics

Inversion

Structure

  • Lineament Learning -> Fault prediction and mapping via potential field deep learning and clustering

Gravity

Magnetics

Petrophysics

Geochemistry

Natural Language Processing

Word Embeddings

Named Entity Recognition

Remote Sensing

Spectral Unmixing

Visualisation

Deep Colormap Extraction from Visualizations

Texture

Other

Platforms

Guides

Data Quality

Machine Learning

  • Geospatial-ml -> Install multiple common packages at once
  • Dask-ml -> Distributed versions of some common ML algorithms

Probabilistic

Clustering

Self Organising Maps

Bayesian

  • Bayseg -> Spatial segmentation

Explainability

Deep Learning

Data

  • Xbatcher -> Xarray based data reading for deep learning

Explainability

Self-supervised learning

Hyperparameters

Coding Environments

Community

Cloud Providers

AWS

Overviews

Domains

Web Services

If listed it is assumed they are generally data, if just pictures like WMS it will say so.

Australia

Geology

Geophysics

Other

New South Wales

Queensland

South Australia

Northern Territory

  • NTGS -> Northern Territory Geological Survey

Tasmania

Victoria

Western Australia

New Zealand

  • GNS -> List of web services

South America

Brazil

Peru

Mexico

Argentina

Colombia

Uruguay

Other

Europe

EGDI -> EGDI Minerals

Sweden

Finland

Portgual

Spain

Ukraine

Ireland

Britain

  • BGS -> British Geological Survey
  • Geoindex -> mineral occurrence example
  • Rest -> BGS Rest services

Germany

Czech Republic

Slovakia

Hungary

Romania

Poland

North America

Canada

USA

Asia

Africa

Other

APIs

Data Portals

Australia

Geoscience Australia

CSIRO

AuScope

TERN

Bureau of Meteorology

Foundational Spatial Data

South Australia

Northern Territory

Queensland

Western Australia

NSW

  • MINVIEW -> New South Wales Geological Survey
  • DiGS -> Publications and Geotechnical collections

Tasmania

Victoria

New Zealand

South America

Brazil

  • CPRM -> Brazil Geological Survey
  • Downloads -> Brazil Geological Survey Downloads
  • Rigeo -> Institutional Repository of Geosciences

Peru

Mexico

Argentina

Colombia

Uruguay

Europe

Denmark

Finland

Sweden

  • SGU -> Swedish Geological Survey

Spain

  • IGME -> Spanish Geological Survey

Portugal

Ireland

  • GSI -> Geological Survey of Ireland
  • GSI - Map viewer
  • Goldmine -> Map and document search
  • data.gov.ie -> National portal view
  • isde -> Irish Spatial Data Exchange

Norway

  • NGU -> Norway Geological Survey
  • database -> Mineral resources and stratigraphy lookups
  • github
  • API
  • GEONORGE -> Data catalogue with download

Britain

Ukraine

Russia

Germany

France

Croatia

Czech Republic

  • GS -> Czech Geological Survey

Slovenia

Slovakia

Hungary

Romania

Poland

North America

Canada

USA

Africa

Asia

China

India

  • Bhukosh -> India Geological Survey

Other

Geology

General

Reports

Australia

Canada

USA

Other

Tools

GIS

  • QGIS -> GIS Data Visualisation and Analysis Open Source desktop application, has some ML tools : Indispensible for some quick and easy viewing
    • 2D Geology in QGIS -> Workshop for QGIS NA 2020 introducing geologic maps and cross-sections for students and hobbyists
    • OpenLog -> Drillhole plugin beta
  • GRASS

3D

Geospatial General

Vector Data

Raster Data

  • Rasterio -> python base library for raster data handling
  • Xarray -> Multidimensional Labelled array handling and analysis
    • Rioxarray -> Fabulous high level api for xarray handling of raster data
    • Geocube -> Rasterisation of vector data api
    • ODC-GEO -> Tools for remote sensing based raster handling with many extremely tools like colorisation, grid workflows
    • COG Validator -> checking format of cloud optimised geotiffs
    • Xarray Spatial -> Statistical analysis of raster data such as classification like natural breaks
    • xrft -> Xarray based Fourier Transforms
  • Raster -> R library
  • Whitebox Tools -> python api, gui, etc. have used for topographical wetness index calculation

Data Conversion

Geochemistry

Geostatistics

Geochronology

Geology

Geophysics

Electromagnetic

Gravity and Magnetics

Seismic

Magnetotellurics

Gridding

Inversion

Geochemistry

Drilling

  • dh2loop -> Drilling Interval assistance
  • PyGSLib -> Downhole surveying and interval normalising
  • dhcomp -> composites geophysical data to a set of intervals

Remote Sensing

Serverless

  • Kerchunk -> Serverless access to cloud based data via Zarr
  • Kerchunk geoh5 -> Access to Geoscient Analyst/geoh5 projects serverlessly via kerchunk

Stac catalogues

Statistics

Visualisation

Mineral Potential

Mining Economics

  • Bluecap -> Framework from Monash University for assessing mine viability
  • Zipfs Law -> Curve fitting the distribution of Mineral Depositions
  • PyASX -> ASX Data Feed scraping
  • Metal Price API -> Containerised Microservice

Visualisation

Colormaps

Geospatial

PyData Stack

C

  • GDAL -> Absolutely crucial data transformation and analysis framework
    • Tools -> Note has many command line tools that are very useful as well

Data Science

Science

Docker

Ontologies

Books

Other

  • GXPy -> Geosoft Python API
  • EarthArxiv -> Download papers from the preprint archive
  • Essoar -> Preprint paper archive

Datasets

Global

Australia

Geochemistry

Geology

Geophysics

  • Gravity -> 2019 Australian National Gravity Grids

Magnetics

  • TMI -> Magnetic Anomaly Map of Australia, Seventh Edition, 2019 TMI
  • 40m -> 40m version
  • VRTP -> Total Magnetic Intensity (TMI) Grid of Australia with Variable Reduction to Pole (VRTP) 2019
  • 1VD -> Total Magnetic Intensity Grid of Australia 2019 - First Vertical Derivative (1VD)

Radiometrics

  • Radiometrics -> Complete Radiometric Grid of Australia (Radmap) v4 2019 with modelled infill
  • K -> Radiometric Grid of Australia (Radmap) v4 2019 filtered pct potassium grid
  • U -> Radiometric Grid of Australia (Radmap) v4 2019 filtered ppm uranium
  • Th -> Radiometric Grid of Australia (Radmap) v4 2019 filtered ppm thorium
  • Th/K -> Radiometric Grid of Australia (Radmap) v4 2019 ratio thorium over potassium
  • U/K -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium over potassium
  • U/Th -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium over thorium
  • U squared/Th -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium squared over thorium
  • Dose Rate-> Radiometric Grid of Australia (Radmap) v4 2019 filtered terrestrial dose rate
  • Ternary Picture -> Radiometric grid of Australia (Radmap) v4 2019 - Ternary image (K, Th, U)

AusAEM

  • AusAEM 1 -> AusAEM Year 1 NT/QLD Airborne Electromagnetic Survey; GA Layered Earth Inversion Products
  • AusAEM 1 -> AusAEM Year 1 NT/QLD: TEMPEST® airborne electromagnetic data and Em Flow® conductivity estimates
  • AusAEM 1 -> AusAEM1 Interpretation Data Package
  • AusAEM 2 -> AusAEM 02 WA/NT 2019-20 Airborne Electromagnetic Survey
  • AusAEM–WA -> AusAEM–WA, Murchison Airborne Electromagnetic Survey Blocks
  • AusAEM–WA -> AusAEM-WA, Southwest-Albany Airborne Electromagnetic Survey Blocks
  • AusAEM–WA -> AusAEM WA 2020-21, Eastern Goldfields & East Yilgarn Airborne
  • AusAEM–WA -> AusAEM (WA) 2020-21, Earaheedy & Desert Strip
  • AusAEM ERC -> AusAEM Eastern Resources Corridor
  • AusAEM WRC -> AusAEM Western Resources Corridor
  • interp overview
  • National surface and near-surface conductivity grids -> National ML interpolation for AusEM in similar fashion to Northern Australia

AusLAMP

Moho

Mineral Deposits

Mineral Potential

Mine Waste

Native Title

Remote Sensing

Topography

Northern

South Australia

Geology

Geophysics

Gawler
  • Gawler MPP -> Gawler Mineral Promotion Project - Data

Queensland

Cloncurry

  • Toolkit -> Multielement toolkit and laboratory

Northern Territory

  • Arunta IOCG -> Iron oxide-copper-gold potential of the southern Arunta Region
  • South Uranium -> Southern Northern Territory uranium and geothermal energy systems assessment digil data package
  • Tennant Creek -> Conductivity Model Derived from Magnetotelluric Data in the East Tennant Region, Northern Territory

New South Wales

Geology

  • Seamless Geology -> NSW Seamless Geology Data Package (older version also on this page)

Mineral Potential Data Packages

Western Australia

Geology

Prospectivity

  • Capricorn-> Prospectivity analysis using a mineral systems approach - Capricorn case study project
  • King Leopold -> Mineral prospectivity of the King Leopold Orogen and Lennard Shelf: analysis of potential field data in the west Kimberley region
  • Yilgarn Gold
  • Yilgarn 2 -> Predictive mineral discovery in the eastern Yilgarn Craton: an example of district-scale targeting of an orogenic gold mineral system
  • [Shop note] -> WA has a few prospecitivity packages available to purchase on USB drive for 50-60AU type prices - see in geospaital maps section

Tasmania

Geology

Victoria

New Zealand

North Americia

National-Scale Geophysical, Geologic, and Mineral Resource Data and Grids -> Also has some Australia data

Canada

Geology

  • Map
  • Geology -> Bedrock geology compilation and regional synthesis of south Rae and parts of Hearne domains, Churchill Province, Northwest Territories, Saskatchewan, Nunavut, Manitoba and Alberta
  • Moho -> National database of Moho depth estimates estimates from seismic refraction and teleseismic surveys

Geophysics

  • Dap Search -> Geoportal search - note annoyingly these are in Geosoft grids - see elsewere for conversion possibilties
  • [Gravity, Magnetics, Radiometrics] -> Mostly country scale

Finland

  • FODD -> Fennoscandian Mineral Deposits

Ireland

  • MPM -> Mineral Potentinal Mapping project

World

Geology

  • Bedrock -> Generalised geology of the world
  • Sedimentary Layers -> Global 1-km Gridded Thickness of Soil, Regolith, and Sedimentary Deposit Layers
  • Paleogeology An Atlas of Phanerozoic Paleogeographic Maps

Geophysics

Gravity

Magnetics

  • EAMG2V3 _> Earth Magnetic Anomaly Grid
  • WDMAM -> World Digital Magnetic Anomaly Map
  • EMC -> global 3D inverse model of electrical conductivity

Seismic

Thermal

Papers with Code

NLP

Geochemistry

Geology

Mineral

Papers with Features Data

  • These you can reproduce the output geospatially from the data given.

Mineral Prospectivity

England

Geochemistry

Geology

Geophysics

Geospatial Output - No Code

Journals

Papers

  • Generally Not ML, or no Code/Data and sometimes no availability at all
  • Eventually will separate out into things that have data packages or not like NSW Zone studies.
  • However, if interested in an area you can often georeference a picture if nothing else as a rough guide.
  • Generally these are not reproducible - a few like the NSW prospectivity zone studies and NWQMP are with some work.
  • The occasional paper in this section may be listed above

New to File

General

Mineral Prospectivity

Australia

Argentina

Brazil

Fuzzy

Canada

Central Africa

Chile

China

Egypt

England

Eritrea

Finland

Finland

Ghana

Greenland

Indonesia

Iran

Ireland

India

Norway

South Korea

Phillipines

Russia

South Africa

Spain

Sweden

Uganda

USA

Zambia

Zimbabwe

Overviews

Deposits

Geochemistry

Geology

Geomorphology

Geophysics

Foundation

EM

Gravity

Hyperspectral

Magnetotellurics

Maps

Mineral

NLP

Petrography

Last edited: 29/09/2020 The below are a collection of works from when I was doing a review

Public Mineral Prospectivity Mapping

Overview

Geochemistry

Fuzzy

Uncertainty

Geospatial Maps

Australia

South Australia

NT

WA

Brazil

Australia

SA

WA

NT

NSW

Brazil

Carajas

Gurupi

Australia

South Australia

Queensland

New South Wales

Tasmania

Victoria

Western Australia

Endowment Modelling

World Models

Financial Forecasting

Agent based Modelling

Spectral Unmixing

  • Overviews and examples, with some focus on neural network approaches.

Neural Networks

General

Africa

Brazil

China

Greenland

India

Iran

Peru

Spain

Other

About

This page lists resources for mineral exploration and machine learning, generally with useful code and examples.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published