Skip to content

convergence pangeo + NASA CMR + NASA data on the cloud

Notifications You must be signed in to change notification settings

pangeo-data/cmr

Repository files navigation

pangeo in relation to CMR

CMR is the NASA Common Metadata Repository

Introduction

This repo asks (answers) some pangeo-centric questions...

NASA intends the pangeo project will support access to earth remote sensing data (and related) via the public cloud and technologies built thereupon. This involves organized/automated computing horsepower and infrastructure. In turn this begs a number of questions, foremost 'What is the learning process that enables a scientist to take advantage of both pangeo and CMR?' Jointly 'What does this pantheon of data look like?' and 'Are there other comparable resources (type, style, scope) to be aware of?'

We begin in the notebooks with basic tactics; basically How to access metadata from the NASA CMR from a Jupyter notebook? However this repo is really a higher-level effort to get our collective arms around the learning and adoption process, by example. We have links to outreach efforts such as Damien Irving's excellent software carpentry sequence on Python for Ocean and Atmospheric Sciences. We provide Python notebooks that demonstrate a set of useful tools applied to various data resources.

Links

Education and Outreach

Organizations

Tech and Tactics

External resources

  • NASA-external platforms for working with NASA-generated data like LANDSAT
  • NASA-external data sources
  • Web Mapping Services
    • Includes map controls like ipyleaflet
    • Search 'NASA WMS' to find NASA (often Goddard) Web Mapping Services.
      • Add to ipyleaflet Map; GetCapabilities and layer qualifiers help needed

More Tactics

As I am running into debugging issues I'm recording some installation steps on an EC2 instance with the idea of using an AMI to grab horsepower/RAM/disk space as needed.

wget https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
bash Miniconda3-latest-Linux-x86_64.sh
rm Miniconda3-latest-Linux-x86_64.sh

This install miniconda. Then we have an environment config/activate:

conda create -n golive python=3.6
conda activate golive

...and requirements.txt...

boto3==1.9.78
obspy==1.1.0
Pillow==5.4.1

...and some package installations not in the requirements...

conda install pandas
conda install netcdf4
conda install xarray
conda install ipywidgets

About

convergence pangeo + NASA CMR + NASA data on the cloud

Resources

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages