NREL Highly Scalable Data Service (HSDS) Examples
NREL's HSDS service provides public access to several of DOEs high-value datasets available internally on the Eagle HCP System. Due to the high demand for the HSDS service, users with access to NREL’s HPC should pursue direct access through that system.
This repository provides examples and convenience functions for accessing the below datasets using HSDS:
This service operates with the HSDS software developed by the HDF Group and is hosted on Amazon Web Services (AWS) using a combination of EC2 (Elastic Compute) and S3 (Scalable Storage Service). You can read more about the HSDS service in this slide deck.
How to Use
To get started, download Anaconda or another distribution of Python, install the h5pyd library:
pip install --user h5pyd
Next you'll need to configure HSDS:
and enter at the prompt:
hs_endpoint = https://developer.nrel.gov/api/hsds hs_username = hs_password = hs_api_key = 3K3JQbjZmWctY0xmIfSYvYgtIcM3CN0cb1Y2w9bf
IMPORTANT: The example API key here is for demonstation and is rate-limited per IP. To get your own API key, visit https://developer.nrel.gov/signup/
You can also add the above contents to a configuration file at ~/.hscfg
Finally, you can use Jupyter Notebook to view the example notebooks:
cd notebooks jupyter notebook
This software is currently developed and maintained by Michael Rossol (firstname.lastname@example.org). This software was initially developed by Caleb Phillips (email@example.com), John Readey (firstname.lastname@example.org), and Jordan Perr-Sauer (Jordan.Perr-Sauer@nrel.gov) to support the NREL Research Data Initiative and WIND Toolkit at the National Rewnable Energy Laboratory in Golden, Colorado, USA.
Copyright (c) 2017, National Renewable Energy Laboratory (NREL) All rights reserved. See LICENSE for additional information.