Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bench_12km dataset for WRF from UCAR #112

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 24 additions & 0 deletions data/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
# Data repository for benchmarks

## Introduction

As part of the EESSI framework, the ReFrame testing infrastructure is set up. Through this framework, both
the functionality and performance of libraries and applications can be verified on different architectures.
For some of the application benchmarks we need reasonably large input data. This github repository will host the
different download scripts to pull this data into cvmfs and allow fast and consistent delivery during the benchmarks
without burdening the data hosting of the datasuppliers.

## Layout

example for WRF Conus 12km dataset:
``` data/w/WRF/bench_12km ```
* data: data directory root
* w: hierarchy mapper
* WRF: application as identified in EasyConfigs
* bench_12km: benchmark name

## Download script

The download script is expected to download and expand the dataset into the same directory as the script, in such
way that the data is directly usable by the application. Additional steps that would require a copy such as unzipping \
or untarring should not be needed to run the benchmarks.
1 change: 1 addition & 0 deletions data/w/WRF/bench_12km.tar.bz2.md5
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
a961ba09bd9ee8081b6d5ef764e7095b bench_12km.tar.bz2
7 changes: 7 additions & 0 deletions data/w/WRF/download-bench_12km.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
#!/bin/bash

wget http://www2.mmm.ucar.edu/wrf/bench/conus12km_v3911/bench_12km.tar.bz2
md5sum -c bench_12km.tar.bz2.md5 || exit
bunzip2 bench_12km.tar.bz2
tar -xf bench_12km.tar
rm -rf bench_12km.tar
3 changes: 3 additions & 0 deletions data/w/WRF/license-bench_12km.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
To the extent that any materials published in a UCAR data repository are protected by copyright, you are hereby granted a license to use such material, unless otherwise stated, subject to the terms and conditions of the Creative Commons Attribution 4.0 International license (https://creativecommons.org/licenses/by/4.0/legalcode). To the extent that any materials published in a UCAR data repository are not protected by copyright, you are hereby granted permission to use such materials for any lawful purpose. When using any materials obtained from a UCAR data repository, you agree to use the recommended data citation format provided by that UCAR data repository. If you have questions concerning this recommendation please contact the user online help service at the UCAR data repository.

ALL MATERIALS PUBLISHED IN A UCAR DATA REPOSITORY ARE PROVIDED “AS IS”. UCAR DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. IN NO EVENT SHALL UCAR BE LIABLE FOR ANY DAMAGES OF ANY NATURE SUFFERED BY YOU, ANY USER, OR ANY THIRD PARTY. IN NO EVENT SHALL UCAR BE LIABLE FOR ANY SPECIAL, INDIRECT PUNITIVE OR CONSEQUENTIAL DAMAGES OR ANY LOSS OR DAMAGES WHATSOEVER, INCLUDING, BUT NOT LIMITED TO, CLAIMS ASSOCIATED WITH THE LOSS OF DATA OR PROFITS THAT ARISE OUT OF OR IN CONNECTION WITH THE ACCESS, USE, CONTENT, PERFORMANCE OR RELIANCE ON THE DATA.