Raijin CMIP5

• Raijin has a bunch of CMIP5 data.
• CoE maintains a list of all files here: http://climate-cms.unsw.wikispaces.net/page/diff/CMIP5+data/583900095

The file list is a bit out of date, we should fix that and put it in a standard location on raijin and elsewhere.

build a shiny page with the list somewhere

https://github.com/mdsumner/CMIP5files

get the file list in R on Raijin

Install packages ,

module load R/3.2.2 
Rscript -e 'install.packages("RSQLite", repos = "http://cloud.r-project.org")'
Rscript -e 'install.packages("dplyr", repos = "http://cloud.r-project.org")'

You do need the module load thing every time you log on, but only need to install packages now and then.

module load R/3.2.2 
R

Now start R and read the database.

Soon we'll set up a place to keep the up-to-date copy of this db.

## update this to only download it if it changes (use raadsync)
download.file("http://climate-cms.unsw.wikispaces.net/file/view/cmip5_raijin.db/553966810/cmip5_raijin.db", "cmip5_raijin.db", mode = "wb")

library(dplyr)
cm5 <- src_sqlite("cmip5_raijin.db")
 ## cm5 ## only table is 'cmip5'

files <- tbl(cm5, "cmip5")

select(files, model) %>% collect() %>% distinct()

Source: local data frame [65 x 1]

           model
           (chr)
1      GISS-E2-H
2      GISS-E2-R
3      ACCESS1-3
4  CSIRO-Mk3-6-0
5      ACCESS1-0
6         MIROC5
7     GFDL-ESM2M
8          CCSM4
9    CESM1-WACCM
10     FGOALS-g2
..           ...