Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

downloading CMIP6 models get sutck with some variables #56

Open
IsaakBM opened this issue Jun 23, 2022 · 1 comment
Open

downloading CMIP6 models get sutck with some variables #56

IsaakBM opened this issue Jun 23, 2022 · 1 comment
Labels
question Further information is requested

Comments

@IsaakBM
Copy link

IsaakBM commented Jun 23, 2022

Hello! I've been having issues downloading models. For some reason, it get stuck in most of the files that I've tried to pull. See some examples using this code for the variable o2.

Thanks for any help!

idx <- init_cmip6_index(
  # only consider ScenarioMIP activity
    activity = "ScenarioMIP",
  # specify dry-bulb temperature and relative humidity
    variable = "o2",
  # specify report frequent
    frequency = "mon",
  # specify experiment name
    experiment = c("ssp126", "ssp245", "ssp585"),
  # specify GCM name
    source = NULL,
  # specify variant
    variant = "r1i1p1f1",
  # More options
    replica = FALSE,
    latest = TRUE,
    resolution = NULL,
    data_node = NULL,
  # specify years of interest
    years = c(seq(2022, 2100, 1)),
  # save to data dictionary
    save = TRUE,
)

esm <- idx$file_url[1]

download.file(url = esm[1],
              destfile = paste0("inputs/o2/", basename(esm[1])),
              cacheOK = TRUE,
              extra = "--random-wait --retry-on-http-error=503",
              mode = "wb")
@hongyuanjia
Copy link
Member

hongyuanjia commented Jun 27, 2022

Hi. Sorry for the late. The data nodes that hold the CMIP experiment results sometimes can down. You can run get_data_node() to see if that specific data node went down at the current time. This probably is the reason.

                    data_node status
                       <char> <char>
 1:            aims3.llnl.gov     UP
 2:           cmip.bcc.cma.cn     UP
 3:          cordexesg.dmi.dk     UP
 4:     crd-esgf-drc.ec.gc.ca     UP
 5:      data.meteo.unican.es     UP
 6:    dpesgf03.nccs.nasa.gov     UP
 7:   esg-cccr.tropmet.res.in     UP
 8:        esg-dn1.nsc.liu.se     UP
 9:          esg-dn1.ru.ac.th     UP
10:        esg-dn2.nsc.liu.se     UP
11:            esg.camscma.cn     UP
12:            esg.lasg.ac.cn     UP
13:        esg.pik-potsdam.de     UP
14:          esg1.umr-cnrm.fr     UP
15:          esg2.umr-cnrm.fr     UP
16:     esgdata.gfdl.noaa.gov     UP
17:    esgf-cnr.hpc.cineca.it     UP
18:          esgf-data.csc.fi     UP
19:     esgf-data1.diasjp.net     UP
20:       esgf-data1.llnl.gov     UP
21:       esgf-data2.llnl.gov     UP
22:     esgf-data3.diasjp.net     UP
23: esgf-nimscmip6.apcc21.org     UP
24:         esgf-node.cmcc.it     UP
25:        esgf-node2.cmcc.it     UP
26:              esgf.anl.gov     UP
27:           esgf.apcc21.org     UP
28:               esgf.bsc.es     UP
29:           esgf.ceda.ac.uk     UP
30:               esgf.dwd.de     UP
31:        esgf.nccs.nasa.gov     UP
32:   esgf.rcec.sinica.edu.tw     UP
33:             esgf2.dkrz.de     UP
34:         vesg.ipsl.upmc.fr     UP
35: cmip.dess.tsinghua.edu.cn   DOWN
36:           cmip.fio.org.cn   DOWN
37:  dataserver.nccs.nasa.gov   DOWN
38:      dist.nmlab.snu.ac.kr   DOWN
39:       eridanus.eoc.dlr.de   DOWN
40:        esgf-data.ucar.edu   DOWN
41:     esgf-data2.diasjp.net   DOWN
42:   esgf-ictp.hpc.cineca.it   DOWN
43:             esgf.ichec.ie   DOWN
44:           esgf.nci.org.au   DOWN
45:             esgf1.dkrz.de   DOWN
46:             esgf3.dkrz.de   DOWN
47:     noresg.nird.sigma2.no   DOWN
48:        polaris.pknu.ac.kr   DOWN
                    data_node status

@hongyuanjia hongyuanjia added the question Further information is requested label Jun 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants