@sckott sckott released this Jan 14, 2019 · 3 commits to master since this release

US federal government shutdown

This very long US federal government shutdown has allowed time for building in nicer failure behavior and more documentation for government shutdowns. There's a number of related changes:

  • better government shutdown failure behavior for the swdi() function (#298)
  • better government shutdown failure behavior for the lcd() function (#295)
  • better failure behavior for all ncdc*() functions (#293) (#297)
  • added a package level manual file section "Where data comes from and government shutdowns"

MINOR IMPROVEMENTS

  • swdi(): changed from downloading data with download.file to crul (#298)
  • fix arc2() tests to not have hard-coded dates (#294)
Assets 2

@sckott sckott released this Dec 3, 2018 · 23 commits to master since this release

NEW FEATURES

  • gains function bsw() for Blended Sea Winds data (#246)
  • gains function ghcnd_read() - to read .dly files directly, e.g., files already downloaded (#223) thanks @shabbychef for the feature request
  • gains function lcd() for Local Climatological Data (#212)
  • gains functions se_data() and se_files() for the Storm Events Database (#282)
  • ghcnd() and ghcnd_search() gain a refresh parameter to refresh data for the query even if it's already cached locally. in addition, these functions now print messages to tell the user what file path the data is locally cached in, and the min and max dates when using ghcnd_search() (#269) thanks @kgmccann
  • ncdc() gains add_units parameter (boolean) to toggle adding units to the output data.frame. default is add_units=FALSE. if add_units=TRUE we match dataset id and data type id and return units if we have them. do be in touch if you see a problem with these units! ncdc() now returns tibbles in the data slot (#233) (#266) (#289) (#287)

MINOR IMPROVEMENTS

  • spelling fixes to coops docs (#228) thanks @jsta
  • fix in ghcnd_search() to arrange data by day instead of by month (#247) thanks @asrivas3 for reporting
  • move swdi() to use xml2 and crul packages instead of XML and httr (#275)
  • added swdi() tests (#239) thanks @kevin-ht-ho
  • isd_stations_search() no longer renames lat and lon column names (#238) thanks @kevin-ht-ho
  • add codemeta keywords to description (#287)
  • replace httr with crul throughout package (#186)
  • many tests use vcr now for caching, more to do waiting on vcr being able to handle direct to disk use cases and binary files like pdfs (#284)
  • fix links in Code of Conduct

BUG FIXES

  • fixes to gefs(). was incorrectly repeating time values within ensembles when it should have repeated time values across ensembles so that each ensemble has a time value for each time period (#230) (#231) thanks for report from @lcsma and fix by @potterzot
  • fix bug in ncdc() - fix to internal function parse_ncdc(), which was failing on strsplit() call if attributes was NULL (#232) thanks for reporting @andypicke
  • fix to cpc_prcp(): URLs were changed at some point, fixes for this (#242)
  • fix to cpc_prcp(): to read .gz files correctly with gzfile instead of file (#248)
  • fix in homr() - NOAA server gives back a 200 OK response even if that's not the case - but we can check content type to see if there was likely an error (#250)
  • fix to autoplot.meteo_coverage (#258)
  • fix to buoy_stations(): was getting the wrong station ids - fixed; and use async HTTP requests to get data faster (#261) thanks @JohnHarley for the bug report
  • fix to ghcnd_stations(): was returning an extra empty row (#267) thanks @joeroe for the bug report
  • related to (#267), ghcnd() was giving a trailing row of NA's - fixed (#270)
  • swdi(): radius parameter doesn't work, update docs to tell users not to use it (#243)
  • ncdc() fix: fix to internal function parse_ncdc(), errored when more than 1 flag returned (#279) thanks @ghaines3 for the bug report
  • buoy fixes (#251)
  • storm_shp() fix: update to use new URL patterns (#263)
  • make swdi() fail better (#274) thanks @OrionDarley
  • fix meteo_nearby_stations() to coerce character to numeric lat and lon values (#257) thanks @mondorescue for the bug report
  • fix to meteo_nearby_stations() - internally ignored the user supplied column names for lat and lon (#286) thanks @ghaines3 for the bug report
  • fixed tornadoes() for Windows OS's: utils::untar() was failing on windows, changed to using utils::unzip() (#203)
  • fixed argo_buoy_files(): use fill=TRUE in the read.table call - was erroring on some Windows OS's (#235) thanks @jonmcalder for reporting
Assets 2

@sckott sckott released this May 5, 2017 · 138 commits to master since this release

Note that some NOAA datasets have changed names:

  • GHCNDMS is now GSOM (Global Summary of the Month)
  • ANNUAL is now GSOY (Global Summary of the Year)

NEW FEATURES

  • isd() gains new parameters additional to toggle whether the
    non-mandatory ISD fields (additional + remarks) are parsed and
    returned & force to toggle whether download new version or use
    cached version. isd_read() gains new parameter additional
    (see description above) (#190)
  • New function for Climate Prediction Center data: cpc_prcp() (#193)
  • New function arc2() to get data from Africa Rainfall Climatology
    version 2 (#201)

MINOR IMPROVEMENTS

  • A number of NOAA services now use https - changed internal code
    to use https from http for coops, swdi, ersst, and tornadoes
    data sources (#187)
  • Changes to sea ice URLs - just internal (#185)
  • Fixes to coops_search() to handle requests better: only certain
    date combinations allowed for certain COOPS products (#213) (#214)
    thanks @tphilippi !
  • Now using hoardr package to manage caching in some functions. Will
    roll out to all functions that cache soon (#191)
  • README img location fix requested by CRAN (#207)
  • GHCNDMS is now GSOM and ANNUAL is now GSOY - added to docs
    and examples of using GSOM and GSOY (#189)

BUG FIXES

  • A number of fixes to isd() (#168)
  • Fixes to coops_search() to fix time zone problems (#184) thanks @drf5n
  • Fixes to ghcnd() - fix some column types that were of inappropriate
    type before (#211)
  • Fix to ghcnd(): we were coercing factors to integers, which caused
    nonsense output - first coercing to character now, then integer (#221)
  • There were problems in parsing flags (attributes) for some datasets
    via ncdc() function. Added metadata to the package to help parse
    flags (#199)
Assets 2

@sckott sckott released this Nov 17, 2016 · 203 commits to master since this release

NEW FEATURES

  • isd() now using a new package isdparser to parse
    NOAA ISD files. We still fetch the file within rnoaa, but the
    file parsing is done by isdparser (#176) (#177) (#180) thanks @mrubayet
    for the push

MINOR IMPROVEMENTS

  • Fixed precipitation units in docs for meteo_* functions (#178)
    thanks @mrubayet

BUG FIXES

  • Fixed bug in ghcnd() where internal unexported function
    was not found (#179)
  • Fix to isd_stations() and isd_stations_search() to work
    correctly on Windows (#181) thanks @GuodongZhu
  • Changed base URL for all NOAA NCDC functions (those starting with
    ncdc) to https from http (#182) thanks @maspotts
  • Changed base URL for all NOAA HOMR functions (those starting with
    homr) to https from http (#183)
Assets 2

@sckott sckott released this Oct 22, 2016 · 224 commits to master since this release

MINOR IMPROVEMENTS

  • Added notes to docs of functions that do file caching - where
    to find cached files.
  • meteo_clear_cache gains parameter force to control force
    parameter in unlink()
  • Removed lubridate usage in seaiceurls() function, just using
    base R functions.

BUG FIXES

  • Fixed bug which was affecting binary installs only. We accidentally
    determined a path on package build, such that the user
    of the CRAN binary build machine got inserted into the path.
    This is now fixed. (#173)
Assets 2

@sckott sckott released this Oct 7, 2016 · 233 commits to master since this release

NEW FEATURES

  • New function isd_read() to read ISD output from isd() manually
    instead of letting isd() read in the data. This is useful when you
    use isd() but need to read the file in later when it's already cached.
    (#169)
  • Some functions in rnoaa cache files that are downloaded from
    various NOAA web services. File caching is usually done when data comes
    from FTP servers. In some of these functions where we cache data, we used
    to write to your home directory, but have now changed all these functions
    to write to a proper cache directory in a platform independent way.
    We determine the cache directory using rappdirs::user_cache_dir().
    Note that this may change your workflow if you'd been depending on
    cached files to be a in particular place on your file system. In addition,
    the path parameter in the changed functions is now defunct, but you
    get an informative warning about it (#171)

MINOR IMPROVEMENTS

  • storm_data() now returns a tibble/data.frame not inside of a list. We used
    to return a list with a single slot data with a data.frame, but this was
    unnecessary.
  • ghcnd_stations() now outputs a data.frame (tbl_df) by itself,
    instead of a data.frame nested in a list. This may change how
    you access data from this function. (#163)
  • Improved docs on token usage for NCDC functions (with prefix
    ncdc_*()) (#167)
  • Added note to isd() docs that when you get an error similar to
    Error: download failed for ftp://ftp.ncdc.noaa.gov/pub/data/noaa/1955/011490-99999-1955.gz,
    the file does not exist on NOAA's ftp servers. If your internet is down,
    you'll get a different error saying as much (#170)
Assets 2

@sckott sckott released this Aug 30, 2016 · 260 commits to master since this release

NEW FEATURES

  • A large PR was merged with a suite of functions. Most functions added
    a prefixed with meteo_*, and are meant to find weather monitors near
    locations (meteo_nearby_stations), find all monitors within a radius
    of a location (meteo_distance), calculate the distances between a
    location and all available stations (meteo_process_geographic_data),
    calculate the distance between two locations (meteo_spherical_distance),
    pull GHCND weather data for multiple weather monitors (meteo_pull_monitors),
    create a tidy GHCND dataset from a single monitor (meteo_tidy_ghcnd),
    and determine the "coverage" for a station data frame (meteo_coverage()).
    In addition, vis_miss() added to visualize missingness in a data.frame. See
    the PR diff against master
    for all the changes. (#159) Thanks a ton to @geanders et al. (@hrbrmstr,
    @masalmon, @jdunic, @njtierney, @leighseverson, @RyanGan, @mandilin, @jferreri,
    @cpatrizio88, @ryan-hicks, @Ewen2015, @mgutilla, @hakessler, @rodlammers)

MINOR IMPROVEMENTS

  • isd_stations_search() changed internal structure. We replaced
    usage of geojsonio and lawn for faster dplyr::filter for
    bbox inputs, and meteo_distance() for lat/long/radius inputs
    . This speeds up this function significantly. Thanks to @lukas-rokka
    (#157)
  • isd_stations_search() and isd_stations() now return
    tibble's instead of data.frame's
  • Removed cached ISD stations dataset within package to reduce
    package size. Only change is now that on first use of the function
    the user has to download the entire thing, but on subsquent
    uses it will pull from the cached version on the users machine.
    isd_stations_search() now caches using rappdirs (#161)
  • Convert all is() uses to inherits()

BUG FIXES

  • Fixed seaiceeurls() function that's used to generate urls for
    the seaice() function - due to change in NOAA urls (#160)
  • Fix to function ghncd_split_vars() to not fail on dplyr::contains
    call (#156) thanks @lawinslow !
Assets 2

@sckott sckott released this May 5, 2016 · 494 commits to master since this release

MINOR IMPROVEMENTS

  • Fixes for new httr version to call encoding explicitly (#135)
  • Fix to broken link for reference to source code used in gefs functions (#121)
  • Speed ups implemented for the isd() function - it's a time consuming task
    as we have to parse a nasty string of characters line by line - more speed
    ups to come in future versions (#146)
  • Replace dplyr::rbind_all() with dplyr::bind_rows() as the former is
    being deprecated (#152)

BUG FIXES

  • Fix for isd() function - was failing on some station names that had
    leading zeros. (#136)
  • Fix for ncdc_stations() - used to allow more than one station id to
    be passed in, but internally only handled one. This is a restriction
    due to the NOAA NCDC API. Documentation now shows an example of how
    to deal with many station ids (#138)
  • Fixes to the suite of ncdc_*() functions to allow multiple inputs
    to those parameters where allowed (#139)
  • Fixed bug in ncdc_plot() due to new ggplot2 version (#153)
  • Fixed bugs in argo() functions: a) with new httr, box input of a vector
    no longer works, now manually make a character vector; b) errant file param
    being passed into the http request, removed (#155)
Assets 2

@sckott sckott released this Jan 25, 2016 · 521 commits to master since this release

NEW FEATURES

MINOR IMPROVEMENTS

  • rgdal moved to Suggests to make usage easier (#125)
  • Changes to ncdc_plot() - made default brakes to just default to what
    ggplot2 does, but you can still pass in your own breaks (#131)
Assets 2

@sckott sckott released this Dec 2, 2015 · 565 commits to master since this release

NEW FEATURES

  • New data source added: NOAA Global Ensemble Forecast System (GEFS) data.
    See functions gefs(), gefs_dimension_values(), gefs_dimensions(), gefs_latitudes(),
    gefs_longitudes(), and gefs_variables() (#106) (#119) thanks @potterzot - he's
    now an author too
  • New data source added: NOAA Extended Reconstructed Sea Surface Temperature
    (ERSST) data. See function ersst() (#96)
  • New function isd_stations() to get ISD station data.
  • Added code of conduct to code repository

MINOR IMPROVEMENTS

  • Swapped ncdf package for ncdf4 package. Windows binaries weren't
    availiable for ncdf4 prior to now. (#117)
  • Proper license info added for javascript modules used inside the
    package (#116)
  • Improvements to isd() function to do transformations of certain
    variables to give back data that makes more sense (#115)
  • leaflet, geojsonio, and lawn added in Suggests, used in a few
    functions.
  • Note added to swdi() function man page that the nldn dataset is
    available to military users only (#107)

BUG FIXES

  • Fix to buoy() function to accept character class inputs for the
    buoyid parameter. the error occurred because matching was not
    case-insensitive, now works regardless of case (#118)
  • Fixes for new ggplot2 version (#113)
  • Built in GET request retries for ghncd functions as
    some URLs fail unpredictably (#110)
Assets 2