Utilities for easily loading big data from relational databases directly into ffdf objects in R.
R
Latest commit 6a283dc Jul 23, 2016 @jwijffels committed on GitHub Merge pull request #4 from mpancia/master
Changed fetch call to dbFetch call.
Permalink
Failed to load latest commit information.
R Changed fetch call to dbFetch call. Jul 23, 2016
inst
man Changed fetch call to dbFetch call. Jul 23, 2016
.Rbuildignore Changed fetch call to dbFetch call. Jul 23, 2016
.gitignore
.travis.yml Travis continued May 16, 2015
DESCRIPTION
ETLUtils.Rproj Rstudio & .gitignore May 16, 2015
NAMESPACE Changed fetch call to dbFetch call. Jul 23, 2016
NEWS added odbcDriverConnect.args argument to read.odbc.ffdf Dec 18, 2015
README.md Readme changes May 16, 2015

README.md

Build Status License Downloads

ETLUtils

ETLUtils provides utility functions to execute standard ETL operations (using package ff) on large data. Currently the following functions might be useful to you if you have some large dataset in SQL and want to import it immediately in an ffdf object

  • read.dbi.ffdf (reading of SQL data through DBI)
  • read.odbc.ffdf (reading of SQL data through RODBC)
  • read.jdbc.ffdf (reading of SQL data through RJDBC)

An example can be found at http://www.bnosac.be/blog/19-get-your-large-sql-data-in-ff-swiftly

For users who want to store data from an ffdf back in a database, the package also provides

  • write.dbi.ffdf (writing of ffdf data to a database table through DBI)
  • write.odbc.ffdf (writing of ffdf data to a database table through RODBC)
  • write.jdbc.ffdf (writing of ffdf data to a database table through RJDBC)

Other utilities

Other functions include factorise, matchmerge, recoder, naLOCFPlusone and renameColumns.

CRAN

This is the development version of the package which is available at CRAN.

To install the latest version from github:

devtools::install_github("jwijffels/ETLUtils")

To get the lastest version from CRAN: