Skip to content
master
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
R
 
 
 
 
man
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

Travis-CI Build Status

sparkavro

Load Avro data into Spark with sparklyr. It is a wrapper of spark-avro

Installation

Install using {devtools} as follows:

devtools::install_github("chezou/sparkavro")

Usage

library(sparklyr)
library(sparkavro)
sc <- spark_connect(master = "spark://HOST:PORT")
df <- spark_read_avro(sc, "test_table", "/user/foo/test.avro")

spark_write_avro(df, "/tmp/output")

Example data are from https://github.com/miguno/avro-cli-examples

About

Load Avro data into Spark with sparklyr

Topics

Resources

License

Releases

No releases published

Packages

No packages published

Languages

You can’t perform that action at this time.