Skip to content
/ torque Public

Serialize your Spark Dataframes to and from Avro

License

Notifications You must be signed in to change notification settings

alivcor/torque

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Serialize your Spark Dataframes to and from Avro.

This project provided serialization/deserialization for seamless conversion between spark dataframes and avro.

However, Spark 2.4 added several methods within Spark for converting Spark DataFrames & Avro Generic Records.

I'll try to update the code, it's work in progress.

Releases

No releases published

Packages

No packages published

Languages