Skip to content

Set of classes for creating Java based MR jobs that use the Avro format and the NEW MR API.

Notifications You must be signed in to change notification settings

gwestersf/avro-mapreduce

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 

Repository files navigation

Set of classes useful for using Avro files with the new MapReduce API. Most of this is copied from / modeled after the original Avro mapred support. The approach for mapper and reducers is slightly different though. The original Avro mapred support fully wraps the actual mapper and reducer and abstracts the framework away from the Avro mapper and reducer. In this approach the Avro mapper and reducer are just subclasses of a specialized mapper and reducer implementation present here.

See the unit test for some examples of how to use.

About

Set of classes for creating Java based MR jobs that use the Avro format and the NEW MR API.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published