Skip to content

yohannj/rest-hdfs-reading

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Rest HDFS reading

Rest HDFS reading regroups tools that allow reading data on HDFS in a synchronous fashion. The goal is to propose installation guide and benchmark instructions for a variety of solutions that answer different needs. (Performance oriented, cost savvy, etc.)

Documentation

For more information on this project, check the wiki pages.

Solutions / Technology used

Apache-Drill, a query engine to read HDFS data.

Apache-Ignite, used as an in memory file system over HDFS.

A WebService running on Apache-Spark as a long-running job. Serves as an alternative to Apache-Drill to query HDFS data.

Links

Github issues

About

Benchmark of different solutions to read from HDFS in real time

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published