Skip to content

ambling/RedisShuffleManager

Repository files navigation

RedisShuffleManager

A shuffle manager based on Redis for Apache Spark

It seems that, a simple repartition of 10,000,000 Ints with this shuffle manager is 10 times slower than Spark's sort-based shuffling...

About

A shuffle manager based on Redis for Apache Spark

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages