SparkCorr

Distributed algorithms to compute distances between all pairs of points (within some range) on a sphere for very large datasets (meaning hundred of millions to billions of objects). Mostly used in astronomy but certainly usefull in many places.

• See details in the paper folder or online
• includes an amazing new progressive pixelization of the sphere (SARSPix) much more adatpted to distance tests (as kNN, crossmatch etc.)
• Class documentation available here