You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Bounded and Balanced Partitioner (two stages, edges belongs to vertex partition that has larger degree, and a re-balanced partitioner, details later. )
The text was updated successfully, but these errors were encountered:
BBR has been tested. Experimental result suggests that BBR is slower than DBH when both partitioners work, but when the topic number is large or it has too many partitions, DBH can't work while BBR works well.
Label propagation partitioner has basically close performance with BBR, but it has two weaknesses: 1. It is an iterative algorithm so it need re-partition again and again so it is slow; 2. It needs transfer a P * P matrix in each iteration which P is the partition number. When P is large, the rdd.collect() call can be very slow and cause the driver OOM.
There are four partitioning strategies in GraphX:
Besides, we also implemented:
The text was updated successfully, but these errors were encountered: