Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Parallelization of Steps #12

Open
rviscomi opened this Issue Mar 8, 2013 · 0 comments

Comments

Projects
None yet
1 participant
Owner

rviscomi commented Mar 8, 2013

Instead of waiting for all user profiles to load before converting locations to geocodes, use a producer/consumer pattern to feed locations into a buffer and process them per the API rate limiting.

This parallelization should significantly speed up total processing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment