Skip to content

v0.2.2

Compare
Choose a tag to compare
@bmjjr bmjjr released this 03 Dec 08:51
· 97 commits to master since this release

Fixed a bug in BaseWorker.load_items() method which previously resulted
in losing scrape data when the number of workers did not equal the number
of tasks. Now, using any number of workers or pool size will result in
consistent export/save results. While scrape time will change proportional
to the number of workers assigned. Wrote tests to ensure the same.