Add batch_process tool

[jwalgran]

Overview

A development helper to make processing a CSV a bit more convenient for developers.

Demo

$ ./tools/batch_process 16
[+] Running 1/0
 ⠿ Container open-apparel-registry-database-1  Running                                                                                  0.0s
parse: 2 successes
[+] Running 1/0
 ⠿ Container open-apparel-registry-database-1  Running                                                                                  0.0s
geocode: 2 successes
[+] Running 1/0
 ⠿ Container open-apparel-registry-database-1  Running                                                                                  0.0s
INFO:api.matching:Rebuilding gazetteer
INFO:dedupe.api:reading training from file
INFO:dedupe.training:Final predicate set:
INFO:dedupe.training:(SimplePredicate: (commonTwoTokens, address), SimplePredicate: (sameSevenCharStartPredicate, name))
INFO:dedupe.training:(SimplePredicate: (sameSevenCharStartPredicate, address), SimplePredicate: (wholeFieldPredicate, country))
INFO:dedupe.training:(SimplePredicate: (commonIntegerPredicate, address), SimplePredicate: (sameFiveCharStartPredicate, name))
INFO:rlr.crossvalidation:using cross validation to find optimum alpha...
INFO:rlr.crossvalidation:optimum alpha: 0.100000, score 0.4985716877424044
INFO:dedupe.training:Final predicate set:
INFO:dedupe.training:(SimplePredicate: (commonSixGram, name), SimplePredicate: (sameSevenCharStartPredicate, address))
INFO:dedupe.training:(SimplePredicate: (commonIntegerPredicate, address), SimplePredicate: (sameFiveCharStartPredicate, name))
INFO:dedupe.training:(SimplePredicate: (commonThreeTokens, name), SimplePredicate: (fingerprint, name))
INFO:api.matching:Indexing started
INFO:api.matching:Indexing finished (0:00:00.095603)
INFO:api.matching:Cleanup training
INFO:dedupe.api:0 records
match: 2 successes

Testing Instructions

• Upload a list and note the list id
• Run ./tools/batch_process {id} and verify that it completes without error.

Checklist

• fixup! commits have been squashed
• CI passes after rebase
• CHANGELOG.md updated with summary of features or fixes, following Keep a Changelog guidelines

[TaiWilkin]

I am thrilled that this PR exists. It works perfectly.

I recommend adding instructions / information about this tool to the README before merging.

[jwalgran]

Thanks for the review. I added the script to the "Tools" section of the README in a rebase.