Skip to content

Commit

Permalink
Fixed error with cron.sh and reduced the number of concurrent inmate_…
Browse files Browse the repository at this point in the history
…scrapers from 42 to 32.
  • Loading branch information
nwinklareth committed Feb 25, 2014
1 parent 5df5a5f commit 0392674
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion countyapi/management/scraper/inmates_scraper.py
Expand Up @@ -4,7 +4,7 @@

from throwable_commands_queue import ThrowawayCommandsQueue

WORKERS_TO_START = 42 #70
WORKERS_TO_START = 32

CCJ_INMATE_DETAILS_URL = 'http://www2.cookcountysheriff.org/search2/details.asp?jailnumber='

Expand Down
4 changes: 2 additions & 2 deletions cron.sh
Expand Up @@ -7,9 +7,9 @@ V1_LOG_FILE=v1-${LOG_FILE_SUFFIX}
V2_LOG_FILE=v2-${LOG_FILE_SUFFIX}

echo "Starting V1.0 Cook County Jail scraper at `date`"
('${HOME}'/apps/cookcountyjail/scripts/scraper.sh 2>&1 ) > '${HOME}'/logs/${V1_LOG_FILE}
(${HOME}/apps/cookcountyjail/scripts/scraper.sh 2>&1 ) > ${HOME}/logs/${V1_LOG_FILE}

echo "Starting V2.0 Cook County Jail scraper at `date`"
('${HOME}'/website/2.0/websites/active/scripts/scraper.sh 2>&1 ) > '${HOME}'/logs/${V2_LOG_FILE}
(${HOME}/website/2.0/websites/active/scripts/scraper.sh 2>&1 ) > ${HOME}/logs/${V2_LOG_FILE}

echo "Cook County Jail scraper controller finished at `date`"

0 comments on commit 0392674

Please sign in to comment.