Scraper needs to automatically check if discharged inmates actually discharged #262

Closed
nwinklareth opened this Issue Feb 26, 2014 · 0 comments

Projects

None yet

1 participant

@nwinklareth
Contributor

Sometimes the Sheriff's website fails to display an known inmate's page which causes the scraper to mark the inmate as being discharged. If the same inmate page was requested later the Sheriff's website would serve it up. The scraper needs to check recently discharged inmates to see if they were indeed discharged. Perhaps looking back 2 or 3 days would be sufficient?

@nwinklareth nwinklareth self-assigned this Mar 1, 2014
@nwinklareth nwinklareth added a commit to nwinklareth/cookcountyjail that referenced this issue Mar 1, 2014
@nwinklareth nwinklareth Issue #262 - started adding automatic search of recently discharge in…
…mates if they are truly discharged.
b0cde4c
@nwinklareth nwinklareth added a commit to nwinklareth/cookcountyjail that referenced this issue Mar 1, 2014
@nwinklareth nwinklareth Issue #262 - completed adding confirmation check of recently discharg…
…ed inmates.
d84333f
@nwinklareth nwinklareth added a commit to nwinklareth/cookcountyjail that referenced this issue Mar 2, 2014
@nwinklareth nwinklareth Issue #262 - fixed error in calling sequence in InmatesScraper and di…
…d a bit of refactoring
d068475
@nwinklareth nwinklareth added a commit to nwinklareth/cookcountyjail that referenced this issue Mar 2, 2014
@nwinklareth nwinklareth Issue #262 - fixed message, improved tests, added debug message level…
… to Monitor and added --verbose option to ng_scraper both to help with getting diagnostics from scraper.
8648603
@nwinklareth nwinklareth added a commit to nwinklareth/cookcountyjail that referenced this issue Mar 3, 2014
@nwinklareth nwinklareth Issue #262 - fixed command line argument error. 7bc5a9f
@nwinklareth nwinklareth added a commit to nwinklareth/cookcountyjail that referenced this issue Mar 4, 2014
@nwinklareth nwinklareth Issue #262 - fixed named argument error in call to Monitor. Added try…
…/catch block around scraper code to catch and display any uncaught exceptions.
5bc8dcc
@nwinklareth nwinklareth closed this Mar 5, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment