search doesn't complete

[edsu]

I don't know if the API has changed but It seems like when twarc reaches the end of results it repeats lookups for the last tweet it found. So you end up seeing something like this in your log.

2015-04-14 21:40:28,978 INFO archived 585331966372872192
2015-04-14 21:40:29,271 INFO archived 585331966372872192
2015-04-14 21:40:29,729 INFO archived 585331966372872192
2015-04-14 21:40:30,066 INFO archived 585331966372872192
2015-04-14 21:40:30,363 INFO archived 585331966372872192
2015-04-14 21:40:30,453 INFO archived 585331966372872192
2015-04-14 21:40:30,543 INFO archived 585331966372872192
2015-04-14 21:40:30,628 INFO archived 585331966372872192
2015-04-14 21:40:30,767 INFO archived 585331966372872192
2015-04-14 21:40:30,886 INFO archived 585331966372872192
2015-04-14 21:40:30,985 INFO archived 585331966372872192
2015-04-14 21:40:31,057 INFO archived 585331966372872192
2015-04-14 21:40:31,148 INFO archived 585331966372872192
2015-04-14 21:40:31,239 INFO archived 585331966372872192
2015-04-14 21:40:31,391 INFO archived 585331966372872192
2015-04-14 21:40:31,545 INFO archived 585331966372872192