Skip to content
This repository has been archived by the owner on Dec 26, 2021. It is now read-only.

financeInfo's log file is incomplete #10

Closed
vincetran96 opened this issue Sep 27, 2021 · 0 comments
Closed

financeInfo's log file is incomplete #10

vincetran96 opened this issue Sep 27, 2021 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@vincetran96
Copy link
Owner

financeInfo's log file does not show downloads stats, etc.:

2021-09-24 20:21:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'bans/status/403': 1,
 'elapsed_time_seconds': 1402.909312,
 'finish_reason': 'CorpAZ is closed; CorpAZ queue is empty; Spider is idling',
 'finish_time': datetime.datetime(2021, 9, 25, 1, 21, 29, 850110),
 'httpcompression/response_bytes': 162246573,
 'httpcompression/response_count': 2135,
 'log_count/INFO': 2910,
 'memusage/max': 61169664,
 'memusage/startup': 55721984,
 'response_received_count': 2136,
 'robotstxt/request_count': 1,
 'robotstxt/response_count': 1,
 'robotstxt/response_status_count/403': 1,
 'scheduler/dequeued/redis': 2135,
 'scheduler/enqueued/redis': 2135,
 'start_time': datetime.datetime(2021, 9, 25, 0, 58, 6, 940798)}
@vincetran96 vincetran96 added the bug Something isn't working label Sep 27, 2021
@vincetran96 vincetran96 self-assigned this Sep 27, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant