2023-11-28 01:57:48 [scrapy.utils.log] INFO: Scrapy 2.11.0 started (bot: gazette) 2023-11-28 01:57:48 [scrapy.utils.log] INFO: Versions: lxml 4.9.3.0, libxml2 2.10.3, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.2, Twisted 22.10.0, Python 3.10.11 (main, Jul 13 2023, 17:23:56) [GCC 9.4.0], pyOpenSSL 23.2.0 (OpenSSL 3.1.3 19 Sep 2023), cryptography 41.0.4, Platform Linux-5.15.0-88-generic-x86_64-with-glibc2.31 2023-11-28 01:57:48 [se_divina_pastora] INFO: Collecting all gazettes available from the beginning 2023-11-28 01:57:48 [se_divina_pastora] INFO: Collecting all gazettes available until today 2023-11-28 01:57:48 [scrapy.addons] INFO: Enabled addons: [] 2023-11-28 01:57:48 [py.warnings] WARNING: /home/trevo/Desktop/Juliana/Repositorios/OKBR/querido-diario/.venv/lib/python3.10/site-packages/scrapy/utils/request.py:254: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2023-11-28 01:57:48 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2023-11-28 01:57:48 [scrapy.extensions.telnet] INFO: Telnet Password: ab01d96a0d1e90c9 2023-11-28 01:57:49 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon', 'gazette.extensions.StatsPersist'] 2023-11-28 01:57:49 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'gazette', 'DOWNLOAD_TIMEOUT': 360, 'FILES_STORE_S3_ACL': 'public-read', 'LOG_FILE': 'se_divina_pastora_completa.txt', 'NEWSPIDER_MODULE': 'gazette.spiders', 'SPIDER_MODULES': ['gazette.spiders'], 'USER_AGENT': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:108.0) ' 'Gecko/20100101 Firefox/108.0'} 2023-11-28 01:57:49 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy_zyte_smartproxy.ZyteSmartProxyMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2023-11-28 01:57:49 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2023-11-28 01:57:49 [scrapy.middleware] INFO: Enabled item pipelines: ['gazette.pipelines.GazetteDateFilteringPipeline', 'gazette.pipelines.DefaultValuesPipeline', 'gazette.pipelines.QueridoDiarioFilesPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline', 'gazette.pipelines.SQLDatabasePipeline'] 2023-11-28 01:57:49 [scrapy.core.engine] INFO: Spider opened 2023-11-28 01:57:50 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2023-11-28 01:57:50 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2023-11-28 01:57:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:57:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial) 2023-11-28 01:58:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-10', 'edition_number': '1', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15hkSSqay07w_zonJqrFrf1bVQXEGpjen'], 'files': [{'checksum': 'dad620ed139157b177802c61c878feff', 'path': '2802007/2019-01-10/11b5139e1546eed0c0d59c1078705f7f4b45d8cf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15hkSSqay07w_zonJqrFrf1bVQXEGpjen'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.244602Z', 'territory_id': '2802007'} 2023-11-28 01:58:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-23', 'edition_number': '7', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JO8_qg4l8gAICnQXnyl8eqkR3cfNMyZA'], 'files': [{'checksum': '7fcae3d90196f9bc23cc24d5097c1d1d', 'path': '2802007/2019-01-23/680496fd4dc33a072a7ae1b5a23983db095e4360', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JO8_qg4l8gAICnQXnyl8eqkR3cfNMyZA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.271187Z', 'territory_id': '2802007'} 2023-11-28 01:58:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-24', 'edition_number': '8', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EZdGau0CKy_CTPh6KLWQ-DMYw21Fn4bi'], 'files': [{'checksum': '4d3830a3475cbdc11f3cc9cb04d67dc6', 'path': '2802007/2019-01-24/71a41bd4c9e615784f2a6033d850d367c1d25b51', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EZdGau0CKy_CTPh6KLWQ-DMYw21Fn4bi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.277773Z', 'territory_id': '2802007'} 2023-11-28 01:58:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-25', 'edition_number': '9', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ahaFNpGDI63Md_s2OyYUGIOhV_ywigJ5'], 'files': [{'checksum': '138dce4b345332be9f9b8fad5ab177e9', 'path': '2802007/2019-01-25/01d09d58963ef121b67b2fb739be60996863449b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ahaFNpGDI63Md_s2OyYUGIOhV_ywigJ5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.283307Z', 'territory_id': '2802007'} 2023-11-28 01:58:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-28', 'edition_number': '10', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HmTLbKUwNqq4AIaUk2yRp_fiQgoSFhyr'], 'files': [{'checksum': 'b82d19231ed8a32a333def0ca35a7dff', 'path': '2802007/2019-01-28/1e066d830863c41717ad72626367236bdca2e8e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HmTLbKUwNqq4AIaUk2yRp_fiQgoSFhyr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.285487Z', 'territory_id': '2802007'} 2023-11-28 01:58:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-30', 'edition_number': '12', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QGPP3c3prt0YAVjHpXqbitGoKeSDMK1Y'], 'files': [{'checksum': 'c47aff3166979b34dc76110f92be176b', 'path': '2802007/2019-01-30/62cd91990df97d59e030be3fade9788c51f30d3b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QGPP3c3prt0YAVjHpXqbitGoKeSDMK1Y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.293395Z', 'territory_id': '2802007'} 2023-11-28 01:58:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-31', 'edition_number': '13', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yPFcNX2AOFzZssKeHpxePZixPSvBJtDU'], 'files': [{'checksum': '0ee28159cc3779f06eaad3bc2015d73e', 'path': '2802007/2019-01-31/380352f0e534c38f80c11d6334794720e62d4931', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yPFcNX2AOFzZssKeHpxePZixPSvBJtDU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.295528Z', 'territory_id': '2802007'} 2023-11-28 01:58:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-01', 'edition_number': '14', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aHgRG7yWnw5uXElS94dlTCup8lVMS9j2'], 'files': [{'checksum': '9355c1618a42e761d91a5db67adf9ef7', 'path': '2802007/2019-02-01/833acdae4285809ef2634664082af957eb5e79ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aHgRG7yWnw5uXElS94dlTCup8lVMS9j2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.297574Z', 'territory_id': '2802007'} 2023-11-28 01:58:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-06', 'edition_number': '15', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19inKvzr6QhsCBGBdgCsLPk1LsOrwwnqV'], 'files': [{'checksum': 'ff26085d1620a0a1e3a75b20978c467c', 'path': '2802007/2019-02-06/4d50b664bd69c417799876ea9fd130c8956f0b0f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19inKvzr6QhsCBGBdgCsLPk1LsOrwwnqV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.299791Z', 'territory_id': '2802007'} 2023-11-28 01:58:50 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 11 pages/min), scraped 9 items (at 9 items/min) 2023-11-28 01:58:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-07', 'edition_number': '16', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rCxtCehMKzP7Bv8aUHd4Vk9uXFK3rb46'], 'files': [{'checksum': '54cc059d9ff5a99e4975ca6e5caea48c', 'path': '2802007/2019-02-07/fb394a295db8261c0f602c875a264d251a569a0d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rCxtCehMKzP7Bv8aUHd4Vk9uXFK3rb46'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.301825Z', 'territory_id': '2802007'} 2023-11-28 01:58:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-14', 'edition_number': '3', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zlPrbCuyU4bSbxtQ6Dkf1HXr2kG8S005'], 'files': [{'checksum': '00c9d4516af1629282e31be151a809a0', 'path': '2802007/2019-01-14/652076b58f6269ccfd3691135e950773c68c99bb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zlPrbCuyU4bSbxtQ6Dkf1HXr2kG8S005'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.253305Z', 'territory_id': '2802007'} 2023-11-28 01:58:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:58:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-29', 'edition_number': '11', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_FJi-RAFarNWqyo_O8KeCTTIlpl9Qm_V'], 'files': [{'checksum': '30fc72be2d3970af9d60b1b92d2bc297', 'path': '2802007/2019-01-29/909c260e1a75861b1bdd0d9b6535b4f041f2c5bb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_FJi-RAFarNWqyo_O8KeCTTIlpl9Qm_V'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.287513Z', 'territory_id': '2802007'} 2023-11-28 01:59:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-16', 'edition_number': '5', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1htvTnSqGKUb-G6QPJ_LISNxZ1Iyb21yn'], 'files': [{'checksum': '5aaebca6260dfb96c34d282f56012bf0', 'path': '2802007/2019-01-16/415ce9dc44e65806252532b820c3e775aa8b1041', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1htvTnSqGKUb-G6QPJ_LISNxZ1Iyb21yn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.262421Z', 'territory_id': '2802007'} 2023-11-28 01:59:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-13', 'edition_number': '19', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O3E9gEPHUlOLkM6vC9QF0siFeO71XJL4'], 'files': [{'checksum': 'a7262edcc0a47e959bc688ab6caff448', 'path': '2802007/2019-02-13/1d16caf58548bb3d3026a9f32076c5b85d45ebf0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O3E9gEPHUlOLkM6vC9QF0siFeO71XJL4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.310991Z', 'territory_id': '2802007'} 2023-11-28 01:59:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-08', 'edition_number': '17', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O8eYN-brN1dcT2nVj3tB4hSezV6euF3y'], 'files': [{'checksum': 'a5a48fad0fc37eccb5677651ba25e399', 'path': '2802007/2019-02-08/b72a75af3e6fb8253c3797d3f5ea36a3028722c4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O8eYN-brN1dcT2nVj3tB4hSezV6euF3y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.306610Z', 'territory_id': '2802007'} 2023-11-28 01:59:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-13', 'edition_number': '18', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jmOFgqrP_EBG1dgn4L-n18ADEqCEw9qU'], 'files': [{'checksum': '2b31271285965bc0468aa8acf61a4cfc', 'path': '2802007/2019-02-13/8cb28103da0896a66f65f190f3ee53ca4ade7141', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jmOFgqrP_EBG1dgn4L-n18ADEqCEw9qU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.308946Z', 'territory_id': '2802007'} 2023-11-28 01:59:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-19', 'edition_number': '22', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y9Gnzvr94G19PvwW2q9hUPXJMBFELzcV'], 'files': [{'checksum': 'b620e91baba9e2102a5abe58642e90c2', 'path': '2802007/2019-02-19/396369259e4ced4bf7e11cc9716785f8b4b8e792', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y9Gnzvr94G19PvwW2q9hUPXJMBFELzcV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.322191Z', 'territory_id': '2802007'} 2023-11-28 01:59:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-14', 'edition_number': '20', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KLwCl0UWsvN2fNDRViMCKa-Q16-b287H'], 'files': [{'checksum': '1bf428fa503001a0c22018fd39502857', 'path': '2802007/2019-02-14/c73889323bf79faf8ea4616e29493501e91a3b18', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KLwCl0UWsvN2fNDRViMCKa-Q16-b287H'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.313004Z', 'territory_id': '2802007'} 2023-11-28 01:59:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-22', 'edition_number': '25', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15fLBZgn7PH_J9RFWDz5ovpRz4AhAHKaw'], 'files': [{'checksum': '4561e3c4881cffe96640c5342184818d', 'path': '2802007/2019-02-22/1b3798036bb08c872627fd1ec8e8dce8aaa5782e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15fLBZgn7PH_J9RFWDz5ovpRz4AhAHKaw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.328577Z', 'territory_id': '2802007'} 2023-11-28 01:59:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-21', 'edition_number': '24', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XY-NEipeUqrUSn9DQC48V02FI0NLdvKd'], 'files': [{'checksum': '2086b2dd617b5bfa42e54559becdf6e0', 'path': '2802007/2019-02-21/49da42ad0ddf6624bce24017bb78455b43c4a8a0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XY-NEipeUqrUSn9DQC48V02FI0NLdvKd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.326391Z', 'territory_id': '2802007'} 2023-11-28 01:59:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-27', 'edition_number': '28', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wi3g44hk77ctJQOxjzLXUkyg5cuG4Xa3'], 'files': [{'checksum': '524175ece12c7a9c84c89c393451ffd7', 'path': '2802007/2019-02-27/7b25391b8384476510dc3eec12e3bd62a15f94fc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wi3g44hk77ctJQOxjzLXUkyg5cuG4Xa3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.341144Z', 'territory_id': '2802007'} 2023-11-28 01:59:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-28', 'edition_number': '29', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1g1uOMUqAsL9QwRztKPTTFipBhJ5AGV1s'], 'files': [{'checksum': '980fae49cf9e416a61959910a47d7caf', 'path': '2802007/2019-02-28/1adf511cc8e129cbd91f9fb55c7b1fd45a683027', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1g1uOMUqAsL9QwRztKPTTFipBhJ5AGV1s'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.343214Z', 'territory_id': '2802007'} 2023-11-28 01:59:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-26', 'edition_number': '27', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1v6B7PYtL4_a22t_pqhXilMb8vMVVIjoV'], 'files': [{'checksum': '8e4ea87f0685f49403c84185bcc1934b', 'path': '2802007/2019-02-26/692a25957431b7ecb6fe6ec0847353fab8adbc3d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1v6B7PYtL4_a22t_pqhXilMb8vMVVIjoV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.338843Z', 'territory_id': '2802007'} 2023-11-28 01:59:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-07', 'edition_number': '31', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ms9mQ5EbUVe4UD2ZIhG_5GB0kpt22XMc'], 'files': [{'checksum': '3b2c54a123c511da2248f54920fd558a', 'path': '2802007/2019-03-07/6139c6a2166ec450021b4ac3d71333ba7499ea14', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ms9mQ5EbUVe4UD2ZIhG_5GB0kpt22XMc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.347354Z', 'territory_id': '2802007'} 2023-11-28 01:59:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-08', 'edition_number': '32', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vgcSDebb3_RYVRtRBbLoo3Q7opc0MZl7'], 'files': [{'checksum': '6d4cb37daf0314e42e5340d558690fe0', 'path': '2802007/2019-03-08/66424315807f7526b1a748ad69204af38a773544', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vgcSDebb3_RYVRtRBbLoo3Q7opc0MZl7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.359265Z', 'territory_id': '2802007'} 2023-11-28 01:59:50 [scrapy.extensions.logstats] INFO: Crawled 27 pages (at 16 pages/min), scraped 25 items (at 16 items/min) 2023-11-28 01:59:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-11', 'edition_number': '33', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ew48PZKyTZQWR7Aq_ZfGzGs3Iz0e2UFO'], 'files': [{'checksum': 'ec20acb49963158c96065a978a31ae2e', 'path': '2802007/2019-03-11/da6b417cfbfad359c3b2dcc02bcb201a43d1c3e7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ew48PZKyTZQWR7Aq_ZfGzGs3Iz0e2UFO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.361412Z', 'territory_id': '2802007'} 2023-11-28 01:59:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-01', 'edition_number': '30', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Sk0zjnSXS25Zf3t0sBByospDGxwgAB3f'], 'files': [{'checksum': 'f14a0faf2b2eab6d6c2f7206da2d6854', 'path': '2802007/2019-03-01/6b7ad5b1768036c98e0856f8cc968f52ba179f3f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Sk0zjnSXS25Zf3t0sBByospDGxwgAB3f'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.345253Z', 'territory_id': '2802007'} 2023-11-28 01:59:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 01:59:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 01:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-12', 'edition_number': '34', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WNBC6j1JlkZ9LP59ZUPGSkEHiE_WUioU'], 'files': [{'checksum': '3137f586ba1fbb9409fb5b64024108fd', 'path': '2802007/2019-03-12/3cb4996915e5e800b17edbd796c05b17565f151d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WNBC6j1JlkZ9LP59ZUPGSkEHiE_WUioU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.363423Z', 'territory_id': '2802007'} 2023-11-28 02:00:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-14', 'edition_number': '36', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ynN5zPE_QSzsUBe09hE_maI3H8FOqiux'], 'files': [{'checksum': 'e2cdb4f3dd2dfdc6cbfdc72bc903ee17', 'path': '2802007/2019-03-14/ca0d911a527409aa050f15552b5bb7343864066c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ynN5zPE_QSzsUBe09hE_maI3H8FOqiux'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.367590Z', 'territory_id': '2802007'} 2023-11-28 02:00:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-25', 'edition_number': '26', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BrR9LRpqgd3jkFyazGqCgnalIYQN_IX1'], 'files': [{'checksum': 'c5a1f49e86e345bd4446077cf7593e40', 'path': '2802007/2019-02-25/a2dcf45b950e5d80899d185d05049f88af42daeb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BrR9LRpqgd3jkFyazGqCgnalIYQN_IX1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.330620Z', 'territory_id': '2802007'} 2023-11-28 02:00:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-15', 'edition_number': '37', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FI3Mdd8vdLJ6pgozS77JOtxErqaOnqXW'], 'files': [{'checksum': 'b5da5b0afd2e661ea36f2fdb5469cf7b', 'path': '2802007/2019-03-15/ed76e6a120d64f0c60768ea0a0b2e9298f23d6a8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FI3Mdd8vdLJ6pgozS77JOtxErqaOnqXW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.369941Z', 'territory_id': '2802007'} 2023-11-28 02:00:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-19', 'edition_number': '38', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RUwo5LFJxn7dNFWoVFiPyJYC5qdJVXcI'], 'files': [{'checksum': 'baa14b16d22ef871826f0c91abd2bc71', 'path': '2802007/2019-03-19/2270cc6dc9178cb135fef8215967967a374b0614', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RUwo5LFJxn7dNFWoVFiPyJYC5qdJVXcI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.372109Z', 'territory_id': '2802007'} 2023-11-28 02:00:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-20', 'edition_number': '40', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1X3Dq7gXsMWsCq-PRl5myTXYbTugogY-L'], 'files': [{'checksum': '1ff8a3df7ec1aae9229a9261982e6dfa', 'path': '2802007/2019-03-20/99cf66810c2084a8ff89ac606e0cb6498f678e60', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1X3Dq7gXsMWsCq-PRl5myTXYbTugogY-L'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.376141Z', 'territory_id': '2802007'} 2023-11-28 02:00:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-13', 'edition_number': '35', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1poJmO6fQr1Hpaktr8J2WYeAefXIuAdmn'], 'files': [{'checksum': 'b436e81625fbe60f610cdaa2b6698177', 'path': '2802007/2019-03-13/fd7df52cd16704580da063c904869792cc5a871f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1poJmO6fQr1Hpaktr8J2WYeAefXIuAdmn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.365597Z', 'territory_id': '2802007'} 2023-11-28 02:00:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-25', 'edition_number': '42', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14mv48PSJF-pW6IvmZM0epWSIYSx9oTba'], 'files': [{'checksum': 'f464ee7de4240f86c728e7677b6793f8', 'path': '2802007/2019-03-25/0c80eb456acb0b5e959d17aadc906c6fdf4e99fa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14mv48PSJF-pW6IvmZM0epWSIYSx9oTba'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.382275Z', 'territory_id': '2802007'} 2023-11-28 02:00:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-20', 'edition_number': '23', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VUOxPF0cmtNwkXsiohLg5ioC2nujshq-'], 'files': [{'checksum': 'bd36ec50448e5f3e86d97248ab7ede96', 'path': '2802007/2019-02-20/d993bf1e8d041d44dc1e9528bdd9364401042794', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VUOxPF0cmtNwkXsiohLg5ioC2nujshq-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.324386Z', 'territory_id': '2802007'} 2023-11-28 02:00:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-21', 'edition_number': '41', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JAJxrOBU3IirqMg3GeZjY0EMGBfbOvuG'], 'files': [{'checksum': '7f1f8f2ca6e46e22e42ff2622fe19f10', 'path': '2802007/2019-03-21/fe311e30d52eb9d0f9af80504c2984ad483c4db2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JAJxrOBU3IirqMg3GeZjY0EMGBfbOvuG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.378362Z', 'territory_id': '2802007'} 2023-11-28 02:00:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-28', 'edition_number': '44', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ukPmha0WX_UWM5f6j4JcCSql_5Jw-9By'], 'files': [{'checksum': 'ce31145aed5b3576835748a86bfd106c', 'path': '2802007/2019-03-28/437535578f17fcdc891168d7540f1463e84908b5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ukPmha0WX_UWM5f6j4JcCSql_5Jw-9By'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.386524Z', 'territory_id': '2802007'} 2023-11-28 02:00:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-27', 'edition_number': '43', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jbe01a3E_RhCCdT0jvu0_JAm0e5nz_Cv'], 'files': [{'checksum': 'e7f0c4b4f4599b67b43fae6792fd1f65', 'path': '2802007/2019-03-27/499089663301da89317e6dae81b226441103cf27', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jbe01a3E_RhCCdT0jvu0_JAm0e5nz_Cv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.384394Z', 'territory_id': '2802007'} 2023-11-28 02:00:50 [scrapy.extensions.logstats] INFO: Crawled 41 pages (at 14 pages/min), scraped 39 items (at 14 items/min) 2023-11-28 02:00:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-17', 'edition_number': '6', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xxQpRcjuRxy03RRNE7mxEcoYfBHnDgic'], 'files': [{'checksum': 'd5027c176846902ad148e851c6651d15', 'path': '2802007/2019-01-17/ba9c10e263f75be9ac4d23951afed5ac66f90cb9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xxQpRcjuRxy03RRNE7mxEcoYfBHnDgic'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.266932Z', 'territory_id': '2802007'} 2023-11-28 02:00:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:00:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-02', 'edition_number': '47', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EWc3P5BImJv7ukDJSTgFsKuC3SKuBzdN'], 'files': [{'checksum': 'b18e67a6ace14a239a1c3c050991fc62', 'path': '2802007/2019-04-02/fffb647ba4555b309bc608fa112bcf7e8a86c4ff', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EWc3P5BImJv7ukDJSTgFsKuC3SKuBzdN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.399409Z', 'territory_id': '2802007'} 2023-11-28 02:01:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-01', 'edition_number': '46', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17fNdq2Fl-yFYIHcP-uW93qJzHMr5maZq'], 'files': [{'checksum': 'e6ed3da196bdbecffd73786c79041e4e', 'path': '2802007/2019-04-01/810a03f4657f74caad004cc3227683f801437b33', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17fNdq2Fl-yFYIHcP-uW93qJzHMr5maZq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.390585Z', 'territory_id': '2802007'} 2023-11-28 02:01:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-03', 'edition_number': '48', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OQOWzNd2fRgz4slfBd5p5iU8FAcVZn_j'], 'files': [{'checksum': '1d3cc65558ae12d0d98cbee0981c5049', 'path': '2802007/2019-04-03/b675adbad2025ee3b192838dd7fb98622d1a5cd1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OQOWzNd2fRgz4slfBd5p5iU8FAcVZn_j'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.401527Z', 'territory_id': '2802007'} 2023-11-28 02:01:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-04', 'edition_number': '49', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17X3IX-CeoEsMxeYkQJ1OBRhAnJLpV0M-'], 'files': [{'checksum': '43295ff858e0f11d430de816b8b3741c', 'path': '2802007/2019-04-04/02592b99d56218355934751f377c9d099408e5d6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17X3IX-CeoEsMxeYkQJ1OBRhAnJLpV0M-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.403500Z', 'territory_id': '2802007'} 2023-11-28 02:01:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-05', 'edition_number': '50', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1v8w5e7ii1zhXOOPgvzzkU7pnn-N0yIQJ'], 'files': [{'checksum': '729f89a9db2c312fe6a1191566fd0f71', 'path': '2802007/2019-04-05/2785a73a37792ac9bd9d1ee8119be59e04d7aa42', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1v8w5e7ii1zhXOOPgvzzkU7pnn-N0yIQJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.405615Z', 'territory_id': '2802007'} 2023-11-28 02:01:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-10', 'edition_number': '51', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wqKOFFyQJXW47l4xj7cl5WiWuSjOUbYt'], 'files': [{'checksum': 'dcd03e2fd2ce05147103881ca96ce9e2', 'path': '2802007/2019-04-10/60681e784294f03d7e30936bed7ce8506ec96366', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wqKOFFyQJXW47l4xj7cl5WiWuSjOUbYt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.407590Z', 'territory_id': '2802007'} 2023-11-28 02:01:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-15', 'edition_number': '53', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CWJdPPE6d-IRmGTP8Nu_TOPongvO65Qa'], 'files': [{'checksum': 'ca42347ba9da6dfab2c150549d5511ba', 'path': '2802007/2019-04-15/d15e55075cfd7c3a94e13fcf6c9e73d5b137d8c1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CWJdPPE6d-IRmGTP8Nu_TOPongvO65Qa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.412122Z', 'territory_id': '2802007'} 2023-11-28 02:01:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-16', 'edition_number': '54', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RJfK_5W8A8xA4TtAwYsknbtVvpIh5BQF'], 'files': [{'checksum': '9b77c9f98550c4f08bcb4c4199ffc764', 'path': '2802007/2019-04-16/83d86b4b21a66e9f7c6e8538e92f2310fda64678', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RJfK_5W8A8xA4TtAwYsknbtVvpIh5BQF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.414289Z', 'territory_id': '2802007'} 2023-11-28 02:01:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-17', 'edition_number': '55', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lYUSLXyg2hxh0WoB_hde4vYkv7Q3PgU7'], 'files': [{'checksum': 'ce35e86e17609a0eafcac96be282ab79', 'path': '2802007/2019-04-17/765bc75940327ad81e76d30d9dca885b8674f4b0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lYUSLXyg2hxh0WoB_hde4vYkv7Q3PgU7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.416297Z', 'territory_id': '2802007'} 2023-11-28 02:01:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-22', 'edition_number': '56', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HSjVHStjm152zm3GNDB0TSdrRgumT6FR'], 'files': [{'checksum': 'e10e0a56e4dd78e97643ec2d4326b17b', 'path': '2802007/2019-04-22/2cfdac172679318ee3302526f00fbea0a0cd46ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HSjVHStjm152zm3GNDB0TSdrRgumT6FR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.418281Z', 'territory_id': '2802007'} 2023-11-28 02:01:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-11', 'edition_number': '52', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YlOFGw7t-Z8GTFMmqqjqOhqq18Zsi_PP'], 'files': [{'checksum': '5021135c894e2ca94e1b9b42617d9833', 'path': '2802007/2019-04-11/59550e9611586ccde06c256a5fb090efd4bc53e5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YlOFGw7t-Z8GTFMmqqjqOhqq18Zsi_PP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.409950Z', 'territory_id': '2802007'} 2023-11-28 02:01:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-25', 'edition_number': '58', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VsrcwQGsdA_2VkrN-6TxtUmyp8soR73x'], 'files': [{'checksum': '988ebcd5c8737f832d357c4e33ee5856', 'path': '2802007/2019-04-25/c57e8660181298628e77b5b64925851b116b655b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VsrcwQGsdA_2VkrN-6TxtUmyp8soR73x'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.422531Z', 'territory_id': '2802007'} 2023-11-28 02:01:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:01:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:01:50 [scrapy.extensions.logstats] INFO: Crawled 54 pages (at 13 pages/min), scraped 52 items (at 13 items/min) 2023-11-28 02:01:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-24', 'edition_number': '57', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=151QoQH6dOQwIGDNl-wD4tcFSw_eIHHHq'], 'files': [{'checksum': '8abd247517b87c1cd46e745d35c13971', 'path': '2802007/2019-04-24/edbb609dda741de7392e512b6ead8d460d7152f6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=151QoQH6dOQwIGDNl-wD4tcFSw_eIHHHq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.420450Z', 'territory_id': '2802007'} 2023-11-28 02:01:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-29', 'edition_number': '59', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fCSE55TgLTdkzUSPnilQvYxCh-bVGFI7'], 'files': [{'checksum': '84e0ba769f3e3ae1cc1de1cd7d44374a', 'path': '2802007/2019-04-29/8188eda2016959bbdc76b7207e967bdb604ca8a6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fCSE55TgLTdkzUSPnilQvYxCh-bVGFI7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.424605Z', 'territory_id': '2802007'} 2023-11-28 02:01:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:01:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-04-30', 'edition_number': '60', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SdOt7MAu0baspRDLc6SGZ_d3jUtvg6gH'], 'files': [{'checksum': '0dc2e90f3aae6e56020dc33591c91328', 'path': '2802007/2019-04-30/4d9d61a02a124185cc757b734e4e7d0e94259ef2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SdOt7MAu0baspRDLc6SGZ_d3jUtvg6gH'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.426673Z', 'territory_id': '2802007'} 2023-11-28 02:02:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-06', 'edition_number': '62', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GgZUpkBGXMU7fD4f5IF442Re8JMvic6I'], 'files': [{'checksum': 'cff1caf484d47eae6bca16e05a2499e4', 'path': '2802007/2019-05-06/2ef11b6efd497d55efb5285a2ded0eb804376a79', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GgZUpkBGXMU7fD4f5IF442Re8JMvic6I'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.431675Z', 'territory_id': '2802007'} 2023-11-28 02:02:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-15', 'edition_number': '66', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ijUvLppdlD1WswB9E2AUnJJ4vRH-Jo1s'], 'files': [{'checksum': '49b60f2b6d69d102dc184d8fe5c8dedf', 'path': '2802007/2019-05-15/b82b5c08d5e86f14c43e180149ddd8d8cab554bb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ijUvLppdlD1WswB9E2AUnJJ4vRH-Jo1s'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.440201Z', 'territory_id': '2802007'} 2023-11-28 02:02:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-14', 'edition_number': '65', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14Xz7eVSjryDkbFp9NvJ9pGC5f7udzKpW'], 'files': [{'checksum': '68ac39d063015505f4b699a18f6298a5', 'path': '2802007/2019-05-14/4389e3c2ee9e257f1177bab4367622e473ade12b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14Xz7eVSjryDkbFp9NvJ9pGC5f7udzKpW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.438065Z', 'territory_id': '2802007'} 2023-11-28 02:02:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-08', 'edition_number': '64', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1i_2pAQy0sxFlUMC6uEFCvPMIWELq5aGH'], 'files': [{'checksum': 'd1c8e32318d47abe551ea3032b857e6a', 'path': '2802007/2019-05-08/7f5c8a64c49ed5d1e6acc8cc0038d8e9a9885d34', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1i_2pAQy0sxFlUMC6uEFCvPMIWELq5aGH'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.435935Z', 'territory_id': '2802007'} 2023-11-28 02:02:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-17', 'edition_number': '68', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oFKFkDcxDPduBM_c-KaSAYmborMwVoE4'], 'files': [{'checksum': 'c24497b30f96c66184d7e85e12f1b91a', 'path': '2802007/2019-05-17/28a240ed21b96fe8109e1b425da5143f98f462fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oFKFkDcxDPduBM_c-KaSAYmborMwVoE4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.444470Z', 'territory_id': '2802007'} 2023-11-28 02:02:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-16', 'edition_number': '67', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EY8gs3zy_k2qyKEmRYIVsbi4H9fIkEVR'], 'files': [{'checksum': '0d71b99d9e5296145e7e4deed00f4019', 'path': '2802007/2019-05-16/9c377f53f928b763e020006bdb5075b3f87f33e0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EY8gs3zy_k2qyKEmRYIVsbi4H9fIkEVR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.442439Z', 'territory_id': '2802007'} 2023-11-28 02:02:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-07', 'edition_number': '63', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YgvHwj69NFDNKMGGDyw_DHH_nayrU9MZ'], 'files': [{'checksum': 'c425cf3975e2a3d25c02967d07678a5c', 'path': '2802007/2019-05-07/d01d6ea18c5ff3dc6669b8802f6504df69fc1690', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YgvHwj69NFDNKMGGDyw_DHH_nayrU9MZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.433931Z', 'territory_id': '2802007'} 2023-11-28 02:02:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-24', 'edition_number': '71', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EZxyCuVrw3oKjgKX912vNd5gjBbM4dM2'], 'files': [{'checksum': 'b3c9e9228f3b15b125bd217722b10389', 'path': '2802007/2019-05-24/b34b1c90fbd815b6d1de30a7a2098fb4001a903c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EZxyCuVrw3oKjgKX912vNd5gjBbM4dM2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.450656Z', 'territory_id': '2802007'} 2023-11-28 02:02:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-28', 'edition_number': '72', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WgZyPC4WZ8Q1eMiqrfMYIVL2Mt8pxXhs'], 'files': [{'checksum': '697f3cf73615b0fe517267d1fca0df53', 'path': '2802007/2019-05-28/ee1e706f25c980ec40e29022b53c0495fc6654f2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WgZyPC4WZ8Q1eMiqrfMYIVL2Mt8pxXhs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.452743Z', 'territory_id': '2802007'} 2023-11-28 02:02:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-29', 'edition_number': '73', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A6AXvmmFdIOVR0-hmFTT4SqdDONBAKi4'], 'files': [{'checksum': '8e598ca867a74e2a1d1603c35065254a', 'path': '2802007/2019-05-29/c6a7126a20b3710403a10feb6d2a1ba922788ba3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A6AXvmmFdIOVR0-hmFTT4SqdDONBAKi4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.454964Z', 'territory_id': '2802007'} 2023-11-28 02:02:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-22', 'edition_number': '70', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RpGyoJSWtpNIDWvdhZx_mObBjbOxVtWo'], 'files': [{'checksum': '86f47a01dd8a11efc139893c529057b4', 'path': '2802007/2019-05-22/f66b4291e09dfa03c253e22fc426f2eee5d3d1f6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RpGyoJSWtpNIDWvdhZx_mObBjbOxVtWo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.448710Z', 'territory_id': '2802007'} 2023-11-28 02:02:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-30', 'edition_number': '74', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mvVnWEmn3tQlZRPiEbvdjZHVUvO9R3fX'], 'files': [{'checksum': '91ee63e59fe989c881b467b7ceaa4c12', 'path': '2802007/2019-05-30/821c2ccf54ae531e4151d81737249924805eb785', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mvVnWEmn3tQlZRPiEbvdjZHVUvO9R3fX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.457050Z', 'territory_id': '2802007'} 2023-11-28 02:02:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-03', 'edition_number': '76', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-W0yYn9Ke7mhD4wHokYAtdg205_8hFel'], 'files': [{'checksum': '770b6a68ff541652a8be7a17b3e3b3b1', 'path': '2802007/2019-06-03/982a644549dc339e96b30a45377e700f570125f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-W0yYn9Ke7mhD4wHokYAtdg205_8hFel'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.461143Z', 'territory_id': '2802007'} 2023-11-28 02:02:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-31', 'edition_number': '75', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CGjL6c7VtBM74a1BsAzXjBL3xyTX38jk'], 'files': [{'checksum': 'c73fc630e535203254c47c99cd9923f1', 'path': '2802007/2019-05-31/a4ca6071731cbe3c44b0bd73d52e68b2e70b6683', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CGjL6c7VtBM74a1BsAzXjBL3xyTX38jk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.459038Z', 'territory_id': '2802007'} 2023-11-28 02:02:50 [scrapy.extensions.logstats] INFO: Crawled 71 pages (at 17 pages/min), scraped 69 items (at 17 items/min) 2023-11-28 02:02:50 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:02:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:02:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-10', 'edition_number': '79', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Kz-EXPc0mhW8prwSuu1zN9GOvYYDnwwI'], 'files': [{'checksum': '68bd6f3138b20c6a6b767d38c83d396c', 'path': '2802007/2019-06-10/87ec964fa37a37e267601b65774324c5bf5ee970', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Kz-EXPc0mhW8prwSuu1zN9GOvYYDnwwI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.467286Z', 'territory_id': '2802007'} 2023-11-28 02:03:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-08', 'edition_number': '78', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y_WKC4QWoBovUGvIoQe2LBZiOH8R44GG'], 'files': [{'checksum': '994815059b048f4d36116ca93bc4793f', 'path': '2802007/2019-06-08/34715548e64a0cec3deb86c0a6ca98621288eb7a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y_WKC4QWoBovUGvIoQe2LBZiOH8R44GG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.465190Z', 'territory_id': '2802007'} 2023-11-28 02:03:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-20', 'edition_number': '69', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vB8cye1_Z8s4WJpdJWeOMxTJko2-3CLL'], 'files': [{'checksum': '15db46b6789ce92bdb8dd4ee6546dea6', 'path': '2802007/2019-05-20/d7543d78ea3b0417d6b06399ec3317369b9d5a03', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vB8cye1_Z8s4WJpdJWeOMxTJko2-3CLL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.446659Z', 'territory_id': '2802007'} 2023-11-28 02:03:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-05-02', 'edition_number': '61', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11t7hk0iV18nuvwhk-tkrQBh_jVEAIDU5'], 'files': [{'checksum': '25a68aeb43ee5229b5c14d271392db0c', 'path': '2802007/2019-05-02/89326f4a2bc82ba20a8e98b607856c2d8caedce3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11t7hk0iV18nuvwhk-tkrQBh_jVEAIDU5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.428638Z', 'territory_id': '2802007'} 2023-11-28 02:03:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-17', 'edition_number': '83', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u1b2Fei_D4Bb13dBRoCSvctY_d0Xpm0g'], 'files': [{'checksum': 'eaf9c77bb00910124e98b175f6a4e968', 'path': '2802007/2019-06-17/b392aed93d00f80a60345b16d3ce540b5749f173', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u1b2Fei_D4Bb13dBRoCSvctY_d0Xpm0g'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.475492Z', 'territory_id': '2802007'} 2023-11-28 02:03:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-28', 'edition_number': '45', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AHd-sdonj3AgfDJ49MHdX2FSHaPuR2Tr'], 'files': [{'checksum': '01909a46561956bb6e9410d0530ace64', 'path': '2802007/2019-03-28/adf2091e89f3dac8219544148c5cdef83fa52b00', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AHd-sdonj3AgfDJ49MHdX2FSHaPuR2Tr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.388637Z', 'territory_id': '2802007'} 2023-11-28 02:03:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-14', 'edition_number': '82', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YQge1aLVGyDRfG0NfvT0_tTlxb7PrabX'], 'files': [{'checksum': '1f6438d1ae0159609b43e3cb6a22ed89', 'path': '2802007/2019-06-14/cf3aa003360f5bb935edecc4f57dc7ffb85e1c9d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YQge1aLVGyDRfG0NfvT0_tTlxb7PrabX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.473568Z', 'territory_id': '2802007'} 2023-11-28 02:03:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-12', 'edition_number': '81', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fBuF_HrviplSeuaZwJG3q6RQgTj8EOhQ'], 'files': [{'checksum': '957679d75bfa88021b39752da9b32a1d', 'path': '2802007/2019-06-12/556e277058c4ca73f0a6be848ef89c2985cbe5e1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fBuF_HrviplSeuaZwJG3q6RQgTj8EOhQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.471383Z', 'territory_id': '2802007'} 2023-11-28 02:03:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:03:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-26', 'edition_number': '88', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b8aDkUMrto9Dg_J1IEvhYJmt6WDbloOj'], 'files': [{'checksum': '7b321a5b365db8fa96a591d54eb9b71d', 'path': '2802007/2019-06-26/367fb475d792a5c0f2998bc2e4aa59371d18ab4c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b8aDkUMrto9Dg_J1IEvhYJmt6WDbloOj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.486974Z', 'territory_id': '2802007'} 2023-11-28 02:03:50 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 9 pages/min), scraped 78 items (at 9 items/min) 2023-11-28 02:04:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-25', 'edition_number': '87', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nd4UOk7FF14h4VeMTkJf93evT6YexcXN'], 'files': [{'checksum': '37e9ea591be0a374a0edec5fbc70cab6', 'path': '2802007/2019-06-25/adddb465ffc6cb5b9c4cd34b466ae50a0cb9e169', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nd4UOk7FF14h4VeMTkJf93evT6YexcXN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.484895Z', 'territory_id': '2802007'} 2023-11-28 02:04:11 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:04:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-27', 'edition_number': '89', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y3aynCpw576P31tcQQvdbx-GfvmuasaW'], 'files': [{'checksum': 'c9ad5dd8b59adf4b0c61bc2e63457085', 'path': '2802007/2019-06-27/4fc8ad83da31917afca46312b806a6c4bfc7cda6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y3aynCpw576P31tcQQvdbx-GfvmuasaW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.488944Z', 'territory_id': '2802007'} 2023-11-28 02:04:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-01', 'edition_number': '90', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10ZA7PbWJRR5PWCWyyXNxH79Jn_hM1QMZ'], 'files': [{'checksum': '96d17461ca6c58eafe536598d94871a9', 'path': '2802007/2019-07-01/8770ded908f301e14bfb5f21f953a03bc1ba2a4c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10ZA7PbWJRR5PWCWyyXNxH79Jn_hM1QMZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.490871Z', 'territory_id': '2802007'} 2023-11-28 02:04:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-22', 'edition_number': '86', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FGzIRNbiFyVfb5D5VBmzM68ZiJP8KaOh'], 'files': [{'checksum': 'a81ccecf1e67d97fccba45f38e80e7bf', 'path': '2802007/2019-06-22/22c28e3d688a117efdcaa9e223e91a744adefa6b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FGzIRNbiFyVfb5D5VBmzM68ZiJP8KaOh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.482853Z', 'territory_id': '2802007'} 2023-11-28 02:04:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-18', 'edition_number': '84', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dSXQDBI6-4XkyygoHY1Qo08IQJV98DF-'], 'files': [{'checksum': '4f6c37a889c7e1ac12ada9167f93fea8', 'path': '2802007/2019-06-18/0852107fcab6ba91ebefdfb7552f0555de26604e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dSXQDBI6-4XkyygoHY1Qo08IQJV98DF-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.477497Z', 'territory_id': '2802007'} 2023-11-28 02:04:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-11', 'edition_number': '93', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11jdGtsLBCRv7e5ZhxafuPhBvxeHHIFI1'], 'files': [{'checksum': '798236f2be624c2a30cbad8053a28bb1', 'path': '2802007/2019-07-11/ee2aaee06c6ddbeef90403c74908002a37643429', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11jdGtsLBCRv7e5ZhxafuPhBvxeHHIFI1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.497107Z', 'territory_id': '2802007'} 2023-11-28 02:04:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-03', 'edition_number': '91', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s1B5xhsInADSLZCnwmjsPRifGO2ssORl'], 'files': [{'checksum': '19206e3e7f60574aa112dc9a45bdf2d3', 'path': '2802007/2019-07-03/8baab6f7a45cb1dcb44c3418b7119730463794df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s1B5xhsInADSLZCnwmjsPRifGO2ssORl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.492998Z', 'territory_id': '2802007'} 2023-11-28 02:04:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-17', 'edition_number': '96', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11YjMU_WjZuCGZkoyYriPjBg6o0Ng7yGE'], 'files': [{'checksum': 'e760fea6604c9d20c048f288d80f557d', 'path': '2802007/2019-07-17/747a8f72cee5dbd9afda9742173dbd169e586f94', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11YjMU_WjZuCGZkoyYriPjBg6o0Ng7yGE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.503106Z', 'territory_id': '2802007'} 2023-11-28 02:04:50 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 8 pages/min), scraped 86 items (at 8 items/min) 2023-11-28 02:04:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:04:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-19', 'edition_number': '98', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1k4feIbmVrc7EJl0JhQlwzP7xvb9v700r'], 'files': [{'checksum': 'ba2f2c0a7b7f63cfa3e6c81af1eee275', 'path': '2802007/2019-07-19/9750eb185500602f565f42fb3df650768952f1ab', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1k4feIbmVrc7EJl0JhQlwzP7xvb9v700r'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.507375Z', 'territory_id': '2802007'} 2023-11-28 02:05:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-18', 'edition_number': '97', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16aTqB8wU_9_e0maI27NaosMp8fHbdI3i'], 'files': [{'checksum': '7f3edbae7944deb964d797a48494f1e9', 'path': '2802007/2019-07-18/4cd86a2a398a3be082ecd92312bfde8dfb8fb2df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16aTqB8wU_9_e0maI27NaosMp8fHbdI3i'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.505268Z', 'territory_id': '2802007'} 2023-11-28 02:05:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-16', 'edition_number': '95', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xQJVNj5MjpRxqQ7UJRd7WbR-LSpGIfNy'], 'files': [{'checksum': 'e8cfde27ceee417bed99793e447489ef', 'path': '2802007/2019-07-16/a1f8f5e05a74aafd1fc9445458269f864e2b66c5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xQJVNj5MjpRxqQ7UJRd7WbR-LSpGIfNy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.501156Z', 'territory_id': '2802007'} 2023-11-28 02:05:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-23', 'edition_number': '100', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17JMVvh6MdLEccwShCXXxWa9L3lRApCSv'], 'files': [{'checksum': '251eddfc8da0a45ff513f02434baf3c8', 'path': '2802007/2019-07-23/256f58cdb4dd12ae1ebfed3888d70152a3e6f60f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17JMVvh6MdLEccwShCXXxWa9L3lRApCSv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.511291Z', 'territory_id': '2802007'} 2023-11-28 02:05:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-24', 'edition_number': '101', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cVrQqtrCYxEN-CzjzZUHjwfqFU2x_i7z'], 'files': [{'checksum': 'af6668a503cb7e11cdf1f4ccf91b2703', 'path': '2802007/2019-07-24/6389e0daa4983ec4c2d24280150928f5d78ff6de', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cVrQqtrCYxEN-CzjzZUHjwfqFU2x_i7z'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:02.976204Z', 'territory_id': '2802007'} 2023-11-28 02:05:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-25', 'edition_number': '102', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1URidIRo8dWpHNl6EeoDThtQeAHyFF70d'], 'files': [{'checksum': 'fa104a77f6b8f78cd68936198bed36dd', 'path': '2802007/2019-07-25/d975cd7c5426435f8e9a1c5364eca87ddcd7e3ef', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1URidIRo8dWpHNl6EeoDThtQeAHyFF70d'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:05.393738Z', 'territory_id': '2802007'} 2023-11-28 02:05:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-22', 'edition_number': '99', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dwcyalZNW16AnEjJfGpGEFviW3uqV8rn'], 'files': [{'checksum': 'd8fbe599da1d3337dca92008ffa961c4', 'path': '2802007/2019-07-22/1817b56dcfd4fa11c1dd829c86301c04de2793a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dwcyalZNW16AnEjJfGpGEFviW3uqV8rn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.509343Z', 'territory_id': '2802007'} 2023-11-28 02:05:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-26', 'edition_number': '103', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GqAodsx56MSbFgv1owz2nUVj0xd36Ko1'], 'files': [{'checksum': 'e63e4b1ba03faca7b88987ee9f1ecb7b', 'path': '2802007/2019-07-26/03c276b5383d368054b328c3eb60c8f7e3d089c3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GqAodsx56MSbFgv1owz2nUVj0xd36Ko1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:07.744832Z', 'territory_id': '2802007'} 2023-11-28 02:05:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-15', 'edition_number': '94', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p8aUqJUYc_JVaraBlAYi3qwuWXsiaQwj'], 'files': [{'checksum': '4f38a4eb6839d372f98854e1a9f8f5f8', 'path': '2802007/2019-07-15/b03b55888dd922d54ea7927a3e7e83ca317f3480', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p8aUqJUYc_JVaraBlAYi3qwuWXsiaQwj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.499045Z', 'territory_id': '2802007'} 2023-11-28 02:05:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-09', 'edition_number': '92', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1q5ZSN6H_OMRmH3OVamK5dRdSGY-T73aJ'], 'files': [{'checksum': '72ae6ea238ece571f99b8a555003a6c6', 'path': '2802007/2019-07-09/c1910665f850cc699ca3c06c39d8ebab8aae8eac', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1q5ZSN6H_OMRmH3OVamK5dRdSGY-T73aJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.495132Z', 'territory_id': '2802007'} 2023-11-28 02:05:50 [scrapy.extensions.logstats] INFO: Crawled 98 pages (at 10 pages/min), scraped 96 items (at 10 items/min) 2023-11-28 02:05:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:05:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-21', 'edition_number': '85', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Lt0k6ZxJJiQJ7SOsOfFFRyaN-rWbggNY'], 'files': [{'checksum': 'bcbd3ef57e429483e4a4ff3d132dbbbc', 'path': '2802007/2019-06-21/3c6c44aa058abdaae33da77a30334c721289613d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Lt0k6ZxJJiQJ7SOsOfFFRyaN-rWbggNY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.480804Z', 'territory_id': '2802007'} 2023-11-28 02:06:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-05', 'edition_number': '108', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=174Z9GqwHkpQlTviANYP0x6gVDdeMgPKY'], 'files': [{'checksum': '1e2664126e519c55020bb647ea16fa4c', 'path': '2802007/2019-08-05/da02496e8030d8536881dd7b89b9c08b4f79f1cf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=174Z9GqwHkpQlTviANYP0x6gVDdeMgPKY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:41.400839Z', 'territory_id': '2802007'} 2023-11-28 02:06:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-06', 'edition_number': '109', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12Hp-EAJBFAmPltrJpCzL7tLCu5aeK2eb'], 'files': [{'checksum': '5fefcc3293bd747404842da0e3d123ef', 'path': '2802007/2019-08-06/d517413f430bde0445045d041ddc5c872322d4e1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12Hp-EAJBFAmPltrJpCzL7tLCu5aeK2eb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:45.376179Z', 'territory_id': '2802007'} 2023-11-28 02:06:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-08', 'edition_number': '110', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zYfBN9NAROH4xPeZ0AmhH6bEkeovJ7Wt'], 'files': [{'checksum': 'b5ad21eab5ca92d1b7b0d821ea0b5a6b', 'path': '2802007/2019-08-08/49d78f174dd81363e2a503bc4425bbf433adb78b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zYfBN9NAROH4xPeZ0AmhH6bEkeovJ7Wt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:50.652292Z', 'territory_id': '2802007'} 2023-11-28 02:06:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-12', 'edition_number': '112', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZAksaVfmNFhWoyhZe-Q9duEd12ppc41D'], 'files': [{'checksum': 'c828112b40fae4380b4135bc8c685038', 'path': '2802007/2019-08-12/7b80db79d1addabb42571384c549fbc69ccba01f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZAksaVfmNFhWoyhZe-Q9duEd12ppc41D'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:56.310730Z', 'territory_id': '2802007'} 2023-11-28 02:06:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-09', 'edition_number': '111', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LJtWLJfZKwrp87eD9Ekrww9stxfm46gF'], 'files': [{'checksum': '501c13c733029c8a5a4189882f67d275', 'path': '2802007/2019-08-09/95b481081fdab6caf904ddb5973aa8f39f5aa417', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LJtWLJfZKwrp87eD9Ekrww9stxfm46gF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:53.179424Z', 'territory_id': '2802007'} 2023-11-28 02:06:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-02', 'edition_number': '107', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yZj9o-EKVdho5I6CMzq5xnzMswqiGj93'], 'files': [{'checksum': 'ace9b3b299b8a4314e5b3e21775360bc', 'path': '2802007/2019-08-02/1818f31111ab5d325278cf175653c82dad661f7f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yZj9o-EKVdho5I6CMzq5xnzMswqiGj93'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:30.237701Z', 'territory_id': '2802007'} 2023-11-28 02:06:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-15', 'edition_number': '115', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tq6PKLDF4AGpsMSNpYnE-rS-VSiTmfcD'], 'files': [{'checksum': '1bbe84b9083e20dcddf88c9593c544d1', 'path': '2802007/2019-08-15/881a504f8832cc0d017f5cbe21a9ba7750eb171d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tq6PKLDF4AGpsMSNpYnE-rS-VSiTmfcD'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:04.458313Z', 'territory_id': '2802007'} 2023-11-28 02:06:32 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:06:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-14', 'edition_number': '114', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=150P8WzEJyyEiuRYXtNVWB23xm6WniDyV'], 'files': [{'checksum': 'a62862889d39bf6d4302834bcf72655f', 'path': '2802007/2019-08-14/224694e8dae21f2b7fc9035dd5871bba55dd9c76', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=150P8WzEJyyEiuRYXtNVWB23xm6WniDyV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:02.548506Z', 'territory_id': '2802007'} 2023-11-28 02:06:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-19', 'edition_number': '116', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l6w1cd4si65G5aqC2EdsgpAv6WYB4GCc'], 'files': [{'checksum': 'cb073051ddc60ef53dd22553b23c4828', 'path': '2802007/2019-08-19/f33452b89ccd30f53ead130461573ab1192f98b4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l6w1cd4si65G5aqC2EdsgpAv6WYB4GCc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:07.555974Z', 'territory_id': '2802007'} 2023-11-28 02:06:40 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:06:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-22', 'edition_number': '117', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17APavVmc37fRwtVIYbFCbNnvVUQTGnKZ'], 'files': [{'checksum': '654e0b558ceb0a7a60921d5879bf2c4d', 'path': '2802007/2019-08-22/e15532cedabc58b032d61fdba02112b8aadb65f7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17APavVmc37fRwtVIYbFCbNnvVUQTGnKZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:14.103608Z', 'territory_id': '2802007'} 2023-11-28 02:06:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-27', 'edition_number': '119', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VETsHcO1y1kDBkPGF7bWqxq72uEl5_YA'], 'files': [{'checksum': '488d754006136a964073f6cebc77b147', 'path': '2802007/2019-08-27/8487a8fdd8be5e38fc8e3ad036f6c819b40dfae9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VETsHcO1y1kDBkPGF7bWqxq72uEl5_YA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:29.310754Z', 'territory_id': '2802007'} 2023-11-28 02:06:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-30', 'edition_number': '121', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ngA7G3RG4GtEX3MVdF0JexCD2mKHEWn3'], 'files': [{'checksum': 'e5032bc8cb5bc8fe598d9eee6d394fa9', 'path': '2802007/2019-08-30/1735c2923f817082a28ed3f133522d264aab2de9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ngA7G3RG4GtEX3MVdF0JexCD2mKHEWn3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:35.783920Z', 'territory_id': '2802007'} 2023-11-28 02:06:50 [scrapy.extensions.logstats] INFO: Crawled 111 pages (at 13 pages/min), scraped 109 items (at 13 items/min) 2023-11-28 02:06:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-30', 'edition_number': '122', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jqy4lROl30xp_J14Q5WELYKEyBg_Vtkt'], 'files': [{'checksum': '904229291a20a92e204ed3890abcdbf9', 'path': '2802007/2019-08-30/a35025dfeeb5f2e1228074e3886ce1f855a980f0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jqy4lROl30xp_J14Q5WELYKEyBg_Vtkt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:39.388712Z', 'territory_id': '2802007'} 2023-11-28 02:06:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:06:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-21', 'edition_number': '118', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WNZ3FWJXqMATWIARAxzt8Jnf52NhFIcP'], 'files': [{'checksum': '2543be2636f5f7d5b8890ade659b0ca3', 'path': '2802007/2019-08-21/0d0d63675da7f2f62f4e17097901bd4e2a16dc35', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WNZ3FWJXqMATWIARAxzt8Jnf52NhFIcP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:10.447057Z', 'territory_id': '2802007'} 2023-11-28 02:07:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-28', 'edition_number': '120', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oeEk91QQsuKsRGqASyaLlASLr50p3gYi'], 'files': [{'checksum': 'f170434da02ce17076574c1f9eca254a', 'path': '2802007/2019-08-28/b97e477c8be3673601fb0741c03f9e5e655bbd85', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oeEk91QQsuKsRGqASyaLlASLr50p3gYi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:31.425272Z', 'territory_id': '2802007'} 2023-11-28 02:07:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-02', 'edition_number': '123', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S7W_lmqUxhAepMyniK0eusJezXE329lW'], 'files': [{'checksum': 'd61b8f2b101af554e5799aec6c72df38', 'path': '2802007/2019-09-02/e17bc0447d410e9b2e37f424c230c7bd5aac91b2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S7W_lmqUxhAepMyniK0eusJezXE329lW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:41.360748Z', 'territory_id': '2802007'} 2023-11-28 02:07:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-13', 'edition_number': '113', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tgxooJN7uGJghGiiTC5m-OBc5ZI7OOjo'], 'files': [{'checksum': 'e7fcd825611a6544d3116fcc7a03eee9', 'path': '2802007/2019-08-13/5b2c04cdd6c61fe0a39f474772aac5b8a35186e1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tgxooJN7uGJghGiiTC5m-OBc5ZI7OOjo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:00.166554Z', 'territory_id': '2802007'} 2023-11-28 02:07:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-08-01', 'edition_number': '106', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yr0DmtwwzVUIlqa3bfkk6APuO81OULDp'], 'files': [{'checksum': '4d98ce944847562fddc094989162c978', 'path': '2802007/2019-08-01/ebea9a39f6ed87029946032a4a1c3178b4e37c05', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yr0DmtwwzVUIlqa3bfkk6APuO81OULDp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:27.235252Z', 'territory_id': '2802007'} 2023-11-28 02:07:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-10', 'edition_number': '127', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xYSj4SV1pgxZy0kxPQVWM8hSB9Sqnceq'], 'files': [{'checksum': '36c2aeb3e81c2c8801d20059a3632fef', 'path': '2802007/2019-09-10/db815763b9630f81da294ed055d03942758874fb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xYSj4SV1pgxZy0kxPQVWM8hSB9Sqnceq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:58.769953Z', 'territory_id': '2802007'} 2023-11-28 02:07:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-09', 'edition_number': '128', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ptqXSNLU8cv55F5v9OuKgv9HqdbjaJVl'], 'files': [{'checksum': '92e1ba465fd6ff911a732747240377eb', 'path': '2802007/2019-09-09/eaf85ec87d89f6c17397de480ad1cb98e27cab45', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ptqXSNLU8cv55F5v9OuKgv9HqdbjaJVl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:56.409861Z', 'territory_id': '2802007'} 2023-11-28 02:07:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-16', 'edition_number': '131', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J8WguAANj3psNZTBmV2-mfdO_-R2ZLib'], 'files': [{'checksum': '59c376e69e977c53702d156e71cecebf', 'path': '2802007/2019-09-16/7e67cbfaea8c0e6377c635073ef1624df9937408', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J8WguAANj3psNZTBmV2-mfdO_-R2ZLib'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:21.607772Z', 'territory_id': '2802007'} 2023-11-28 02:07:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-12', 'edition_number': '130', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XcnLox6NbEnCfmvHHuKz_Hz25NWFaPsm'], 'files': [{'checksum': '98bbe062c72cca46f41a9b8982bd5abc', 'path': '2802007/2019-09-12/cf594b90d6270fc103deac56ad101edff6df08ed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XcnLox6NbEnCfmvHHuKz_Hz25NWFaPsm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:17.010446Z', 'territory_id': '2802007'} 2023-11-28 02:07:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-18', 'edition_number': '132', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sIi2EfP7VyVieq0TS719A_Wsds7bXjqc'], 'files': [{'checksum': '3098f3aef336be8d9b4ccb54636e7388', 'path': '2802007/2019-09-18/961fb896dfd4502a24e3ac202bad82573d3856f4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sIi2EfP7VyVieq0TS719A_Wsds7bXjqc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:23.444057Z', 'territory_id': '2802007'} 2023-11-28 02:07:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-19', 'edition_number': '133', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18yQGHMNdBQgTuboE2ZGrw1UMO81woFm3'], 'files': [{'checksum': '3343089355c9c02d1d49c1eb3cdaaf37', 'path': '2802007/2019-09-19/8ab7a96f2630690e9aa3bf9e2392fd5f8c49fc62', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18yQGHMNdBQgTuboE2ZGrw1UMO81woFm3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:27.730684Z', 'territory_id': '2802007'} 2023-11-28 02:07:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-27', 'edition_number': '134', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Kq7QS10PPVmTJtQwf3W0PiSBTa5flIwT'], 'files': [{'checksum': '538b03743a1b315beece12175a81309b', 'path': '2802007/2019-09-27/9f3cd2bad6b7e68d26950b9e0d6e5101757307d9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Kq7QS10PPVmTJtQwf3W0PiSBTa5flIwT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:29.582264Z', 'territory_id': '2802007'} 2023-11-28 02:07:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-01', 'edition_number': '136', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tifhA6uaFoobOIT8RnN11lqOBzjdhDdx'], 'files': [{'checksum': 'cd409a35496df35967c9b3c8a5233714', 'path': '2802007/2019-10-01/6140b8e79f80f2c4a0b6a20886f8940b222d7fee', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tifhA6uaFoobOIT8RnN11lqOBzjdhDdx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:36.086254Z', 'territory_id': '2802007'} 2023-11-28 02:07:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-11', 'edition_number': '129', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Guv3rnUEcWpBwmW1PGTzzRbeG7mKR5GN'], 'files': [{'checksum': '0eaa7201d8d5be62e1085486e28facd0', 'path': '2802007/2019-09-11/2736ed2abf2823a3fa3ccfa11441a984482f13f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Guv3rnUEcWpBwmW1PGTzzRbeG7mKR5GN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:01.962660Z', 'territory_id': '2802007'} 2023-11-28 02:07:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-03', 'edition_number': '137', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1stWk-T1giMH25LtgyuWPSVstGdDm6H0l'], 'files': [{'checksum': 'fb8b241eae15774d77a33b5a49f8753f', 'path': '2802007/2019-10-03/2bfe8fbc866fda45b1c1e73f19c2b23b3ecc0859', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1stWk-T1giMH25LtgyuWPSVstGdDm6H0l'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:40.943292Z', 'territory_id': '2802007'} 2023-11-28 02:07:50 [scrapy.extensions.logstats] INFO: Crawled 127 pages (at 16 pages/min), scraped 125 items (at 16 items/min) 2023-11-28 02:07:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:07:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-05', 'edition_number': '126', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uv_ROeoMC_w81bazTJLBFURG4rToSD6L'], 'files': [{'checksum': 'a4c09e5143cbe5276db108a81fdef9a5', 'path': '2802007/2019-09-05/8f423ce22eb4cacb43e80a2cd3ed23212db16bf6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uv_ROeoMC_w81bazTJLBFURG4rToSD6L'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:51.054159Z', 'territory_id': '2802007'} 2023-11-28 02:08:50 [scrapy.extensions.logstats] INFO: Crawled 128 pages (at 1 pages/min), scraped 126 items (at 1 items/min) 2023-11-28 02:08:57 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (82749915) larger than download warn size (33554432) in request . 2023-11-28 02:09:02 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:09:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-30', 'edition_number': '135', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YMBVs7N4faYqSarhXcxMKaM67lhNSPdY'], 'files': [{'checksum': 'c6be1b45ec9c1d4d1add43ee99fc1733', 'path': '2802007/2019-09-30/bffcae8fd060a6ccc56148ce486ec709df731840', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YMBVs7N4faYqSarhXcxMKaM67lhNSPdY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:33.720243Z', 'territory_id': '2802007'} 2023-11-28 02:09:10 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:09:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-08', 'edition_number': '140', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tKh7qsbH03iMXfq7Xpqvb7mMqueDc_YP'], 'files': [{'checksum': '96ee478dfefbd86e46fac955f6c29a75', 'path': '2802007/2019-10-08/77b6b16a26b3acff2ffe2e070e3c857fc95fae9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tKh7qsbH03iMXfq7Xpqvb7mMqueDc_YP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:54.836107Z', 'territory_id': '2802007'} 2023-11-28 02:09:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-09', 'edition_number': '141', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Kt9NXNvQLf0yoRdNe--L9q7sTLMZH3O9'], 'files': [{'checksum': '876588526124f96f51934c7da15c802e', 'path': '2802007/2019-10-09/22f469d5720c8fad079d3df2d944f66826ea20a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Kt9NXNvQLf0yoRdNe--L9q7sTLMZH3O9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:58.592878Z', 'territory_id': '2802007'} 2023-11-28 02:09:14 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:09:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-11', 'edition_number': '143', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rn-itADFknBvc1bDd2luEUHVH5XxDHDK'], 'files': [{'checksum': 'e503a5cb0d167b5e27f313a3abe2e3d5', 'path': '2802007/2019-10-11/309ea559158ddf399a757a950634bbb64596ad5a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rn-itADFknBvc1bDd2luEUHVH5XxDHDK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:05.519144Z', 'territory_id': '2802007'} 2023-11-28 02:09:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-15', 'edition_number': '144', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KnKaRNMRWU5d6D_M8c5dqvaSoEmNMwC9'], 'files': [{'checksum': '1257c500ba14c266cf1af0482cc5dbe0', 'path': '2802007/2019-10-15/d41d710873985c2d471329e8e53198d653a26376', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KnKaRNMRWU5d6D_M8c5dqvaSoEmNMwC9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:10.876774Z', 'territory_id': '2802007'} 2023-11-28 02:09:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-17', 'edition_number': '146', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MiZpYq1VxD2W3lr1N9feLTfyBvxtgyhs'], 'files': [{'checksum': 'b4fa49429af32dc8dba5d3372bd76de3', 'path': '2802007/2019-10-17/bb9338f01c09e64af2286a5c3834b22249f2420b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MiZpYq1VxD2W3lr1N9feLTfyBvxtgyhs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:24.130494Z', 'territory_id': '2802007'} 2023-11-28 02:09:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-16', 'edition_number': '145', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=150okk0dVDLrRYlO-vsWN5-dSj3N16dK8'], 'files': [{'checksum': 'f2e79ef6c95add87899ff2fe1579d6f6', 'path': '2802007/2019-10-16/01092bc879c01e61e87c9644d1198ad49c5edbc4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=150okk0dVDLrRYlO-vsWN5-dSj3N16dK8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:20.941335Z', 'territory_id': '2802007'} 2023-11-28 02:09:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-29', 'edition_number': '149', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13ExJJCVYUNYh8y-SHLGKPml3AWSjEo1c'], 'files': [{'checksum': 'b5b432ed6f8d69539c8d438b07e3bb56', 'path': '2802007/2019-10-29/666ded84429bfdec215885f53cf60ca8e6d09d25', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13ExJJCVYUNYh8y-SHLGKPml3AWSjEo1c'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:39.423816Z', 'territory_id': '2802007'} 2023-11-28 02:09:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-07', 'edition_number': '139', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lKkOXMdwr4fHjb4WHXm5GVDsbY740iaC'], 'files': [{'checksum': '233efd6a1ae7b7e4c4ba58de5a312410', 'path': '2802007/2019-10-07/4bb3c52c37e86d9b3fe696475ba65a4bf2d9463a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lKkOXMdwr4fHjb4WHXm5GVDsbY740iaC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:48.963510Z', 'territory_id': '2802007'} 2023-11-28 02:09:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-24', 'edition_number': '147', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_yqoB9kT6ocYnYDJubUQNGbCWu9pNkNk'], 'files': [{'checksum': 'e3de03bfc5d30b6940a6eda755acf2f5', 'path': '2802007/2019-10-24/b2b3ccfd082dcff4d812a1166af6b1d39903f6c0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_yqoB9kT6ocYnYDJubUQNGbCWu9pNkNk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:28.817718Z', 'territory_id': '2802007'} 2023-11-28 02:09:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-30', 'edition_number': '150', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kxSDUvt1TrjI7y77dd3ZgpmuooApUy2o'], 'files': [{'checksum': '52ec9b2cd99f5af6c7def4728470faf0', 'path': '2802007/2019-10-30/1d8a1697174b1846ca5071fa6d928dbf18ee9945', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kxSDUvt1TrjI7y77dd3ZgpmuooApUy2o'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:42.930454Z', 'territory_id': '2802007'} 2023-11-28 02:09:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-25', 'edition_number': '148', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KhouZlJTNFv8mOtAw-GYsx8Rk1CCuMXg'], 'files': [{'checksum': '606d5b954ccad386d7b89c441bf7acfa', 'path': '2802007/2019-10-25/47c0d02db8c61c3c597e4dd5cafbc415d12cc397', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KhouZlJTNFv8mOtAw-GYsx8Rk1CCuMXg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:33.553396Z', 'territory_id': '2802007'} 2023-11-28 02:09:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-15', 'edition_number': '4', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZTz4suUA1RkwTLHJvIlAhuYuxz1euzBy'], 'files': [{'checksum': '43d1246f8bfefd59bd342148caa01ac8', 'path': '2802007/2019-01-15/e3de0e593c5f628eee16e6c5bdb3525245a063cf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZTz4suUA1RkwTLHJvIlAhuYuxz1euzBy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.257632Z', 'territory_id': '2802007'} 2023-11-28 02:09:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-31', 'edition_number': '151', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15E6bUgjwv3HIkbKcIeiMAe3xlj_LrYOU'], 'files': [{'checksum': 'd083e7a7572200c893404549f34c2a62', 'path': '2802007/2019-10-31/a0272a346a890cf253bda4451a91872dc64b8a28', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15E6bUgjwv3HIkbKcIeiMAe3xlj_LrYOU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:44.610914Z', 'territory_id': '2802007'} 2023-11-28 02:09:50 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 14 pages/min), scraped 140 items (at 14 items/min) 2023-11-28 02:09:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-01-11', 'edition_number': '2', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CgjgDV-eDuPmmpb8GIQrX8PFqS9jAVkR'], 'files': [{'checksum': '4c51d9c07f13eb3ced846211f4afbce9', 'path': '2802007/2019-01-11/6408788a9911cd699cd90b04ac7ae9993460756b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CgjgDV-eDuPmmpb8GIQrX8PFqS9jAVkR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.248786Z', 'territory_id': '2802007'} 2023-11-28 02:09:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:09:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-05', 'edition_number': '154', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PA7hmhb8YnN4FPas80MBQBjaksWZLRV7'], 'files': [{'checksum': 'caa8705a0843165a2bf557fdd276e97f', 'path': '2802007/2019-11-05/9b387b31d956d9d3878307611a8662ab2f07eb82', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PA7hmhb8YnN4FPas80MBQBjaksWZLRV7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:52.793116Z', 'territory_id': '2802007'} 2023-11-28 02:10:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-06', 'edition_number': '155', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Fv6EJo3shr2EznGcuPXjJNr5_A76P2pA'], 'files': [{'checksum': '7e1e8661597d322bafaf128cdf047afb', 'path': '2802007/2019-11-06/4454eb0f306163231780adc4c1fda9718ba4e98c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Fv6EJo3shr2EznGcuPXjJNr5_A76P2pA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:59.287894Z', 'territory_id': '2802007'} 2023-11-28 02:10:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-08', 'edition_number': '156', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cv79XY4JAzoqVKjJ_VqB8nI8zFFck2_E'], 'files': [{'checksum': 'bfee88d95bac57e44e2f39bf807fce00', 'path': '2802007/2019-11-08/9f0c28be69b5cfca019134a3aebffccc3319fa55', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cv79XY4JAzoqVKjJ_VqB8nI8zFFck2_E'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:03.543554Z', 'territory_id': '2802007'} 2023-11-28 02:10:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-12', 'edition_number': '157', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OPTu8qNBzTbfiq-6wbzcz4Nryu4bu55S'], 'files': [{'checksum': 'fa5c28b92cf47bee845cd45fe6c35dfb', 'path': '2802007/2019-11-12/7210dc2ba1dcc16451a2ed51d03ba73f171476c3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OPTu8qNBzTbfiq-6wbzcz4Nryu4bu55S'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:07.982563Z', 'territory_id': '2802007'} 2023-11-28 02:10:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-04', 'edition_number': '153', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AfepHwc2ZOYoCwev1c8__3ibm-SqFwpJ'], 'files': [{'checksum': '05ffbfcac4f60387dbf903ed0cb7e561', 'path': '2802007/2019-11-04/d915560cd4b208bd80a59d730448bb75dd09fa89', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AfepHwc2ZOYoCwev1c8__3ibm-SqFwpJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:51.184408Z', 'territory_id': '2802007'} 2023-11-28 02:10:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-19', 'edition_number': '158', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hVz8CMxE4u7np6b6M2XGzr31asXim9R2'], 'files': [{'checksum': '5c50ccb2b7c20066596cc09590c91f16', 'path': '2802007/2019-11-19/5a1b71bff860d989ef25c2f21f789d4caeec6bf6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hVz8CMxE4u7np6b6M2XGzr31asXim9R2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:11.126044Z', 'territory_id': '2802007'} 2023-11-28 02:10:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-22', 'edition_number': '160', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Z7fcEd38FYfcpK1-anALG0x-6SZG6Hx'], 'files': [{'checksum': '84a6c34fee8240feba5b3eb2eec42996', 'path': '2802007/2019-11-22/98be98b60652e3d31753988e682ec62f5086e4a8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Z7fcEd38FYfcpK1-anALG0x-6SZG6Hx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:17.014365Z', 'territory_id': '2802007'} 2023-11-28 02:10:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-25', 'edition_number': '161', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gfNe8Z-hnmbjNxDn8llMQiZTGX26khH9'], 'files': [{'checksum': '32ee2641128f92b8016fc92cd812e069', 'path': '2802007/2019-11-25/87e86ae35a469a755ed1a2cd5914486d1bdf8fa2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gfNe8Z-hnmbjNxDn8llMQiZTGX26khH9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:19.001397Z', 'territory_id': '2802007'} 2023-11-28 02:10:42 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:10:46 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:10:50 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 9 pages/min), scraped 149 items (at 9 items/min) 2023-11-28 02:10:51 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (47348980) larger than download warn size (33554432) in request . 2023-11-28 02:10:57 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:10:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:10:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-20', 'edition_number': '159', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CFed54MY81da38kOxtX3NnP49mrW7Uca'], 'files': [{'checksum': '40a969a2dddd849d2abfdd3b8b1442bb', 'path': '2802007/2019-11-20/4fa9152701204f38cdcfe7fc14ae60e43a7f0321', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CFed54MY81da38kOxtX3NnP49mrW7Uca'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:14.929986Z', 'territory_id': '2802007'} 2023-11-28 02:11:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-04', 'edition_number': '165', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IQ54OuROrJgpIrwuuIdeVYhk9fnn9yVx'], 'files': [{'checksum': 'c2fd1b52fd1534f307733be9dd4c00ee', 'path': '2802007/2019-12-04/95caa4915543fa831704ef1b50860ce5f610320d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IQ54OuROrJgpIrwuuIdeVYhk9fnn9yVx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:32.974887Z', 'territory_id': '2802007'} 2023-11-28 02:11:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-02', 'edition_number': '164', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UHdadecRmWE3F4vFtE6UcU2KsSNDlXMa'], 'files': [{'checksum': '019d1cd87fd795e2b190baab5074cdc1', 'path': '2802007/2019-12-02/102da643a1cb40c457360fb2e9f6e41dad3dac7d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UHdadecRmWE3F4vFtE6UcU2KsSNDlXMa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:29.506475Z', 'territory_id': '2802007'} 2023-11-28 02:11:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-29', 'edition_number': '163', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sRlu9Jsefn9Iv_Ff7oc4Hsh4j0dvCAGB'], 'files': [{'checksum': 'c3ed1348d5d072ec9cb2b5e540afcf28', 'path': '2802007/2019-11-29/2f72b81dd547306d49973f9faa5cb645ddaa118b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sRlu9Jsefn9Iv_Ff7oc4Hsh4j0dvCAGB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:27.246249Z', 'territory_id': '2802007'} 2023-11-28 02:11:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-10', 'edition_number': '168', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uT9HXulTPfnqMZgu2BvFfNIyGTJxemqr'], 'files': [{'checksum': 'fc9429aad21c8604947f87b952c94dbc', 'path': '2802007/2019-12-10/182ee32e7d747410b857ed4bcea0fab17ccb7ed7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uT9HXulTPfnqMZgu2BvFfNIyGTJxemqr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:45.744759Z', 'territory_id': '2802007'} 2023-11-28 02:11:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-11', 'edition_number': '169', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Vx_DWS1dTVR2up8X6S1mwnwMHyj9fUI-'], 'files': [{'checksum': 'b87277e41543eeca9a4efb40d8f63d03', 'path': '2802007/2019-12-11/e5c77c94055697c56c79c2aaeef81013e2ba162d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Vx_DWS1dTVR2up8X6S1mwnwMHyj9fUI-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:47.557887Z', 'territory_id': '2802007'} 2023-11-28 02:11:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-02-18', 'edition_number': '21', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WIzRZvjLEow9F4HN9LXP7T5w0LvlY80n'], 'files': [{'checksum': '3a73edacc0ea9ad82c6ab221719300b7', 'path': '2802007/2019-02-18/30f229bf202b52d105025907f6700d5a9434d74f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WIzRZvjLEow9F4HN9LXP7T5w0LvlY80n'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.314977Z', 'territory_id': '2802007'} 2023-11-28 02:11:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-16', 'edition_number': '171', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RPFEY22nqS1Q0atD5vUWSYFM-PYUD8nM'], 'files': [{'checksum': '3de5f2d6433d09c390f132556284801e', 'path': '2802007/2019-12-16/400b86a833465c478ea2087f6485004d999f7669', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RPFEY22nqS1Q0atD5vUWSYFM-PYUD8nM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:06.804641Z', 'territory_id': '2802007'} 2023-11-28 02:11:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-06', 'edition_number': '167', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZhuZI9YxIXe9jGGCoU2n9VZ_Jt9Ma0A7'], 'files': [{'checksum': '1e3d5672b8ffa6f5de2f848065df1321', 'path': '2802007/2019-12-06/228cb0230a3505667df11a0afc9956a5d35716d2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZhuZI9YxIXe9jGGCoU2n9VZ_Jt9Ma0A7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:42.499982Z', 'territory_id': '2802007'} 2023-11-28 02:11:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-13', 'edition_number': '170', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_utI5z9WVmVHsAoDvYASvk9oNjxmCdlG'], 'files': [{'checksum': '606b0818dcefcd631499019e3e655bf4', 'path': '2802007/2019-12-13/05a9adc832dc9d5f791ec25f5ff125e77f248cca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_utI5z9WVmVHsAoDvYASvk9oNjxmCdlG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:52.292463Z', 'territory_id': '2802007'} 2023-11-28 02:11:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-23', 'edition_number': '174', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uiLPwrEaa4Le7uFmXndRJbXDv5RM_S6w'], 'files': [{'checksum': '39261575a6ef5864b99ddbba8ae15700', 'path': '2802007/2019-12-23/6cf5445cdf4871aeeafbce863ceab67b6f2a4c68', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uiLPwrEaa4Le7uFmXndRJbXDv5RM_S6w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:20.155583Z', 'territory_id': '2802007'} 2023-11-28 02:11:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:33 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-17', 'edition_number': '172', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cavzDoD68nNrIsnudTeheMR7damSxbga'], 'files': [{'checksum': 'eeb25642698ecb855bb2998cb7194093', 'path': '2802007/2019-12-17/601385b5a116be945633e1dde6c468ad1be5754b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cavzDoD68nNrIsnudTeheMR7damSxbga'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:13.243711Z', 'territory_id': '2802007'} 2023-11-28 02:11:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-26', 'edition_number': '175', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KWUMgwgWdxKh81Uxh-TU0woKPU38MMij'], 'files': [{'checksum': '03ede686785a90751d9aae39db857773', 'path': '2802007/2019-12-26/ba74186bb94bfe2d921f66d5ea978cfcce7f7911', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KWUMgwgWdxKh81Uxh-TU0woKPU38MMij'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:24.074996Z', 'territory_id': '2802007'} 2023-11-28 02:11:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-27', 'edition_number': '162', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1enmfqghC8tWqsTiMkPUSR9b1C3OPsni4'], 'files': [{'checksum': '0bdc98411ef97f1b3cb94b49c081e44d', 'path': '2802007/2019-11-27/548791984512052db4e0503e8a6048847c9eb326', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1enmfqghC8tWqsTiMkPUSR9b1C3OPsni4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:23.535459Z', 'territory_id': '2802007'} 2023-11-28 02:11:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-02', 'edition_number': '177', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YwBTMQz201vr4unEvS1NmUaVCW2McLQ9'], 'files': [{'checksum': '4476496d2ed8639904705294d50fe03c', 'path': '2802007/2020-01-02/c89c31858d175ed04b64564dfca43929dcb1675d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YwBTMQz201vr4unEvS1NmUaVCW2McLQ9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:39.867414Z', 'territory_id': '2802007'} 2023-11-28 02:11:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-11-01', 'edition_number': '152', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cuO7PZv_QtMLiCeg5FkudrS0C_vY8Vot'], 'files': [{'checksum': 'ac1095aa0097793ac7fe5ff3b358bcc5', 'path': '2802007/2019-11-01/be3cd533ca6c558ec3209b99680d91928ded8f34', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cuO7PZv_QtMLiCeg5FkudrS0C_vY8Vot'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:47.625963Z', 'territory_id': '2802007'} 2023-11-28 02:11:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-27', 'edition_number': '176', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SRHxEBeHrR9cdJLtsrQOd_bTMmcn8isx'], 'files': [{'checksum': 'e9b685e6e51dec104e6781e98024e27f', 'path': '2802007/2019-12-27/5d0761d6826fd740f18f5b619ee699c8488dbc37', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SRHxEBeHrR9cdJLtsrQOd_bTMmcn8isx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:27.659528Z', 'territory_id': '2802007'} 2023-11-28 02:11:50 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 17 pages/min), scraped 166 items (at 17 items/min) 2023-11-28 02:11:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-06', 'edition_number': '178', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17DP8LEJSJ4A5DOzLdarLIClZjRHiohIs'], 'files': [{'checksum': '688f16f20c2c5b5052d10b36dc76fa94', 'path': '2802007/2020-01-06/279e27d5ff79f2904eb78f1aa3424c1d2f125241', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17DP8LEJSJ4A5DOzLdarLIClZjRHiohIs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:43.690089Z', 'territory_id': '2802007'} 2023-11-28 02:11:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-09', 'edition_number': '181', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vAtfMpVNrN4F3pSE67q3UCVWv66F-esN'], 'files': [{'checksum': '9dfc83043e03dd4e769b96e4dc83c11a', 'path': '2802007/2020-01-09/71ec34d41e8242610dcb2d2835b210a38bca77ca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vAtfMpVNrN4F3pSE67q3UCVWv66F-esN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:15.669552Z', 'territory_id': '2802007'} 2023-11-28 02:11:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-13', 'edition_number': '182', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FIr2jpUwNwPeiLYwdUVtIIFvhxlNaXbV'], 'files': [{'checksum': '3b9d6b5cb3cb04e6fd93259968e8aa64', 'path': '2802007/2020-01-13/4dc42cbfc179826ad86595359400dcb3c9e71f4d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FIr2jpUwNwPeiLYwdUVtIIFvhxlNaXbV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:20.914951Z', 'territory_id': '2802007'} 2023-11-28 02:11:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:11:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-10', 'edition_number': '142', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17yEJTFG7lKx9V29A2fu6n1fbSLZswLjp'], 'files': [{'checksum': '1c5d79d4c95c186226ae160cc023311f', 'path': '2802007/2019-10-10/d74c0a3524878413b5c5c8b6c9e5054ded23903b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17yEJTFG7lKx9V29A2fu6n1fbSLZswLjp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:01:01.283935Z', 'territory_id': '2802007'} 2023-11-28 02:12:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-07', 'edition_number': '179', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zdTmrRRrT6qlIkgWWHBsgdvRbD0NTk3K'], 'files': [{'checksum': '9bcdd37fc9320454eae2375cfd31d591', 'path': '2802007/2020-01-07/b1a5b47b6d5fd2a165824f5fe2e54fc4355737a3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zdTmrRRrT6qlIkgWWHBsgdvRbD0NTk3K'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:01.628074Z', 'territory_id': '2802007'} 2023-11-28 02:12:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-16', 'edition_number': '185', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15m8t_qv0RuTns86deENkAYogU1Nzdtcr'], 'files': [{'checksum': '1b0c2aac48e906b12aa07a0676f4338d', 'path': '2802007/2020-01-16/1527c330e43831e6c1dfa9becc597ad4b1bad93d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15m8t_qv0RuTns86deENkAYogU1Nzdtcr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:32.179942Z', 'territory_id': '2802007'} 2023-11-28 02:12:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-15', 'edition_number': '184', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EAGrI2sChvazKfjQPscRr_Bw0FqgpjFz'], 'files': [{'checksum': '7454677263e67bb3f547d5ed2684b200', 'path': '2802007/2020-01-15/1ec09c434202a558de4cfc2864c328f53d2818bc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EAGrI2sChvazKfjQPscRr_Bw0FqgpjFz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:29.328055Z', 'territory_id': '2802007'} 2023-11-28 02:12:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-14', 'edition_number': '183', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SEK-xUNodoQooEuq_Jv8hIoOUjvh8Trz'], 'files': [{'checksum': '5ea9221479ecac23e576bb5d38d799a9', 'path': '2802007/2020-01-14/55f38ce8c2476dcca96ebdb9440922dedcd71555', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SEK-xUNodoQooEuq_Jv8hIoOUjvh8Trz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:24.462425Z', 'territory_id': '2802007'} 2023-11-28 02:12:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-21', 'edition_number': '188', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Lt4HYyaWRI_9spiih-kmAbPorpdL-qZN'], 'files': [{'checksum': 'fa464a3890e661af55b5dc12c9e335e8', 'path': '2802007/2020-01-21/9088c2b4fa1abdf6fbb6651373404931b7535b09', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Lt4HYyaWRI_9spiih-kmAbPorpdL-qZN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:00.196669Z', 'territory_id': '2802007'} 2023-11-28 02:12:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-20', 'edition_number': '187', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11WZoS2xJ9XRIuV0BH0Ht3_kpWRlgNqgv'], 'files': [{'checksum': '53d96544c67c185084a46ec40b215263', 'path': '2802007/2020-01-20/016077a589f0b5ac2aed3e869440e5606e4421ed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11WZoS2xJ9XRIuV0BH0Ht3_kpWRlgNqgv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:56.485804Z', 'territory_id': '2802007'} 2023-11-28 02:12:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-24', 'edition_number': '190', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M_Gv178Pr0l4L30GaSbyhsEzqkwBVxKc'], 'files': [{'checksum': '8ffd49841fdabd03ae32dbb5bf493347', 'path': '2802007/2020-01-24/185a6a7bc01aaeb040db46ebf8b2622002788f13', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M_Gv178Pr0l4L30GaSbyhsEzqkwBVxKc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:15.135358Z', 'territory_id': '2802007'} 2023-11-28 02:12:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-27', 'edition_number': '191', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11ozyPw8ddeBFXdw2dhU4SMGPmIkQRbT5'], 'files': [{'checksum': 'f3c9e8742d5b00b52b1a6e013fb87631', 'path': '2802007/2020-01-27/327095cd54431356326fa9548b905cf32fc67387', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11ozyPw8ddeBFXdw2dhU4SMGPmIkQRbT5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:18.225112Z', 'territory_id': '2802007'} 2023-11-28 02:12:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-29', 'edition_number': '193', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1o469RNrJ9i0j3iANoT7-ggNIG3U-8FOc'], 'files': [{'checksum': '34f712fe2cda86e070f3868cd52e64b3', 'path': '2802007/2020-01-29/810c89b07f66a373c050ad8c4a60b2905873f9fc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1o469RNrJ9i0j3iANoT7-ggNIG3U-8FOc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:24.927210Z', 'territory_id': '2802007'} 2023-11-28 02:12:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-28', 'edition_number': '192', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dlww_E5nNCFcilK5qyq_Qi8Lz_XzmV58'], 'files': [{'checksum': '1b37130d02244c59991ffa562cd5c633', 'path': '2802007/2020-01-28/8d56fa49d4bd964992a1325a0b89ae99b0a3fe1e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dlww_E5nNCFcilK5qyq_Qi8Lz_XzmV58'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:20.905216Z', 'territory_id': '2802007'} 2023-11-28 02:12:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-23', 'edition_number': '189', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YluuNO7sw8s3ooJDBMm5g2DJYtIk6IZQ'], 'files': [{'checksum': 'e03991e972fef6519b8c02c4c457aad4', 'path': '2802007/2020-01-23/7de9398034ac8bf1ff8baecb245fa94253236bb4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YluuNO7sw8s3ooJDBMm5g2DJYtIk6IZQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:02.949094Z', 'territory_id': '2802007'} 2023-11-28 02:12:50 [scrapy.extensions.logstats] INFO: Crawled 183 pages (at 15 pages/min), scraped 181 items (at 15 items/min) 2023-11-28 02:12:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:12:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-04', 'edition_number': '195', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bAMVDKG4SIzN_Cri4JcwWEspNCTViQFd'], 'files': [{'checksum': 'd6bf2312514b0903b7203b7311339e68', 'path': '2802007/2020-02-04/a49e55aad7b20c62520718b47975c3216b7cd01a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bAMVDKG4SIzN_Cri4JcwWEspNCTViQFd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:32.361767Z', 'territory_id': '2802007'} 2023-11-28 02:13:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-30', 'edition_number': '194', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14bk5qFACaQ5-jLrV4vB276PUDu7VgfHK'], 'files': [{'checksum': '9da1ee74d445d11d4c25b2e92b298692', 'path': '2802007/2020-01-30/7c853c2e8225e908c95cdd40feb2ac4af7468c9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14bk5qFACaQ5-jLrV4vB276PUDu7VgfHK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:28.711763Z', 'territory_id': '2802007'} 2023-11-28 02:13:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-06', 'edition_number': '197', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UpuKiGk9JY0wyjKxH2owoUZzOemUsvP1'], 'files': [{'checksum': '5dc5d1b172ee85fa3615313a5bd8e6a1', 'path': '2802007/2020-02-06/2dc9ebb9c78ffbb449f3890b0bc7576e52f680ce', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UpuKiGk9JY0wyjKxH2owoUZzOemUsvP1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:59.436259Z', 'territory_id': '2802007'} 2023-11-28 02:13:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-05', 'edition_number': '196', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jQraSuJypCd_FQqabzXefRlYEIlBCv4Z'], 'files': [{'checksum': '27481621e4f7b8ff2474064e3acb0e40', 'path': '2802007/2020-02-05/915468043d1b58d5af9fea56415861db5be05cb1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jQraSuJypCd_FQqabzXefRlYEIlBCv4Z'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:05:35.151890Z', 'territory_id': '2802007'} 2023-11-28 02:13:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-07', 'edition_number': '198', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZvqO6AO4GM7vmuZbk2QaeVJ1FZtLths0'], 'files': [{'checksum': 'e7f24c33cb42885decd4fab7959f91c6', 'path': '2802007/2020-02-07/36e57a46f964e36d059b28592b596c0755f07e2a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZvqO6AO4GM7vmuZbk2QaeVJ1FZtLths0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:08.765816Z', 'territory_id': '2802007'} 2023-11-28 02:13:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-17', 'edition_number': '186', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1envZUjRkP822CRcry_TlC3wAN7o_8mLG'], 'files': [{'checksum': '26d122d088cb6ea61f4ec123f4838fb1', 'path': '2802007/2020-01-17/31c050127956660e20d3c694849c9576cbfb3045', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1envZUjRkP822CRcry_TlC3wAN7o_8mLG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:35.086893Z', 'territory_id': '2802007'} 2023-11-28 02:13:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-12', 'edition_number': '200', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=104JBglSPIeLe73LqoWtNVa2ia12uVLym'], 'files': [{'checksum': 'a3ed4dd584b04ec84d591c9ca7738ca1', 'path': '2802007/2020-02-12/390a27c04db3ce5d93711a538a5f188474cded94', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=104JBglSPIeLe73LqoWtNVa2ia12uVLym'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:15.292817Z', 'territory_id': '2802007'} 2023-11-28 02:13:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-17', 'edition_number': '202', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UdGUba-v4M0iU4kg3nms_BHXMdQeNDNJ'], 'files': [{'checksum': '753111314fda26bade946ab43df63fa1', 'path': '2802007/2020-02-17/bbb2114fcca9a3be04dd5fe13c9872c83834ba61', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UdGUba-v4M0iU4kg3nms_BHXMdQeNDNJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:22.632144Z', 'territory_id': '2802007'} 2023-11-28 02:13:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-19', 'edition_number': '204', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DckZgdp-PKmAA9TV0nXRzV6Jw4kviUq_'], 'files': [{'checksum': 'd50dd09ff714c155b682421a770bad93', 'path': '2802007/2020-02-19/fc99a7b59e06ea7a0f7a8c20b8dea3c808ebbb62', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DckZgdp-PKmAA9TV0nXRzV6Jw4kviUq_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:29.222456Z', 'territory_id': '2802007'} 2023-11-28 02:13:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-18', 'edition_number': '203', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J94y0FaGE65ajYG6arqZidwwUyX-jLvi'], 'files': [{'checksum': '88df20d0b65ccb694d00d7ff2c2c4d5f', 'path': '2802007/2020-02-18/92cfdc9fefda417e89577176c791ff1a6ace11ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J94y0FaGE65ajYG6arqZidwwUyX-jLvi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:25.667540Z', 'territory_id': '2802007'} 2023-11-28 02:13:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-06', 'edition_number': '77', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pYU_Fx0lW9BtNkLHwImmRVIyw7x7tVpC'], 'files': [{'checksum': 'f443879c77aa82722036c8ae097bb4d1', 'path': '2802007/2019-06-06/38a808d5cf6905bf1d03576fa42406f15997132e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pYU_Fx0lW9BtNkLHwImmRVIyw7x7tVpC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.463151Z', 'territory_id': '2802007'} 2023-11-28 02:13:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-20', 'edition_number': '205', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HuwUjP5fR9ImizgQLVYPwFuYvKCNrbB6'], 'files': [{'checksum': 'af86bb4658e28130fc3047fe9d42cc55', 'path': '2802007/2020-02-20/9c15c6b9410fb0ceb628d5fae1ef4a75722e6234', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HuwUjP5fR9ImizgQLVYPwFuYvKCNrbB6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:34.417033Z', 'territory_id': '2802007'} 2023-11-28 02:13:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-27', 'edition_number': '206', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18SYRfkRUq1R_vTLch9YWORz5qdXL01Du'], 'files': [{'checksum': '6502d938ad6bc93f91b6c421da6c32bd', 'path': '2802007/2020-02-27/aaae8826b0e6056b9941fe770f9ec918be2deddf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18SYRfkRUq1R_vTLch9YWORz5qdXL01Du'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:37.126470Z', 'territory_id': '2802007'} 2023-11-28 02:13:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-06-11', 'edition_number': '80', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PjwkecF51HxT0n0RYn9oxmbpVVNr5kSo'], 'files': [{'checksum': '7c80610325fe35d4830f4b9534f207fb', 'path': '2802007/2019-06-11/ead380ab2f960aa90d9a3241e7a872d24d46ab59', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PjwkecF51HxT0n0RYn9oxmbpVVNr5kSo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.469353Z', 'territory_id': '2802007'} 2023-11-28 02:13:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-28', 'edition_number': '207', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WNf64IrXi5BaRa3FYU0IepBlkcTnvw-M'], 'files': [{'checksum': 'bf65efaaf577e7dce00cf16740a9a5b8', 'path': '2802007/2020-02-28/421b28ad02cbaffe88a1baf668309098e803e05b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WNf64IrXi5BaRa3FYU0IepBlkcTnvw-M'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:40.721550Z', 'territory_id': '2802007'} 2023-11-28 02:13:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-03', 'edition_number': '208', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KC4fZQrOROsTv1ygAKv5udG9YqhA9dgb'], 'files': [{'checksum': '966e1cbc7c2feef9423c450334c9e429', 'path': '2802007/2020-03-03/baafb21aadfcf4d2ea9f818a584a9d3638429959', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KC4fZQrOROsTv1ygAKv5udG9YqhA9dgb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:45.105195Z', 'territory_id': '2802007'} 2023-11-28 02:13:50 [scrapy.extensions.logstats] INFO: Crawled 199 pages (at 16 pages/min), scraped 197 items (at 16 items/min) 2023-11-28 02:13:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-13', 'edition_number': '201', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Qkgn05b04zlefZkXhuhKfg4hXj-_wHj9'], 'files': [{'checksum': '23dbb8904aa697be75cbfd2bcacdfe29', 'path': '2802007/2020-02-13/2552079cbe95cd7fcaf4c524ed45ad5bee852d2c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Qkgn05b04zlefZkXhuhKfg4hXj-_wHj9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:19.171170Z', 'territory_id': '2802007'} 2023-11-28 02:13:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:13:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-02-11', 'edition_number': '199', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19_WZAxEBbUyjXNiZX2ZdgDUhDSMWw4e2'], 'files': [{'checksum': '87b7b2e4316822cd73f5a3dce0a16bc9', 'path': '2802007/2020-02-11/ec1c32efaaed304ab2b58cca8571c7443d37aa60', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19_WZAxEBbUyjXNiZX2ZdgDUhDSMWw4e2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:12.460229Z', 'territory_id': '2802007'} 2023-11-28 02:14:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-05', 'edition_number': '210', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1__qeSGdmWLV35tRVhOcYJ32ndQARrG0y'], 'files': [{'checksum': 'dfcef56f853621b75581a24ee0a6c314', 'path': '2802007/2020-03-05/352678f741c199b1b61b3df7cde137922d1c548e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1__qeSGdmWLV35tRVhOcYJ32ndQARrG0y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:52.221819Z', 'territory_id': '2802007'} 2023-11-28 02:14:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-01-08', 'edition_number': '180', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=170XsXBkixdKKZWzKniGqGVYytNyDLHL2'], 'files': [{'checksum': '958765e63d9e4539abee037b6398c5e7', 'path': '2802007/2020-01-08/61600b89bf1a3a6a8af9a5c72d54567ddff14eab', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=170XsXBkixdKKZWzKniGqGVYytNyDLHL2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:04:12.356220Z', 'territory_id': '2802007'} 2023-11-28 02:14:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-10', 'edition_number': '213', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ab6Y2JgY7qDiqiJ9RvVTWwoFRuECSTnj'], 'files': [{'checksum': 'ea3dac814f3e8dc10106f7e917f23cdb', 'path': '2802007/2020-03-10/22b943a51aeecfb2e2d9c735d2e0079e05152d9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ab6Y2JgY7qDiqiJ9RvVTWwoFRuECSTnj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:04.510073Z', 'territory_id': '2802007'} 2023-11-28 02:14:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-11', 'edition_number': '214', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xT4EHzs4duklk0XPLshKsxl3j3zFslnq'], 'files': [{'checksum': 'a7bf8052cf733ec5d2847049eda674db', 'path': '2802007/2020-03-11/5b5ce2160dbd4fd0f7a6c014ac637587139c64fe', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xT4EHzs4duklk0XPLshKsxl3j3zFslnq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:08.830932Z', 'territory_id': '2802007'} 2023-11-28 02:14:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-06', 'edition_number': '211', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nn35oKN8TOU5ZQ_Kc740ATf53ysRqzVj'], 'files': [{'checksum': '977f7d2c06a07d6fbb912a6aed1354da', 'path': '2802007/2020-03-06/0756cf70d00543cc79f799683e78406223539dcc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nn35oKN8TOU5ZQ_Kc740ATf53ysRqzVj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:56.873594Z', 'territory_id': '2802007'} 2023-11-28 02:14:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-16', 'edition_number': '216', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Xd5ZWnGlOFk6JjKhBw3dfXUwSizatg-T'], 'files': [{'checksum': 'b8baa0229ebfcbf0a959dae3fe0641e9', 'path': '2802007/2020-03-16/ed83b335fb16f8fdaf8b2602429d6d96edc1d7df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Xd5ZWnGlOFk6JjKhBw3dfXUwSizatg-T'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:15.993155Z', 'territory_id': '2802007'} 2023-11-28 02:14:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-04', 'edition_number': '209', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jG6S9GPdbEbkDmFknwOIrSgOU4xIpTbU'], 'files': [{'checksum': '3d0f072b874d57b7e46a36820b1a2541', 'path': '2802007/2020-03-04/e26d81a5f41266451ec8390c36a4a92e0ef337c7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jG6S9GPdbEbkDmFknwOIrSgOU4xIpTbU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:06:48.868234Z', 'territory_id': '2802007'} 2023-11-28 02:14:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-09', 'edition_number': '212', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PUm4_6H9bVhs5bGgSpaRRUhVDtcDsac9'], 'files': [{'checksum': '6ad373c43d24f7b5d8edc17a5a28459c', 'path': '2802007/2020-03-09/e9e9a05f16572357de71d1e2e58292ab4527818d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PUm4_6H9bVhs5bGgSpaRRUhVDtcDsac9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:01.567881Z', 'territory_id': '2802007'} 2023-11-28 02:14:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-18', 'edition_number': '218', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15A4ct5pAtEyZj4rOETwayBoJbpD8zIH-'], 'files': [{'checksum': '3a75d862bde3e96a187287434dcb5f24', 'path': '2802007/2020-03-18/da89b96ffc3eb9962638ad4173e8978b4a934920', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15A4ct5pAtEyZj4rOETwayBoJbpD8zIH-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:23.070888Z', 'territory_id': '2802007'} 2023-11-28 02:14:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-03-19', 'edition_number': '39', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15cXXb7OGWaLTaROo2ZOapJdSnG45rFru'], 'files': [{'checksum': '0ebb028029e277b8b974340c667b6f65', 'path': '2802007/2019-03-19/a2a396399c9305587d187053cc51333d039f65da', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15cXXb7OGWaLTaROo2ZOapJdSnG45rFru'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:57:59.374133Z', 'territory_id': '2802007'} 2023-11-28 02:14:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-20', 'edition_number': '219', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AhbkIGEBUYUh3jKRZORPEHrxAzZr3iJO'], 'files': [{'checksum': 'ee01f0ac6cc4744f030aa9720896c9e1', 'path': '2802007/2020-03-20/f308108e2beb97eef89ea033d3c4f8a38786b7fa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AhbkIGEBUYUh3jKRZORPEHrxAzZr3iJO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:25.786964Z', 'territory_id': '2802007'} 2023-11-28 02:14:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-31', 'edition_number': '222', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15PX7u-H4XjfSX3hecrw1Qxm0CJ5bDwqb'], 'files': [{'checksum': 'f70fd34f04d3c1e872318eaafed37825', 'path': '2802007/2020-03-31/0ff4570a611ef56ba3c9b070f26e78b70dc5f99e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15PX7u-H4XjfSX3hecrw1Qxm0CJ5bDwqb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:36.375601Z', 'territory_id': '2802007'} 2023-11-28 02:14:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-23', 'edition_number': '220', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RVuCmHAaxOs6mGOYqMFxrm9syOF0JA8s'], 'files': [{'checksum': '4487a45f6af172bf1f9585efc8b0cbde', 'path': '2802007/2020-03-23/d0fd5969f5309c6aa21787118361c045673e2bf1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RVuCmHAaxOs6mGOYqMFxrm9syOF0JA8s'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:29.451394Z', 'territory_id': '2802007'} 2023-11-28 02:14:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-01', 'edition_number': '223', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15q4zDHvTE2EnLtyqcssptbZdYzC8UIJj'], 'files': [{'checksum': 'd6eb8fa288683d6b259189854197f381', 'path': '2802007/2020-04-01/7f53fd028570c85800219592590c6f0c7b060902', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15q4zDHvTE2EnLtyqcssptbZdYzC8UIJj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:40.222028Z', 'territory_id': '2802007'} 2023-11-28 02:14:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-30', 'edition_number': '221', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1coEop6DKIXnDoJAp-UNuWvm5mJVx8PSE'], 'files': [{'checksum': 'd8f9c688c78ce09839dc7ddc8fb7ced5', 'path': '2802007/2020-03-30/1e720708428c1c815d8e030b147998fde487f7f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1coEop6DKIXnDoJAp-UNuWvm5mJVx8PSE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:34.019708Z', 'territory_id': '2802007'} 2023-11-28 02:14:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-07', 'edition_number': '225', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ERnQtya_5f1DQgOdTxgFoCjGiw1pjQym'], 'files': [{'checksum': '83f1142b1dee99a563782591a71dcb08', 'path': '2802007/2020-04-07/4191e9f3e1dae8f5fce546365775de92f6130722', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ERnQtya_5f1DQgOdTxgFoCjGiw1pjQym'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:47.297471Z', 'territory_id': '2802007'} 2023-11-28 02:14:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-09', 'edition_number': '227', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EiyHdQcBTgId-CzzfMJCv3TeobmL3MiE'], 'files': [{'checksum': 'ec2493aac869ffb4d0536c2e79d0b70b', 'path': '2802007/2020-04-09/14206edadf8a275b802bc93969b9408c4b988fd6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EiyHdQcBTgId-CzzfMJCv3TeobmL3MiE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:09.026660Z', 'territory_id': '2802007'} 2023-11-28 02:14:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:14:50 [scrapy.extensions.logstats] INFO: Crawled 218 pages (at 19 pages/min), scraped 216 items (at 19 items/min) 2023-11-28 02:14:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-08', 'edition_number': '226', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11KRNwQpcARPYlRDAvqLvqP6E5NMmZTfc'], 'files': [{'checksum': '13d10201608a42bff0ed0a7895640eef', 'path': '2802007/2020-04-08/d0e6f7132ea3e0783d0abe8e1bba3b76ea55f267', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11KRNwQpcARPYlRDAvqLvqP6E5NMmZTfc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:50.389339Z', 'territory_id': '2802007'} 2023-11-28 02:14:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-03', 'edition_number': '224', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L92qg9XoLwTnVZgD98ucHEBE4mbe0Hf7'], 'files': [{'checksum': '15071a0c21b97e5f63bf626ab61feae8', 'path': '2802007/2020-04-03/324c0e43d1ff3207e8f8b57efbe6c91a376eb267', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L92qg9XoLwTnVZgD98ucHEBE4mbe0Hf7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:43.862896Z', 'territory_id': '2802007'} 2023-11-28 02:14:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:14:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-13', 'edition_number': '228', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DSVElXS3-yUtZhDt7v_X9YKSsPhfP7Lx'], 'files': [{'checksum': 'ce839b0591dcb3482e2eebf698c74c44', 'path': '2802007/2020-04-13/4d22f50f8faa988ed8180214d2dbea84173c8cf9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DSVElXS3-yUtZhDt7v_X9YKSsPhfP7Lx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:11.145822Z', 'territory_id': '2802007'} 2023-11-28 02:15:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-18', 'edition_number': '173', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EqRha18UIgjhPgSJfrCjmgK0Ru8NcY_7'], 'files': [{'checksum': 'd6c21d1dc50fa8823ed832f274d6484c', 'path': '2802007/2019-12-18/c8a84ed47d56d1872af4974c5c84b5132b1c7f9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EqRha18UIgjhPgSJfrCjmgK0Ru8NcY_7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:03:15.461620Z', 'territory_id': '2802007'} 2023-11-28 02:15:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-20', 'edition_number': '231', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Eh4w1OeJiP78FyiX3MhceC51jDYe0Z2x'], 'files': [{'checksum': '67cedf2aec516823e1469649a1618209', 'path': '2802007/2020-04-20/c465c4469f7d99ac15e5217460059941b6ab769b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Eh4w1OeJiP78FyiX3MhceC51jDYe0Z2x'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:20.119681Z', 'territory_id': '2802007'} 2023-11-28 02:15:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-17', 'edition_number': '230', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14E5VMUUm9c5pS_dSDyVmQuUaTyQRtklw'], 'files': [{'checksum': '88743885057db229d1a2ea13406e3664', 'path': '2802007/2020-04-17/95a0d9ec845675dfa3e3b434adb089a4841ee605', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14E5VMUUm9c5pS_dSDyVmQuUaTyQRtklw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:17.835320Z', 'territory_id': '2802007'} 2023-11-28 02:15:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-23', 'edition_number': '233', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nbssmmwAdyzY0_O8hjm1Y_Z24JNkITyc'], 'files': [{'checksum': '5921c7b6ca2918bce5157156ef9fd812', 'path': '2802007/2020-04-23/f4ae193ac988ce25d3a39bfe48c14e740304132e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nbssmmwAdyzY0_O8hjm1Y_Z24JNkITyc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:24.394712Z', 'territory_id': '2802007'} 2023-11-28 02:15:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-14', 'edition_number': '229', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17TxErLDnT84CgXyE4pCpRzwsCtnezN4C'], 'files': [{'checksum': '60df169802e9eb9f7b1646d7766b1384', 'path': '2802007/2020-04-14/57c0927caa3bffe3519c43ca7fdf7142e571214f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17TxErLDnT84CgXyE4pCpRzwsCtnezN4C'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:13.290296Z', 'territory_id': '2802007'} 2023-11-28 02:15:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-29', 'edition_number': '104', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1quY5gjuA1Jkukv-VBDtULgHKGZwPqRH6'], 'files': [{'checksum': 'b73be0751ad809446bf3696f27807a7e', 'path': '2802007/2019-07-29/c9643206ce56bc2f2fe9a5ed4fa62bbad8816599', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1quY5gjuA1Jkukv-VBDtULgHKGZwPqRH6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:10.338545Z', 'territory_id': '2802007'} 2023-11-28 02:15:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-29', 'edition_number': '235', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A2oG_hSfFr7YnQmL_zx4FJr1-exg3v2U'], 'files': [{'checksum': 'ecc4df109619272bb7256623fed1807f', 'path': '2802007/2020-04-29/8cafa2fb9d94e416649cbffbae048effaced3810', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A2oG_hSfFr7YnQmL_zx4FJr1-exg3v2U'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:31.879872Z', 'territory_id': '2802007'} 2023-11-28 02:15:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-05', 'edition_number': '238', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ChhAbldp3rzVxKhMDMT-x9uIl8ibq74j'], 'files': [{'checksum': '8ab54477c9f4808102cb7866488a0384', 'path': '2802007/2020-05-05/204e63effad55ff11a21aa645b8655e188e4a1d8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ChhAbldp3rzVxKhMDMT-x9uIl8ibq74j'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:40.569838Z', 'territory_id': '2802007'} 2023-11-28 02:15:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-30', 'edition_number': '237', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1j8tIhkJQK97Rewv6e5tSCHNH1v7S5FYQ'], 'files': [{'checksum': '69d73c7fbbeee3fcb2c4c7f1c2cb47dc', 'path': '2802007/2020-04-30/f51bb35335f3afa1820c97e2f255017e96e68c66', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1j8tIhkJQK97Rewv6e5tSCHNH1v7S5FYQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:38.417512Z', 'territory_id': '2802007'} 2023-11-28 02:15:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-29', 'edition_number': '236', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HsbN82QD__QrVeloSKG_P48zKPyOwLxX'], 'files': [{'checksum': 'ce7c94a09239a09e9c9947195625c3bd', 'path': '2802007/2020-04-29/cac31f023b539e0bf6342507d269b73385e3c5d4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HsbN82QD__QrVeloSKG_P48zKPyOwLxX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:34.830262Z', 'territory_id': '2802007'} 2023-11-28 02:15:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-07', 'edition_number': '240', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1h24PSJpumYOJr0EqFNwiBB-jmWjJ3oJC'], 'files': [{'checksum': 'fc9781f9262c35e7595b6791d5993cf9', 'path': '2802007/2020-05-07/514aa9b62a370703f2882999ce8c00354d0506f1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1h24PSJpumYOJr0EqFNwiBB-jmWjJ3oJC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:48.686536Z', 'territory_id': '2802007'} 2023-11-28 02:15:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-08', 'edition_number': '242', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LbpKQkclRQZGkgrX-QbcXOkno3rAgpHT'], 'files': [{'checksum': 'e83dad0f8bb3186d5a59b0fce04d0d23', 'path': '2802007/2020-05-08/fb653c8cd8424f8c19ffe170b900f2909ab52dac', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LbpKQkclRQZGkgrX-QbcXOkno3rAgpHT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:59.728610Z', 'territory_id': '2802007'} 2023-11-28 02:15:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-07', 'edition_number': '241', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rjugff-CsJsDrdeL-sE0ZJsVQzskYbDP'], 'files': [{'checksum': '206620095d6e4c597834f39358f30a14', 'path': '2802007/2020-05-07/e8c616c3e7d16846290b26f3d6fb2510ccfed1a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rjugff-CsJsDrdeL-sE0ZJsVQzskYbDP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:55.230807Z', 'territory_id': '2802007'} 2023-11-28 02:15:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-12', 'edition_number': '244', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cceIy3Ut0mqxxMoebIRCDTvnXRzQpbsF'], 'files': [{'checksum': '710b31a90c3aa4553efbda6cd44b3f6b', 'path': '2802007/2020-05-12/20e8f59feba1bd1597f93d0fc1e67dd7045bd5fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cceIy3Ut0mqxxMoebIRCDTvnXRzQpbsF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:05.587685Z', 'territory_id': '2802007'} 2023-11-28 02:15:50 [scrapy.extensions.logstats] INFO: Crawled 235 pages (at 17 pages/min), scraped 233 items (at 17 items/min) 2023-11-28 02:15:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-11', 'edition_number': '243', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NNkUUOxZh6V7QAQyb0-cqmqNpUXxeZL_'], 'files': [{'checksum': 'cfa8f206526280159068528b48b0fb8d', 'path': '2802007/2020-05-11/1011a405cd5c01fbc63906fd8ca4eff3b65b1001', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NNkUUOxZh6V7QAQyb0-cqmqNpUXxeZL_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:01.879493Z', 'territory_id': '2802007'} 2023-11-28 02:15:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-28', 'edition_number': '234', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UjaF8Q6GKLI_Qe7aPLZCqikySRp7Qi4c'], 'files': [{'checksum': '240c6306be2aea4d493b5f1d36999193', 'path': '2802007/2020-04-28/d2f992447b0109fc9ce684d1a0a6f16dd2d4f292', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UjaF8Q6GKLI_Qe7aPLZCqikySRp7Qi4c'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:27.627449Z', 'territory_id': '2802007'} 2023-11-28 02:15:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:15:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:15:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-06', 'edition_number': '239', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HO_ge6dm898KWKc6wX_Up5Hx0Ti8wPyM'], 'files': [{'checksum': 'f12e355c1bb289a554c3efa6c33a62af', 'path': '2802007/2020-05-06/d1cabd3bcf0d5586ae5dabd04cd0a724e8df1480', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HO_ge6dm898KWKc6wX_Up5Hx0Ti8wPyM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:42.653106Z', 'territory_id': '2802007'} 2023-11-28 02:16:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-21', 'edition_number': '248', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U83yaOVsffRJ4sBVdnDGjI1Q8OuD5lRV'], 'files': [{'checksum': 'd23f85a8eaa2c3208daf98074c6711e9', 'path': '2802007/2020-05-21/285968254f91cbbbd4589ab53aa68f2f5ca2f9a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U83yaOVsffRJ4sBVdnDGjI1Q8OuD5lRV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:20.640260Z', 'territory_id': '2802007'} 2023-11-28 02:16:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-20', 'edition_number': '247', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QAGQ7NyxJXLpJi8tmbu07HpHHqqd7pid'], 'files': [{'checksum': '970d82b037ace71bc5d1bfba0c147c58', 'path': '2802007/2020-05-20/28b750ff14d60a9f1f10725a2582f3c5f23ca68a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QAGQ7NyxJXLpJi8tmbu07HpHHqqd7pid'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:16.000924Z', 'territory_id': '2802007'} 2023-11-28 02:16:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-22', 'edition_number': '249', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18UWk9cMG99m9eG0XnpOz5Ogb-ztFbC7m'], 'files': [{'checksum': '318f9b0a941c1d71b603bcdbb474d60e', 'path': '2802007/2020-05-22/cfc7753b41b6fa45912f9e9f69c2bf68996d63db', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18UWk9cMG99m9eG0XnpOz5Ogb-ztFbC7m'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:24.142249Z', 'territory_id': '2802007'} 2023-11-28 02:16:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-19', 'edition_number': '246', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1q_Loy2IYtAi1h532WHuj9uqOU8J6CYkm'], 'files': [{'checksum': '815c4bdbd10852854dac25d0be8f9175', 'path': '2802007/2020-05-19/4d2d366c78af152d4f9e2199f4be48def8816016', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1q_Loy2IYtAi1h532WHuj9uqOU8J6CYkm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:12.998481Z', 'territory_id': '2802007'} 2023-11-28 02:16:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-03', 'edition_number': '124', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1C2i742JGtU1Skj0-5v79wooRYKnqYMXy'], 'files': [{'checksum': '59480ed064de36c8c41bc7894bfdbe15', 'path': '2802007/2019-09-03/60f2c80ce8edec1cfde0eb0dcc278eadf5cb6c74', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1C2i742JGtU1Skj0-5v79wooRYKnqYMXy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:44.196051Z', 'territory_id': '2802007'} 2023-11-28 02:16:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-28', 'edition_number': '251', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pTVQbugtKXcBzzWuX61R96_aPtRTug0E'], 'files': [{'checksum': '9956a5791f23ee27f7ffe51179cd4cc2', 'path': '2802007/2020-05-28/1a8abe4479c6269c63986b8f75bb3a094d380099', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pTVQbugtKXcBzzWuX61R96_aPtRTug0E'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:04.793446Z', 'territory_id': '2802007'} 2023-11-28 02:16:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-14', 'edition_number': '245', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VLKKPbMhbD4eHLhrh6ynTDP3yfrbWoOn'], 'files': [{'checksum': '81f8852fc02d4b58914155069a4da7c8', 'path': '2802007/2020-05-14/8489b459a3056694eb1813a35ef5a2e3228123fa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VLKKPbMhbD4eHLhrh6ynTDP3yfrbWoOn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:09.165509Z', 'territory_id': '2802007'} 2023-11-28 02:16:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-27', 'edition_number': '250', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OKuYokqhXFiGicgKAVfrhY04DpDeiyqK'], 'files': [{'checksum': '2c9076908c4534b78391219b7a78ba86', 'path': '2802007/2020-05-27/0ea05bb0b9308d05b4881a6d73427ecb0d41bbeb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OKuYokqhXFiGicgKAVfrhY04DpDeiyqK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:10:59.962888Z', 'territory_id': '2802007'} 2023-11-28 02:16:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-09-04', 'edition_number': '125', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jDf8xpBzK__gccFgGu2tAcFrheVKDdU3'], 'files': [{'checksum': 'a7e55525d4c6710c3becb184567f4074', 'path': '2802007/2019-09-04/04c2e454abf1994e57b00e2331fa6122536fd5d6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jDf8xpBzK__gccFgGu2tAcFrheVKDdU3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:59:46.660250Z', 'territory_id': '2802007'} 2023-11-28 02:16:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-07-30', 'edition_number': '105', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M1mkvV4hve60YAU1QNzHKx34tAx_4jsY'], 'files': [{'checksum': '054d680c966b48030c722db24abf703d', 'path': '2802007/2019-07-30/670b0673277de5be3eb1f077e1272ba665a8ae79', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M1mkvV4hve60YAU1QNzHKx34tAx_4jsY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T04:58:13.404015Z', 'territory_id': '2802007'} 2023-11-28 02:16:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-04-22', 'edition_number': '232', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pk2oFIL94JTSRlxwzP4IIQ_hveaoUYXa'], 'files': [{'checksum': '28024776941cf56681047c7496553dee', 'path': '2802007/2020-04-22/2a1a68be9c3d0f0dcb71e2007400375d9398be7b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pk2oFIL94JTSRlxwzP4IIQ_hveaoUYXa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:09:22.595092Z', 'territory_id': '2802007'} 2023-11-28 02:16:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-03', 'edition_number': '256', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14VSn-684OKEjcgseRTRiO5mYyvl5Fl7y'], 'files': [{'checksum': '4d1a04701723f8eee732d9a388f1c3ae', 'path': '2802007/2020-06-03/fcb5ae1284940237795088314eca971d740443e9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14VSn-684OKEjcgseRTRiO5mYyvl5Fl7y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:17.986592Z', 'territory_id': '2802007'} 2023-11-28 02:16:50 [scrapy.extensions.logstats] INFO: Crawled 250 pages (at 15 pages/min), scraped 248 items (at 15 items/min) 2023-11-28 02:16:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-04', 'edition_number': '257', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wTc1HtcOXjw8jIpet304YSHKd63BfxdX'], 'files': [{'checksum': 'f20fec2ad2700e4e3ace17cd3ee46a36', 'path': '2802007/2020-06-04/204b8bacb0d6c5f7053ff92dd19e2de3d48649d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wTc1HtcOXjw8jIpet304YSHKd63BfxdX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:22.478779Z', 'territory_id': '2802007'} 2023-11-28 02:16:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-02', 'edition_number': '255', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tL9JfVpFbuUQ7XL43soy9QvWHPv0UD-f'], 'files': [{'checksum': '3e65b00badfbe5a6fd917174fd0dd64b', 'path': '2802007/2020-06-02/81d08527a5a7d7530c24c153f5b9cc8f11184c57', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tL9JfVpFbuUQ7XL43soy9QvWHPv0UD-f'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:14.517246Z', 'territory_id': '2802007'} 2023-11-28 02:16:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-05', 'edition_number': '259', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1suSGG4JbsKOLjgy1s3FXlA9nEPLPe0zU'], 'files': [{'checksum': 'c0e252402bf18431a7fd69d19e2eea05', 'path': '2802007/2020-06-05/79ef6b43ea4b252e9370808706b1a44ad4dc82a8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1suSGG4JbsKOLjgy1s3FXlA9nEPLPe0zU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:25.828132Z', 'territory_id': '2802007'} 2023-11-28 02:16:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:16:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-07', 'edition_number': '258', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YBHQhLr_Vz9vLDokVDEQdZ5PakTco3DS'], 'files': [{'checksum': '873adeec4c6d930043388e7c973e61ea', 'path': '2802007/2020-06-07/bf8f46f567a2088077a3b43e2b1f08615c1d6be5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YBHQhLr_Vz9vLDokVDEQdZ5PakTco3DS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:27.730070Z', 'territory_id': '2802007'} 2023-11-28 02:16:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:16:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-09', 'edition_number': '260', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jIicUhI9Nr-PLKYr1ZZc1TwduQd1iOj4'], 'files': [{'checksum': 'fa5cb42dfab33d2d2b26f26cced88b3f', 'path': '2802007/2020-06-09/1a5a9864f8af2c371d67d94e29a5231ed9884b3b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jIicUhI9Nr-PLKYr1ZZc1TwduQd1iOj4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:30.241386Z', 'territory_id': '2802007'} 2023-11-28 02:17:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-11', 'edition_number': '262', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1As6Yb_i3V6KLg1XVDfKFRec7RGlC7GZp'], 'files': [{'checksum': '23e1234d2fccc7cfd3ffbe688840fcff', 'path': '2802007/2020-06-11/0bc18ce571651c58426575e79a318553bb76c85c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1As6Yb_i3V6KLg1XVDfKFRec7RGlC7GZp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:36.422278Z', 'territory_id': '2802007'} 2023-11-28 02:17:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-10', 'edition_number': '261', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lkTR2uLHCuKLmZ9aHv244TJNVV4Z5r8C'], 'files': [{'checksum': 'efbbb76902e6aef7de84769389732701', 'path': '2802007/2020-06-10/808995a40ffd81ca0b3b382f55890babda42d965', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lkTR2uLHCuKLmZ9aHv244TJNVV4Z5r8C'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:34.018481Z', 'territory_id': '2802007'} 2023-11-28 02:17:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-01', 'edition_number': '254', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1R6Fh6Zep9xDv5mA7Wb-7IlGc2gpOcs1Y'], 'files': [{'checksum': '9420068abdb5263886c8128fca7bf469', 'path': '2802007/2020-06-01/eeb36d921945c8895e1e3e9c3c75cf1d441e0302', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1R6Fh6Zep9xDv5mA7Wb-7IlGc2gpOcs1Y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:12.430651Z', 'territory_id': '2802007'} 2023-11-28 02:17:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-16', 'edition_number': '265', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EiGjQpimcaZy20QhQ0Bicj6rxFYXStIb'], 'files': [{'checksum': '4c0dbb8cac9a2ffc393ba310a0146a30', 'path': '2802007/2020-06-16/4d1629cbc4a827296dfd53796e0427b2c3e23e02', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EiGjQpimcaZy20QhQ0Bicj6rxFYXStIb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:44.889049Z', 'territory_id': '2802007'} 2023-11-28 02:17:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-14', 'edition_number': '264', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QyCq6NZI6XCYePC6OeQLm8GT1FPe1f7e'], 'files': [{'checksum': '12883d8c4d6d95f6d20f0cefd3cdf8c6', 'path': '2802007/2020-06-14/6851683e87fb83b3f87acef813c9f266304a3a89', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QyCq6NZI6XCYePC6OeQLm8GT1FPe1f7e'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:42.629701Z', 'territory_id': '2802007'} 2023-11-28 02:17:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-12', 'edition_number': '263', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13Hb_ajEhdFlzAOp_UNrwYBR-BhAK9-mw'], 'files': [{'checksum': '6fccdf618365b8b3266e66644eef7e4b', 'path': '2802007/2020-06-12/5c484661dcf5508f7fa99965d2cea310d25c443f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13Hb_ajEhdFlzAOp_UNrwYBR-BhAK9-mw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:41.432399Z', 'territory_id': '2802007'} 2023-11-28 02:17:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-20', 'edition_number': '268', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1plQYMvv5CGbWvd_-DMg1kv11GqoTgYdm'], 'files': [{'checksum': '4489c1eda8609f9604ed7852df43b8f3', 'path': '2802007/2020-06-20/12acce6ed1e39fb93bafcf888e3697399439ad91', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1plQYMvv5CGbWvd_-DMg1kv11GqoTgYdm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:52.919831Z', 'territory_id': '2802007'} 2023-11-28 02:17:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-21', 'edition_number': '269', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iozg2YjWm6XYF3GynTp5wfTgH3ydnyRo'], 'files': [{'checksum': 'e03a2088462b49d8ced7d248907a55ea', 'path': '2802007/2020-06-21/ef9cbc1523eb5c28b4c86171cb4e0fc27d75e525', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iozg2YjWm6XYF3GynTp5wfTgH3ydnyRo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:56.341160Z', 'territory_id': '2802007'} 2023-11-28 02:17:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-22', 'edition_number': '270', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JxzcvwsJvMHktlM4xIWfAE0G6DLAlbCF'], 'files': [{'checksum': '574a4ff0c3022e46df4e538dc09f4ded', 'path': '2802007/2020-06-22/03f683ba3d23e7e656e34b86d2ed1b3f44c62f80', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JxzcvwsJvMHktlM4xIWfAE0G6DLAlbCF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:58.231878Z', 'territory_id': '2802007'} 2023-11-28 02:17:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-23', 'edition_number': '271', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QvInfwVipSblNcOsEikF_pbd3CBlLuaT'], 'files': [{'checksum': '2a0499e5a9a8b6ffc60e6814a2e86e6d', 'path': '2802007/2020-06-23/c1639dc58034724aa2be72d5a4ae53de24a483ef', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QvInfwVipSblNcOsEikF_pbd3CBlLuaT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:02.651029Z', 'territory_id': '2802007'} 2023-11-28 02:17:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-18', 'edition_number': '267', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H9AsncIEYs2RNFs7JBiIo_-AVQk4aqLs'], 'files': [{'checksum': '73c14687c27e68154645b32553439374', 'path': '2802007/2020-06-18/d4ea20d45dec061baa7cdf37c5b0e17f1d5e7884', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H9AsncIEYs2RNFs7JBiIo_-AVQk4aqLs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:50.359261Z', 'territory_id': '2802007'} 2023-11-28 02:17:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-17', 'edition_number': '266', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WYyiYb9wLR4SJQ8uPAJy6dgHibn63lBx'], 'files': [{'checksum': '5f37e1932973d2738694307aff5cce8a', 'path': '2802007/2020-06-17/c8ef4a25b2491e3c7684a629cac7b6a237a1b95c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WYyiYb9wLR4SJQ8uPAJy6dgHibn63lBx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:47.428639Z', 'territory_id': '2802007'} 2023-11-28 02:17:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-24', 'edition_number': '273', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PkCu0CEG8MZuoVjM_UmdaJZb8erv9N0-'], 'files': [{'checksum': '91130f2471ed6fbb266ecd7e81afb30c', 'path': '2802007/2020-06-24/d83706e5973577fe9ee66a78c293f2a8f4519e4e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PkCu0CEG8MZuoVjM_UmdaJZb8erv9N0-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:12.769291Z', 'territory_id': '2802007'} 2023-11-28 02:17:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-25', 'edition_number': '274', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K6LAu77i2rAfcNQceR1hIoxOiCmV3BzL'], 'files': [{'checksum': '3c2ad57cbdd1bc784a54ce9b91a8e315', 'path': '2802007/2020-06-25/929ab367dfdc4a9fa4a49fea490cade08e004bd3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K6LAu77i2rAfcNQceR1hIoxOiCmV3BzL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:16.173004Z', 'territory_id': '2802007'} 2023-11-28 02:17:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-26', 'edition_number': '275', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p4f0BRS26zxzca_OkHGr9Xm69MGzyo7F'], 'files': [{'checksum': '65e2449b86af497e941dc7ec01a6069d', 'path': '2802007/2020-06-26/a062be9ef42abf9c59faaeb6c40cd98b19cd0b8d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p4f0BRS26zxzca_OkHGr9Xm69MGzyo7F'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:18.130162Z', 'territory_id': '2802007'} 2023-11-28 02:17:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-10-04', 'edition_number': '138', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M0oypryPe3lbni79UAjTu_iuRa6SNiAf'], 'files': [{'checksum': '3195c8c6478d3dea10096cf5e966d8c3', 'path': '2802007/2019-10-04/a0892e99c109de0990e4a42bb3d15bc5e608aaf4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M0oypryPe3lbni79UAjTu_iuRa6SNiAf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:00:44.960699Z', 'territory_id': '2802007'} 2023-11-28 02:17:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-27', 'edition_number': '277', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PfSNGJ7HOQtY521bNPMs2HZbo-miYSjp'], 'files': [{'checksum': '8be53ebebca155a26b23680661319664', 'path': '2802007/2020-06-27/974c6bdd22ad8d61f52dd59909a7dc692146eef7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PfSNGJ7HOQtY521bNPMs2HZbo-miYSjp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:30.595673Z', 'territory_id': '2802007'} 2023-11-28 02:17:50 [scrapy.extensions.logstats] INFO: Crawled 272 pages (at 22 pages/min), scraped 270 items (at 22 items/min) 2023-11-28 02:17:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-28', 'edition_number': '278', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JdAlmhvtub7nU5PAoGaD-CtP_d4ZEe7q'], 'files': [{'checksum': '6d6dbfda19c9b946e11616091b82d940', 'path': '2802007/2020-06-28/a1f82da3af646f0303ce4ee9e371cc5343a344d2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JdAlmhvtub7nU5PAoGaD-CtP_d4ZEe7q'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:34.052475Z', 'territory_id': '2802007'} 2023-11-28 02:17:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-26', 'edition_number': '276', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tb9ClEpkq1OFf1rCZw9qRsnQUFVsbXF-'], 'files': [{'checksum': '1c249761fbfd0f40a7fdd29c87757abe', 'path': '2802007/2020-06-26/de0d2798bda1af961623b16ae50feb0830ea62e7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tb9ClEpkq1OFf1rCZw9qRsnQUFVsbXF-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:20.252454Z', 'territory_id': '2802007'} 2023-11-28 02:17:55 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:17:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:17:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:17:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-29', 'edition_number': '279', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hbV8EnvQmsyN0pXU6igkxB7tGzjXyS58'], 'files': [{'checksum': '283313aa1778a21244c7c5d22e797818', 'path': '2802007/2020-06-29/5edabd02209819a8396ab59bfd84493043001901', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hbV8EnvQmsyN0pXU6igkxB7tGzjXyS58'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:39.696993Z', 'territory_id': '2802007'} 2023-11-28 02:18:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-30', 'edition_number': '281', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rWX3mVdj42YotkB7H02XST48n5tWX2z8'], 'files': [{'checksum': '832d01f835f1d5656257ec2372a21c5f', 'path': '2802007/2020-06-30/35fc21bfaced3780c7e153054e3e269d6820f214', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rWX3mVdj42YotkB7H02XST48n5tWX2z8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:45.456396Z', 'territory_id': '2802007'} 2023-11-28 02:18:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:18:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-02', 'edition_number': '283', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HmZxZOdsszaoyRndU3dXJPWI46KNRapM'], 'files': [{'checksum': 'e5f21a0f6426c1f3b33e2d592c977372', 'path': '2802007/2020-07-02/e469d6926e45c8c4603c30fbc67d1655892787dc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HmZxZOdsszaoyRndU3dXJPWI46KNRapM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:04.832068Z', 'territory_id': '2802007'} 2023-11-28 02:18:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-05', 'edition_number': '285', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GRQYrZpGCUhslXMKjMd5Nn75JuDDb-cb'], 'files': [{'checksum': 'ed5eb769f28fdc6a7a1c4a993377d7b9', 'path': '2802007/2020-07-05/5f2b1f0887f1479e492ae5b17def789d564c9edd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GRQYrZpGCUhslXMKjMd5Nn75JuDDb-cb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:09.784893Z', 'territory_id': '2802007'} 2023-11-28 02:18:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-03', 'edition_number': '284', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mELKSNF4YRFEhkpSBD_1et1sNAzaIvr3'], 'files': [{'checksum': '628ce0c4016719aaf43fe753aa0629cd', 'path': '2802007/2020-07-03/f5206c428902d93b9af967ecbf265cf651a06867', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mELKSNF4YRFEhkpSBD_1et1sNAzaIvr3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:06.543495Z', 'territory_id': '2802007'} 2023-11-28 02:18:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-29', 'edition_number': '280', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QxcZZP-gjBwAXiWrW65z-5qoN-A1WnRt'], 'files': [{'checksum': '078c6d5ca47761fa3c1ab10111835dee', 'path': '2802007/2020-06-29/214038b7e069c66acd6a97f94041ce3323e2ba25', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QxcZZP-gjBwAXiWrW65z-5qoN-A1WnRt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:43.138412Z', 'territory_id': '2802007'} 2023-11-28 02:18:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-07', 'edition_number': '287', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19nJ6ZUqOKMFZqNg8w7H-BsC_UYcmk4n9'], 'files': [{'checksum': '5e48b7ca2d00296a7a76c290b2b3456c', 'path': '2802007/2020-07-07/c617e2414cae207c8fbebae1d2f242e408261ec7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19nJ6ZUqOKMFZqNg8w7H-BsC_UYcmk4n9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:16.978120Z', 'territory_id': '2802007'} 2023-11-28 02:18:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-09', 'edition_number': '289', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YjbTU0mR4lzyeg0FVshzuSzl9-YnOJN-'], 'files': [{'checksum': '289915412475b771dd88209ef52dfab4', 'path': '2802007/2020-07-09/9220c7d5a28ec5bd4ae5c7db496046e38ea83da3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YjbTU0mR4lzyeg0FVshzuSzl9-YnOJN-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:24.530247Z', 'territory_id': '2802007'} 2023-11-28 02:18:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-08', 'edition_number': '288', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vG15G78qUPv2-gufIG6br5Q3QfvhThEh'], 'files': [{'checksum': 'c49fb62daea6006d344a082605207db6', 'path': '2802007/2020-07-08/7a8d51b73e1dd18e78ec7164d0cedb042a70f84a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vG15G78qUPv2-gufIG6br5Q3QfvhThEh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:21.951242Z', 'territory_id': '2802007'} 2023-11-28 02:18:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-01', 'edition_number': '282', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1plLAuOOWFSwWBHjyND2e0elCVCzb98Kb'], 'files': [{'checksum': 'dbb3b691b3e7904be537640e615e66ed', 'path': '2802007/2020-07-01/fce424d554209507740fded46cfbefb26e7af917', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1plLAuOOWFSwWBHjyND2e0elCVCzb98Kb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:50.320305Z', 'territory_id': '2802007'} 2023-11-28 02:18:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-06', 'edition_number': '286', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fwEy_UcNVL7XBsWZ_8t67vUMbXINNCsf'], 'files': [{'checksum': '7765ad8be6006102c9bc6516a1b0d5a7', 'path': '2802007/2020-07-06/d5c2890d98188591551f6669d9e2403fcac2974f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fwEy_UcNVL7XBsWZ_8t67vUMbXINNCsf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:13.385360Z', 'territory_id': '2802007'} 2023-11-28 02:18:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-16', 'edition_number': '293', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ua3bPQRQEPc1gWP_ST0wVeHTFPB0z8xK'], 'files': [{'checksum': 'a8417c225cf81294a68427f6c34e12cc', 'path': '2802007/2020-07-16/6d34caf79f9078adbb10d72a049891e485197b5c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ua3bPQRQEPc1gWP_ST0wVeHTFPB0z8xK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:38.764610Z', 'territory_id': '2802007'} 2023-11-28 02:18:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-17', 'edition_number': '294', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B9JMpxkeG2Ev0wrdcbpCqXnGs7WFHSLf'], 'files': [{'checksum': 'c6b956681f19c83ea65b3c6a2ad6868d', 'path': '2802007/2020-07-17/442158b5e7c63b9fc2664dbefaf585dd3a927698', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B9JMpxkeG2Ev0wrdcbpCqXnGs7WFHSLf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:40.511979Z', 'territory_id': '2802007'} 2023-11-28 02:18:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-15', 'edition_number': '292', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CLW9_rEeA5S6EGSZxq8jnaLFZU_QM0jF'], 'files': [{'checksum': '9f48776a5be5831f49fbd4484de206f2', 'path': '2802007/2020-07-15/f7f29973af57383f4e64e01129e5b5b36b229316', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CLW9_rEeA5S6EGSZxq8jnaLFZU_QM0jF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:35.104448Z', 'territory_id': '2802007'} 2023-11-28 02:18:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-21', 'edition_number': '296', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xpAGNSxOusGi0S6Azr4MUhhDbvEUrs8c'], 'files': [{'checksum': 'cfd9430af2e9f4ea2c55aafd7813d286', 'path': '2802007/2020-07-21/ce0af21481d18f01b84555343a4e978189e48b6f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xpAGNSxOusGi0S6Azr4MUhhDbvEUrs8c'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:47.444913Z', 'territory_id': '2802007'} 2023-11-28 02:18:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-20', 'edition_number': '295', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jqd5yLOvGrphUf6IZO26r81c9aY6XMqB'], 'files': [{'checksum': 'c776770c58673d86c05f23a5c1e2b6e1', 'path': '2802007/2020-07-20/dce4f3e71b3b851cffa05a5d3ddd784864528fa7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jqd5yLOvGrphUf6IZO26r81c9aY6XMqB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:42.659829Z', 'territory_id': '2802007'} 2023-11-28 02:18:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-13', 'edition_number': '291', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11d-67Bp_9a_W_CkkUTzlR8Dn_ApGKxFa'], 'files': [{'checksum': '7fa69843a2f657cb9490d07990075b65', 'path': '2802007/2020-07-13/7c90838bba40d2b768b1efe73f76b966697dff09', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11d-67Bp_9a_W_CkkUTzlR8Dn_ApGKxFa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:32.837836Z', 'territory_id': '2802007'} 2023-11-28 02:18:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-12', 'edition_number': '290', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Jd2aiHYlOHabR48z1JxMUhewoP1REeKz'], 'files': [{'checksum': '3ec1c609ce4ccd8ee13a88a84d26a1f4', 'path': '2802007/2020-07-12/157ae9103ce09857dd65ca6a948f103995a3fbf4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Jd2aiHYlOHabR48z1JxMUhewoP1REeKz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:28.683651Z', 'territory_id': '2802007'} 2023-11-28 02:18:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:50 [scrapy.extensions.logstats] INFO: Crawled 293 pages (at 21 pages/min), scraped 290 items (at 20 items/min) 2023-11-28 02:18:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-25', 'edition_number': '300', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12QUphyqth_MYEaLYUPfW4TYL9rrP85aT'], 'files': [{'checksum': '37719569397d211a97a3c6d4aae7adfe', 'path': '2802007/2020-07-25/3369b63311af196bafe1d497acf3a6270836e1c9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12QUphyqth_MYEaLYUPfW4TYL9rrP85aT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:00.742232Z', 'territory_id': '2802007'} 2023-11-28 02:18:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-24', 'edition_number': '299', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_czAWm2oaSI08QDbSiaxPf2Ss90GlbOK'], 'files': [{'checksum': 'ac063c755c67ef0cb3808c016aec06c8', 'path': '2802007/2020-07-24/2b454fc4bab48e2e24b04929286316473accac36', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_czAWm2oaSI08QDbSiaxPf2Ss90GlbOK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:55.026263Z', 'territory_id': '2802007'} 2023-11-28 02:18:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:18:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-27', 'edition_number': '302', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PD5JIPquxy_IYKTCxZJbx9Vz41KVAU0w'], 'files': [{'checksum': '11bca843aad3d1167e62cd0df27ad03a', 'path': '2802007/2020-07-27/81eb8eefb2c73372c37ca939606d22e24f8ea837', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PD5JIPquxy_IYKTCxZJbx9Vz41KVAU0w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:05.443111Z', 'territory_id': '2802007'} 2023-11-28 02:19:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:19:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-28', 'edition_number': '303', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EImxjSv6TFVNl6fQzg8W1j_Od1B0xRBK'], 'files': [{'checksum': 'ebbbed9f5b72aad5e48447b1ac94519f', 'path': '2802007/2020-07-28/d8799e15270cb2b28bb22dadf4605ffdafafc28d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EImxjSv6TFVNl6fQzg8W1j_Od1B0xRBK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:09.975158Z', 'territory_id': '2802007'} 2023-11-28 02:19:46 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (55810836) larger than download warn size (33554432) in request . 2023-11-28 02:19:50 [scrapy.extensions.logstats] INFO: Crawled 296 pages (at 3 pages/min), scraped 294 items (at 4 items/min) 2023-11-28 02:19:51 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:19:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:19:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:19:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-29', 'edition_number': '304', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fCghMPvTuuGUglK1N3gFj-dElBfIygXs'], 'files': [{'checksum': '03f4a6a6132415d3bd60f812b6a933f3', 'path': '2802007/2020-07-29/5f6c66700cb146ad3d89a2d431005f420ec2cab1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fCghMPvTuuGUglK1N3gFj-dElBfIygXs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:12.154489Z', 'territory_id': '2802007'} 2023-11-28 02:19:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:19:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-29', 'edition_number': '305', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WEinmfg1BEU4AI4YVoa9YY_Swqx_jAeA'], 'files': [{'checksum': '2505153a44b3a7591b686a6da79e0f55', 'path': '2802007/2020-07-29/5fdaa2e3e89364f4a0d1816ae245074f739f24fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WEinmfg1BEU4AI4YVoa9YY_Swqx_jAeA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:15.744921Z', 'territory_id': '2802007'} 2023-11-28 02:19:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:19:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:19:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-30', 'edition_number': '306', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12J8Y-wjyWE-f45Iold5zh86A8jX3eUKx'], 'files': [{'checksum': '1290bb1fffa9d8b6824ef2d9d770107d', 'path': '2802007/2020-07-30/2af877733e033823759e040718e8a542162d5614', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12J8Y-wjyWE-f45Iold5zh86A8jX3eUKx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:17.473734Z', 'territory_id': '2802007'} 2023-11-28 02:20:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-02', 'edition_number': '308', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PfBSiz4MQoiu2zI8VvZCARxNqf2nGV1R'], 'files': [{'checksum': '2387a2aaf70f338a395850cad4232168', 'path': '2802007/2020-08-02/cc196608ce94689bf5a1e9f3cfa1b604fc5d7efb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PfBSiz4MQoiu2zI8VvZCARxNqf2nGV1R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:23.379381Z', 'territory_id': '2802007'} 2023-11-28 02:20:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-03', 'edition_number': '309', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vqP1qiKjfz-0fYz1QmMB_C5HNrpC8MC5'], 'files': [{'checksum': '5cab0d43c29f700a3d59ae0707b7f17e', 'path': '2802007/2020-08-03/e6d8cf0fa4c6bc111cfc174e7b570ab9f5e45092', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vqP1qiKjfz-0fYz1QmMB_C5HNrpC8MC5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:26.321792Z', 'territory_id': '2802007'} 2023-11-28 02:20:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-31', 'edition_number': '307', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OGasr3X2OfV9vQu8fapIal47WNcWZ8Lb'], 'files': [{'checksum': 'da804a292724450f207fcf2b43dbc546', 'path': '2802007/2020-07-31/30ecd8ffc2b5406ba547ad428775c75435136c39', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OGasr3X2OfV9vQu8fapIal47WNcWZ8Lb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:20.793764Z', 'territory_id': '2802007'} 2023-11-28 02:20:11 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:20:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-05', 'edition_number': '311', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yAZR4ucHrlR-qy2AkBmHJn-Gv9oUsVr6'], 'files': [{'checksum': '1b8c97eeced17bade06519a01c1d205d', 'path': '2802007/2020-08-05/0e8607b6a7ebe2eda3231b2e69f74c3ae8712e60', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yAZR4ucHrlR-qy2AkBmHJn-Gv9oUsVr6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:31.719336Z', 'territory_id': '2802007'} 2023-11-28 02:20:14 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:20:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-06', 'edition_number': '313', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HLb8zjLn4gaSThCKeh3_f_bnJShXiTum'], 'files': [{'checksum': 'b36dd4edcbe0d24c1210b74b3423658c', 'path': '2802007/2020-08-06/7f7ca0661c6e82284c390f3fdcc6904503eaf8e6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HLb8zjLn4gaSThCKeh3_f_bnJShXiTum'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:38.656496Z', 'territory_id': '2802007'} 2023-11-28 02:20:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-26', 'edition_number': '301', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1x0nXkzcdp_7NsrDm_iteJnt-uhL7g18J'], 'files': [{'checksum': '17615291392d7b26b45c740288db2384', 'path': '2802007/2020-07-26/6dea83ac7197c9f6a8227ad9847ec40f337febea', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1x0nXkzcdp_7NsrDm_iteJnt-uhL7g18J'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:03.122180Z', 'territory_id': '2802007'} 2023-11-28 02:20:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-05', 'edition_number': '312', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=183Xs0zCqOCA62Wc9iHDLae42FBPMHR8q'], 'files': [{'checksum': '176b2713d4bd0f207cf220a399cae6d7', 'path': '2802007/2020-08-05/994c0ae59628a4f2821572de29f24c246c6f5e71', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=183Xs0zCqOCA62Wc9iHDLae42FBPMHR8q'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:33.729488Z', 'territory_id': '2802007'} 2023-11-28 02:20:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-23', 'edition_number': '298', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u8axnx3H-CxPT_OgaMWYPFlfxNgswqua'], 'files': [{'checksum': '41e368e802c0e1564a4c56a47f929d0a', 'path': '2802007/2020-07-23/d1e879bf3b8a8af45ff301a95b9f20f00ef87854', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u8axnx3H-CxPT_OgaMWYPFlfxNgswqua'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:53.188023Z', 'territory_id': '2802007'} 2023-11-28 02:20:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-10', 'edition_number': '316', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-rhSfpD3oIkvew0hvnC2g8d-mVOFJPlC'], 'files': [{'checksum': '842da78b3a89ac53cdeba85b66082848', 'path': '2802007/2020-08-10/973c2fdbe36d5193c43cf2f6a07d4b152fa5cec2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-rhSfpD3oIkvew0hvnC2g8d-mVOFJPlC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:48.068439Z', 'territory_id': '2802007'} 2023-11-28 02:20:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-11', 'edition_number': '317', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AII9hci2bhtbPJQ-sNIeJAt5ZskNdEiG'], 'files': [{'checksum': '9945ebe80ea119d35edf7bf3fcb6fc53', 'path': '2802007/2020-08-11/2a14c1b586ded1902848c8aee46aa9fa172661c3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AII9hci2bhtbPJQ-sNIeJAt5ZskNdEiG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:51.202777Z', 'territory_id': '2802007'} 2023-11-28 02:20:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-12', 'edition_number': '318', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ob9W-K3g8QU7JLs6IynwKSnDnfQkGB6W'], 'files': [{'checksum': 'b976edf6d182206664753ed631d270a5', 'path': '2802007/2020-08-12/00138d837f1955ba89473adbf742e39b21096144', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ob9W-K3g8QU7JLs6IynwKSnDnfQkGB6W'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:54.930493Z', 'territory_id': '2802007'} 2023-11-28 02:20:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-13', 'edition_number': '319', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eVbM5EuM57q-TTEoBIADv86x9OKQgVr4'], 'files': [{'checksum': '934187b89697174cef7171f0ca1e461b', 'path': '2802007/2020-08-13/776a87ec872374b41b4994d48c08bc7ac05c38ca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eVbM5EuM57q-TTEoBIADv86x9OKQgVr4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:58.425398Z', 'territory_id': '2802007'} 2023-11-28 02:20:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-16', 'edition_number': '321', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1am-6JrlYjI24veOc3JEfiT2RCYBr874j'], 'files': [{'checksum': 'd6a3bffc7b37d8186a0750c055551311', 'path': '2802007/2020-08-16/81d42fe6a19f50f5815268b724536f1f19775fe6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1am-6JrlYjI24veOc3JEfiT2RCYBr874j'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:05.123794Z', 'territory_id': '2802007'} 2023-11-28 02:20:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-14', 'edition_number': '320', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19X7Sm_nf4nbexcPU825JkVc6RA6a6waX'], 'files': [{'checksum': '7f8c4baa7ba534bfe9b1eaefe189e2ab', 'path': '2802007/2020-08-14/a6e852a60fcd8738bc11a42335c0296b08a68f1f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19X7Sm_nf4nbexcPU825JkVc6RA6a6waX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:02.854369Z', 'territory_id': '2802007'} 2023-11-28 02:20:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2019-12-05', 'edition_number': '166', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B1y3vidl2urpqfnYfvQgS1h1tjFOxJpS'], 'files': [{'checksum': 'd6898b11409d56c4bf4d9109d905e9cc', 'path': '2802007/2019-12-05/9f56b139c146749d993ea13925f8b5442cb604ab', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B1y3vidl2urpqfnYfvQgS1h1tjFOxJpS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:02:36.502745Z', 'territory_id': '2802007'} 2023-11-28 02:20:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-07', 'edition_number': '315', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a6ZRF0D99TnhkwUcsMIT8c1EidquYUSE'], 'files': [{'checksum': 'ece98156e74df4c3a5a03fe8df2c7d16', 'path': '2802007/2020-08-07/0a7595ee90e00095683a54ad6d2a681057cc2cdc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a6ZRF0D99TnhkwUcsMIT8c1EidquYUSE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:44.402808Z', 'territory_id': '2802007'} 2023-11-28 02:20:50 [scrapy.extensions.logstats] INFO: Crawled 315 pages (at 19 pages/min), scraped 313 items (at 19 items/min) 2023-11-28 02:20:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-07', 'edition_number': '314', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17SxNil-d0q4zLUolJcMCFmSuBS-1bFbE'], 'files': [{'checksum': '8c95018fa30919abb32d82e5ad0a9dbd', 'path': '2802007/2020-08-07/1ccc02b5b71ea2becebc2b62eed355052ee4b04b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17SxNil-d0q4zLUolJcMCFmSuBS-1bFbE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:42.266896Z', 'territory_id': '2802007'} 2023-11-28 02:20:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-04', 'edition_number': '310', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Im0axXTfmWvQSBySJgsue95p0x6hL5_-'], 'files': [{'checksum': '8bd80308d040382e45a50421c89c5717', 'path': '2802007/2020-08-04/cdc9b973eae476b4450530fab0997a5a55160351', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Im0axXTfmWvQSBySJgsue95p0x6hL5_-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:14:28.549880Z', 'territory_id': '2802007'} 2023-11-28 02:20:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-21', 'edition_number': '326', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gUIKcNeldntp9029FO44eskeOofB5Bmc'], 'files': [{'checksum': 'c6836fb62cb3610235dfcfa315a64153', 'path': '2802007/2020-08-21/36416f7bd04c0fb8ae132b153b54863bb6ae5096', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gUIKcNeldntp9029FO44eskeOofB5Bmc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:20.217048Z', 'territory_id': '2802007'} 2023-11-28 02:20:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:20:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-24', 'edition_number': '327', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14DPPv3bE39ady6SXUxL1l6PqkHX4GsRq'], 'files': [{'checksum': 'ee3c8a4eca1a7b05bd9b13b3f9772a73', 'path': '2802007/2020-08-24/ff96b7f9cf156e8d12a7e9d62a794eec79fc27e9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14DPPv3bE39ady6SXUxL1l6PqkHX4GsRq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:31.158847Z', 'territory_id': '2802007'} 2023-11-28 02:21:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-25', 'edition_number': '328', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_QNLUOxM6Il23ZmMCDWbHAzrb7Aihx-f'], 'files': [{'checksum': 'e84782de5a8a9c90de32f7f7df75e860', 'path': '2802007/2020-08-25/183bef6c52cbccc8a02badc893f648fae559e8af', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_QNLUOxM6Il23ZmMCDWbHAzrb7Aihx-f'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:33.218759Z', 'territory_id': '2802007'} 2023-11-28 02:21:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-18', 'edition_number': '324', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QAJ_mPtFrGSDR2Lp6PNtotpDDn_8Nn7y'], 'files': [{'checksum': 'b4bf4216ffb7f31a46bf35bbdc3de1ef', 'path': '2802007/2020-08-18/836ded841d676865d91f7050717da5fb1e3d1f5e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QAJ_mPtFrGSDR2Lp6PNtotpDDn_8Nn7y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:13.931354Z', 'territory_id': '2802007'} 2023-11-28 02:21:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-18', 'edition_number': '323', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18x9aR22kYP1zaJ1dCOn9KB2L2t7D8W8e'], 'files': [{'checksum': '5942fca5c1cfb9b0a8253aa305986469', 'path': '2802007/2020-08-18/70ef7c76308ea8e4ff5fb16e548af5187478e269', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18x9aR22kYP1zaJ1dCOn9KB2L2t7D8W8e'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:10.283142Z', 'territory_id': '2802007'} 2023-11-28 02:21:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-17', 'edition_number': '322', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ic2FoctrwODRJIMenzRp0LF1iUUYtOSs'], 'files': [{'checksum': '2cd8ddd5840ce543245c41cd4a973d66', 'path': '2802007/2020-08-17/0cf017b7e72ad8430e3794f26edcbc880cb5e895', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ic2FoctrwODRJIMenzRp0LF1iUUYtOSs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:07.906905Z', 'territory_id': '2802007'} 2023-11-28 02:21:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-07-22', 'edition_number': '297', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GLt8hRLQYpQ8qhqsnfylrrr7H6twDb2n'], 'files': [{'checksum': '6bbcaa75e019ab441d363f290cd85bab', 'path': '2802007/2020-07-22/5c7bdfbed20236007e0ed5f644dfd3b37ba99900', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GLt8hRLQYpQ8qhqsnfylrrr7H6twDb2n'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:13:48.828100Z', 'territory_id': '2802007'} 2023-11-28 02:21:18 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:21:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-27', 'edition_number': '330', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1E0t8vEDW47qvebalk9eHcNW2cW1OHaXE'], 'files': [{'checksum': '8053016e6dcd71d4290beb39ffd9020b', 'path': '2802007/2020-08-27/10081d62d06980abc86a6edba9fe6718cfc39707', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1E0t8vEDW47qvebalk9eHcNW2cW1OHaXE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:38.909702Z', 'territory_id': '2802007'} 2023-11-28 02:21:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-03', 'edition_number': '334', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12kID3XslxSTNNbQe2nlhP2yHkk0bi2lo'], 'files': [{'checksum': '5d23c270ae47965f8db29e8c4cc37d77', 'path': '2802007/2020-09-03/70133cb2fcc13d3199e976afecb8473b794c5dca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12kID3XslxSTNNbQe2nlhP2yHkk0bi2lo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:50.428264Z', 'territory_id': '2802007'} 2023-11-28 02:21:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-01', 'edition_number': '332', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PdCd2i-DVxZ2RulyClCvS-PamdtBUtD1'], 'files': [{'checksum': '211e51d4cef20a77de45ddbd2dd1f436', 'path': '2802007/2020-09-01/92c01e577eb0881b70ef0cf8d614967becefe7e2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PdCd2i-DVxZ2RulyClCvS-PamdtBUtD1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:43.447437Z', 'territory_id': '2802007'} 2023-11-28 02:21:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-02', 'edition_number': '333', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DGnI1KYoXwnl0QSwayvZkXEp9W6SKjdK'], 'files': [{'checksum': '00ae32be0af80dc4d839b275e11d5622', 'path': '2802007/2020-09-02/ce109744ef9453539a9c181da7f1f62f154594ca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DGnI1KYoXwnl0QSwayvZkXEp9W6SKjdK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:46.354450Z', 'territory_id': '2802007'} 2023-11-28 02:21:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-10', 'edition_number': '338', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UcZQ_G5B08eTo0P9p11LX0PdkSkMDPZS'], 'files': [{'checksum': '696e48d6402a3f25dc09e982d2723381', 'path': '2802007/2020-09-10/d107f1c1ed8f465561e7189aadb5e7c60bbc399a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UcZQ_G5B08eTo0P9p11LX0PdkSkMDPZS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:08.823891Z', 'territory_id': '2802007'} 2023-11-28 02:21:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-09', 'edition_number': '337', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1D2IhHWabUc6NGT1InT5Qyg2VdDI1SZu_'], 'files': [{'checksum': '54f48fd07f7e2cac6d3b0b511029a1bb', 'path': '2802007/2020-09-09/751e5c4c987bfa249c7f4b774c50a8b1813a8f60', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1D2IhHWabUc6NGT1InT5Qyg2VdDI1SZu_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:03.957025Z', 'territory_id': '2802007'} 2023-11-28 02:21:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-14', 'edition_number': '339', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QqlVUEae7GVkKeE1ph9cjkHtBVQQ7vmE'], 'files': [{'checksum': 'd7dbace797d530a0b121a74397d40cf6', 'path': '2802007/2020-09-14/1874096944f256314d31e37ad5f29c9600d5f242', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QqlVUEae7GVkKeE1ph9cjkHtBVQQ7vmE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:12.131914Z', 'territory_id': '2802007'} 2023-11-28 02:21:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-17', 'edition_number': '342', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pa-glVt7PrAgmV-R85OnbkCwlU9LvR0X'], 'files': [{'checksum': 'f7b8388f3e3fce5f6db46ab03f4745b0', 'path': '2802007/2020-09-17/2afcf6ba8a35fd1267e8b30f5cd05849bd955f94', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pa-glVt7PrAgmV-R85OnbkCwlU9LvR0X'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:21.415571Z', 'territory_id': '2802007'} 2023-11-28 02:21:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-08', 'edition_number': '336', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RQ0jIWGJ01ycmT7ccKK65t0CCeUiEQN9'], 'files': [{'checksum': '135d0a5e61cb5722b23f19618d9b2d52', 'path': '2802007/2020-09-08/204bd336225631db480758c96773f05565bc2a24', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RQ0jIWGJ01ycmT7ccKK65t0CCeUiEQN9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:58.214402Z', 'territory_id': '2802007'} 2023-11-28 02:21:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-23', 'edition_number': '343', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zPMRciiY4puVtJY5SzEYN-qFS_ZXcRCQ'], 'files': [{'checksum': 'a2d93598abc1758bfa0b9a421a7e1017', 'path': '2802007/2020-09-23/6403c5a076ba32f660ebdfdb62165ccfcf26c728', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zPMRciiY4puVtJY5SzEYN-qFS_ZXcRCQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:24.444730Z', 'territory_id': '2802007'} 2023-11-28 02:21:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-25', 'edition_number': '345', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OBa6LdlShG0DqsQeievqgNah75MmCeyM'], 'files': [{'checksum': 'fe0279d9434566ceb6b537316bc4ab86', 'path': '2802007/2020-09-25/145b03d55f956a701c8c2630f2cb0b835a98e835', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OBa6LdlShG0DqsQeievqgNah75MmCeyM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:30.500477Z', 'territory_id': '2802007'} 2023-11-28 02:21:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:50 [scrapy.extensions.logstats] INFO: Crawled 336 pages (at 21 pages/min), scraped 333 items (at 20 items/min) 2023-11-28 02:21:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-16', 'edition_number': '341', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ASpBc3MeEdEIA9Y7JqDWRJivmUgv4xgE'], 'files': [{'checksum': '01ca8fe45bf2888e912432f0668b9622', 'path': '2802007/2020-09-16/f6d981f6cf09e348a0f3241b974c0ba24379dd95', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ASpBc3MeEdEIA9Y7JqDWRJivmUgv4xgE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:17.003159Z', 'territory_id': '2802007'} 2023-11-28 02:21:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:21:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:21:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-26', 'edition_number': '346', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13ZH4rsWKPFQdDk18LNrcivDgCyoxsiwA'], 'files': [{'checksum': '8e5793ceb3dd5dc9d222fb1156797f61', 'path': '2802007/2020-09-26/af8594e31430cbf509da511b15072d042aa61d8a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13ZH4rsWKPFQdDk18LNrcivDgCyoxsiwA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:34.086179Z', 'territory_id': '2802007'} 2023-11-28 02:22:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-28', 'edition_number': '348', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1c34ddK1I7kdtdarp8PWym2coRktGZaYJ'], 'files': [{'checksum': '05cc870068cf13e5e80c21c5bf9d69af', 'path': '2802007/2020-09-28/480ab1308fc1329292e3ed38d080f5816e0c96df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1c34ddK1I7kdtdarp8PWym2coRktGZaYJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:39.484120Z', 'territory_id': '2802007'} 2023-11-28 02:22:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-27', 'edition_number': '347', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=171F0OtJ7-XNQSJo1-nZcvvH99_uzsLdP'], 'files': [{'checksum': 'c610aa3e867eec8b5e997aacfd1716a8', 'path': '2802007/2020-09-27/0af1fd9b076404639c3e67f661063fddc07a230e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=171F0OtJ7-XNQSJo1-nZcvvH99_uzsLdP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:37.244461Z', 'territory_id': '2802007'} 2023-11-28 02:22:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-30', 'edition_number': '349', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oq7sSUIct6diR3S5QFC88irIms8pJLdI'], 'files': [{'checksum': '3fabda1cd58b215173f869fbb064bf11', 'path': '2802007/2020-09-30/527b5d6496dd604649a277b4df1026ba8fd28432', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oq7sSUIct6diR3S5QFC88irIms8pJLdI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:52.440735Z', 'territory_id': '2802007'} 2023-11-28 02:22:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-01', 'edition_number': '350', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lwQb1xBEjKpxmd7CHWYXpWq1wI2iwbDI'], 'files': [{'checksum': 'c8a00c759c2680c48a9feb281f6f8f4a', 'path': '2802007/2020-10-01/5de80d30b42f1baaf79e9c086ba9f51b6512e2c8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lwQb1xBEjKpxmd7CHWYXpWq1wI2iwbDI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:54.323385Z', 'territory_id': '2802007'} 2023-11-28 02:22:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-24', 'edition_number': '344', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10sFrU58Llp-6vtx1pcfLWfo7w4AOAoBE'], 'files': [{'checksum': 'd01cd5b80e48f3c865b48f04ff635188', 'path': '2802007/2020-09-24/9b579fbecb535c480eb2c455b7dd1e6c1bd4d7f5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10sFrU58Llp-6vtx1pcfLWfo7w4AOAoBE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:28.501599Z', 'territory_id': '2802007'} 2023-11-28 02:22:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-02', 'edition_number': '351', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GAS0yGf4ayQGm8QguE8klgSfYByVRGyP'], 'files': [{'checksum': '13ec0c2851ea33f7aa77661178dcb7f2', 'path': '2802007/2020-10-02/16df81ac2d276b360437f1ec3110186d657dbe3a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GAS0yGf4ayQGm8QguE8klgSfYByVRGyP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:56.174185Z', 'territory_id': '2802007'} 2023-11-28 02:22:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-04', 'edition_number': '353', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KJbz4X1eKk5galmC2IQ9u5pxvlEiJbgu'], 'files': [{'checksum': 'aa8f4410d57559daa195fa40e3b18bfe', 'path': '2802007/2020-10-04/8ad71301f000888152ac572205b8e57f7c77c9c8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KJbz4X1eKk5galmC2IQ9u5pxvlEiJbgu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:00.067417Z', 'territory_id': '2802007'} 2023-11-28 02:22:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-03', 'edition_number': '352', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ybp111u-MENxzxBDJQIRmBBMTbPWspOj'], 'files': [{'checksum': 'cee5d76aaccc6a6b59d228ebc7321ae6', 'path': '2802007/2020-10-03/60567800fd72980d78a460a908cf330647e75e4e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ybp111u-MENxzxBDJQIRmBBMTbPWspOj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:57.963314Z', 'territory_id': '2802007'} 2023-11-28 02:22:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-06', 'edition_number': '354', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OIjJFNe96lcb054SxiLyC9hfng8TgSRW'], 'files': [{'checksum': '7220ed7472770019db9226d7dae7079f', 'path': '2802007/2020-10-06/207fa4764653871a6f62ceaef5e2b3abde85689b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OIjJFNe96lcb054SxiLyC9hfng8TgSRW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:02.322497Z', 'territory_id': '2802007'} 2023-11-28 02:22:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-07', 'edition_number': '356', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SeoJu52_KIQ22_Z7bLYm5Lpa8QOCjWxy'], 'files': [{'checksum': 'b9d41f9e91377cd7fcdd4203e62d2164', 'path': '2802007/2020-10-07/67ec2eb5b72a9d1ab5c44349d6b385cabedbd6fa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SeoJu52_KIQ22_Z7bLYm5Lpa8QOCjWxy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:09.222145Z', 'territory_id': '2802007'} 2023-11-28 02:22:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-08', 'edition_number': '358', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=176WM1ylN5-aG2izzdxJ24dInk1VnYWad'], 'files': [{'checksum': '32911d67cebd423a64f97c38c18872d1', 'path': '2802007/2020-10-08/301e8bcccd884b5c647e86e3acf9aaf8e30fe298', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=176WM1ylN5-aG2izzdxJ24dInk1VnYWad'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:14.349299Z', 'territory_id': '2802007'} 2023-11-28 02:22:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-07', 'edition_number': '357', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fTSXhY7DHuY3M40fWfw7OAPphHaEOYWP'], 'files': [{'checksum': '5231632afdc29c16a85adb0378feaade', 'path': '2802007/2020-10-07/ba6f2a34040baa8b6f3675bd507ae18cdeaa3c99', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fTSXhY7DHuY3M40fWfw7OAPphHaEOYWP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:12.432275Z', 'territory_id': '2802007'} 2023-11-28 02:22:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-10', 'edition_number': '360', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1I4kOS5q3qR-CR1sBGuHVYvC8OO6TRVKN'], 'files': [{'checksum': '97a005132e69d31501687e665f4676e5', 'path': '2802007/2020-10-10/5546411630ced3f609145a276a7dbd847f4d8d5e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1I4kOS5q3qR-CR1sBGuHVYvC8OO6TRVKN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:21.082147Z', 'territory_id': '2802007'} 2023-11-28 02:22:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-12', 'edition_number': '361', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VxYbFTNln7isYmIPM-b8Abyc20gQBDS6'], 'files': [{'checksum': 'f1e5f2f8004303fdf30e4089a3d3f8d9', 'path': '2802007/2020-10-12/ca6d0e8956971997a1f3c9fc077d0466355baf15', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VxYbFTNln7isYmIPM-b8Abyc20gQBDS6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:23.674593Z', 'territory_id': '2802007'} 2023-11-28 02:22:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-09', 'edition_number': '359', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B3-PXjqwShrqZpEQy9uGgh-QpUjhQZrK'], 'files': [{'checksum': 'a908c6f6b5d308a4347353ca33f46887', 'path': '2802007/2020-10-09/7e980f2f138fae6953848c7594f7a436af8a2f0e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B3-PXjqwShrqZpEQy9uGgh-QpUjhQZrK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:17.179241Z', 'territory_id': '2802007'} 2023-11-28 02:22:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-06', 'edition_number': '355', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VMzqeP75rCYc-iWxWC27_vfnuGd8bgk5'], 'files': [{'checksum': '37a80db161aa265e315577ffb2075d57', 'path': '2802007/2020-10-06/094e10283cb4a3b3d38c1691a3e1f5a2e52eb6f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VMzqeP75rCYc-iWxWC27_vfnuGd8bgk5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:05.570042Z', 'territory_id': '2802007'} 2023-11-28 02:22:50 [scrapy.extensions.logstats] INFO: Crawled 353 pages (at 17 pages/min), scraped 351 items (at 18 items/min) 2023-11-28 02:22:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-14', 'edition_number': '363', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tz7bI86JiVfQPNicChw3PzsTJ5o7OHl2'], 'files': [{'checksum': 'f17a32d8d1b9821e3d73a882e690307d', 'path': '2802007/2020-10-14/95a84bdb63260f826f443c27b389fafd8b5004ed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tz7bI86JiVfQPNicChw3PzsTJ5o7OHl2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:28.968785Z', 'territory_id': '2802007'} 2023-11-28 02:22:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-20', 'edition_number': '365', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yWmdbkdgaa292FA2UQ3S1yUbm_OTwFcc'], 'files': [{'checksum': '75e9c3218aa2e45024cbe5187d70853a', 'path': '2802007/2020-10-20/3670cbdf94861d4d26f95fabf95a939ffaf2188e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yWmdbkdgaa292FA2UQ3S1yUbm_OTwFcc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:34.115720Z', 'territory_id': '2802007'} 2023-11-28 02:22:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-15', 'edition_number': '340', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GYqyknWMWJDQLTDmQkHOzvAGo_elOiZh'], 'files': [{'checksum': '171dcb68f679f7709cc34ffd13022b06', 'path': '2802007/2020-09-15/221afb0e400f5cb446fede24683704ab42d4996e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GYqyknWMWJDQLTDmQkHOzvAGo_elOiZh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:16:14.044389Z', 'territory_id': '2802007'} 2023-11-28 02:22:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:22:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:22:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-21', 'edition_number': '367', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14yfG-VTaynUksL3_e54k3yvb5l_O1mwu'], 'files': [{'checksum': '08c201b7a79c2e6ee7fdb16b939dbd63', 'path': '2802007/2020-10-21/9b0f370d39c4b52241a23ba91caa3c911f48c506', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14yfG-VTaynUksL3_e54k3yvb5l_O1mwu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:40.296342Z', 'territory_id': '2802007'} 2023-11-28 02:23:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-20', 'edition_number': '366', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1koISHy3ADZjLekTd6ToTjMJcBq4-kRhR'], 'files': [{'checksum': '0e299ad4062555865adfb484e867f3af', 'path': '2802007/2020-10-20/779afa58949af51eca56b92be74dcaf865d8f11e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1koISHy3ADZjLekTd6ToTjMJcBq4-kRhR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:38.073409Z', 'territory_id': '2802007'} 2023-11-28 02:23:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-16', 'edition_number': '364', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZUgqtbFI39m5gDWuz2ABFGJ9ZQ7twaA6'], 'files': [{'checksum': '7f4cd5511c6146ddd555d89cce870f12', 'path': '2802007/2020-10-16/9cc9b8ea9f2ccdf2dfd2c7f99f78b1e87c61537a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZUgqtbFI39m5gDWuz2ABFGJ9ZQ7twaA6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:31.512163Z', 'territory_id': '2802007'} 2023-11-28 02:23:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-22', 'edition_number': '368', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pXL_lY-Ng0XJ6-5_Q5k2fDyE7aBZ61DG'], 'files': [{'checksum': '0dc23649383b6ec2cd56a76ac705420b', 'path': '2802007/2020-10-22/cf9fd66a310d7a04c9ee07cd9901aebc8a9ff893', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pXL_lY-Ng0XJ6-5_Q5k2fDyE7aBZ61DG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:42.138039Z', 'territory_id': '2802007'} 2023-11-28 02:23:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-22', 'edition_number': '369', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nZTB5iXSNBomq8l6mbfOlw5s3v7HEn52'], 'files': [{'checksum': '27fb6295fd0207aba203852253188dde', 'path': '2802007/2020-10-22/4b71107d619c2c9fdcf1fddc6e90e63130ecf04c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nZTB5iXSNBomq8l6mbfOlw5s3v7HEn52'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:46.267209Z', 'territory_id': '2802007'} 2023-11-28 02:23:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-27', 'edition_number': '371', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KxkdiIAurGgyqVtl8gkH-MM5gzAiKtOu'], 'files': [{'checksum': '1ec205b4071132c2aea6134ea6165554', 'path': '2802007/2020-10-27/c8327347aa199f28d3ba1c7e780324be9758826a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KxkdiIAurGgyqVtl8gkH-MM5gzAiKtOu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:50.767557Z', 'territory_id': '2802007'} 2023-11-28 02:23:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-27', 'edition_number': '372', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_pfDdeUzFdvyoOj8j5L-uni7ZiaudWP1'], 'files': [{'checksum': 'da49f3791c5bfb517e3889314a76e450', 'path': '2802007/2020-10-27/e33fab49c3919e8fb7f86c6e033c6f0de5cae4a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_pfDdeUzFdvyoOj8j5L-uni7ZiaudWP1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:52.980491Z', 'territory_id': '2802007'} 2023-11-28 02:23:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-12', 'edition_number': '215', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oMYTNpOTyO_yTBVd1fmdyHtSN4tG78BV'], 'files': [{'checksum': 'a8a5fb259b527bf6dd528ef8396808da', 'path': '2802007/2020-03-12/4153bf1892ce164bb0e9e8c9b348b47bee0e3456', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oMYTNpOTyO_yTBVd1fmdyHtSN4tG78BV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:12.122602Z', 'territory_id': '2802007'} 2023-11-28 02:23:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-28', 'edition_number': '373', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1san8wjeKS3lLW7I0lkywJK2kBNZRceAF'], 'files': [{'checksum': '32986a76ac6bea2b412257830bc58993', 'path': '2802007/2020-10-28/cb0518a0d2cdaf81e25753a02b1aa06fa6053466', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1san8wjeKS3lLW7I0lkywJK2kBNZRceAF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:56.670455Z', 'territory_id': '2802007'} 2023-11-28 02:23:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-29', 'edition_number': '374', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KPXSwf5g9IKgdUA8iKy-iN1iTPB7OoEJ'], 'files': [{'checksum': '1156026d41ed4569c52836614b0233c8', 'path': '2802007/2020-10-29/42718591f78a9df876ae7745e2956c7d066d1f53', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KPXSwf5g9IKgdUA8iKy-iN1iTPB7OoEJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:01.149341Z', 'territory_id': '2802007'} 2023-11-28 02:23:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-03-17', 'edition_number': '217', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GEexf6L0FVxRnXKqqse_8l8-N2r71GfO'], 'files': [{'checksum': '95e7421ce2591b109053501cc684d9a6', 'path': '2802007/2020-03-17/5ea577f6eb84e27017165ee55d11596e65f156e0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GEexf6L0FVxRnXKqqse_8l8-N2r71GfO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:07:19.727783Z', 'territory_id': '2802007'} 2023-11-28 02:23:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-23', 'edition_number': '370', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12trLOrSploIupHJF_dbVe9ef8cs24wMm'], 'files': [{'checksum': '25f83da71efd0bac4fa47261f23c4fd7', 'path': '2802007/2020-10-23/61f843023b4d151bd51d9ac35d5444d99c522622', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12trLOrSploIupHJF_dbVe9ef8cs24wMm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:48.392943Z', 'territory_id': '2802007'} 2023-11-28 02:23:50 [scrapy.extensions.logstats] INFO: Crawled 368 pages (at 15 pages/min), scraped 366 items (at 15 items/min) 2023-11-28 02:23:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-30', 'edition_number': '375', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uoRPkp7H83i7ocoUsw3ejbXol5ZW8A0O'], 'files': [{'checksum': '0a8580cf9c55a659c144e308d6991463', 'path': '2802007/2020-10-30/b04183394bd00ee40ccfa1f20d7d9c1a51eae9b1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uoRPkp7H83i7ocoUsw3ejbXol5ZW8A0O'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:04.431544Z', 'territory_id': '2802007'} 2023-11-28 02:23:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:23:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:23:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-03', 'edition_number': '376', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1n-8x9knNhZkErC7t0YviNVjcU8E5tYKc'], 'files': [{'checksum': '72d2f7ecafef7187d1fc5bf11ad34977', 'path': '2802007/2020-11-03/c27c5539047b9c01c442207f788566f2e9196eaf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1n-8x9knNhZkErC7t0YviNVjcU8E5tYKc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:06.941115Z', 'territory_id': '2802007'} 2023-11-28 02:24:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-09-03', 'edition_number': '335', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DKxdK3LvuDktqd00-bu5NNwQ8Y5xpdiU'], 'files': [{'checksum': '00901ac17972fb9be92b4270eec001a2', 'path': '2802007/2020-09-03/62efa9ca67d903e2a2a668ec193607b124c6fcfd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DKxdK3LvuDktqd00-bu5NNwQ8Y5xpdiU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:56.469053Z', 'territory_id': '2802007'} 2023-11-28 02:24:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-10-13', 'edition_number': '362', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gU4xOUrQ4L-8T3j703Rt0_iHJjS_6rB4'], 'files': [{'checksum': '57da26287acc15b15d5beeeab22607c3', 'path': '2802007/2020-10-13/dbeb2213ec02598a507088bb9d742b9861ba6470', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gU4xOUrQ4L-8T3j703Rt0_iHJjS_6rB4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:17:26.150783Z', 'territory_id': '2802007'} 2023-11-28 02:24:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-10', 'edition_number': '380', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yEJikLhD71Ywft5Brl2vQ5JlYM7EGuFl'], 'files': [{'checksum': '78ac7b3ee8f27653c2ad8de8ab4d8fb9', 'path': '2802007/2020-11-10/7bf2dc0f4f6293cf6d64e06b7a04950d199c8b1d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yEJikLhD71Ywft5Brl2vQ5JlYM7EGuFl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:17.920364Z', 'territory_id': '2802007'} 2023-11-28 02:24:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-06', 'edition_number': '379', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19cj7mEoLh_8AzwAOML4d1a3x78MN9_Bl'], 'files': [{'checksum': '853b426c6cff8a45addc483e84de4485', 'path': '2802007/2020-11-06/e5be81d505ef349dfb1717d4f00b259e1915777f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19cj7mEoLh_8AzwAOML4d1a3x78MN9_Bl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:14.600587Z', 'territory_id': '2802007'} 2023-11-28 02:24:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-31', 'edition_number': '331', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RLrsl_F-AbDCzlyzYsrScyNpMAQENYSs'], 'files': [{'checksum': '95b6e1ef5c3003f2e30ac579af46c2a6', 'path': '2802007/2020-08-31/6bd9f22a5330727c99487e371d15ba8b6b2b5268', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RLrsl_F-AbDCzlyzYsrScyNpMAQENYSs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:41.026892Z', 'territory_id': '2802007'} 2023-11-28 02:24:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-11', 'edition_number': '381', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bICu_KEekgRAtn6-JvCfmXX0CQO43EXb'], 'files': [{'checksum': 'b86e43bb0ae0cc54b39e5c0e77672eb9', 'path': '2802007/2020-11-11/dd9d19f7ef1c41fd11cb1cc66dcbfce196c93a2b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bICu_KEekgRAtn6-JvCfmXX0CQO43EXb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:22.205622Z', 'territory_id': '2802007'} 2023-11-28 02:24:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-12', 'edition_number': '382', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=186fsGPdYeR162lvpV8KYVUCd63vetCpT'], 'files': [{'checksum': 'db4ea368d1463bac8c9d37cf333a613e', 'path': '2802007/2020-11-12/744aaad5bdcb8f8827f3d88213fa85d46d71bc16', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=186fsGPdYeR162lvpV8KYVUCd63vetCpT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:25.163587Z', 'territory_id': '2802007'} 2023-11-28 02:24:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-23', 'edition_number': '385', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11XDAnRR7nUh61rQxb7UFHrSD4ZQsUJBr'], 'files': [{'checksum': 'bf5698a5235d660b3bb9620ca4a22f48', 'path': '2802007/2020-11-23/e86163fef71cdc00ba22ba40367b5012d73a2b36', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11XDAnRR7nUh61rQxb7UFHrSD4ZQsUJBr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:33.241548Z', 'territory_id': '2802007'} 2023-11-28 02:24:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-24', 'edition_number': '386', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16fhHlUEkckNtghgaRwHQ0mvb04GZV-hs'], 'files': [{'checksum': '4ff03c9901b99803855231207c0d4a19', 'path': '2802007/2020-11-24/eec5d02c0c846181216a618c280d9a66dc76ef7e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16fhHlUEkckNtghgaRwHQ0mvb04GZV-hs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:36.683670Z', 'territory_id': '2802007'} 2023-11-28 02:24:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-17', 'edition_number': '383', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DDqHwNyPRAALktyupCDdsZolxFGepDPq'], 'files': [{'checksum': '2d8af449c7c48eb0ffea9c9d5ed3e908', 'path': '2802007/2020-11-17/8ea3f6b59b790c9832a5a3543aed8c52559d4544', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DDqHwNyPRAALktyupCDdsZolxFGepDPq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:27.234553Z', 'territory_id': '2802007'} 2023-11-28 02:24:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-25', 'edition_number': '388', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1W4ug-28jcZmmRzK9b18skHSujFTvLdLD'], 'files': [{'checksum': '54202ba89392e875dfb2fba0d646ae6e', 'path': '2802007/2020-11-25/5d677826319b1af5b31da8f6b676bd9af148e9ce', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1W4ug-28jcZmmRzK9b18skHSujFTvLdLD'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:43.192693Z', 'territory_id': '2802007'} 2023-11-28 02:24:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-25', 'edition_number': '387', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TYH2kdbwBDwxjSGbcBa9JoPFQUNdU4-r'], 'files': [{'checksum': 'c844842ceae9bd857454dd732154a6fd', 'path': '2802007/2020-11-25/e577baa97f0e3e1a416f10794c764579c7d1229a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TYH2kdbwBDwxjSGbcBa9JoPFQUNdU4-r'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:40.782028Z', 'territory_id': '2802007'} 2023-11-28 02:24:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-19', 'edition_number': '384', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u49rsNxzyB9nb1SaBwvVecz9eZD5SW7K'], 'files': [{'checksum': '38a43e364f61d462ee1c56dc56fef0c9', 'path': '2802007/2020-11-19/c6023acb5fd847d1af3e5b35b7fec5419c19456c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u49rsNxzyB9nb1SaBwvVecz9eZD5SW7K'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:29.952656Z', 'territory_id': '2802007'} 2023-11-28 02:24:39 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:24:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-30', 'edition_number': '392', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DvNxOjuFs9Ib3Kgnyw3HsiWO00uYhh0U'], 'files': [{'checksum': '8d602785788d7f2a2395f75bf56f2516', 'path': '2802007/2020-11-30/e57e5659f0486567ff213efaf6ab0813956615aa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DvNxOjuFs9Ib3Kgnyw3HsiWO00uYhh0U'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:52.984440Z', 'territory_id': '2802007'} 2023-11-28 02:24:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-29', 'edition_number': '391', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cJCqrtBQSWZ6o0eZZmeFE2FoGuA9sTW3'], 'files': [{'checksum': '8a8fdb2be40879a72c85cf62317808b4', 'path': '2802007/2020-11-29/d803b29db2b4bcfa888221b57c706fcbba7a0f59', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cJCqrtBQSWZ6o0eZZmeFE2FoGuA9sTW3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:50.088218Z', 'territory_id': '2802007'} 2023-11-28 02:24:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:24:50 [scrapy.extensions.logstats] INFO: Crawled 385 pages (at 17 pages/min), scraped 383 items (at 17 items/min) 2023-11-28 02:24:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-03', 'edition_number': '395', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=113zYZFXI92QX6FOZIiXFyKjXD657Dd3P'], 'files': [{'checksum': 'edeaea83de38731e1eba4f6f1911257e', 'path': '2802007/2020-12-03/6124c596dc86efcbf64b79eb95524b970fb9ffb8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=113zYZFXI92QX6FOZIiXFyKjXD657Dd3P'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:19:54.763117Z', 'territory_id': '2802007'} 2023-11-28 02:24:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-02', 'edition_number': '394', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-OmgVovJiv1abwwM2LTfmgHE5dJ_wkdf'], 'files': [{'checksum': 'f8fa6974ff88ff573c2e60efd092c15e', 'path': '2802007/2020-12-02/f66bbd8dab57747ae5b54ceb88c1190b51bda7f2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-OmgVovJiv1abwwM2LTfmgHE5dJ_wkdf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:19:00.201629Z', 'territory_id': '2802007'} 2023-11-28 02:24:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:24:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:24:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-01', 'edition_number': '393', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vr-oYTHntkE1POmNYEKrIuwWVN2rK1GW'], 'files': [{'checksum': '7b433763ebde43ba508ab4602dd152fd', 'path': '2802007/2020-12-01/39bbf19d6c1a25a38d3f46d94e461a61cf020b39', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vr-oYTHntkE1POmNYEKrIuwWVN2rK1GW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:55.560934Z', 'territory_id': '2802007'} 2023-11-28 02:25:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-07', 'edition_number': '398', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XQCl-6NFeffXX77neWAlKRfC0mKlU7Ne'], 'files': [{'checksum': 'f5475b986d02d889c5ddd20535036b5f', 'path': '2802007/2020-12-07/c9a6a60c68b1c9a53d87c29feb19511a536ccea3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XQCl-6NFeffXX77neWAlKRfC0mKlU7Ne'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:01.730938Z', 'territory_id': '2802007'} 2023-11-28 02:25:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-27', 'edition_number': '390', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O0qQvoXRzV5sPXQvhOApZZDy8wyyA4Qo'], 'files': [{'checksum': 'af16f02fb30af643844505882aafd402', 'path': '2802007/2020-11-27/a4e6966699332bdc66acc195f4930c76071ba01e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O0qQvoXRzV5sPXQvhOApZZDy8wyyA4Qo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:47.662983Z', 'territory_id': '2802007'} 2023-11-28 02:25:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-26', 'edition_number': '389', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xmBbUyo7KUuu7Gd2gO0PGGOXwn55agsC'], 'files': [{'checksum': '196be8238d87102c7551c8eb6d9eec72', 'path': '2802007/2020-11-26/4239ad58ac91b7000a7ebeece0f9283eb7a5a0e8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xmBbUyo7KUuu7Gd2gO0PGGOXwn55agsC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:45.440363Z', 'territory_id': '2802007'} 2023-11-28 02:25:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-09', 'edition_number': '400', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bgtvftfgzvl3s2fidTyGnwfygpqF_prx'], 'files': [{'checksum': 'db1fe393c2853861edf576c230cf634e', 'path': '2802007/2020-12-09/b512acea81b19c54a517d922c191dcfcd2f0bde7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bgtvftfgzvl3s2fidTyGnwfygpqF_prx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:09.913397Z', 'territory_id': '2802007'} 2023-11-28 02:25:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-08', 'edition_number': '399', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mCi68MSCzOw9C4NEranSUfoaEk_MgjGL'], 'files': [{'checksum': '325e6bc0244b4790296352cda6c565e7', 'path': '2802007/2020-12-08/ee56f8ab2bb16950a4eb4b4811b9a46856b9d07a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mCi68MSCzOw9C4NEranSUfoaEk_MgjGL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:06.062553Z', 'territory_id': '2802007'} 2023-11-28 02:25:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-05', 'edition_number': '397', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ictv0aqwnxamymzbVyGO0Dote_43U9Ft'], 'files': [{'checksum': '861d6da670a93e1d935efec53e74f283', 'path': '2802007/2020-12-05/97ff19c3cfbb71e150e6e666fef7dd35edbbc1a3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ictv0aqwnxamymzbVyGO0Dote_43U9Ft'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:19:59.186635Z', 'territory_id': '2802007'} 2023-11-28 02:25:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-04', 'edition_number': '396', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1o5L-LmaaoxlSyZEXKbDvXeEVOrODi38q'], 'files': [{'checksum': 'c547b04f397098747ad4e262a922b00e', 'path': '2802007/2020-12-04/33e42c1d452a9edd6df0026d7e7254e922aa4d15', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1o5L-LmaaoxlSyZEXKbDvXeEVOrODi38q'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:19:56.308615Z', 'territory_id': '2802007'} 2023-11-28 02:25:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-10', 'edition_number': '401', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bkzt5Fqh50_F-Fa7B1O1ADOf42e21JPq'], 'files': [{'checksum': '1f5d1e208c0815b7bf5d7517accf988b', 'path': '2802007/2020-12-10/13aed9efa6707b339dab66cbf6aae399851a5069', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bkzt5Fqh50_F-Fa7B1O1ADOf42e21JPq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:12.419902Z', 'territory_id': '2802007'} 2023-11-28 02:25:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-29', 'edition_number': '253', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PAA1y_fFkMukoSC66MBjDfVaqyLc4wv2'], 'files': [{'checksum': 'c1802d02fd56b7eebd8c0b0e601aa153', 'path': '2802007/2020-05-29/c7992273454d2d9029ca87561a780b542136fddb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PAA1y_fFkMukoSC66MBjDfVaqyLc4wv2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:10.863877Z', 'territory_id': '2802007'} 2023-11-28 02:25:50 [scrapy.extensions.logstats] INFO: Crawled 397 pages (at 12 pages/min), scraped 395 items (at 12 items/min) 2023-11-28 02:25:53 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (35791584) larger than download warn size (33554432) in request . 2023-11-28 02:25:58 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:25:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:25:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:25:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-16', 'edition_number': '405', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14z6TrIXYbvBtLEldBqLD41AZoOU4azTm'], 'files': [{'checksum': '1dcd7d80b9558d4953670e0164f8642b', 'path': '2802007/2020-12-16/965b6a7d5fa791a3d7ab88e4e4aea76c5f94f724', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14z6TrIXYbvBtLEldBqLD41AZoOU4azTm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:25.268971Z', 'territory_id': '2802007'} 2023-11-28 02:26:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-17', 'edition_number': '406', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UmZKLuGWhVIyqCubwAzlamdNYdEQrmZL'], 'files': [{'checksum': '61f0c75c4f5a5e6c45f8b110210b4787', 'path': '2802007/2020-12-17/c0eaf7253dcdc1e5f299bbe7e56e97e904770f8c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UmZKLuGWhVIyqCubwAzlamdNYdEQrmZL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:27.441189Z', 'territory_id': '2802007'} 2023-11-28 02:26:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-21', 'edition_number': '408', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VFyJi4WyU3dL59Ks-y0iRIZG3npHLdZR'], 'files': [{'checksum': '3efea494444db4a59bdf85712c405e8d', 'path': '2802007/2020-12-21/7ad335f201357f03586180c3bf8bfd826b7178d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VFyJi4WyU3dL59Ks-y0iRIZG3npHLdZR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:34.580018Z', 'territory_id': '2802007'} 2023-11-28 02:26:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-22', 'edition_number': '409', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aQvrtl1wWe-7F_fC-PaoPNncsKc6BBv_'], 'files': [{'checksum': '91a4758ae73223db73cb7ee71478b28b', 'path': '2802007/2020-12-22/03e1f3eca0003ca6636bfff4a46b86042e1f21fb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aQvrtl1wWe-7F_fC-PaoPNncsKc6BBv_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:36.844211Z', 'territory_id': '2802007'} 2023-11-28 02:26:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-23', 'edition_number': '410', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1udt_qAASd5oUOVySR2PyM-tMTo_a1g5M'], 'files': [{'checksum': 'a2f7d369883f1baeecd6348063631bae', 'path': '2802007/2020-12-23/bc9d3fcd4079f3965062c802bd2e7e9e1bb7443a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1udt_qAASd5oUOVySR2PyM-tMTo_a1g5M'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:39.202846Z', 'territory_id': '2802007'} 2023-11-28 02:26:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-24', 'edition_number': '411', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=163SaR5fkiWRqQ4duCKur5kDvXW27mdqz'], 'files': [{'checksum': '878ef2958d490fbc04ab4a06f6346cfa', 'path': '2802007/2020-12-24/d9dfb26d01b0f3ada83ef4dd5f76d77bd27a1e2c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=163SaR5fkiWRqQ4duCKur5kDvXW27mdqz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:42.833992Z', 'territory_id': '2802007'} 2023-11-28 02:26:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-18', 'edition_number': '407', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ImrmaFYswtrLU2WvV243cvUDr4v9MECM'], 'files': [{'checksum': '259f10542a0bf5fe0ab7ec85eabc0048', 'path': '2802007/2020-12-18/09a8ae9c12b988f2143b26dc4f3848cb8b78e430', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ImrmaFYswtrLU2WvV243cvUDr4v9MECM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:31.498177Z', 'territory_id': '2802007'} 2023-11-28 02:26:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-30', 'edition_number': '413', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1suK8VF4jrCoZmqC7_KYdMHt_p1IJlRT8'], 'files': [{'checksum': 'b26b58dbf6bffa7617913fb42fc333de', 'path': '2802007/2020-12-30/84c0674859abd89037929c78ae09999f4ab551ea', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1suK8VF4jrCoZmqC7_KYdMHt_p1IJlRT8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:49.466134Z', 'territory_id': '2802007'} 2023-11-28 02:26:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-31', 'edition_number': '414', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tyNlHpYJ4ye1dGDdGE6Swk7oCAZ0qWCb'], 'files': [{'checksum': '728778a94bc14c299b05f8b0784866d7', 'path': '2802007/2020-12-31/6c8895e23764f366c9b7e074f2be5442c76c0600', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tyNlHpYJ4ye1dGDdGE6Swk7oCAZ0qWCb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:51.338465Z', 'territory_id': '2802007'} 2023-11-28 02:26:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-28', 'edition_number': '412', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QhGwaO2Kd61N5lA5R8yx9cfjOPRgt_cB'], 'files': [{'checksum': '5a93e34d6dbbf069cc5aaea1e21b1001', 'path': '2802007/2020-12-28/5c9748aa9146db29f6981310b19a517dca755ec9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QhGwaO2Kd61N5lA5R8yx9cfjOPRgt_cB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:46.329833Z', 'territory_id': '2802007'} 2023-11-28 02:26:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-14', 'edition_number': '404', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gua4zwGSjVLGF0pji_8cYTkVfEswK2P3'], 'files': [{'checksum': '08764e886085a21a05105fb43af76dfe', 'path': '2802007/2020-12-14/53836ea2b41226e40918ce8aac0cb2b1ab9b5ab2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gua4zwGSjVLGF0pji_8cYTkVfEswK2P3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:21.355985Z', 'territory_id': '2802007'} 2023-11-28 02:26:50 [scrapy.extensions.logstats] INFO: Crawled 408 pages (at 11 pages/min), scraped 406 items (at 11 items/min) 2023-11-28 02:26:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-04', 'edition_number': '415', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15bREQ6MTwMDEXtSzqwXAr_sXtiJmtvEZ'], 'files': [{'checksum': 'c097feb8c7228052b2004abc547bf3ee', 'path': '2802007/2021-01-04/1b440d7083d7cfbbf41b529139f55abc377c7f5b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15bREQ6MTwMDEXtSzqwXAr_sXtiJmtvEZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:53.592575Z', 'territory_id': '2802007'} 2023-11-28 02:26:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-10', 'edition_number': '402', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QdKs-drHkaDV-PdXOUYbkhqEeeICTz-B'], 'files': [{'checksum': '359047be55f627d6a3c896960b4f2690', 'path': '2802007/2020-12-10/883727938ef69d970658519d38d7abdf8e12116c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QdKs-drHkaDV-PdXOUYbkhqEeeICTz-B'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:15.250203Z', 'territory_id': '2802007'} 2023-11-28 02:26:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:26:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:26:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-12', 'edition_number': '419', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1--xqpvzyTA39p3okdmsUs2Mx3qSXPU5M'], 'files': [{'checksum': '3ea9f599d788c2e88a1fc13cd800182d', 'path': '2802007/2021-01-12/ed9641a1bdca6e14dccebfb48d3b085650da6a46', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1--xqpvzyTA39p3okdmsUs2Mx3qSXPU5M'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:07.362874Z', 'territory_id': '2802007'} 2023-11-28 02:27:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-11', 'edition_number': '418', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ws9OLVcdkUdZP2Xrv73TBxlh2pMIiXGV'], 'files': [{'checksum': '0c8ac517e52c790d129093c810ff8eda', 'path': '2802007/2021-01-11/01e7cc134e97724b78a26cf72fc14b0d933327c3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ws9OLVcdkUdZP2Xrv73TBxlh2pMIiXGV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:03.690146Z', 'territory_id': '2802007'} 2023-11-28 02:27:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-12-11', 'edition_number': '403', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bPga41xWVoVUjcbeUnIFwW54JyuMdYXC'], 'files': [{'checksum': 'b9e028b0ba2bc3c4681a43e706d9f3d9', 'path': '2802007/2020-12-11/e809fac949577479440c1aa77745a089021b56de', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bPga41xWVoVUjcbeUnIFwW54JyuMdYXC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:17.918670Z', 'territory_id': '2802007'} 2023-11-28 02:27:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-08', 'edition_number': '417', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tDFXZNPaSBpjkfpJ5XBIy1frMr2N0aJ_'], 'files': [{'checksum': 'b1aeaa141244ab765aa1196fac9c3013', 'path': '2802007/2021-01-08/3f2682d388dd8efbe5ad70b71a936371e3378fd4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tDFXZNPaSBpjkfpJ5XBIy1frMr2N0aJ_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:59.726829Z', 'territory_id': '2802007'} 2023-11-28 02:27:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-05-29', 'edition_number': '252', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1agPAF-JWMDb7JQSMS3ww8r966ssS1CmF'], 'files': [{'checksum': '3b7d7669c486c1d9f9683a266a0ecb81', 'path': '2802007/2020-05-29/4ecc03878acc5784c47b22e547878f8a8b1829a6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1agPAF-JWMDb7JQSMS3ww8r966ssS1CmF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:11:07.242211Z', 'territory_id': '2802007'} 2023-11-28 02:27:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-14', 'edition_number': '422', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1URxd9Xvg35CXmyPKoKySM5Nw4mearFkR'], 'files': [{'checksum': 'c70ba45de399841c902b88ddaecab978', 'path': '2802007/2021-01-14/48ceb0d7009d8feda0d3d02278108582e1bf997e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1URxd9Xvg35CXmyPKoKySM5Nw4mearFkR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:17.181495Z', 'territory_id': '2802007'} 2023-11-28 02:27:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-15', 'edition_number': '423', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zHOkfNi-O9q3RMiarRDmp5qH-GNMtcKl'], 'files': [{'checksum': 'ad25c7383e00ae0b7086d9d9dd8efe35', 'path': '2802007/2021-01-15/0a38e68f0df2da56c4f64da560f7c75364779944', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zHOkfNi-O9q3RMiarRDmp5qH-GNMtcKl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:19.093043Z', 'territory_id': '2802007'} 2023-11-28 02:27:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-12', 'edition_number': '420', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bUa1PqLP6SXmeVETEGXNR_d_a0PqNkXT'], 'files': [{'checksum': 'ce0d679dd7cf81872c00b3f6e2c34ec2', 'path': '2802007/2021-01-12/fc5d976d42871a5e02f1ecc6970dd84093fb9758', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bUa1PqLP6SXmeVETEGXNR_d_a0PqNkXT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:10.991222Z', 'territory_id': '2802007'} 2023-11-28 02:27:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-19', 'edition_number': '425', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SJFrrILOmYDzEPGmkuj6wGk9ICfPgqm3'], 'files': [{'checksum': '9a9e47eab9386db6dad83dc8854014c9', 'path': '2802007/2021-01-19/df9eb126af9e36c6ec38cf3f4fae36943222866f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SJFrrILOmYDzEPGmkuj6wGk9ICfPgqm3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:22.883873Z', 'territory_id': '2802007'} 2023-11-28 02:27:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-06-23', 'edition_number': '272', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iQ_wvRLxZRIqEUVPyNL07wwt-sEmX9S_'], 'files': [{'checksum': '612dd7dc06108f886f34d14c11bf9899', 'path': '2802007/2020-06-23/0a8c624c72939ceaf8fb10df4a9ecade156d40a1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iQ_wvRLxZRIqEUVPyNL07wwt-sEmX9S_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:12:09.406700Z', 'territory_id': '2802007'} 2023-11-28 02:27:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-20', 'edition_number': '426', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dUHmMGUFLBVlpZIr3So5Zu47YXsiQRpa'], 'files': [{'checksum': '7f33d52e1c7d0dc5955124e4bcfc1d68', 'path': '2802007/2021-01-20/c195c12d335ac2ab641b1c4ccd3b3419151d82d8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dUHmMGUFLBVlpZIr3So5Zu47YXsiQRpa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:26.100530Z', 'territory_id': '2802007'} 2023-11-28 02:27:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-21', 'edition_number': '427', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17u4xFdN2DyRQPCt5erapwSIyKT8aMCdl'], 'files': [{'checksum': '1ad3535ea79cb1adcbd4605ec6eb09e9', 'path': '2802007/2021-01-21/b8dacab83b96dc82f112a2aa32bb64362cd8097f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17u4xFdN2DyRQPCt5erapwSIyKT8aMCdl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:28.816412Z', 'territory_id': '2802007'} 2023-11-28 02:27:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-22', 'edition_number': '429', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K5C6QhSetp-o_IwH8tUp1mbOPJVkuiZr'], 'files': [{'checksum': '89ec4ed398afd63f48cbad2757460618', 'path': '2802007/2021-01-22/6d79f96d9a8ab088d5311a9345b5ed62301ff81f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K5C6QhSetp-o_IwH8tUp1mbOPJVkuiZr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:34.072492Z', 'territory_id': '2802007'} 2023-11-28 02:27:38 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:27:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-22', 'edition_number': '428', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12g1AlotrNVt8WoZlgv7BDlLOYJnKASzc'], 'files': [{'checksum': '4ef6364c6fa90756a09b42de088ac974', 'path': '2802007/2021-01-22/73256a3bc0a6c1ff47e034bf8de78aaeb3b52932', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12g1AlotrNVt8WoZlgv7BDlLOYJnKASzc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:32.303032Z', 'territory_id': '2802007'} 2023-11-28 02:27:40 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:27:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-26', 'edition_number': '432', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-obE8ayWzjqIOreOn6sEpnrk6we_cLEi'], 'files': [{'checksum': '9521fe0c0175fb3b4119b6aae11e1005', 'path': '2802007/2021-01-26/bf919df56de8347a873b1faeb1121b3fb98b0202', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-obE8ayWzjqIOreOn6sEpnrk6we_cLEi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:43.295329Z', 'territory_id': '2802007'} 2023-11-28 02:27:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-28', 'edition_number': '434', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lsbHJMGlU0gYzrye5i-X1U8fWvBtE-LJ'], 'files': [{'checksum': 'aa620de89890fcbcedaaa245a912c9b1', 'path': '2802007/2021-01-28/ac38b33fb81edb6636727aedfe396aa8953a1e5a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lsbHJMGlU0gYzrye5i-X1U8fWvBtE-LJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:50.079714Z', 'territory_id': '2802007'} 2023-11-28 02:27:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-29', 'edition_number': '435', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bM-0xE0OBuWR97nvavVi6B4lOP0JXpMc'], 'files': [{'checksum': '26e4a6d756b9d765f1d1871bcf5be655', 'path': '2802007/2021-01-29/1ec72340ae5513a59299f0f9cb20ab33b448513b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bM-0xE0OBuWR97nvavVi6B4lOP0JXpMc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:52.014780Z', 'territory_id': '2802007'} 2023-11-28 02:27:50 [scrapy.extensions.logstats] INFO: Crawled 427 pages (at 19 pages/min), scraped 425 items (at 19 items/min) 2023-11-28 02:27:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:27:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:27:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-25', 'edition_number': '430', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11vgqeEJl7wbmvodvs-hX6F8xdQQ4B8Lm'], 'files': [{'checksum': 'cc6c05be6cc806e468ea954e0ebc9134', 'path': '2802007/2021-01-25/7dba4f0d0190344838b33d3e619f0e0a145d097d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11vgqeEJl7wbmvodvs-hX6F8xdQQ4B8Lm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:36.494814Z', 'territory_id': '2802007'} 2023-11-28 02:28:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-29', 'edition_number': '436', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TeMTOi6QFzJVnVynGr0f0Z-sw4E3Ecbn'], 'files': [{'checksum': 'ab5f26a344974a824042c23d1e1692fa', 'path': '2802007/2021-01-29/3eba473074a8daef88775346e9f7f6aa5264c0df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TeMTOi6QFzJVnVynGr0f0Z-sw4E3Ecbn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:04.577482Z', 'territory_id': '2802007'} 2023-11-28 02:28:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-26', 'edition_number': '431', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wpgsoUFz_chqtR-CcEYcRWA2e9ictyLb'], 'files': [{'checksum': 'ada26ca28a055cfeb6d29a4fc3e5845d', 'path': '2802007/2021-01-26/87ffc76f15474d444ba8c6c4988cbc6a220e6541', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wpgsoUFz_chqtR-CcEYcRWA2e9ictyLb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:41.406142Z', 'territory_id': '2802007'} 2023-11-28 02:28:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-01', 'edition_number': '438', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WJDErx4-6UkI55brbpQYlcnkuwJDxV-U'], 'files': [{'checksum': '7d75d36359d250ab4595f5198d5751d3', 'path': '2802007/2021-02-01/1d7a4f56f8475aea2247cad3beda05d8ee9a47df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WJDErx4-6UkI55brbpQYlcnkuwJDxV-U'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:09.921909Z', 'territory_id': '2802007'} 2023-11-28 02:28:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-02', 'edition_number': '440', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TxIUHL5pm7Vm19QIRlXtzwD4U8-ZLmLE'], 'files': [{'checksum': 'ac819f7da707cc15d23055f0852f5eaa', 'path': '2802007/2021-02-02/5cfa5583758b7da916cf0ae3ac687bbf0a5fd388', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TxIUHL5pm7Vm19QIRlXtzwD4U8-ZLmLE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:17.465701Z', 'territory_id': '2802007'} 2023-11-28 02:28:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-02', 'edition_number': '439', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lhWkpNBcIhDdHKOHOcdVrhP401LmUMkn'], 'files': [{'checksum': 'd87ea00e06ee553e1226f2618a905ba1', 'path': '2802007/2021-02-02/3014375ff245c5733d138f96a5426de508970a83', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lhWkpNBcIhDdHKOHOcdVrhP401LmUMkn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:14.265206Z', 'territory_id': '2802007'} 2023-11-28 02:28:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-03', 'edition_number': '442', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kGK5rrpTRhao3uFdRQwmORjc8kZ4jPqe'], 'files': [{'checksum': 'f3ee7197146413dc4f4bdbb6681db64c', 'path': '2802007/2021-02-03/ac136905b2e28fbb01b1162106c122bd20e48909', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kGK5rrpTRhao3uFdRQwmORjc8kZ4jPqe'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:21.236580Z', 'territory_id': '2802007'} 2023-11-28 02:28:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-30', 'edition_number': '437', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qO8Uh8jchpDt5LJXjf2YvULXzUujtr_q'], 'files': [{'checksum': '5f63b0d4c49fe3a69d7eae835a9fdf78', 'path': '2802007/2021-01-30/030c5ded1b22b8db7945e24a127c9300464e4109', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qO8Uh8jchpDt5LJXjf2YvULXzUujtr_q'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:06.357802Z', 'territory_id': '2802007'} 2023-11-28 02:28:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-04', 'edition_number': '444', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11LBMzmwegxNgJVu43VAmJCttjzJS5UyJ'], 'files': [{'checksum': '5bd71d017bb7dee15d6982b8288d702b', 'path': '2802007/2021-02-04/79a302d498a2c60d97c1b9f886410e3ad928b8ef', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11LBMzmwegxNgJVu43VAmJCttjzJS5UyJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:27.083488Z', 'territory_id': '2802007'} 2023-11-28 02:28:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-04', 'edition_number': '443', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rp17tX673k8i7Y74AhLk--doXLufgToq'], 'files': [{'checksum': '10fa7423be36e28ab44369bb415c6588', 'path': '2802007/2021-02-04/d712b439da7d47e77b2416b555016c4b494473b4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rp17tX673k8i7Y74AhLk--doXLufgToq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:24.974789Z', 'territory_id': '2802007'} 2023-11-28 02:28:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-05', 'edition_number': '445', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PsIdqG_piFzKUNXGpXqi9xcYE3dyRSxk'], 'files': [{'checksum': '9f09f6742c1b61381fc74c628cc8e35a', 'path': '2802007/2021-02-05/f075b1cd0312b01956238b852bf8b2db66419210', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PsIdqG_piFzKUNXGpXqi9xcYE3dyRSxk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:30.714774Z', 'territory_id': '2802007'} 2023-11-28 02:28:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-08', 'edition_number': '446', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XG1k6ZtQUy-vVihVH5ifTfL6dg0asxPx'], 'files': [{'checksum': '66e3aee95d1549840025fa08e4311572', 'path': '2802007/2021-02-08/8c533837d4070dfbf0f0a8fb402b0d3546082684', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XG1k6ZtQUy-vVihVH5ifTfL6dg0asxPx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:35.339918Z', 'territory_id': '2802007'} 2023-11-28 02:28:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-09', 'edition_number': '447', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12QfKGl8Ip9z9Z9J-TM0E39m0vrmtkzY0'], 'files': [{'checksum': 'f85760742d7facffc87f0607452e002d', 'path': '2802007/2021-02-09/9b5185c7e48be838913fc4ed62b774f696633173', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12QfKGl8Ip9z9Z9J-TM0E39m0vrmtkzY0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:37.737925Z', 'territory_id': '2802007'} 2023-11-28 02:28:50 [scrapy.extensions.logstats] INFO: Crawled 440 pages (at 13 pages/min), scraped 438 items (at 13 items/min) 2023-11-28 02:28:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-11', 'edition_number': '449', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oem0_Rwe6S1viR8gwCbKS5mxE2BkxCbX'], 'files': [{'checksum': '672e9798012cefcda44c529548c58d47', 'path': '2802007/2021-02-11/e62eb37feddd49f6cbb38654edf63ec288731c42', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oem0_Rwe6S1viR8gwCbKS5mxE2BkxCbX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:42.643172Z', 'territory_id': '2802007'} 2023-11-28 02:28:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:28:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:28:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-03', 'edition_number': '441', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uYYI2QozfZEGCtxrpbog3bJl2_Tj_8fU'], 'files': [{'checksum': '8ff9a06cea3c09bba35f1822822737f6', 'path': '2802007/2021-02-03/f04d253f782f54fdb1bde6552b70342a85848e97', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uYYI2QozfZEGCtxrpbog3bJl2_Tj_8fU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:19.151794Z', 'territory_id': '2802007'} 2023-11-28 02:29:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-13', 'edition_number': '451', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Feupko31UnS6IvfXtwLekUZqY1si1Lr'], 'files': [{'checksum': '6a8a1031a696aa1037804e74cf70d2e9', 'path': '2802007/2021-02-13/c2e621bb5702bbf298c21c0e7fa1319d5595d3bf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Feupko31UnS6IvfXtwLekUZqY1si1Lr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:49.140767Z', 'territory_id': '2802007'} 2023-11-28 02:29:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-27', 'edition_number': '433', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZxPrxfvH4yThW8sC-80MH-d7IbQ-FYGy'], 'files': [{'checksum': 'de3fa38e799e5ec7fe61d08263b9cdfa', 'path': '2802007/2021-01-27/308903584b332efc7cb3ac62f5073cffb118d53b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZxPrxfvH4yThW8sC-80MH-d7IbQ-FYGy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:45.508373Z', 'territory_id': '2802007'} 2023-11-28 02:29:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-17', 'edition_number': '453', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1G8JICqMjOwOYfASf_JYgxhWhelOKRtzJ'], 'files': [{'checksum': '65b9a4e5ae2cd21e880e4c3419e19270', 'path': '2802007/2021-02-17/b5102371034d2b996a49394bf3348c5b9d5f77e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1G8JICqMjOwOYfASf_JYgxhWhelOKRtzJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:53.217606Z', 'territory_id': '2802007'} 2023-11-28 02:29:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-18', 'edition_number': '424', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_xnlA67rDSICdj66rc2388yPdGyYYtcN'], 'files': [{'checksum': '4c10356bda4e44fa094ce2dd15056603', 'path': '2802007/2021-01-18/6575c1b2d9b507ef8d5aeede20be2a086b166a27', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_xnlA67rDSICdj66rc2388yPdGyYYtcN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:20.825978Z', 'territory_id': '2802007'} 2023-11-28 02:29:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-13', 'edition_number': '421', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GoIb8nC9UPkE9BCm_kqjhwss7pFq_0R0'], 'files': [{'checksum': 'e8d3ea431b5cbac39abb141fd807da1a', 'path': '2802007/2021-01-13/43b8588f5b9ab422d5703afe5fd7b00d59d97f25', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GoIb8nC9UPkE9BCm_kqjhwss7pFq_0R0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:21:12.902682Z', 'territory_id': '2802007'} 2023-11-28 02:29:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-20', 'edition_number': '455', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yK_61o0647zm5oCX_IJIoFqzoPLoKDrk'], 'files': [{'checksum': 'db2e49d13baf3ccdccc3471b4a4ef594', 'path': '2802007/2021-02-20/812a4225eeb9cc0fbff0fc312b280f0a2a15b950', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yK_61o0647zm5oCX_IJIoFqzoPLoKDrk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:58.054965Z', 'territory_id': '2802007'} 2023-11-28 02:29:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-19', 'edition_number': '454', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y0vLmTrHLFLsiYjJVmmfiBYBKlvnpR0G'], 'files': [{'checksum': '584871768e140dd40720b21dbe036c42', 'path': '2802007/2021-02-19/1486fd9c67d16e10c57298674986db797c7f9ef7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y0vLmTrHLFLsiYjJVmmfiBYBKlvnpR0G'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:55.530770Z', 'territory_id': '2802007'} 2023-11-28 02:29:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-01-05', 'edition_number': '416', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uDKX62Di7vucSsq-FUOYyvkXu_gxiIjl'], 'files': [{'checksum': '750b01b7d25b6b75d4bed17f07229012', 'path': '2802007/2021-01-05/fe0a8d141e862783ad24112ad280415cb3c7249f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uDKX62Di7vucSsq-FUOYyvkXu_gxiIjl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:20:56.353783Z', 'territory_id': '2802007'} 2023-11-28 02:29:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-17', 'edition_number': '452', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_XJstJcrcKsHdDeILSYWFR1apRjm2NNR'], 'files': [{'checksum': '99bda94002de5dcc045f9429561f2dcf', 'path': '2802007/2021-02-17/130771e62d2580c2836326a815ac974aacb22b55', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_XJstJcrcKsHdDeILSYWFR1apRjm2NNR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:50.945862Z', 'territory_id': '2802007'} 2023-11-28 02:29:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-23', 'edition_number': '457', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zo9B_CVLcYyYaQq2DNWxTtoctJ_Sxo3i'], 'files': [{'checksum': 'eec04a51cffefc47f73b101ab1a71457', 'path': '2802007/2021-02-23/d27d41cf9f3ef7a2538f11416549eeff5b0950db', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zo9B_CVLcYyYaQq2DNWxTtoctJ_Sxo3i'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:05.340480Z', 'territory_id': '2802007'} 2023-11-28 02:29:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-12', 'edition_number': '450', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UeMBCg3E_kfDf44Ob3L6afPLpN6U2xPf'], 'files': [{'checksum': 'f6b1aa4867eb1c9e67ae9f5426e3ae30', 'path': '2802007/2021-02-12/dfe041abb1a32600bef6014cffdf01a76e8e2814', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UeMBCg3E_kfDf44Ob3L6afPLpN6U2xPf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:46.101030Z', 'territory_id': '2802007'} 2023-11-28 02:29:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-25', 'edition_number': '459', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VStWvIDa9xvJs0i50mae3DCNYsOR--e5'], 'files': [{'checksum': '1473d75eef08b60f5ad54c0f620ab2f5', 'path': '2802007/2021-02-25/0e052310de574ef589f25dcd8660da8b315a15e0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VStWvIDa9xvJs0i50mae3DCNYsOR--e5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:11.788123Z', 'territory_id': '2802007'} 2023-11-28 02:29:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-27', 'edition_number': '462', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1r_nSzYFgRf1awhe_cQ3OUQIqSW3fNkLT'], 'files': [{'checksum': 'a667b85dce1a3a10472dc9040267ccd3', 'path': '2802007/2021-02-27/54757d5f22fb183d6ebc22b64a59ad57044bcb2b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1r_nSzYFgRf1awhe_cQ3OUQIqSW3fNkLT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:24.398978Z', 'territory_id': '2802007'} 2023-11-28 02:29:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-26', 'edition_number': '461', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RqgXK7SvGbGqCBfJTG1xURh4CWsBwWXy'], 'files': [{'checksum': '2c2c293ebae7a69e1b2419a8cc78ccb2', 'path': '2802007/2021-02-26/eff565f207c01e0f72e4f345b1805d6c4be567fb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RqgXK7SvGbGqCBfJTG1xURh4CWsBwWXy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:17.500803Z', 'territory_id': '2802007'} 2023-11-28 02:29:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-01', 'edition_number': '463', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TKYHp4rYVR_En4OUbUIMKATEcEuoarHf'], 'files': [{'checksum': '04ddb9e4db40615c0d5614a65aee4beb', 'path': '2802007/2021-03-01/576b4423028e73bea4d67760ca0919dce5476f7c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TKYHp4rYVR_En4OUbUIMKATEcEuoarHf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:25.962455Z', 'territory_id': '2802007'} 2023-11-28 02:29:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-04', 'edition_number': '466', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zFyPduiaOAYuXKZ56Vni9Qz7RVYGcEsr'], 'files': [{'checksum': '262ff25154a11c5b17b1317074c35b56', 'path': '2802007/2021-03-04/839d7d121c3bb522067ac18612be6da1bbd50873', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zFyPduiaOAYuXKZ56Vni9Qz7RVYGcEsr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:48.210279Z', 'territory_id': '2802007'} 2023-11-28 02:29:50 [scrapy.extensions.logstats] INFO: Crawled 458 pages (at 18 pages/min), scraped 456 items (at 18 items/min) 2023-11-28 02:29:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:29:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:29:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-06', 'edition_number': '468', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CkabCxfbCJ6VrxQJbfYP0bZP5nge9PJo'], 'files': [{'checksum': '6eb96834a1832a20fe8ccf241abf7ff2', 'path': '2802007/2021-03-06/8287fae62a1e9f90bf4ef7b579eafe7474174caa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CkabCxfbCJ6VrxQJbfYP0bZP5nge9PJo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:53.250414Z', 'territory_id': '2802007'} 2023-11-28 02:30:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-05', 'edition_number': '467', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19JotJsuocGULUUtX2x14-VqvAdgcqmqC'], 'files': [{'checksum': '93a82b5c300a0546444fbca10927d07d', 'path': '2802007/2021-03-05/af36468c756e9fa1bee3abd0e8a2dff126e5a39f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19JotJsuocGULUUtX2x14-VqvAdgcqmqC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:50.704427Z', 'territory_id': '2802007'} 2023-11-28 02:30:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-06', 'edition_number': '469', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yzmmFaoJCDXnFerL_3hh1rWPtGUSRnHW'], 'files': [{'checksum': '3cd8d5822507d5589588354ec3924d2a', 'path': '2802007/2021-03-06/f43d9be331a384e43e4b9dd64948e68e76a25f5a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yzmmFaoJCDXnFerL_3hh1rWPtGUSRnHW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:03.105336Z', 'territory_id': '2802007'} 2023-11-28 02:30:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-10', 'edition_number': '471', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_awCTRJKs1lCkdzOODBWzkatsyQMRm0t'], 'files': [{'checksum': 'b9a9e6cfbbbc2c25dc0a932f591bc17a', 'path': '2802007/2021-03-10/b193a8f24075dbd7a5ee1556e0cbded8ba721c93', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_awCTRJKs1lCkdzOODBWzkatsyQMRm0t'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:07.480168Z', 'territory_id': '2802007'} 2023-11-28 02:30:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-04', 'edition_number': '465', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lLg_xjo3pFeJZwWm2Y1bMDAmq2cd8ywQ'], 'files': [{'checksum': '2e5822b82d420c8434a13c67d1fa1e4a', 'path': '2802007/2021-03-04/b44af1d33f3d55245ae5f1a50a7550a50a798b13', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lLg_xjo3pFeJZwWm2Y1bMDAmq2cd8ywQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:46.048989Z', 'territory_id': '2802007'} 2023-11-28 02:30:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-11', 'edition_number': '472', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KUwbTkrER-ocjKLnhYIJImqGkd73Wybs'], 'files': [{'checksum': '41fdf87ee9b4c691b30ae6360ea1e0e1', 'path': '2802007/2021-03-11/0e4b571f129dc76ddb7e41b154715d1a3aee7ddd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KUwbTkrER-ocjKLnhYIJImqGkd73Wybs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:10.871972Z', 'territory_id': '2802007'} 2023-11-28 02:30:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-15', 'edition_number': '473', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BcBZMcz27fIkDroR_7t4At7FaSAJgrIa'], 'files': [{'checksum': 'e73c4add6da4b2dbefe5083a8fdaad87', 'path': '2802007/2021-03-15/253f30f7e2c93e0dd686fbb3dcfb46c7fe945edc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BcBZMcz27fIkDroR_7t4At7FaSAJgrIa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:12.921010Z', 'territory_id': '2802007'} 2023-11-28 02:30:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-16', 'edition_number': '474', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1duFNh2Nnlkzym7F25G05O0nYWCwYwm-t'], 'files': [{'checksum': 'e2b4e8b8276c8bdfad646fa490f533ed', 'path': '2802007/2021-03-16/91088ae130366a08245038a74658d05c296ec93d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1duFNh2Nnlkzym7F25G05O0nYWCwYwm-t'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:16.907501Z', 'territory_id': '2802007'} 2023-11-28 02:30:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-17', 'edition_number': '475', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1idqtBIxloz00xYkrqzHWO4GWaKllnbQd'], 'files': [{'checksum': '8b38d1c71318dae7203e0d0095135e30', 'path': '2802007/2021-03-17/935a933dd60603a07d7d93ffcc285196ad73b2e0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1idqtBIxloz00xYkrqzHWO4GWaKllnbQd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:20.421801Z', 'territory_id': '2802007'} 2023-11-28 02:30:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-09', 'edition_number': '470', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1el08RIi-gvyJa5cn3JvJc4lQBU2fNEDF'], 'files': [{'checksum': '72d1aa46b9184f0a2ae298ce6bc2919a', 'path': '2802007/2021-03-09/138b3231c97f2908d0e2168888b03fda11bc735d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1el08RIi-gvyJa5cn3JvJc4lQBU2fNEDF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:05.618506Z', 'territory_id': '2802007'} 2023-11-28 02:30:50 [scrapy.extensions.logstats] INFO: Crawled 468 pages (at 10 pages/min), scraped 466 items (at 10 items/min) 2023-11-28 02:30:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-17', 'edition_number': '476', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bUVk5u_YW219rbX7lKIxpa8pHaigk_69'], 'files': [{'checksum': '294b7cd49f391182eb4933c1f59f8dfd', 'path': '2802007/2021-03-17/e8df7e988eb28a718ded6293d1a7b9e57e3ef1ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bUVk5u_YW219rbX7lKIxpa8pHaigk_69'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:24.348927Z', 'territory_id': '2802007'} 2023-11-28 02:30:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-18', 'edition_number': '477', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A316PneLUhaUeWxDneslE2Y_JUMvGYAN'], 'files': [{'checksum': 'd4fec4ea02f1d5bd869910ef123acfac', 'path': '2802007/2021-03-18/4c5eafc74385198cf416cbd9eb1ecd5523b1200b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A316PneLUhaUeWxDneslE2Y_JUMvGYAN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:28.001678Z', 'territory_id': '2802007'} 2023-11-28 02:30:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:30:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-20', 'edition_number': '479', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iHq9bpTaw8uviHe-qEDjoMx9_t1Jka17'], 'files': [{'checksum': 'ddbbf5c88c949abf4087173ae39e3b5f', 'path': '2802007/2021-03-20/a79ec9e84a43f3e3784cf109a130505e81410f7f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iHq9bpTaw8uviHe-qEDjoMx9_t1Jka17'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:35.692492Z', 'territory_id': '2802007'} 2023-11-28 02:31:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-21', 'edition_number': '480', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1m81eUKFiAgNlif-i56iVvvFrDPaZz1uF'], 'files': [{'checksum': '09906366281e2b7c3a43f17ea8de542d', 'path': '2802007/2021-03-21/e9675aad97554c1043816cc3d869ac0dda3a4a37', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1m81eUKFiAgNlif-i56iVvvFrDPaZz1uF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:37.102741Z', 'territory_id': '2802007'} 2023-11-28 02:31:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-19', 'edition_number': '478', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16lS88VN7W4pjMui9aCRCRdmSNbAJUmDn'], 'files': [{'checksum': '2c8520d05084e67f4472255c0438bb8a', 'path': '2802007/2021-03-19/f111150ad01e3f7e07f6547852bfaa521470e88c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16lS88VN7W4pjMui9aCRCRdmSNbAJUmDn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:30.215102Z', 'territory_id': '2802007'} 2023-11-28 02:31:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-23', 'edition_number': '482', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y6Otb-8IjvYuVR5sM7V0gmhwnRJhtc3r'], 'files': [{'checksum': 'b152434fcc05bb40e11786a40bbd6acd', 'path': '2802007/2021-03-23/6d6a222ccd2ada430d34ecce61948efefccdf272', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y6Otb-8IjvYuVR5sM7V0gmhwnRJhtc3r'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:44.014597Z', 'territory_id': '2802007'} 2023-11-28 02:31:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-19', 'edition_number': '325', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DH95l5FxSEsbamp0w0YWxcOEb55MpJNG'], 'files': [{'checksum': '83c233d8e12795faff7e5a012caa9430', 'path': '2802007/2020-08-19/e4e83430c3ca9fde84a34687ea84bcbc5b7c32fc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DH95l5FxSEsbamp0w0YWxcOEb55MpJNG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:17.978412Z', 'territory_id': '2802007'} 2023-11-28 02:31:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-22', 'edition_number': '481', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vGbNh3-jVD0krL3yoyzvlOpkE3O99Zwl'], 'files': [{'checksum': 'b9845b238ebffcf138b6b28840d40c48', 'path': '2802007/2021-03-22/1c439e64658f464b09e64b573f50c3d5493328e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vGbNh3-jVD0krL3yoyzvlOpkE3O99Zwl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:39.225657Z', 'territory_id': '2802007'} 2023-11-28 02:31:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-08-26', 'edition_number': '329', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tdcTUf8BVyieDSHXPWs7uZfJ31e2M719'], 'files': [{'checksum': 'e5dd70a5f757caf815c74e92f0821cff', 'path': '2802007/2020-08-26/c0044d0cd08aecac704a74e0098983a50c2414c6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tdcTUf8BVyieDSHXPWs7uZfJ31e2M719'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:15:35.437825Z', 'territory_id': '2802007'} 2023-11-28 02:31:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-24', 'edition_number': '484', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nTeUeQ8k_xZgJr72qiFn_FBlxYyOKuuU'], 'files': [{'checksum': '8ffc2ef8ad9c6090667830e94cff3d6f', 'path': '2802007/2021-03-24/0cb020b35710e6b83a7cff3179429c6b106263ac', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nTeUeQ8k_xZgJr72qiFn_FBlxYyOKuuU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:51.897909Z', 'territory_id': '2802007'} 2023-11-28 02:31:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-25', 'edition_number': '485', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Ox71WRXB0UXAPr1ne1EZJ2JUs7Anz4I'], 'files': [{'checksum': '7d17f86e0734523c522caa74cbc11f9f', 'path': '2802007/2021-03-25/2214dad4afc92f88baa3c67f5a5bf330736be752', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Ox71WRXB0UXAPr1ne1EZJ2JUs7Anz4I'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:54.757118Z', 'territory_id': '2802007'} 2023-11-28 02:31:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-02', 'edition_number': '464', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qWTVNHf1S--oL1W7LfuNTOHK96iyb6El'], 'files': [{'checksum': '7c6e9ee19575d7faf56c6746a0f7478e', 'path': '2802007/2021-03-02/88a806b6ceaa6fd98c4bbe01e3187761c0efa71e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qWTVNHf1S--oL1W7LfuNTOHK96iyb6El'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:43.478982Z', 'territory_id': '2802007'} 2023-11-28 02:31:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-27', 'edition_number': '486', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1R7l3ZjVql7Zm92tlwOVfbbz7Co5XgtOL'], 'files': [{'checksum': 'd1232c4aa2f82e4fafa6c751a3584b47', 'path': '2802007/2021-03-27/3e488e4a386cbe53a93111dc46ae265e63a45830', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1R7l3ZjVql7Zm92tlwOVfbbz7Co5XgtOL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:57.400350Z', 'territory_id': '2802007'} 2023-11-28 02:31:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-28', 'edition_number': '487', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1m5Bb2ZmIarZdWMfFp1TZkAhnTTEkR0Ey'], 'files': [{'checksum': '052664431d3cba1cbbfd17983a3fb0ae', 'path': '2802007/2021-03-28/59d16a2900215c651544a0bfd9d0157b35ac2dd9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1m5Bb2ZmIarZdWMfFp1TZkAhnTTEkR0Ey'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:01.875603Z', 'territory_id': '2802007'} 2023-11-28 02:31:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-31', 'edition_number': '490', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DisWLNvWxN5iaZhZTkNjJ1OT78QemEkQ'], 'files': [{'checksum': 'c452098ade97af3e4d301e35911a9a75', 'path': '2802007/2021-03-31/d0474d5ce6fde55ebb54dd9707dfcf6c13bc1f99', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DisWLNvWxN5iaZhZTkNjJ1OT78QemEkQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:20.577626Z', 'territory_id': '2802007'} 2023-11-28 02:31:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-29', 'edition_number': '488', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1elZwGAZa9nD8zK2nvCx-E110gRcgs64s'], 'files': [{'checksum': 'd58a8d56a0daea8475c947a992c93067', 'path': '2802007/2021-03-29/302516d86a6bee3fe25a1a7dd77799f740d2cfcc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1elZwGAZa9nD8zK2nvCx-E110gRcgs64s'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:15.134751Z', 'territory_id': '2802007'} 2023-11-28 02:31:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-30', 'edition_number': '489', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CD1AIC2hQq3YaLfussd9z-PYQW2KWyTh'], 'files': [{'checksum': 'afefe858a765cb35cd07d17cd4664719', 'path': '2802007/2021-03-30/6ad3dd4b6c8468ee020a325969e6391830ae2d40', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CD1AIC2hQq3YaLfussd9z-PYQW2KWyTh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:16.427140Z', 'territory_id': '2802007'} 2023-11-28 02:31:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-24', 'edition_number': '483', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1k3xw0nOejL1sB96Kbf0RB-GUUamGXr1o'], 'files': [{'checksum': '44fb251f9992dd53b90e17c7d6f88705', 'path': '2802007/2021-03-24/f61b5b7a7d356a876b9d696cc34e6f861d2f90b3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1k3xw0nOejL1sB96Kbf0RB-GUUamGXr1o'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:24:47.951153Z', 'territory_id': '2802007'} 2023-11-28 02:31:50 [scrapy.extensions.logstats] INFO: Crawled 486 pages (at 18 pages/min), scraped 484 items (at 18 items/min) 2023-11-28 02:31:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-25', 'edition_number': '460', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cGExWG7BkAyqssRfaUxEBCrNe-kRJPgU'], 'files': [{'checksum': '051a0c50e3194f4a22bff8cf42e815c1', 'path': '2802007/2021-02-25/42e6b528fa608240ceba6030bda21542d60e4dfd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cGExWG7BkAyqssRfaUxEBCrNe-kRJPgU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:13.903847Z', 'territory_id': '2802007'} 2023-11-28 02:31:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:31:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-24', 'edition_number': '458', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17TWh4IJQaQtNy6TJvqNbPuaGP1UyZE1l'], 'files': [{'checksum': '71ed1d1c32ffa41203316bff61511c9a', 'path': '2802007/2021-02-24/b57a8a54ab9ec0389ffd350ba8d925708f5e8f84', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17TWh4IJQaQtNy6TJvqNbPuaGP1UyZE1l'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:08.933538Z', 'territory_id': '2802007'} 2023-11-28 02:32:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-06', 'edition_number': '495', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pHHIQfZqBrabQsDJXYxa3aHRuZANB_QE'], 'files': [{'checksum': 'fd0631bcdc1caeb55e0142bdaf8158f5', 'path': '2802007/2021-04-06/517d5d2cf1873e78b3722ebdd02113645e97d2c1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pHHIQfZqBrabQsDJXYxa3aHRuZANB_QE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:37.159543Z', 'territory_id': '2802007'} 2023-11-28 02:32:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-04', 'edition_number': '493', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oi30Fq3TTwpkkkEpvVMP_dmtRGh1LqCs'], 'files': [{'checksum': 'f23d89960cc2b6f850cc492e1b1aaf52', 'path': '2802007/2021-04-04/af300abecff8d0b9493184dd37fe9d826f0012b3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oi30Fq3TTwpkkkEpvVMP_dmtRGh1LqCs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:31.341576Z', 'territory_id': '2802007'} 2023-11-28 02:32:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-01', 'edition_number': '492', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KwNM1pFDYgrUyFy5QFxqI_5mRMM-Oabk'], 'files': [{'checksum': '13263705eef6e8887985486d329be15a', 'path': '2802007/2021-04-01/9b459f12aa9c5cdc1a775611638e9279a1ad41c5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KwNM1pFDYgrUyFy5QFxqI_5mRMM-Oabk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:27.509767Z', 'territory_id': '2802007'} 2023-11-28 02:32:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-09', 'edition_number': '498', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VQvsynJ9i1Vk07LSt_iJ99-3cmyh4f7w'], 'files': [{'checksum': '470f63ee4e866925b71be99c0cdf5f11', 'path': '2802007/2021-04-09/2692f0575f00dbb6eab7c1d8382b4962e8dd49b3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VQvsynJ9i1Vk07LSt_iJ99-3cmyh4f7w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:03.755876Z', 'territory_id': '2802007'} 2023-11-28 02:32:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-10', 'edition_number': '499', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1o81PnyVaQgYVDP32V0ereTK-o7ZKJ5l3'], 'files': [{'checksum': 'fa9d5c1b53e682d502f44b9b1e75dd6c', 'path': '2802007/2021-04-10/3d88688945b6c510c2fc1d21180d4fba1da9eb17', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1o81PnyVaQgYVDP32V0ereTK-o7ZKJ5l3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:07.412784Z', 'territory_id': '2802007'} 2023-11-28 02:32:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:32:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-05', 'edition_number': '494', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YOGPAw6pkBuDGwJP6BIyz34mj2_rWpga'], 'files': [{'checksum': '61cd22981977c562d1bc032dd794fea4', 'path': '2802007/2021-04-05/ebd8e29838259360402c3a7e7eafb97883e446e2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YOGPAw6pkBuDGwJP6BIyz34mj2_rWpga'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:33.365536Z', 'territory_id': '2802007'} 2023-11-28 02:32:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-12', 'edition_number': '501', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1djs7SSTku2yFmwX9A188yDiXohoxAToy'], 'files': [{'checksum': 'a3a34398afe2b989f493155e3e87d268', 'path': '2802007/2021-04-12/3466a31c9a268c5fa422af56b153e0a6f40f6fe8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1djs7SSTku2yFmwX9A188yDiXohoxAToy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:16.583066Z', 'territory_id': '2802007'} 2023-11-28 02:32:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-07', 'edition_number': '497', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gaJPiCz2N-Ml53sEX76y2VxbIErbyZqx'], 'files': [{'checksum': 'fced87bcab3597742c5f5f85ed758282', 'path': '2802007/2021-04-07/533ab246a59b55e3d7842bd33c1912a75d289d1e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gaJPiCz2N-Ml53sEX76y2VxbIErbyZqx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:01.103809Z', 'territory_id': '2802007'} 2023-11-28 02:32:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-11', 'edition_number': '500', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mZwEcmWe2bESX6x9HeS7G_FXmwwqaBFI'], 'files': [{'checksum': '04e5cd63f321df1b7af5589f90b9627d', 'path': '2802007/2021-04-11/766f510b99056d3393e8eb5d0f5725c578fc2e06', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mZwEcmWe2bESX6x9HeS7G_FXmwwqaBFI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:11.385481Z', 'territory_id': '2802007'} 2023-11-28 02:32:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-13', 'edition_number': '503', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tyaU_dgWuyNapGFGM_8oHscw230Ab1Qr'], 'files': [{'checksum': 'ce4a98418b5be9269b2a430cee54df17', 'path': '2802007/2021-04-13/6d8469264ed39bba6ee6fe3312fa0ac9ab506845', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tyaU_dgWuyNapGFGM_8oHscw230Ab1Qr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:20.602125Z', 'territory_id': '2802007'} 2023-11-28 02:32:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:32:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-16', 'edition_number': '507', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1D73rSbzMbffBXB6s2uYCUKgIDEpqRNyg'], 'files': [{'checksum': '7151c3b715255ce02efbda630816d7a7', 'path': '2802007/2021-04-16/1e31b9132d083c1e8cc7024e01d1bc123641e1cf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1D73rSbzMbffBXB6s2uYCUKgIDEpqRNyg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:50.740202Z', 'territory_id': '2802007'} 2023-11-28 02:32:50 [scrapy.extensions.logstats] INFO: Crawled 499 pages (at 13 pages/min), scraped 497 items (at 13 items/min) 2023-11-28 02:33:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-15', 'edition_number': '506', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SY2Ues_Y4pA7vD_Aa5Y0Hu3uC_l8kifm'], 'files': [{'checksum': '247eae2359107380f886f3603f73811f', 'path': '2802007/2021-04-15/870a5f292820db2a098aac27dacd3e1b3826e6e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SY2Ues_Y4pA7vD_Aa5Y0Hu3uC_l8kifm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:36.040999Z', 'territory_id': '2802007'} 2023-11-28 02:33:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:33:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-15', 'edition_number': '505', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NFI8v-4CItwic1mytnNMMNUO8sgzdRbX'], 'files': [{'checksum': '46b75a09bbcc220b8213c6ce9ae33c15', 'path': '2802007/2021-04-15/2641f9576beac90447123239112789236eb19641', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NFI8v-4CItwic1mytnNMMNUO8sgzdRbX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:32.959864Z', 'territory_id': '2802007'} 2023-11-28 02:33:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-14', 'edition_number': '504', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w7cl1piJQFfAHIZmZbtpB0p89x-XCMBn'], 'files': [{'checksum': '2a8845fe24ef31481b643229bbcf9939', 'path': '2802007/2021-04-14/1539d399b1fb625f9d13598774c1c4bb6ef2b678', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w7cl1piJQFfAHIZmZbtpB0p89x-XCMBn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:29.522367Z', 'territory_id': '2802007'} 2023-11-28 02:33:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-17', 'edition_number': '508', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dsBZphzAYuV-voO_BksqiLYnsYlVB699'], 'files': [{'checksum': '8f8f45e288bd0aa61190470f52fa1328', 'path': '2802007/2021-04-17/bff0a4cbfcc71059b9fe2dc6b97014ea49c628c3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dsBZphzAYuV-voO_BksqiLYnsYlVB699'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:53.138240Z', 'territory_id': '2802007'} 2023-11-28 02:33:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-21', 'edition_number': '511', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EstgCqAIMS05VLK6Ii5O64CA4BZTLTBv'], 'files': [{'checksum': '05f610419ce24d62b15f1c052b15dd4b', 'path': '2802007/2021-04-21/4d2ac1c763faae5cf4e10422481c96153029aaa3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EstgCqAIMS05VLK6Ii5O64CA4BZTLTBv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:03.691673Z', 'territory_id': '2802007'} 2023-11-28 02:33:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-24', 'edition_number': '514', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_5ELt4S8R_oXjXewRIZ7P1q6EjQiOy_z'], 'files': [{'checksum': 'c04aac7f2950e40cefa8b3f9d3d0d188', 'path': '2802007/2021-04-24/058b7cc0699a3c967f2cb73bebdc42df67e67040', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_5ELt4S8R_oXjXewRIZ7P1q6EjQiOy_z'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:12.085982Z', 'territory_id': '2802007'} 2023-11-28 02:33:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-23', 'edition_number': '513', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1x5_dSKXUr8CafioxQ93F3fL15wSRUzMP'], 'files': [{'checksum': '346650cf56254e2080f9ba277300d785', 'path': '2802007/2021-04-23/a581cf11436b5dd818e1835594324e952f26c5ff', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1x5_dSKXUr8CafioxQ93F3fL15wSRUzMP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:09.915153Z', 'territory_id': '2802007'} 2023-11-28 02:33:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-26', 'edition_number': '515', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dL4rokCKKsWGTLf_NOqv5H5NwIKR133Z'], 'files': [{'checksum': '74beaeebe6748b298bdf3cdf15dc58ca', 'path': '2802007/2021-04-26/2637bfddb9b38453b5fa08d8075ac5af2124fd40', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dL4rokCKKsWGTLf_NOqv5H5NwIKR133Z'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:14.517090Z', 'territory_id': '2802007'} 2023-11-28 02:33:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-27', 'edition_number': '516', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gchcn73CUolvWYAn8wgfq-Xyba8qyCTi'], 'files': [{'checksum': '9a93a0f27dc5b7f99bf0671196e9892e', 'path': '2802007/2021-04-27/3a24f043a33024ccb1ff0ae46912bc3423c07897', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gchcn73CUolvWYAn8wgfq-Xyba8qyCTi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:18.243674Z', 'territory_id': '2802007'} 2023-11-28 02:33:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:33:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-28', 'edition_number': '517', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nNeOxaZtIKw5KBbvN8ukcOs2UpGK0Zb0'], 'files': [{'checksum': '1d547ae9d6718786594bf229ec68b645', 'path': '2802007/2021-04-28/e5dd92581a008625fe4eb6ce93bb8db494ab3640', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nNeOxaZtIKw5KBbvN8ukcOs2UpGK0Zb0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:21.190815Z', 'territory_id': '2802007'} 2023-11-28 02:33:50 [scrapy.extensions.logstats] INFO: Crawled 509 pages (at 10 pages/min), scraped 507 items (at 10 items/min) 2023-11-28 02:34:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-29', 'edition_number': '518', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_MrnfCBcfhuCSK_we2XRfBxQ6mxAlEad'], 'files': [{'checksum': '6a866892ed36701dd307bec72ed017bc', 'path': '2802007/2021-04-29/a34125251f6b0a6c16efdadf414b56f4e73eb628', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_MrnfCBcfhuCSK_we2XRfBxQ6mxAlEad'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:24.278359Z', 'territory_id': '2802007'} 2023-11-28 02:34:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-22', 'edition_number': '512', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fe3fmjsopby5ysiAOboaPUnCJQr84mcS'], 'files': [{'checksum': 'c92cdda8e0621c3e37c08ca5a3670a6f', 'path': '2802007/2021-04-22/ffb04cc59e12c214c94397ca626249824646b6d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fe3fmjsopby5ysiAOboaPUnCJQr84mcS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:06.912420Z', 'territory_id': '2802007'} 2023-11-28 02:34:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-30', 'edition_number': '519', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NbgzYiXS2iG1oa9rlLAaniDDaRTwQ8Ta'], 'files': [{'checksum': '3dbb447e4e788665555c709f5a3af61b', 'path': '2802007/2021-04-30/237967311ce74dd4d62500b4996ba8367dfd5f77', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NbgzYiXS2iG1oa9rlLAaniDDaRTwQ8Ta'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:28.532358Z', 'territory_id': '2802007'} 2023-11-28 02:34:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-04', 'edition_number': '377', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16CFr4-jA60rgrKrzWXCJeEn-VDL-4bYv'], 'files': [{'checksum': '1d8ee078fe26be0edf6634d95fcc4587', 'path': '2802007/2020-11-04/51878bd5e97ca6ea99f516fb472733371fa9e219', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16CFr4-jA60rgrKrzWXCJeEn-VDL-4bYv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:09.151912Z', 'territory_id': '2802007'} 2023-11-28 02:34:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-02', 'edition_number': '521', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BTBzlirBVPvKuY2rtZhHEnMihu0lEgGj'], 'files': [{'checksum': '0b9c8e7edb23aad023f27ee802b46f0e', 'path': '2802007/2021-05-02/b59b7ff7024b27737b89ab401518e9ca0b3e0999', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BTBzlirBVPvKuY2rtZhHEnMihu0lEgGj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:37.163035Z', 'territory_id': '2802007'} 2023-11-28 02:34:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-20', 'edition_number': '510', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZozuKrhbUgQBVyUcCtmk5-2udcv3RAXl'], 'files': [{'checksum': 'aa1c984a7a6cb5fa64733da085ca5297', 'path': '2802007/2021-04-20/07bc5c381e4f5a432ec8282c6e2b16552393d7fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZozuKrhbUgQBVyUcCtmk5-2udcv3RAXl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:01.577226Z', 'territory_id': '2802007'} 2023-11-28 02:34:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-19', 'edition_number': '509', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ePWHOT52CptYwOvjAUdQ3ZSImgMQo2av'], 'files': [{'checksum': 'f5a153c01b7371ffb8c9eedcc3b7cb2c', 'path': '2802007/2021-04-19/d96da0775fb43eccbc6fd7fcfd56c68fedc85874', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ePWHOT52CptYwOvjAUdQ3ZSImgMQo2av'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:55.548837Z', 'territory_id': '2802007'} 2023-11-28 02:34:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2020-11-05', 'edition_number': '378', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UvCZNmOXfSl-GBo85uB_rG2l7HYhDFpX'], 'files': [{'checksum': 'e7bb3d02610dd7b44d5275f10bd3fe6d', 'path': '2802007/2020-11-05/c0c23f07a04b4693c1c538b1ba343747d6989289', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UvCZNmOXfSl-GBo85uB_rG2l7HYhDFpX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:18:11.541482Z', 'territory_id': '2802007'} 2023-11-28 02:34:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-05', 'edition_number': '524', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14MNU1RIQQ4W4NbfCGf4arIoLOGGfIXTZ'], 'files': [{'checksum': '9bbd6b840744fa1544617a8f00336c16', 'path': '2802007/2021-05-05/463257756423458ce9a084aba5b5aa2a070de0b6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14MNU1RIQQ4W4NbfCGf4arIoLOGGfIXTZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:46.267889Z', 'territory_id': '2802007'} 2023-11-28 02:34:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-04', 'edition_number': '523', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L4pjZEpdOqx1lFm3nMW2CDyJTcZXLY9u'], 'files': [{'checksum': '59e5aa23ec41ed449dcae1cf8233c2d9', 'path': '2802007/2021-05-04/256665533b715d9c4c5ae4c5cf17b080930d56f9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L4pjZEpdOqx1lFm3nMW2CDyJTcZXLY9u'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:42.585359Z', 'territory_id': '2802007'} 2023-11-28 02:34:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-05', 'edition_number': '525', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qbcHWhHorotvwfFIQXNWt9ovpDHYIYbq'], 'files': [{'checksum': 'be666bbcc87690df9b92505262423fd7', 'path': '2802007/2021-05-05/6067332518282f517b99e058d258e6596635c5dd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qbcHWhHorotvwfFIQXNWt9ovpDHYIYbq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:49.809641Z', 'territory_id': '2802007'} 2023-11-28 02:34:50 [scrapy.extensions.logstats] INFO: Crawled 520 pages (at 11 pages/min), scraped 518 items (at 11 items/min) 2023-11-28 02:34:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-03', 'edition_number': '522', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ufOUPMGjljJ0eE9nx2S-pA8i1Q11H3DM'], 'files': [{'checksum': 'cc96220cdaa129cde5dd65d620bfaedd', 'path': '2802007/2021-05-03/2f70422bc08e03486cad37ef38786cc8f1b92b21', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ufOUPMGjljJ0eE9nx2S-pA8i1Q11H3DM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:39.411896Z', 'territory_id': '2802007'} 2023-11-28 02:34:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-01', 'edition_number': '520', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1V4sOvdCYvM1okpd2Y5PD044WAu5v_3uw'], 'files': [{'checksum': '8c718b22e8ccf2356d6353d8d9364ae0', 'path': '2802007/2021-05-01/16435aff85e59264c22ca5faa16986434ec97d9d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1V4sOvdCYvM1okpd2Y5PD044WAu5v_3uw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:33.964833Z', 'territory_id': '2802007'} 2023-11-28 02:34:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:34:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-08', 'edition_number': '528', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EGOA1DkUPBrCPSm5McNXylcgHBp_QnRD'], 'files': [{'checksum': '26c4cf46002fcfbe67a9cc5238f67318', 'path': '2802007/2021-05-08/7ce4718275b4da8fefb5343f0aee94452f9d9101', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EGOA1DkUPBrCPSm5McNXylcgHBp_QnRD'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:04.208714Z', 'territory_id': '2802007'} 2023-11-28 02:35:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-08', 'edition_number': '527', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xy6cYd6dXVa0ywQwGJuaOlq0AFOvJmQ_'], 'files': [{'checksum': 'f4999890d1562a4fda31df125547bbaf', 'path': '2802007/2021-05-08/03d0f06003ed96209b5f7760582d159129391d70', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xy6cYd6dXVa0ywQwGJuaOlq0AFOvJmQ_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:01.194380Z', 'territory_id': '2802007'} 2023-11-28 02:35:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-12', 'edition_number': '531', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15__i51-xIlB20Aa01K6KaDXfQRH28DOz'], 'files': [{'checksum': 'e4d5b28e30e170fb00d4d87a1ac66de9', 'path': '2802007/2021-05-12/8b9ed3f91c423ac7181a16b9c25853664e23055e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15__i51-xIlB20Aa01K6KaDXfQRH28DOz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:20.451433Z', 'territory_id': '2802007'} 2023-11-28 02:35:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-13', 'edition_number': '533', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FZd9daYdoTVr6AfKjuEJdekjYUVLorh3'], 'files': [{'checksum': '496a838266e2f7720536faa960ec597d', 'path': '2802007/2021-05-13/3c2a2426c91fbfd8bfe273f218869dbc88065436', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FZd9daYdoTVr6AfKjuEJdekjYUVLorh3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:29.922898Z', 'territory_id': '2802007'} 2023-11-28 02:35:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-10', 'edition_number': '529', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KucgmgT9MvhjFGO5pUfMbyZEAEeD4jb3'], 'files': [{'checksum': '565edab65ed883cbde43f2845903bd66', 'path': '2802007/2021-05-10/aa5d8dbb8db1d7684f48ef21d41755b2a5ba8957', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KucgmgT9MvhjFGO5pUfMbyZEAEeD4jb3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:09.802119Z', 'territory_id': '2802007'} 2023-11-28 02:35:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-14', 'edition_number': '534', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ddXOp2olOrKnpcClxVriou_n8tmmuZ0w'], 'files': [{'checksum': '475c16d1e66cd28901381875a4e52a97', 'path': '2802007/2021-05-14/09ffc315509d6eec38c323c71f2fe6cf4b9d4a95', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ddXOp2olOrKnpcClxVriou_n8tmmuZ0w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:32.842011Z', 'territory_id': '2802007'} 2023-11-28 02:35:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-15', 'edition_number': '535', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zpXe7ueEqdRwYDXLUrzzQMeIBYQuB_YJ'], 'files': [{'checksum': '224af1d85125aeb3e88239a7acc14a96', 'path': '2802007/2021-05-15/a7e208721338c7e39dd4e46017a70bb4f70bcf8f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zpXe7ueEqdRwYDXLUrzzQMeIBYQuB_YJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:34.656828Z', 'territory_id': '2802007'} 2023-11-28 02:35:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-06', 'edition_number': '526', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RPE0KJ-EDrXHAvQdkJ_r46eb06cFxfqG'], 'files': [{'checksum': '11fb3356f179402779b0d6fd2e13305e', 'path': '2802007/2021-05-06/7aabec11e2b4f54b08bfd4b9dff22b61bc38eb66', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RPE0KJ-EDrXHAvQdkJ_r46eb06cFxfqG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:27:59.273672Z', 'territory_id': '2802007'} 2023-11-28 02:35:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-13', 'edition_number': '532', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YjObX19i2g-MzULe6xUZJOdTEa6Je1ML'], 'files': [{'checksum': '4c6ce4318c41884418f2454725473398', 'path': '2802007/2021-05-13/0e671e69fad0037f0bda431ebf32e1750f41f2b8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YjObX19i2g-MzULe6xUZJOdTEa6Je1ML'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:27.803489Z', 'territory_id': '2802007'} 2023-11-28 02:35:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-19', 'edition_number': '538', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CIErb_biwcFWSf4Qy6jNq9ZI4fgCDmE6'], 'files': [{'checksum': 'b7cc6900760377dc81ff5be6549ee808', 'path': '2802007/2021-05-19/8af1f363ffb40886d37e59ec0c35cd5f46abf5bf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CIErb_biwcFWSf4Qy6jNq9ZI4fgCDmE6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:46.432659Z', 'territory_id': '2802007'} 2023-11-28 02:35:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-11', 'edition_number': '530', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17-sm6KKdgpF1Hg3ZI7_WYqiYtjn5UMS9'], 'files': [{'checksum': '46dd59854e6080a2c6e71a71a18d3cfc', 'path': '2802007/2021-05-11/656291c87370ecaa617ede5b9060aed805e26d55', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17-sm6KKdgpF1Hg3ZI7_WYqiYtjn5UMS9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:15.270532Z', 'territory_id': '2802007'} 2023-11-28 02:35:31 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:35:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-20', 'edition_number': '539', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iB7nH6shpkv9UJEa9vyWLNMkK1mZYqQh'], 'files': [{'checksum': '5f9458986ca57815fbf12153f1c7dad2', 'path': '2802007/2021-05-20/8cdcd5ba6bf38c2d3f1f4a074e35bd5b2b46bf5b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iB7nH6shpkv9UJEa9vyWLNMkK1mZYqQh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:55.798649Z', 'territory_id': '2802007'} 2023-11-28 02:35:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-22', 'edition_number': '542', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VfTsUkb_J5c7J1AogkymFQnRPhod-pV0'], 'files': [{'checksum': '08c0edc410592cc3a77218e343a5626a', 'path': '2802007/2021-05-22/6ddb6592a5b3b5017501e0f897c1ef2f60b58197', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VfTsUkb_J5c7J1AogkymFQnRPhod-pV0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:06.576229Z', 'territory_id': '2802007'} 2023-11-28 02:35:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-21', 'edition_number': '541', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IJhmBO_NEb6IBb4UxRPEMcT1RBltW8Od'], 'files': [{'checksum': 'f2c939b415c719e348ed983e98818bc5', 'path': '2802007/2021-05-21/887b30d4389e92799f58c25699573b9f66703a5d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IJhmBO_NEb6IBb4UxRPEMcT1RBltW8Od'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:00.602430Z', 'territory_id': '2802007'} 2023-11-28 02:35:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-20', 'edition_number': '540', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vF5l896KcS7466g1MMIgyx0OwTXyqyb3'], 'files': [{'checksum': '07800af6b758156336c2313878fecc2a', 'path': '2802007/2021-05-20/3a08417a919cb3a0954ba028b714d21a678bf6d5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vF5l896KcS7466g1MMIgyx0OwTXyqyb3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:57.429779Z', 'territory_id': '2802007'} 2023-11-28 02:35:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-25', 'edition_number': '545', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19a5iQZncuAjpJKHyFf1fJhmf8m3MDkfu'], 'files': [{'checksum': '13595c2d3d53d5ed3c86cf3ca1d73fea', 'path': '2802007/2021-05-25/226f6caec6fa12412d3c6736c8d986bf29da86b7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19a5iQZncuAjpJKHyFf1fJhmf8m3MDkfu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:17.402012Z', 'territory_id': '2802007'} 2023-11-28 02:35:47 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:35:50 [scrapy.extensions.logstats] INFO: Crawled 538 pages (at 18 pages/min), scraped 536 items (at 18 items/min) 2023-11-28 02:35:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-27', 'edition_number': '547', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b55A50aZtCUMYQD0wiMAUeIBeIhidLIE'], 'files': [{'checksum': '8cfda2fd6c74bfecd4d9d54040b1ee29', 'path': '2802007/2021-05-27/68a4b6ef50a233b58d9180287704374aa6b2eeca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b55A50aZtCUMYQD0wiMAUeIBeIhidLIE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:21.730762Z', 'territory_id': '2802007'} 2023-11-28 02:35:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-26', 'edition_number': '546', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L7KGcJ49C3SIZRaLGtbPsXWH_CzBZ3m6'], 'files': [{'checksum': 'b751112e11a39f3593ee6765e1f7de9c', 'path': '2802007/2021-05-26/9456de4ddd86545a1753317732de562367e7e62b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L7KGcJ49C3SIZRaLGtbPsXWH_CzBZ3m6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:19.292896Z', 'territory_id': '2802007'} 2023-11-28 02:35:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:35:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-28', 'edition_number': '548', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1E23ltBIb6HhwOj95RW0ZL68ztZz7b4CC'], 'files': [{'checksum': '1aa0ac59bf675433b0ef705e6fcaf0d5', 'path': '2802007/2021-05-28/37a04bcfa10a906606fa3939d4b5a9f2683386a5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1E23ltBIb6HhwOj95RW0ZL68ztZz7b4CC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:24.594822Z', 'territory_id': '2802007'} 2023-11-28 02:36:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-30', 'edition_number': '550', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L3JMejAXjehZ1UtOcv7aR6YnffWmEFNK'], 'files': [{'checksum': '80157606a56048526e8fc9abcf6b1dbf', 'path': '2802007/2021-05-30/1ca393dcf5744bf20def4c74b8ab94183019db88', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L3JMejAXjehZ1UtOcv7aR6YnffWmEFNK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:31.943314Z', 'territory_id': '2802007'} 2023-11-28 02:36:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-31', 'edition_number': '551', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1j8aiwmYgyynoRK8Bta_Tx5oK8hGTNO4S'], 'files': [{'checksum': '41470802f718fe74b9b284ca13fee938', 'path': '2802007/2021-05-31/624ff08bae1d7e26364c88987c5e20b5e408b8e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1j8aiwmYgyynoRK8Bta_Tx5oK8hGTNO4S'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:34.083841Z', 'territory_id': '2802007'} 2023-11-28 02:36:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-29', 'edition_number': '549', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DJT2jEP-hsHbP_Rvshbs1xQ2dUi3HnTh'], 'files': [{'checksum': '34a81098afeb6ce35a717840ec732464', 'path': '2802007/2021-05-29/82b947c68da55b3a8086812ebefe4fe599cc199a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DJT2jEP-hsHbP_Rvshbs1xQ2dUi3HnTh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:29.271059Z', 'territory_id': '2802007'} 2023-11-28 02:36:17 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:36:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-01', 'edition_number': '553', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10z0KJujbH079gC94g6nWcRSyT-jnK7Rj'], 'files': [{'checksum': '8a20661bd2fa589b70f0e2aabe994977', 'path': '2802007/2021-06-01/bc9cd5b0e3cee0d7cd11af5f7066d7283258ca25', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10z0KJujbH079gC94g6nWcRSyT-jnK7Rj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:39.025724Z', 'territory_id': '2802007'} 2023-11-28 02:36:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-01', 'edition_number': '552', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1v03GZuAmuLNgMInVzFRJVkloxIAdtIhA'], 'files': [{'checksum': '57e29505d76194f1b619651e9e65b64e', 'path': '2802007/2021-06-01/d21a1153f1a791c7655d34c8fbf8c246dbe202b0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1v03GZuAmuLNgMInVzFRJVkloxIAdtIhA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:36.673036Z', 'territory_id': '2802007'} 2023-11-28 02:36:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-02', 'edition_number': '554', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PkJf1qUrHnqWpeW7x2FFtm6YNvE-1n4x'], 'files': [{'checksum': '8698f2fa5ab0408285fdaf270affc6e3', 'path': '2802007/2021-06-02/dee0a83be28210f07d066316c1a22562861f1249', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PkJf1qUrHnqWpeW7x2FFtm6YNvE-1n4x'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:41.807153Z', 'territory_id': '2802007'} 2023-11-28 02:36:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-07', 'edition_number': '558', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MBRvdvu6Ye4bnLHrl3PSfZ_Jg9aswfSJ'], 'files': [{'checksum': 'ee994e496bb3775676f369b7ebb2d961', 'path': '2802007/2021-06-07/aa50efd27b1f5ef91c5a354f56c557f6c7b16cbf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MBRvdvu6Ye4bnLHrl3PSfZ_Jg9aswfSJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:03.520006Z', 'territory_id': '2802007'} 2023-11-28 02:36:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-05', 'edition_number': '557', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fBc1iUqLAWUy0aMa-3wihMaAG-GCh0HK'], 'files': [{'checksum': '573687fea56b5b428ff62ed15fb4f54c', 'path': '2802007/2021-06-05/f913f1eb5706e215c706749a28410fb2dbf81089', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fBc1iUqLAWUy0aMa-3wihMaAG-GCh0HK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:57.519565Z', 'territory_id': '2802007'} 2023-11-28 02:36:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-08', 'edition_number': '559', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1laydtoRWzupeU0S-bWp-XOH6aYt1jWP5'], 'files': [{'checksum': '562cb36ebedc27b085579b77d0235d6e', 'path': '2802007/2021-06-08/f8215d7a2265dd1389259c7286596086291182fc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1laydtoRWzupeU0S-bWp-XOH6aYt1jWP5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:05.402390Z', 'territory_id': '2802007'} 2023-11-28 02:36:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-09', 'edition_number': '560', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-8fxBsoRBvw78ljiizKo1yReKWZG0rIv'], 'files': [{'checksum': 'ccbcf089c6947eb3e692dce3a263d5f1', 'path': '2802007/2021-06-09/169f7acaa4cd831f8557dd16ca11b376c6eb4746', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-8fxBsoRBvw78ljiizKo1yReKWZG0rIv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:10.690650Z', 'territory_id': '2802007'} 2023-11-28 02:36:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-04', 'edition_number': '556', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=164J6wuclaoOPobEkhxTXpZxJfhZTZhOZ'], 'files': [{'checksum': '1808f60df50e45b26a49591473e09abc', 'path': '2802007/2021-06-04/788cfe5e182f9fb0c10c9f93686d8a32612bc4fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=164J6wuclaoOPobEkhxTXpZxJfhZTZhOZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:47.564998Z', 'territory_id': '2802007'} 2023-11-28 02:36:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-03', 'edition_number': '555', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=188MWuzTLQgFz7e8JiuWqP5ChOuP04YWd'], 'files': [{'checksum': '5a6fa10ca7ebb26f195ead748cf61f49', 'path': '2802007/2021-06-03/1dec497ec288076102853e4fed0b5cf9a5565bf6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=188MWuzTLQgFz7e8JiuWqP5ChOuP04YWd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:43.952895Z', 'territory_id': '2802007'} 2023-11-28 02:36:50 [scrapy.extensions.logstats] INFO: Crawled 553 pages (at 15 pages/min), scraped 551 items (at 15 items/min) 2023-11-28 02:36:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:36:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-25', 'edition_number': '544', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GUivmYwGL-OeAZB0QL5sj7laZsz96dq_'], 'files': [{'checksum': 'acac1a82ea98acef77b8203167af91d6', 'path': '2802007/2021-05-25/9602e0fd17ae5b71b62ac8452fc3cfc6566307b6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GUivmYwGL-OeAZB0QL5sj7laZsz96dq_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:15.352206Z', 'territory_id': '2802007'} 2023-11-28 02:37:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-11', 'edition_number': '564', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VFa17jmOS97QcJ1QR6KrNf8Z7SeDn4BR'], 'files': [{'checksum': 'cef2ac49b9b370fea5b31c56d7a8cfad', 'path': '2802007/2021-06-11/7281fac7e3d24c00effbe7978e6281734e0b23d4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VFa17jmOS97QcJ1QR6KrNf8Z7SeDn4BR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:43.511582Z', 'territory_id': '2802007'} 2023-11-28 02:37:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-12', 'edition_number': '565', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a96xaTrE_NWLMnpv4kyI-bRtNAawhWrw'], 'files': [{'checksum': '96b5e1921cce3857c155a4c962df5d2c', 'path': '2802007/2021-06-12/d41649d9a89328552587c1b06c3d774952f4408f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a96xaTrE_NWLMnpv4kyI-bRtNAawhWrw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:46.081283Z', 'territory_id': '2802007'} 2023-11-28 02:37:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-11', 'edition_number': '563', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gdp9szZnQ6pWpKCIYW0_LWooVHB4c0Y3'], 'files': [{'checksum': '7fa4c16b18ee107422a2b396f876fce9', 'path': '2802007/2021-06-11/5544b5e11feee56fd610364fc1964c03e47f80af', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gdp9szZnQ6pWpKCIYW0_LWooVHB4c0Y3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:21.233102Z', 'territory_id': '2802007'} 2023-11-28 02:37:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-09', 'edition_number': '561', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zd6TmknH4PGry0PGQN3RdbryaAizM_fj'], 'files': [{'checksum': '678ebb112e0280ac67b03350f94fb4fc', 'path': '2802007/2021-06-09/2c6d9dc3707fe990456b7a04bd61cf4a8826b4c4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zd6TmknH4PGry0PGQN3RdbryaAizM_fj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:12.728529Z', 'territory_id': '2802007'} 2023-11-28 02:37:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-13', 'edition_number': '566', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KnCKgPpGIAmSRQf8BuswBd5ICNfiO5al'], 'files': [{'checksum': '8b70d60f83aa25a4776c4c77dfcf1b1c', 'path': '2802007/2021-06-13/c41731ff2383e5dffcc0c7b3606f571d8181795d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KnCKgPpGIAmSRQf8BuswBd5ICNfiO5al'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:48.203455Z', 'territory_id': '2802007'} 2023-11-28 02:37:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-15', 'edition_number': '568', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dO2Z51KaI9x9WaQ5qZQ-7vw0jhAwOwqr'], 'files': [{'checksum': '13b95bfc57c0a12ea88480b643915c6d', 'path': '2802007/2021-06-15/148b8ce8c2c35088f9a0c7f14577a1f2c731c95d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dO2Z51KaI9x9WaQ5qZQ-7vw0jhAwOwqr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:55.168624Z', 'territory_id': '2802007'} 2023-11-28 02:37:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-16', 'edition_number': '569', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Rfa1dFqvcXqbHOKtQZHIGZEs7lGUSoZ'], 'files': [{'checksum': '4d9d40164acf8dd0588c70a8234f9e44', 'path': '2802007/2021-06-16/2381a6a247712b293e3ce684bb0c758a1c03b525', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Rfa1dFqvcXqbHOKtQZHIGZEs7lGUSoZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:57.368925Z', 'territory_id': '2802007'} 2023-11-28 02:37:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-17', 'edition_number': '571', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18RAWg1LzO7lkeP3VI9a_a9edS7QPKDkp'], 'files': [{'checksum': 'e1de02ff72858bb1320af232c30bbc66', 'path': '2802007/2021-06-17/2dd2f7ef0eae923cba473a7c644fcb43b5b4f862', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18RAWg1LzO7lkeP3VI9a_a9edS7QPKDkp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:04.453081Z', 'territory_id': '2802007'} 2023-11-28 02:37:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-17', 'edition_number': '572', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AtBTCX1_iLr5yjuHxA7Dg4N7VzzOjA1y'], 'files': [{'checksum': 'a134f978cf5ec836b7cd4a1dfa623f83', 'path': '2802007/2021-06-17/5722e978dde1f355ebeff3fdd0884030845d35a9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AtBTCX1_iLr5yjuHxA7Dg4N7VzzOjA1y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:08.143354Z', 'territory_id': '2802007'} 2023-11-28 02:37:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-14', 'edition_number': '567', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VcQHI3Sh9j2LdMjw6qqYLyVUga4rBLn-'], 'files': [{'checksum': 'b009b6323f705a733a615a7b5056c020', 'path': '2802007/2021-06-14/07b10f3d653f402de4d6fcd74058dbaeab82aec7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VcQHI3Sh9j2LdMjw6qqYLyVUga4rBLn-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:50.680120Z', 'territory_id': '2802007'} 2023-11-28 02:37:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-22', 'edition_number': '575', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EOtUol2vXRDlcoXzzRLuyXdp5ygCc02w'], 'files': [{'checksum': '9aed82687e9feb9044a4e74d1d0a7d93', 'path': '2802007/2021-06-22/eebfee306517f5c7acdda256869b3f7a96a15157', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EOtUol2vXRDlcoXzzRLuyXdp5ygCc02w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:18.041852Z', 'territory_id': '2802007'} 2023-11-28 02:37:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-10', 'edition_number': '562', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10-HwE9dsA8fMd_Ze2R2c_1pB15fW7UMu'], 'files': [{'checksum': '7c5f0a01898130c0870a458591e846c0', 'path': '2802007/2021-06-10/84decd7b2ea14ef4624ae7daa6e3cf358f34a43c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10-HwE9dsA8fMd_Ze2R2c_1pB15fW7UMu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:30:18.647770Z', 'territory_id': '2802007'} 2023-11-28 02:37:50 [scrapy.extensions.logstats] INFO: Crawled 566 pages (at 13 pages/min), scraped 564 items (at 13 items/min) 2023-11-28 02:37:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-24', 'edition_number': '543', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ILJi-PBA28uQJqTgbcJmrucWfq8D14GX'], 'files': [{'checksum': '053a1a20882cec05f34b684d7cac92a0', 'path': '2802007/2021-05-24/7ce0964d9622c3305d93afdb2f37f7705be49c31', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ILJi-PBA28uQJqTgbcJmrucWfq8D14GX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:29:08.097553Z', 'territory_id': '2802007'} 2023-11-28 02:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-28', 'edition_number': '577', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1P41Jb5LcW80nZKzqbIzzBCrYdMXduS5N'], 'files': [{'checksum': '894dbae6d7816b1212ae1b8575851de8', 'path': '2802007/2021-06-28/fa7b7dffd650d447e8aca790c0fb5f9ce7383809', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1P41Jb5LcW80nZKzqbIzzBCrYdMXduS5N'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:26.432733Z', 'territory_id': '2802007'} 2023-11-28 02:37:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:37:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-23', 'edition_number': '576', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zU2wig05DLmTfGkeIds9rVEzvWWvKO1X'], 'files': [{'checksum': '3e6c83d0ccf73fdc2aee339027fc2780', 'path': '2802007/2021-06-23/c62477b1e1746a1f583a534944f5ea9aa2aef85e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zU2wig05DLmTfGkeIds9rVEzvWWvKO1X'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:23.831056Z', 'territory_id': '2802007'} 2023-11-28 02:38:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-21', 'edition_number': '574', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nkuDbWtMKctnq6OkSKjgN4uy043lWnmt'], 'files': [{'checksum': 'd04fde483b0a707342f3d36819bf6027', 'path': '2802007/2021-06-21/d3f549ffbdf41239e2770f08b73d4cc30ef1c6f2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nkuDbWtMKctnq6OkSKjgN4uy043lWnmt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:14.829338Z', 'territory_id': '2802007'} 2023-11-28 02:38:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-02', 'edition_number': '580', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=137gwbS-AfH5mgzKDdOxxXDk_TfvG0f-t'], 'files': [{'checksum': '2d815eba29d902bee5257d6984112f87', 'path': '2802007/2021-07-02/f2ac70ce55e0aa4df6f5041f6263f5604c20a0d8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=137gwbS-AfH5mgzKDdOxxXDk_TfvG0f-t'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:38.142229Z', 'territory_id': '2802007'} 2023-11-28 02:38:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-05', 'edition_number': '581', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nFpDuP5hmMtnXM0W17Uiy505FrjdqEcF'], 'files': [{'checksum': '16ff10bd2e664d9da493362645da8bc1', 'path': '2802007/2021-07-05/f9f21be89ba1eccf7fb1730803cd9e2210ff0598', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nFpDuP5hmMtnXM0W17Uiy505FrjdqEcF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:41.893973Z', 'territory_id': '2802007'} 2023-11-28 02:38:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-06', 'edition_number': '582', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19r41IUAzleiMrGbFbtPwFCtgrXxKIVY_'], 'files': [{'checksum': '14089ffb39a0efb98d8d8062d6261fac', 'path': '2802007/2021-07-06/736d2bca5c0d6e21c6956ade7010cf862e4e09ce', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19r41IUAzleiMrGbFbtPwFCtgrXxKIVY_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:44.365544Z', 'territory_id': '2802007'} 2023-11-28 02:38:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-07', 'edition_number': '583', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15RnTOI_AJaPEbflrd3y3PEXCeHOwjaYx'], 'files': [{'checksum': 'f019e05a5f51d4ada5904207f48751f3', 'path': '2802007/2021-07-07/91e7b85cb7c9ef2e40bfcdb78bb9d3f1e13e58c0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15RnTOI_AJaPEbflrd3y3PEXCeHOwjaYx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:46.909173Z', 'territory_id': '2802007'} 2023-11-28 02:38:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-01', 'edition_number': '579', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=151Uvrs-iM07QQ0eQhH1uwZ2dDxmPI1to'], 'files': [{'checksum': '304b9fe4d481ae36b14a0d809957fa8f', 'path': '2802007/2021-07-01/49cfe461be2f6f0fa4195e3c4a83e6847b258843', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=151Uvrs-iM07QQ0eQhH1uwZ2dDxmPI1to'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:34.837535Z', 'territory_id': '2802007'} 2023-11-28 02:38:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-08', 'edition_number': '584', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LALHnBRN-_3BTKL6-OHEsiYKsrX_EZ1U'], 'files': [{'checksum': '03b49ddb8ede003561de84bd3c5baec8', 'path': '2802007/2021-07-08/fc4b26ba872f85316c0f3d384454ccadd038f1bb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LALHnBRN-_3BTKL6-OHEsiYKsrX_EZ1U'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:49.527096Z', 'territory_id': '2802007'} 2023-11-28 02:38:50 [scrapy.extensions.logstats] INFO: Crawled 576 pages (at 10 pages/min), scraped 574 items (at 10 items/min) 2023-11-28 02:38:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:38:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-12', 'edition_number': '586', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xtnoufBYr9aE--qHmqE3yb6FlKlczgbA'], 'files': [{'checksum': '9f728786d06b08501d571ffb1acb1138', 'path': '2802007/2021-07-12/dac616d55aad4cb98b8cc266b18f98bc76794c84', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xtnoufBYr9aE--qHmqE3yb6FlKlczgbA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:57.793941Z', 'territory_id': '2802007'} 2023-11-28 02:39:01 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:39:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:39:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-09', 'edition_number': '585', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bwSwvhrr9x6qqd_dbS0I-rQYSX8nQism'], 'files': [{'checksum': '137d2195382c418cc10c87b17ca45a3d', 'path': '2802007/2021-07-09/53404c24d5a4781e9c12d17dca730c01f5fe2ab5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bwSwvhrr9x6qqd_dbS0I-rQYSX8nQism'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:54.365874Z', 'territory_id': '2802007'} 2023-11-28 02:39:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-15', 'edition_number': '590', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PssuTUSKb0fv3NMVZsNfqemJMtlPSgIG'], 'files': [{'checksum': 'e47b7fc6d0801ae78407d49ea7fffe9a', 'path': '2802007/2021-07-15/ebd59083a6ab163ddc6a1164e7f3b26997e1d20d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PssuTUSKb0fv3NMVZsNfqemJMtlPSgIG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:20.638883Z', 'territory_id': '2802007'} 2023-11-28 02:39:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-15', 'edition_number': '591', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A6URb8OZ1Ib4WzO_nNItFL7IMx54Sqk4'], 'files': [{'checksum': '9ebe6b9a9f648b408bb1fea45cf42889', 'path': '2802007/2021-07-15/535814dd19394a8709f5cc511a7bd55045494f9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A6URb8OZ1Ib4WzO_nNItFL7IMx54Sqk4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:27.137953Z', 'territory_id': '2802007'} 2023-11-28 02:39:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-10', 'edition_number': '448', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Sg85ueyYssqIxsO17LiwbxMsXYHONi4c'], 'files': [{'checksum': '4eb5b6a29576b0b2bd38a9d1cad9e608', 'path': '2802007/2021-02-10/01f04a7c1f3d3ee42741a6d12946f688361d0f41', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Sg85ueyYssqIxsO17LiwbxMsXYHONi4c'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:22:40.209310Z', 'territory_id': '2802007'} 2023-11-28 02:39:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-14', 'edition_number': '589', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sRbZaaw6AF7Pq6QW_g_Lyeetk5I8QutP'], 'files': [{'checksum': 'f945845f2fdb1322464fb92843a7614c', 'path': '2802007/2021-07-14/80d767825516123f1017edd5568822f4434851e8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sRbZaaw6AF7Pq6QW_g_Lyeetk5I8QutP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:10.078522Z', 'territory_id': '2802007'} 2023-11-28 02:39:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-20', 'edition_number': '593', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1f791Hul6cTHgIn7zeVU8bgGWGY2TizKe'], 'files': [{'checksum': '4273e1e448c8c7ba776968f78848f409', 'path': '2802007/2021-07-20/979616d57cd50621c27fa3b4d273b4be8f73cdee', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1f791Hul6cTHgIn7zeVU8bgGWGY2TizKe'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:30.823519Z', 'territory_id': '2802007'} 2023-11-28 02:39:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-21', 'edition_number': '594', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1veukQ-Yq7fXjyJOgzJW-frKFCCk1pUHy'], 'files': [{'checksum': 'f78455697fc37afe06d69595c68e79a4', 'path': '2802007/2021-07-21/b6c7c8d5c74898edf9a07469d97aac1026e678c5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1veukQ-Yq7fXjyJOgzJW-frKFCCk1pUHy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:32.589887Z', 'territory_id': '2802007'} 2023-11-28 02:39:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:39:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-13', 'edition_number': '588', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1som8XVW9xt43Gla-0CWAIcorjWmWyMsU'], 'files': [{'checksum': '821c3c0aabff953d872f446cfe4942e6', 'path': '2802007/2021-07-13/1ec22c90c517f03a05ed0346f39265e5ed5981cf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1som8XVW9xt43Gla-0CWAIcorjWmWyMsU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:03.109092Z', 'territory_id': '2802007'} 2023-11-28 02:39:50 [scrapy.extensions.logstats] INFO: Crawled 585 pages (at 9 pages/min), scraped 583 items (at 9 items/min) 2023-11-28 02:39:59 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (33848503) larger than download warn size (33554432) in request . 2023-11-28 02:40:04 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:40:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-22', 'edition_number': '595', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IxNjG76c5mVbo2HbLGGoewYbHHIK_W6e'], 'files': [{'checksum': 'c5404bbe4951c1d563aaa2f0786a12f3', 'path': '2802007/2021-07-22/14a804d2c7281c535ab2dde9ca2c8430e1e6e062', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IxNjG76c5mVbo2HbLGGoewYbHHIK_W6e'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:39.931839Z', 'territory_id': '2802007'} 2023-11-28 02:40:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-24', 'edition_number': '597', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=106taNSrbtL7FYkVNLNXbPNOzqm6KOU6R'], 'files': [{'checksum': 'ac769e139f87b80758b2e4a2af8e8709', 'path': '2802007/2021-07-24/509af4da3d7eab6cbbb31116dd57ceda88a38e7a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=106taNSrbtL7FYkVNLNXbPNOzqm6KOU6R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:45.844634Z', 'territory_id': '2802007'} 2023-11-28 02:40:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-23', 'edition_number': '596', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17p8cSg1DLdE64k2FWEEj_7BLWAcJnl6n'], 'files': [{'checksum': 'fa70eeccf9f40dff95543b1fe7f32e4c', 'path': '2802007/2021-07-23/832caae4e11ed24b2e3e40d3174cc056c0e33936', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17p8cSg1DLdE64k2FWEEj_7BLWAcJnl6n'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:42.130839Z', 'territory_id': '2802007'} 2023-11-28 02:40:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-26', 'edition_number': '598', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QsfVKDKezSgIg6iNs337Xocihs1mOVQK'], 'files': [{'checksum': 'd37daab4ae0905bbdb61777683cef0f0', 'path': '2802007/2021-07-26/3e1ad577b0979007e194dc8a948f128557735900', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QsfVKDKezSgIg6iNs337Xocihs1mOVQK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:03.078531Z', 'territory_id': '2802007'} 2023-11-28 02:40:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-28', 'edition_number': '600', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MRmEJMrvUR2v060q4CC47WPNndvAlPq5'], 'files': [{'checksum': '4a31f69bcb1122a93c82f96bee3fb4cf', 'path': '2802007/2021-07-28/2313b746d53ebbe1cefec9ffc60c78813f16ad67', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MRmEJMrvUR2v060q4CC47WPNndvAlPq5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:09.497580Z', 'territory_id': '2802007'} 2023-11-28 02:40:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-27', 'edition_number': '599', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eVlU4QylqJ46YH0sSmjPKyLC2ydHi4dS'], 'files': [{'checksum': '2b415efe2061cd4d24891fdb93fea539', 'path': '2802007/2021-07-27/a51fad9a009c75de870e905790a2083714fd6e6a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eVlU4QylqJ46YH0sSmjPKyLC2ydHi4dS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:05.694544Z', 'territory_id': '2802007'} 2023-11-28 02:40:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-29', 'edition_number': '601', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UZd-aie_VxIm0zQphG_xH5Uj41i0_VLk'], 'files': [{'checksum': '1fa45211100dc1a3f17b7b6521fd0d94', 'path': '2802007/2021-07-29/ecf66fc47e3786dbbd5a99a4b191a73b3b56b2e5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UZd-aie_VxIm0zQphG_xH5Uj41i0_VLk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:10.943530Z', 'territory_id': '2802007'} 2023-11-28 02:40:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-31', 'edition_number': '603', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hGSzbG94GvtMRB1n2dc-Di-zw0c7PCtd'], 'files': [{'checksum': '6b98738fdf60c2ac54b76b6b9c666ed1', 'path': '2802007/2021-07-31/6515904c6ce16b403ee08760a34cdb7f42dba627', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hGSzbG94GvtMRB1n2dc-Di-zw0c7PCtd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:16.806410Z', 'territory_id': '2802007'} 2023-11-28 02:40:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-30', 'edition_number': '602', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sD2Qk-N7McM9S5A8bnNSlM-CSm6gqOGo'], 'files': [{'checksum': 'a16c67dff92832e3293ebb69565672f5', 'path': '2802007/2021-07-30/792cd406064e0230f61af48d8c73543b38c68df9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sD2Qk-N7McM9S5A8bnNSlM-CSm6gqOGo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:13.026201Z', 'territory_id': '2802007'} 2023-11-28 02:40:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:40:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-02-22', 'edition_number': '456', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xZl2stJOecQhHqljKkEvYWAN3D3Q8qi-'], 'files': [{'checksum': '6a9074a7bccc46fdf6ce34058718c6f3', 'path': '2802007/2021-02-22/12f0ac58e7206e79059e5c2fb5a6e16b14d5b5e0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xZl2stJOecQhHqljKkEvYWAN3D3Q8qi-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:23:01.642085Z', 'territory_id': '2802007'} 2023-11-28 02:40:50 [scrapy.extensions.logstats] INFO: Crawled 595 pages (at 10 pages/min), scraped 593 items (at 10 items/min) 2023-11-28 02:40:55 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (35760864) larger than download warn size (33554432) in request . 2023-11-28 02:41:00 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:41:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-01', 'edition_number': '604', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AZyw0rwVXL2ZL12Q1t-yierdpNueBaNG'], 'files': [{'checksum': '1d2f52fbc052798133ea55bdbddff42f', 'path': '2802007/2021-08-01/fc376b8d6a7eb80bbb2faa10548a23a2c2d01b5d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AZyw0rwVXL2ZL12Q1t-yierdpNueBaNG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:33.783644Z', 'territory_id': '2802007'} 2023-11-28 02:41:10 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:41:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-03', 'edition_number': '606', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_I5-YXd_ifBQPG1XJ7u-j8I-XtyxjmXn'], 'files': [{'checksum': 'd80b9ba319ee1acbfa1292069a8a74a3', 'path': '2802007/2021-08-03/d032b90fed87699442573b66f506125a06823499', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_I5-YXd_ifBQPG1XJ7u-j8I-XtyxjmXn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:40.666907Z', 'territory_id': '2802007'} 2023-11-28 02:41:18 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:41:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-02', 'edition_number': '605', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zx2mbgpu4NVabpl7URV6BSjsXliP641Q'], 'files': [{'checksum': 'd16781a2aef26913c2e2769f40ee15aa', 'path': '2802007/2021-08-02/d7a254db4469c5d4b54dacf6994e829fe1987ba7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zx2mbgpu4NVabpl7URV6BSjsXliP641Q'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:37.551408Z', 'territory_id': '2802007'} 2023-11-28 02:41:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-09', 'edition_number': '610', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zfnr2Xpq4EJAFaWLpFfpHUksovm1yawQ'], 'files': [{'checksum': '3b4b5bc7e66aeead892069b38351753a', 'path': '2802007/2021-08-09/651fab5f6f6dc7d55ba78082b25ae454ad80e1fc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zfnr2Xpq4EJAFaWLpFfpHUksovm1yawQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:07.394231Z', 'territory_id': '2802007'} 2023-11-28 02:41:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-10', 'edition_number': '611', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OGuf6Uja76dg6VYG9tKfKgiDhZHhh-iU'], 'files': [{'checksum': '15a406e26efe04e169bb539fe2a52295', 'path': '2802007/2021-08-10/8903a86f08aa1894642446e5a622e840ea53e9e2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OGuf6Uja76dg6VYG9tKfKgiDhZHhh-iU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:08.938263Z', 'territory_id': '2802007'} 2023-11-28 02:41:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-11', 'edition_number': '612', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K-XQoNV0Hp2g8WiATxgYOeic09uO9ODA'], 'files': [{'checksum': '0c37c24a126505024e1e838699d55fd6', 'path': '2802007/2021-08-11/f7773a445ab3b2d77212d83dc9036776e6c07c49', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K-XQoNV0Hp2g8WiATxgYOeic09uO9ODA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:11.049827Z', 'territory_id': '2802007'} 2023-11-28 02:41:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-06', 'edition_number': '609', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17O6lydGj5OGDPqSr8ER2vWKWmi93m4SM'], 'files': [{'checksum': 'b118953e88483540e407b47d51659339', 'path': '2802007/2021-08-06/45013c3ccd020ab087f0a773edd33cbdfcc74b24', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17O6lydGj5OGDPqSr8ER2vWKWmi93m4SM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:03.850564Z', 'territory_id': '2802007'} 2023-11-28 02:41:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:41:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-05', 'edition_number': '608', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U2nAVG9Lf6sqDURR1N2A-V4s2W1QS7IE'], 'files': [{'checksum': 'd255e5fa89661889a1997f9cdebabd37', 'path': '2802007/2021-08-05/05975b5be88fcf401dc04720b0b7ec84de9e744f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U2nAVG9Lf6sqDURR1N2A-V4s2W1QS7IE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:00.945312Z', 'territory_id': '2802007'} 2023-11-28 02:41:41 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:41:50 [scrapy.extensions.logstats] INFO: Crawled 603 pages (at 8 pages/min), scraped 601 items (at 8 items/min) 2023-11-28 02:41:55 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (39960594) larger than download warn size (33554432) in request . 2023-11-28 02:42:00 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:42:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-13', 'edition_number': '614', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l8KEQLzKH00ieBCTaZqf0okqChD_ABPm'], 'files': [{'checksum': '73c71bcb02ebfc5a5cd29a6382f0f0f8', 'path': '2802007/2021-08-13/a4337c44dd95a1064314ca814da353c59825915d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l8KEQLzKH00ieBCTaZqf0okqChD_ABPm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:23.013934Z', 'territory_id': '2802007'} 2023-11-28 02:42:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-17', 'edition_number': '616', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FlCbLL4EH0GcdFJgi9zfoiwTMp4Lj7p0'], 'files': [{'checksum': '25a53e19e3c146dbf67d24e874a61cb3', 'path': '2802007/2021-08-17/d9e34f79bb08e05aa6049796e7150843801da984', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FlCbLL4EH0GcdFJgi9zfoiwTMp4Lj7p0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:27.197243Z', 'territory_id': '2802007'} 2023-11-28 02:42:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-16', 'edition_number': '615', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1x5DoytSWf3xeM4mANBnfigvJzBCalr96'], 'files': [{'checksum': '905cf076e32d15304db0e7be880b7c5b', 'path': '2802007/2021-08-16/be43cf6a27f848fc2918735fb3e75cae6794d375', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1x5DoytSWf3xeM4mANBnfigvJzBCalr96'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:24.269609Z', 'territory_id': '2802007'} 2023-11-28 02:42:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-20', 'edition_number': '619', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sM8VB0_lMVg8Gw-P1t7lMuleuo6poF4r'], 'files': [{'checksum': '26078202ac1119d21a5f11cd1b5e6e60', 'path': '2802007/2021-08-20/92047398a862727dbf1a6f6a98539e6821f84015', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sM8VB0_lMVg8Gw-P1t7lMuleuo6poF4r'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:53.049377Z', 'territory_id': '2802007'} 2023-11-28 02:42:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-04', 'edition_number': '607', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l8qg2B8ZUPDVcXM20m7t5OJiM4BJ7ZnF'], 'files': [{'checksum': 'd99e69db21febf0edbc9d77acb2d77f0', 'path': '2802007/2021-08-04/ce1ba1ba0b974e66db40c36bf521b1e841d8a6f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l8qg2B8ZUPDVcXM20m7t5OJiM4BJ7ZnF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:33:44.024960Z', 'territory_id': '2802007'} 2023-11-28 02:42:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-17', 'edition_number': '592', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HNlLdKbOCVKgEHTlwLkSWjOMpoMy23Ak'], 'files': [{'checksum': 'b117e71e73635a3124cab736c5e98a9f', 'path': '2802007/2021-07-17/3818182db6cd5897fafe35d3c9f2f131edd59673', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HNlLdKbOCVKgEHTlwLkSWjOMpoMy23Ak'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:28.474176Z', 'territory_id': '2802007'} 2023-11-28 02:42:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-21', 'edition_number': '620', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JoJgb_cTl93kH5QnzuIbL77zizZstika'], 'files': [{'checksum': 'dd8c78457c9d2b1b117912b1aaf31e48', 'path': '2802007/2021-08-21/2203909c3c4bd4a3d7f5dc186764abac342c586d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JoJgb_cTl93kH5QnzuIbL77zizZstika'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:55.861922Z', 'territory_id': '2802007'} 2023-11-28 02:42:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-24', 'edition_number': '622', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MvDYDwqbU9jAhKaBSRKpdMgV45L4BEb5'], 'files': [{'checksum': '29d9ff69c590db4ca506d1e39e81a744', 'path': '2802007/2021-08-24/fa7e161ed0ae5083623633132f6b07ad0931ca46', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MvDYDwqbU9jAhKaBSRKpdMgV45L4BEb5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:01.358483Z', 'territory_id': '2802007'} 2023-11-28 02:42:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-26', 'edition_number': '624', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JyYANUXKX609EbeI9qwhlIa4c6yfHdML'], 'files': [{'checksum': '9fcd3cc925d7f8214c37cdfdea3e152e', 'path': '2802007/2021-08-26/244aad3c6ae321da78e1486a088338e6634f47f9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JyYANUXKX609EbeI9qwhlIa4c6yfHdML'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:06.554761Z', 'territory_id': '2802007'} 2023-11-28 02:42:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-27', 'edition_number': '625', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pLrfmFV21L6KwaRz9GWrVbWMhN_d7-Mn'], 'files': [{'checksum': 'ac9909092f103cb7c4d6e2b9df72c765', 'path': '2802007/2021-08-27/e3095a791297ac198b54df79be89f907254737d9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pLrfmFV21L6KwaRz9GWrVbWMhN_d7-Mn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:09.601494Z', 'territory_id': '2802007'} 2023-11-28 02:42:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-29', 'edition_number': '626', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14jCVWzT-orRUUu2wULAzPXoyuQleLePC'], 'files': [{'checksum': 'ffdd422f82a9cf05d2294e304a2fdea9', 'path': '2802007/2021-08-29/e78af62402fd17f95510a765ca256d928dfa2151', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14jCVWzT-orRUUu2wULAzPXoyuQleLePC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:11.320614Z', 'territory_id': '2802007'} 2023-11-28 02:42:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-25', 'edition_number': '623', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hmx3anz49RNJnlnvkkm4W9BFPIg-HT_B'], 'files': [{'checksum': 'eacd2538d248979eefc2d0491bc6f142', 'path': '2802007/2021-08-25/11d716d1c377743ccf2faad8b1e8435897ae00fb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hmx3anz49RNJnlnvkkm4W9BFPIg-HT_B'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:03.355039Z', 'territory_id': '2802007'} 2023-11-28 02:42:37 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:42:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-30', 'edition_number': '627', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A-lNg8o9T8u-fSqeJIxSH-UVXwM9y-O6'], 'files': [{'checksum': 'cecac75a57e896e4af04fb96f9bd9bd4', 'path': '2802007/2021-08-30/8be58fbba63a6a8897e926c3a0194781e80d8baf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A-lNg8o9T8u-fSqeJIxSH-UVXwM9y-O6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:14.942389Z', 'territory_id': '2802007'} 2023-11-28 02:42:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-31', 'edition_number': '628', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Jls9jyCCoN4oChNKJJX9_Ro5Sp-TSGjw'], 'files': [{'checksum': '20b5ce7181d2b3a520cc977073fb7f33', 'path': '2802007/2021-08-31/719909cb052535c04d3d36981639b7a55ead03c1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Jls9jyCCoN4oChNKJJX9_Ro5Sp-TSGjw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:20.184597Z', 'territory_id': '2802007'} 2023-11-28 02:42:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-02', 'edition_number': '630', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZWB3dhoIJPxRGf_8wLcq4Y3AaAYYuSXl'], 'files': [{'checksum': '0519d7ba1286e98929d6d9e2d73bd9de', 'path': '2802007/2021-09-02/220357dfd7e10dda3c840f26c944f7081a7b4bba', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZWB3dhoIJPxRGf_8wLcq4Y3AaAYYuSXl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:26.662331Z', 'territory_id': '2802007'} 2023-11-28 02:42:50 [scrapy.extensions.logstats] INFO: Crawled 618 pages (at 15 pages/min), scraped 616 items (at 15 items/min) 2023-11-28 02:42:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-03-31', 'edition_number': '491', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yZvmwA9V42Wlqh1WeQDKqTNbdY7mWZCx'], 'files': [{'checksum': 'f06a058f194ae01eae5394e7c14a0032', 'path': '2802007/2021-03-31/ad66980fe2448c0c6df6435971f030efa6043e8f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yZvmwA9V42Wlqh1WeQDKqTNbdY7mWZCx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:23.955743Z', 'territory_id': '2802007'} 2023-11-28 02:42:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:42:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-03', 'edition_number': '631', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14Qo0fRHU_UzU6ACYfpb2q3NJY3mX9SlF'], 'files': [{'checksum': '4181a90962d57fe437348b45a0fde603', 'path': '2802007/2021-09-03/4845d70cd6ce659c61a2ebc094f99d505d053689', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14Qo0fRHU_UzU6ACYfpb2q3NJY3mX9SlF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:28.695155Z', 'territory_id': '2802007'} 2023-11-28 02:43:13 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (38563927) larger than download warn size (33554432) in request . 2023-11-28 02:43:18 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:43:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-07', 'edition_number': '634', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sfa6ebftAi9LfGENkRsaG_-gi70VBpeZ'], 'files': [{'checksum': '3134ac668752aa5b29a956846f9e954c', 'path': '2802007/2021-09-07/ab67433aedc2bca5415a6b5318fd4c390b37fddc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sfa6ebftAi9LfGENkRsaG_-gi70VBpeZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:39.145282Z', 'territory_id': '2802007'} 2023-11-28 02:43:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-06', 'edition_number': '633', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MwP1dqErH9j4QkdzMcqrysfuTf483opB'], 'files': [{'checksum': '7215ab0c8451991de6208b1ec6e3c529', 'path': '2802007/2021-09-06/fea4efb0d4ee20c806d29a8f52f13506e68070f9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MwP1dqErH9j4QkdzMcqrysfuTf483opB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:35.812820Z', 'territory_id': '2802007'} 2023-11-28 02:43:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-08', 'edition_number': '635', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cTFoYQVIbUNe5w-eJqdtWYXF8o2d3pMt'], 'files': [{'checksum': 'd29ff4706e06a3dd343a8102ebb6beac', 'path': '2802007/2021-09-08/f0a5811dcfde62ace504204e6a9fd5c913bc3b6e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cTFoYQVIbUNe5w-eJqdtWYXF8o2d3pMt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:44.363576Z', 'territory_id': '2802007'} 2023-11-28 02:43:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-09', 'edition_number': '636', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1C3i3OWfYVwai-hD8pEV1dyTGVVYomKg5'], 'files': [{'checksum': 'ab30e1cb7c4c5485e8ad9a4f2776fddf', 'path': '2802007/2021-09-09/b305f2ea4ce928cf93e680c115ce31386eaf6d3e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1C3i3OWfYVwai-hD8pEV1dyTGVVYomKg5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:45.861165Z', 'territory_id': '2802007'} 2023-11-28 02:43:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-07', 'edition_number': '496', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZssZlfIBrW5gQ5iIxX1atXnozU4rudaf'], 'files': [{'checksum': '41ff53983be23c3982e5b290ff90ee79', 'path': '2802007/2021-04-07/0acd76409ab68f5fb0aa671e1b6fad1ebd20f194', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZssZlfIBrW5gQ5iIxX1atXnozU4rudaf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:25:59.039638Z', 'territory_id': '2802007'} 2023-11-28 02:43:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-10', 'edition_number': '637', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13J4WUNw8jW5UdLnoLB1D31QcF4UV0zE0'], 'files': [{'checksum': '5a296e9e674bc3e4b052b1cd10c33218', 'path': '2802007/2021-09-10/260a3c4f8301e3c69401d388c1d1f71e498aa409', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13J4WUNw8jW5UdLnoLB1D31QcF4UV0zE0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:50.553377Z', 'territory_id': '2802007'} 2023-11-28 02:43:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-11', 'edition_number': '638', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1afwCXXZvMo2oKnyKIIpEjwBeIa6Wf2zP'], 'files': [{'checksum': '5797d37d4b7eb5ed7db98534cef6ad72', 'path': '2802007/2021-09-11/fe83bb618fd3e3768b35f9625e012edb80e98d47', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1afwCXXZvMo2oKnyKIIpEjwBeIa6Wf2zP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:54.478711Z', 'territory_id': '2802007'} 2023-11-28 02:43:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-15', 'edition_number': '640', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cJnBNcawi27J4IL0xf76eOwMCN-SFZKq'], 'files': [{'checksum': 'df21bfa5f85e9bbfa30f22da3d9bfe47', 'path': '2802007/2021-09-15/b09cd8ab84681eb2e11aaffe1fbb0cb72def9940', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cJnBNcawi27J4IL0xf76eOwMCN-SFZKq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:08.753852Z', 'territory_id': '2802007'} 2023-11-28 02:43:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-14', 'edition_number': '639', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19b6-wvBR_0WaOkv6bse0s17NR0F0FWDD'], 'files': [{'checksum': '9735567fe3d61c86276a7b82e8cb75b3', 'path': '2802007/2021-09-14/a8f8e72ffae121b65b8f3484f1de00edd1cdada5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19b6-wvBR_0WaOkv6bse0s17NR0F0FWDD'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:56.636891Z', 'territory_id': '2802007'} 2023-11-28 02:43:50 [scrapy.extensions.logstats] INFO: Crawled 629 pages (at 11 pages/min), scraped 627 items (at 11 items/min) 2023-11-28 02:43:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:43:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-01', 'edition_number': '629', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Wwyy7xPOxVRv35KczHckxYyG7g56gbjO'], 'files': [{'checksum': '2e77e20eb90f9c933d6a697ed3d328b1', 'path': '2802007/2021-09-01/0b67501b7bf02e5885bd3a26897cd4cd93e7bfc8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Wwyy7xPOxVRv35KczHckxYyG7g56gbjO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:22.406978Z', 'territory_id': '2802007'} 2023-11-28 02:44:11 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (40430920) larger than download warn size (33554432) in request . 2023-11-28 02:44:16 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:44:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-16', 'edition_number': '641', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cDG5jZ5TV3u5nByiyMc1ZW-pVPyRgaNX'], 'files': [{'checksum': '890136082430d729d238bd28dfafa5f0', 'path': '2802007/2021-09-16/870653dcae2883380d35b3c82e699c47effba9f9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cDG5jZ5TV3u5nByiyMc1ZW-pVPyRgaNX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:13.298918Z', 'territory_id': '2802007'} 2023-11-28 02:44:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-04-12', 'edition_number': '502', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Z9T5iNfina1IUPI_QH-Te-ab5snm2fCw'], 'files': [{'checksum': '454a217cefaf95978ead587e8b5ff131', 'path': '2802007/2021-04-12/23b71b3ab4c67ef9a45af8232cf4aa436c74d3f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Z9T5iNfina1IUPI_QH-Te-ab5snm2fCw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:26:18.048742Z', 'territory_id': '2802007'} 2023-11-28 02:44:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-21', 'edition_number': '644', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zKmP0U9j2nlUJz8t_fZ9Ab8g2AqQ6Vlk'], 'files': [{'checksum': '0ed0065197aa9358c5106795d4a0b021', 'path': '2802007/2021-09-21/3cbcba761274f1d8e70c8559beeb7b888141eb79', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zKmP0U9j2nlUJz8t_fZ9Ab8g2AqQ6Vlk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:23.419464Z', 'territory_id': '2802007'} 2023-11-28 02:44:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-21', 'edition_number': '645', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1I1sGmrLUI_-ENMO72SpiC6qPjJ4hyzeX'], 'files': [{'checksum': 'b9959f722666cda3c60d8e3fc4703ab8', 'path': '2802007/2021-09-21/d9ad5fef6f853eb7fefbc45061b2a7c263997c72', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1I1sGmrLUI_-ENMO72SpiC6qPjJ4hyzeX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:27.686944Z', 'territory_id': '2802007'} 2023-11-28 02:44:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-17', 'edition_number': '642', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w8Qeb9kvblcdhmF01tmovNbaGpwC6xv2'], 'files': [{'checksum': '391a4128ab8968c81cb7f0aee39308e6', 'path': '2802007/2021-09-17/51ce2664e0944f405776fc6971a42d5ec7a03a24', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w8Qeb9kvblcdhmF01tmovNbaGpwC6xv2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:15.510533Z', 'territory_id': '2802007'} 2023-11-28 02:44:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-22', 'edition_number': '646', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Af6BojJ_WYoxcudp7yjMK4gsIJUG7S59'], 'files': [{'checksum': 'cb22342b68a52a4d7e0ac1933756c7eb', 'path': '2802007/2021-09-22/06b7c86f49f7b304cd60e23e8358984030ea5e1b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Af6BojJ_WYoxcudp7yjMK4gsIJUG7S59'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:29.909810Z', 'territory_id': '2802007'} 2023-11-28 02:44:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-24', 'edition_number': '647', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xCPhTPIP2sHkHgSdME5K4dVEdO4EJM6T'], 'files': [{'checksum': 'e9b9622ffb52710adf21fcc9819be371', 'path': '2802007/2021-09-24/43724188fdfdc648e1c114198eb80db94175f2b8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xCPhTPIP2sHkHgSdME5K4dVEdO4EJM6T'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:32.670457Z', 'territory_id': '2802007'} 2023-11-28 02:44:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-04', 'edition_number': '632', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vyh_mQEasVq7lFJ_OXh_pbgcXf2ke4fp'], 'files': [{'checksum': '0f5ded0f0452012341c8d38e37ad498a', 'path': '2802007/2021-09-04/f3c4921976792280c69406feb519bd5157995629', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vyh_mQEasVq7lFJ_OXh_pbgcXf2ke4fp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:35:32.051633Z', 'territory_id': '2802007'} 2023-11-28 02:44:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-23', 'edition_number': '621', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WBnbIf1tVgkneiOw5pRXViovt4l0VIRs'], 'files': [{'checksum': 'c9891e5217fc66bfe5873f933432b734', 'path': '2802007/2021-08-23/5493dd0cc9a19eab31b176ca008c9ebf60efd8bd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WBnbIf1tVgkneiOw5pRXViovt4l0VIRs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:57.766837Z', 'territory_id': '2802007'} 2023-11-28 02:44:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-27', 'edition_number': '649', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13qrOupmp9uQyd6C-fUFyg9Dh1mRnRw_k'], 'files': [{'checksum': '60adb83463d1b80f7e7b0bb5c2483201', 'path': '2802007/2021-09-27/4efae3fccf36afad695f456839701d707b5e7577', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13qrOupmp9uQyd6C-fUFyg9Dh1mRnRw_k'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:44.149014Z', 'territory_id': '2802007'} 2023-11-28 02:44:50 [scrapy.extensions.logstats] INFO: Crawled 640 pages (at 11 pages/min), scraped 638 items (at 11 items/min) 2023-11-28 02:44:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-28', 'edition_number': '650', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CidknXZl_kxNBsWW5RjKBh9XhRRPWu-n'], 'files': [{'checksum': '49aa656e9ad024351b6d9f7c664b85fe', 'path': '2802007/2021-09-28/1d4555b3b6235da487a853f685be3abc237de648', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CidknXZl_kxNBsWW5RjKBh9XhRRPWu-n'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:46.557016Z', 'territory_id': '2802007'} 2023-11-28 02:44:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:44:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-29', 'edition_number': '651', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VsppLnVIfbbOUf7yeA3fZKAWnia59G5R'], 'files': [{'checksum': '6f647e4842bfabf79e3994a6bb63bd0d', 'path': '2802007/2021-09-29/be6ff3355e34216368d37866cacf32f02f8d2c6e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VsppLnVIfbbOUf7yeA3fZKAWnia59G5R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:49.224703Z', 'territory_id': '2802007'} 2023-11-28 02:45:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-01', 'edition_number': '653', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12o2VdU3bSqsCXRAhBh6xY5zh6VrVDVpa'], 'files': [{'checksum': '7187fd7bfba700f9929fd781e474227d', 'path': '2802007/2021-10-01/f509b995c73b2e1d25730f7c3f51a881e33eca8f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12o2VdU3bSqsCXRAhBh6xY5zh6VrVDVpa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:08.005318Z', 'territory_id': '2802007'} 2023-11-28 02:45:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-04', 'edition_number': '654', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pAUfuMh2m7yiB1Zd9fJBYwygHvcZmkiC'], 'files': [{'checksum': 'dfb53ed756ec5bc4e56482f44a805ce9', 'path': '2802007/2021-10-04/cc78a64eadea3519f0a0bea18d958e12bbdddbc5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pAUfuMh2m7yiB1Zd9fJBYwygHvcZmkiC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:11.395130Z', 'territory_id': '2802007'} 2023-11-28 02:45:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-30', 'edition_number': '652', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12DHDUomPL83fEJROX15DvWWO1pyUKAnI'], 'files': [{'checksum': '3a681d556903a9cecf24354df544fce9', 'path': '2802007/2021-09-30/53fefc383980b0f8aa99db4ef60b6c7f25ca8437', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12DHDUomPL83fEJROX15DvWWO1pyUKAnI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:52.061353Z', 'territory_id': '2802007'} 2023-11-28 02:45:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-05', 'edition_number': '655', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sFXcxfLZccCiFS30GxdARCOvairdraDm'], 'files': [{'checksum': '7296de1e4fa83472d99ec1e572270c44', 'path': '2802007/2021-10-05/8a9334b1bfabff25e43468af9b124eea213ecb38', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sFXcxfLZccCiFS30GxdARCOvairdraDm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:13.587219Z', 'territory_id': '2802007'} 2023-11-28 02:45:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-26', 'edition_number': '648', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jjJaaylw_ny69IBzXxsDBdsOaizl5rdS'], 'files': [{'checksum': 'f940c8ad3ecfda03c5aafeeccfb8c48b', 'path': '2802007/2021-09-26/0d05d4b27fa4a1ea291d8f73471a79feee88e4d6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jjJaaylw_ny69IBzXxsDBdsOaizl5rdS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:40.664277Z', 'territory_id': '2802007'} 2023-11-28 02:45:16 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:45:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-09-20', 'edition_number': '643', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ybnfcAqIhsN8qwD5qU9lvl2ZpZABP6uu'], 'files': [{'checksum': '56be6416066b81c4e66111601b8e3111', 'path': '2802007/2021-09-20/7fb6150e5aa2a900d6d57215e534a8ba33178ded', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ybnfcAqIhsN8qwD5qU9lvl2ZpZABP6uu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:36:20.155382Z', 'territory_id': '2802007'} 2023-11-28 02:45:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-19', 'edition_number': '618', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18MxhaxJzptffBLym1Lgcc3Kbhx6IuGJ6'], 'files': [{'checksum': '3670995f5e0e64fa11307f9a7098c897', 'path': '2802007/2021-08-19/37faa5779132abfed8b4482112ad8e6ad07b0eb8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18MxhaxJzptffBLym1Lgcc3Kbhx6IuGJ6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:49.273954Z', 'territory_id': '2802007'} 2023-11-28 02:45:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-05', 'edition_number': '656', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FT01A4Lf97HlnSBP3ZLtyPO62knp7Ugg'], 'files': [{'checksum': '7b93ae2dee3ac452b3ab1cca8f5f3d1f', 'path': '2802007/2021-10-05/24e3c40cc241ddc0b76157b1c887a0f43d6ab5d9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FT01A4Lf97HlnSBP3ZLtyPO62knp7Ugg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:18.995169Z', 'territory_id': '2802007'} 2023-11-28 02:45:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-13', 'edition_number': '662', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11AZkJdbCagujN1Z0LPjIHH5-GfA4xne5'], 'files': [{'checksum': 'a37e95da41c560ed7bcb361a67582da7', 'path': '2802007/2021-10-13/59a03de6a3b9932807d81b7f87d7adef3c860409', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11AZkJdbCagujN1Z0LPjIHH5-GfA4xne5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:33.966610Z', 'territory_id': '2802007'} 2023-11-28 02:45:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-14', 'edition_number': '663', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1z1B6jkBkqRBtsn9Ivp2k1ZF95KukPCLR'], 'files': [{'checksum': '138c2d97e207b6009707d50438f797f4', 'path': '2802007/2021-10-14/8eaca5f3700271af46873b448461f2adf2c451a2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1z1B6jkBkqRBtsn9Ivp2k1ZF95KukPCLR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:38.553634Z', 'territory_id': '2802007'} 2023-11-28 02:45:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:45:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-18', 'edition_number': '617', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wV5I1TiShiqqMF3xdvtlRxMZPurKWyl0'], 'files': [{'checksum': '99148f85bc5b26de5918ec4f19302503', 'path': '2802007/2021-08-18/4a5dddbe20aab7a34e02cf8a85e320d545e3840f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wV5I1TiShiqqMF3xdvtlRxMZPurKWyl0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:48.516143Z', 'territory_id': '2802007'} 2023-11-28 02:45:50 [scrapy.extensions.logstats] INFO: Crawled 653 pages (at 13 pages/min), scraped 651 items (at 13 items/min) 2023-11-28 02:46:08 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (58763735) larger than download warn size (33554432) in request . 2023-11-28 02:46:13 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:46:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-15', 'edition_number': '664', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p6XNfXWgEjb_HZwy3xhRhs0YV6L31XEQ'], 'files': [{'checksum': '3d2f8f1c68bc0d06fcd5889efe89055f', 'path': '2802007/2021-10-15/f00654aefe7b2a32d455721daaf8b15040dfa59f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p6XNfXWgEjb_HZwy3xhRhs0YV6L31XEQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:41.971715Z', 'territory_id': '2802007'} 2023-11-28 02:46:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-19', 'edition_number': '666', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zSurwpoQhGJRx8sFBALsC05pIXKWeBl_'], 'files': [{'checksum': 'e76d057d1ed7eeabd13878a8902ae182', 'path': '2802007/2021-10-19/ce963648b60c7a432ab36460bee1f009fa83f90a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zSurwpoQhGJRx8sFBALsC05pIXKWeBl_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:52.074077Z', 'territory_id': '2802007'} 2023-11-28 02:46:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-18', 'edition_number': '665', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WrRUqECENQMCjVIYmXjqp5c9ywPuMs_x'], 'files': [{'checksum': '68dc438b32c252999ff1329925cebefc', 'path': '2802007/2021-10-18/0508769a0a8301a765ebade39b4a52087d76e388', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WrRUqECENQMCjVIYmXjqp5c9ywPuMs_x'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:52.001307Z', 'territory_id': '2802007'} 2023-11-28 02:46:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-21', 'edition_number': '668', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uWeQ8lyNILnDcwrWkHoLEzSFN1M3Fspe'], 'files': [{'checksum': 'a7ffea8a07803a0628cd3444ca2a60f8', 'path': '2802007/2021-10-21/0f8613b7a00132657b18ccec6045ef7f88572af0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uWeQ8lyNILnDcwrWkHoLEzSFN1M3Fspe'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:12.047615Z', 'territory_id': '2802007'} 2023-11-28 02:46:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-22', 'edition_number': '670', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19dCwPj7SBKUBDV2oDkPGoRKXVvxJ8bz5'], 'files': [{'checksum': '0f5ccefb85a79b8b2eacbdee1cfe5a8f', 'path': '2802007/2021-10-22/811ebd1ff20c0c731ed265f3944877b94fcb537a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19dCwPj7SBKUBDV2oDkPGoRKXVvxJ8bz5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:18.943018Z', 'territory_id': '2802007'} 2023-11-28 02:46:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-12', 'edition_number': '661', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HR3AuAsm8RwEIsqyYM40261w6_NBz-V4'], 'files': [{'checksum': '286aaf1a8917e9ab40869bac4a0cd44a', 'path': '2802007/2021-10-12/b7cd0ec713c3cf0cc0ec06d1310a4981e7c8f7a9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HR3AuAsm8RwEIsqyYM40261w6_NBz-V4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:31.991361Z', 'territory_id': '2802007'} 2023-11-28 02:46:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-09', 'edition_number': '660', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VX8oIA71wBMXZJ-DFCGwQ_e2Fuk80WG2'], 'files': [{'checksum': 'e8ff2e9b9943f1b7c9791e6fa93aff01', 'path': '2802007/2021-10-09/0a8a63c13d33bd3a1880711727f66085c0d369ac', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VX8oIA71wBMXZJ-DFCGwQ_e2Fuk80WG2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:28.962408Z', 'territory_id': '2802007'} 2023-11-28 02:46:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-21', 'edition_number': '669', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VpZIh3eud61SwgrmnSCtnGUcpvfxhOrv'], 'files': [{'checksum': '9fa2e7befe5dda28859c95e56a47f67e', 'path': '2802007/2021-10-21/31c066b8f63f8459e14eaa74404c7247291a2a3a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1VpZIh3eud61SwgrmnSCtnGUcpvfxhOrv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:16.389369Z', 'territory_id': '2802007'} 2023-11-28 02:46:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:46:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-25', 'edition_number': '672', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AXaOPk5o613LzttoaT3fjSUSAobiZuzr'], 'files': [{'checksum': '8981124f293d0db40ef4ffed068fcdf3', 'path': '2802007/2021-10-25/d9fe54afaa3be6930d306a524cf5f60c3078305f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AXaOPk5o613LzttoaT3fjSUSAobiZuzr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:40.796155Z', 'territory_id': '2802007'} 2023-11-28 02:46:50 [scrapy.extensions.logstats] INFO: Crawled 662 pages (at 9 pages/min), scraped 660 items (at 9 items/min) 2023-11-28 02:47:22 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (59015346) larger than download warn size (33554432) in request . 2023-11-28 02:47:27 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:47:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-27', 'edition_number': '674', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sQHlojcCUG5jt0OHPY94XDxpaPc6txKS'], 'files': [{'checksum': 'e83ee64ddf8ad1be4477922edecb96a3', 'path': '2802007/2021-10-27/fe8aef782c3149c219ffb8cbbf5beee6b6d595bf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1sQHlojcCUG5jt0OHPY94XDxpaPc6txKS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:47.450736Z', 'territory_id': '2802007'} 2023-11-28 02:47:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-28', 'edition_number': '675', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qlhZJgnk1--s7gU4DDTbdsuhPcwy5uUt'], 'files': [{'checksum': '13664611417fb81f90a8ba190d3476c6', 'path': '2802007/2021-10-28/50e85dc6c867dca3ae9f03bb2b060e9905b1c60f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qlhZJgnk1--s7gU4DDTbdsuhPcwy5uUt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:51.807105Z', 'territory_id': '2802007'} 2023-11-28 02:47:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-26', 'edition_number': '673', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qk06BI9i3BvgI9CRYOSFMjPtdqSaVCAM'], 'files': [{'checksum': '7427d143f134fcd74cafb84ad9915e2f', 'path': '2802007/2021-10-26/d92e22c64f8fc5f4c931db50e212f9c7ab8a21ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qk06BI9i3BvgI9CRYOSFMjPtdqSaVCAM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:44.803792Z', 'territory_id': '2802007'} 2023-11-28 02:47:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-25', 'edition_number': '671', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZegmkteFIbmNb2AgPE3vtJcXdjSiuieN'], 'files': [{'checksum': '4d9970f0a09dc33e6d96115348121f14', 'path': '2802007/2021-10-25/4224c08d5879f580fc65dae51235112fe7d665ea', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZegmkteFIbmNb2AgPE3vtJcXdjSiuieN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:38:39.854994Z', 'territory_id': '2802007'} 2023-11-28 02:47:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-18', 'edition_number': '537', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vuGjphiczkm8FhENRFqqkuFCrWuQfHKN'], 'files': [{'checksum': '3d6e3beafe0153d28100f8ed1d7388be', 'path': '2802007/2021-05-18/553dc92e50594188c82dbf809b450f2baa2cd580', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vuGjphiczkm8FhENRFqqkuFCrWuQfHKN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:43.201403Z', 'territory_id': '2802007'} 2023-11-28 02:47:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-05-17', 'edition_number': '536', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rmuy7X5wwY4wBJz2PvqJ0wurlA_DU79K'], 'files': [{'checksum': '394e2058b4fae47adbc75a76fe3a3214', 'path': '2802007/2021-05-17/98b566e578d5f56ca3e5134ef2433bcb368b71eb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rmuy7X5wwY4wBJz2PvqJ0wurlA_DU79K'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:28:37.291387Z', 'territory_id': '2802007'} 2023-11-28 02:47:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-04', 'edition_number': '677', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EPBXiGUYoPenNfUQJItZSswuAeNHdN-D'], 'files': [{'checksum': 'bd24b5932bc2b06cc2744fe19684cbc3', 'path': '2802007/2021-11-04/eabb0f621058d1192e2c7456d006be4f780d8e78', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EPBXiGUYoPenNfUQJItZSswuAeNHdN-D'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:25.282625Z', 'territory_id': '2802007'} 2023-11-28 02:47:50 [scrapy.extensions.logstats] INFO: Crawled 669 pages (at 7 pages/min), scraped 667 items (at 7 items/min) 2023-11-28 02:47:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-05', 'edition_number': '678', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14vGwR9x4f4993HaZoE05BbYben1MgGAO'], 'files': [{'checksum': 'b867ef757d585c38cd54cc4c17935aa7', 'path': '2802007/2021-11-05/1ea183b33bf1fb0cf44659d2feeab2661faf7673', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14vGwR9x4f4993HaZoE05BbYben1MgGAO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:27.927109Z', 'territory_id': '2802007'} 2023-11-28 02:47:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-20', 'edition_number': '667', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZEiPq5zByuQ7QUKky0_M2ePfbDCA2C97'], 'files': [{'checksum': 'f44431fddb3926f074bfd049cd0a599e', 'path': '2802007/2021-10-20/010af3479d1fae5863d8d3b0257186ca554cda0c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZEiPq5zByuQ7QUKky0_M2ePfbDCA2C97'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:55.094913Z', 'territory_id': '2802007'} 2023-11-28 02:47:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:47:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-10', 'edition_number': '681', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dCrucXo93a0XVsi8JJcXnfR29bdq8O-X'], 'files': [{'checksum': '6f29630c478dee6dbe2c772202f32831', 'path': '2802007/2021-11-10/f4ce068f7503fbe3ba002329278e481170068fd3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dCrucXo93a0XVsi8JJcXnfR29bdq8O-X'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:36.443832Z', 'territory_id': '2802007'} 2023-11-28 02:48:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-10', 'edition_number': '682', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1e7x7DbmZ5-NKbrY0yZroXCnm9OxLgnl3'], 'files': [{'checksum': '239f3a0fe5f1b7e99e644d637c77790e', 'path': '2802007/2021-11-10/931697ec541d1121b16b78c827bf39abf6d1c015', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1e7x7DbmZ5-NKbrY0yZroXCnm9OxLgnl3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:38.662303Z', 'territory_id': '2802007'} 2023-11-28 02:48:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-11', 'edition_number': '683', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uzViuyyucEdPfQygAspXQuUlfytA6NZf'], 'files': [{'checksum': '52df7c24621fbe338d7577cfd4259c00', 'path': '2802007/2021-11-11/60776db1b8c29e367c3c66c78b1bc10d4b0bc3da', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uzViuyyucEdPfQygAspXQuUlfytA6NZf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:40.506435Z', 'territory_id': '2802007'} 2023-11-28 02:48:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-16', 'edition_number': '685', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16MDy5vuQkrl5sjXwQXZiby77U-SK5cRj'], 'files': [{'checksum': 'f6a351b7649d2dac8acaf28f83dc173a', 'path': '2802007/2021-11-16/536edb501fd4d045279981f4c79128d70edb2fac', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16MDy5vuQkrl5sjXwQXZiby77U-SK5cRj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:06.613244Z', 'territory_id': '2802007'} 2023-11-28 02:48:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-12', 'edition_number': '684', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YojX0Rw0h-BX3aoKAULBKKkENZ2Jyu6N'], 'files': [{'checksum': '9da445564db4ffd8bb671ad89f3f80f9', 'path': '2802007/2021-11-12/c104a0a4f1a1f6ea77cb655fa692b46bf7c9d28e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YojX0Rw0h-BX3aoKAULBKKkENZ2Jyu6N'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:04.800090Z', 'territory_id': '2802007'} 2023-11-28 02:48:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-09', 'edition_number': '680', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BDdJ1lZ0034iSoTSVB-qYa5NqDoldPj-'], 'files': [{'checksum': 'ebbb44d191a1e71f56abdb5270358bc5', 'path': '2802007/2021-11-09/d79c9dcf46265cf69fc047b68a374a7ad14c8839', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BDdJ1lZ0034iSoTSVB-qYa5NqDoldPj-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:33.721133Z', 'territory_id': '2802007'} 2023-11-28 02:48:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-06', 'edition_number': '679', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GwM5CIn9iuEzmQt425J16HEloqHKhw4G'], 'files': [{'checksum': '97b122b8ecef31745267997eda4ad54e', 'path': '2802007/2021-11-06/0f5454423c4ed495c6985137ca9fa53b224e270e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GwM5CIn9iuEzmQt425J16HEloqHKhw4G'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:31.575243Z', 'territory_id': '2802007'} 2023-11-28 02:48:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-17', 'edition_number': '686', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KyxIu4usOfHvdc2gyiEXT0xhaNwykGmL'], 'files': [{'checksum': '51734222a9b2f26df6bbf8acf4203d09', 'path': '2802007/2021-11-17/e4aea55f557a16653f86065b534656d2806eb21d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KyxIu4usOfHvdc2gyiEXT0xhaNwykGmL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:10.601913Z', 'territory_id': '2802007'} 2023-11-28 02:48:40 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (36660909) larger than download warn size (33554432) in request . 2023-11-28 02:48:47 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:48:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-19', 'edition_number': '688', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pzLW-WUMmTVjSUiSQ6wkMrxtgH0w7uxB'], 'files': [{'checksum': '88f4c56ea9531e7685cb9866fb21eca6', 'path': '2802007/2021-11-19/19a5be4482171125be5e56bf7951c3d22b35843c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pzLW-WUMmTVjSUiSQ6wkMrxtgH0w7uxB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:19.793056Z', 'territory_id': '2802007'} 2023-11-28 02:48:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-23', 'edition_number': '690', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-6A9ujzIT3XWI3AtmQrktNxTMz0LNxSM'], 'files': [{'checksum': '65e2d119f00523111da954e34f8572db', 'path': '2802007/2021-11-23/6888ec5bd04b3db2c7666473d56040800d76b3c2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-6A9ujzIT3XWI3AtmQrktNxTMz0LNxSM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:25.753199Z', 'territory_id': '2802007'} 2023-11-28 02:48:50 [scrapy.extensions.logstats] INFO: Crawled 681 pages (at 12 pages/min), scraped 679 items (at 12 items/min) 2023-11-28 02:48:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:48:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-25', 'edition_number': '692', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Wik-zYK1DweY9LTa-jHusH2BdyoSTK7f'], 'files': [{'checksum': '64378a8fa861a2286417f64bd0101fb9', 'path': '2802007/2021-11-25/e0d599a35e177508b6181e921821fcaa45a8ba50', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Wik-zYK1DweY9LTa-jHusH2BdyoSTK7f'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:31.843042Z', 'territory_id': '2802007'} 2023-11-28 02:48:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:49:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:49:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:49:40 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (62937908) larger than download warn size (33554432) in request . 2023-11-28 02:49:46 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:49:50 [scrapy.extensions.logstats] INFO: Crawled 682 pages (at 1 pages/min), scraped 680 items (at 1 items/min) 2023-11-28 02:49:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:49:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-23', 'edition_number': '691', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Op69bo5UCnR471KdusrRt_kO2uZl2LOY'], 'files': [{'checksum': 'cee5aca5e59ab7738519e543c4b26832', 'path': '2802007/2021-11-23/f5430823d3175486646e468174e085a18d3047ed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Op69bo5UCnR471KdusrRt_kO2uZl2LOY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:28.477264Z', 'territory_id': '2802007'} 2023-11-28 02:49:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:49:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:49:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-30', 'edition_number': '695', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s_f8eZlwgDnurvNp49WiKA1TyS637uEU'], 'files': [{'checksum': '88ffe0c688411317cf7eb5f47252543a', 'path': '2802007/2021-11-30/4b356981fe48fe5d07c15e728888de2c977db0cf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s_f8eZlwgDnurvNp49WiKA1TyS637uEU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:17.855156Z', 'territory_id': '2802007'} 2023-11-28 02:49:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:49:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-18', 'edition_number': '573', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pK6Cphunqd3KaBHf4ifsz0Qhnp7eoz1y'], 'files': [{'checksum': 'f06978bc2dac9fedf7111b5a0bdd174c', 'path': '2802007/2021-06-18/6ce39543d93fde41b4af42159f35a385dde2a5f7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pK6Cphunqd3KaBHf4ifsz0Qhnp7eoz1y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:11.548759Z', 'territory_id': '2802007'} 2023-11-28 02:50:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-03', 'edition_number': '697', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mmUWrIYolRofhGnohzIr7iM3_JtcoFk4'], 'files': [{'checksum': 'f714f4037124a6aaef650d6631dd4266', 'path': '2802007/2021-12-03/4527fd7167593ede303b717e2775eac946719f40', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mmUWrIYolRofhGnohzIr7iM3_JtcoFk4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:23.536089Z', 'territory_id': '2802007'} 2023-11-28 02:50:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-06', 'edition_number': '698', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DDrel7HgWTJsN1vdvsn-TOSFtoBAvdPz'], 'files': [{'checksum': '39d6ff4a8aca3ce909bff7950eb1cd4b', 'path': '2802007/2021-12-06/b804d2799855a16771d1657e5ab68c6704e96260', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DDrel7HgWTJsN1vdvsn-TOSFtoBAvdPz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:26.240658Z', 'territory_id': '2802007'} 2023-11-28 02:50:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-01', 'edition_number': '696', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14cxr47Wssv7P0wTzRwdZKsBULZRqXMp0'], 'files': [{'checksum': 'efa41c8a6b2f2412bbf757d245a81e04', 'path': '2802007/2021-12-01/43d6418391785e7d436ff5a90b73037823fd1460', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14cxr47Wssv7P0wTzRwdZKsBULZRqXMp0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:20.070225Z', 'territory_id': '2802007'} 2023-11-28 02:50:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-16', 'edition_number': '570', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1unM_0DGbM2eP2P-FXHBJi2CJ4qJWcalz'], 'files': [{'checksum': 'f81593045f3b4dd2abe79fb33f8d295a', 'path': '2802007/2021-06-16/63e91e7382d570bd591ebc9a4be84bf3e421602e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1unM_0DGbM2eP2P-FXHBJi2CJ4qJWcalz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:00.951937Z', 'territory_id': '2802007'} 2023-11-28 02:50:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-09', 'edition_number': '700', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J0jMieloHAHbq5nYgVEKO4gaN4BV2cr4'], 'files': [{'checksum': 'efcf1e4d70b62fcf6f7be6ca65f70f83', 'path': '2802007/2021-12-09/329e1e389f32813da2cc1c0c400bf2d409158ebb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J0jMieloHAHbq5nYgVEKO4gaN4BV2cr4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:30.762573Z', 'territory_id': '2802007'} 2023-11-28 02:50:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-07', 'edition_number': '699', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RlsJfGTWDSDsG8ASMQ1-S9FpBdQKXLUI'], 'files': [{'checksum': 'eaa0e1530cb1accf338b07df4cc589cd', 'path': '2802007/2021-12-07/d67b9b323819f3f678879436f388a516e4debbad', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RlsJfGTWDSDsG8ASMQ1-S9FpBdQKXLUI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:28.328616Z', 'territory_id': '2802007'} 2023-11-28 02:50:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-06-29', 'edition_number': '578', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MBC-FNLUp3abMjsXbMyNNQjGVF8oPn0m'], 'files': [{'checksum': 'c61afc29059eedc86aadf2cd2b2ee75c', 'path': '2802007/2021-06-29/b0c59f7670bacc0884145d595c7abeff4cb8048d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MBC-FNLUp3abMjsXbMyNNQjGVF8oPn0m'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:31:29.630092Z', 'territory_id': '2802007'} 2023-11-28 02:50:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-13', 'edition_number': '702', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tmqlrU9DpH5F-In0YFei5c3r99DItaej'], 'files': [{'checksum': '4d625915760cd97146ad8eeb663d0ddb', 'path': '2802007/2021-12-13/3d14c46ea9845ba4236390fbc7b6027638ce92b8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tmqlrU9DpH5F-In0YFei5c3r99DItaej'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:01.831694Z', 'territory_id': '2802007'} 2023-11-28 02:50:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-10', 'edition_number': '701', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eqnpfPHG9_99LdK3y1T0zvcXhgYfc-G4'], 'files': [{'checksum': 'd0a6b6c01e89cf62a53f3446002d04c7', 'path': '2802007/2021-12-10/af74aa9fdf5adb7e6da6efa429fbd905bcf3f444', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eqnpfPHG9_99LdK3y1T0zvcXhgYfc-G4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:33.177027Z', 'territory_id': '2802007'} 2023-11-28 02:50:50 [scrapy.extensions.logstats] INFO: Crawled 694 pages (at 12 pages/min), scraped 692 items (at 12 items/min) 2023-11-28 02:50:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-16', 'edition_number': '704', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M0EHvCD6jtgndIbjpKZnvVTxKAfxGsXd'], 'files': [{'checksum': '3dca7b58ca3e3c2b3e19ac304eeb371c', 'path': '2802007/2021-12-16/eac5f30db9c2691c52cbcef00da572468f0d6d06', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M0EHvCD6jtgndIbjpKZnvVTxKAfxGsXd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:07.483333Z', 'territory_id': '2802007'} 2023-11-28 02:50:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-17', 'edition_number': '705', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nnvoEOaDNafeT7DLQvPtu9-8fntSUWx_'], 'files': [{'checksum': '088babf878c85d8e7ed4c8e1f6713c46', 'path': '2802007/2021-12-17/4fd60e806adaaae44bced8834062e1275db7d427', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nnvoEOaDNafeT7DLQvPtu9-8fntSUWx_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:10.097739Z', 'territory_id': '2802007'} 2023-11-28 02:50:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:50:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-20', 'edition_number': '706', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NzIPK0F8AnvBYBNqAdkxYpBYElt-PlPD'], 'files': [{'checksum': '172e939b3c506b0e84c1ee8789eaa61e', 'path': '2802007/2021-12-20/6f57588fdeea38778d0b9c7aec8b397809e4f1e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NzIPK0F8AnvBYBNqAdkxYpBYElt-PlPD'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:12.815850Z', 'territory_id': '2802007'} 2023-11-28 02:51:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:51:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-14', 'edition_number': '703', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1354Q9c_2bnJwdcShcf_kqwDSzZwdDtqN'], 'files': [{'checksum': 'd130e3b5d988fd85903c481334265429', 'path': '2802007/2021-12-14/614db9ec415733d49caeca05f32bcf4073ff40f0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1354Q9c_2bnJwdcShcf_kqwDSzZwdDtqN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:03.961719Z', 'territory_id': '2802007'} 2023-11-28 02:51:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:51:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-29', 'edition_number': '694', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cmN-OxmGl4WmJhSB306TjAMJicNKoiG0'], 'files': [{'checksum': 'd5b46276e12ea274b3bc9ca7669585c0', 'path': '2802007/2021-11-29/24242730f023d3fca247ab031b6fafad9714234b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cmN-OxmGl4WmJhSB306TjAMJicNKoiG0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:41:01.509943Z', 'territory_id': '2802007'} 2023-11-28 02:51:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:51:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-22', 'edition_number': '708', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CdGJvtmU3-WAcPzNUfo4G4BIdqf8wi12'], 'files': [{'checksum': 'f091887f332e64cb4460c501aa8b0b3c', 'path': '2802007/2021-12-22/8d0bc5a7f6f82a7c1342a0e0a7ccd92fecbdc5ef', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CdGJvtmU3-WAcPzNUfo4G4BIdqf8wi12'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:16.915585Z', 'territory_id': '2802007'} 2023-11-28 02:51:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:51:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-23', 'edition_number': '709', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nkvSOY1LFWf6yi3CD4shYnsdA-4-4m2A'], 'files': [{'checksum': '6e11ce2e2dbbfddae9c426676df0e074', 'path': '2802007/2021-12-23/2e8a46d8ed73b13fa477ed2f647e551549afe6d4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nkvSOY1LFWf6yi3CD4shYnsdA-4-4m2A'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:19.487779Z', 'territory_id': '2802007'} 2023-11-28 02:51:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:51:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-21', 'edition_number': '707', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SQjn3-aCyxZFSFyIbfr5OlNWVY0A5DSY'], 'files': [{'checksum': '513f910643905f4224df1fe47adbfdb6', 'path': '2802007/2021-12-21/86f9ec9e681ad377595447d0a9b940170fb2cea2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SQjn3-aCyxZFSFyIbfr5OlNWVY0A5DSY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:14.648194Z', 'territory_id': '2802007'} 2023-11-28 02:51:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:51:50 [scrapy.extensions.logstats] INFO: Crawled 702 pages (at 8 pages/min), scraped 700 items (at 8 items/min) 2023-11-28 02:51:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:52:06 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:52:07 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (70512468) larger than download warn size (33554432) in request . 2023-11-28 02:52:13 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:52:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-24', 'edition_number': '710', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JydGcc-TIxRVSQHLEpZSAFxEn-FN__io'], 'files': [{'checksum': '0f90f3586462ad9be7ec9716530c953d', 'path': '2802007/2021-12-24/135bd9ecf14b7df1ac64c69446292aebe87062d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JydGcc-TIxRVSQHLEpZSAFxEn-FN__io'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:23.395904Z', 'territory_id': '2802007'} 2023-11-28 02:52:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-30', 'edition_number': '714', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19BL9X_Gxh2c4ks4XPUtx_k3t2B6UiIx0'], 'files': [{'checksum': '926f22ed110da827db216df24a4fb0ae', 'path': '2802007/2021-12-30/f2b05f414ff1dc6a195bb9947c0849352d3aed26', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19BL9X_Gxh2c4ks4XPUtx_k3t2B6UiIx0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:39.995585Z', 'territory_id': '2802007'} 2023-11-28 02:52:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-03', 'edition_number': '715', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DuD5_SLN6Ozpqv6c5Z4eQ1V5B8ej8qJB'], 'files': [{'checksum': 'e499b03cf1f7c9c8218bfc74feeb9d9e', 'path': '2802007/2022-01-03/f6974a2e049bd7b38457d8e0cab98eb5bda2ea70', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DuD5_SLN6Ozpqv6c5Z4eQ1V5B8ej8qJB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:41.954505Z', 'territory_id': '2802007'} 2023-11-28 02:52:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-05', 'edition_number': '717', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Rc2ca6Q89T94uaYafHZVcyA9p9tdSm0h'], 'files': [{'checksum': 'f5a3c256141b5478fe2b8cc66724d9f3', 'path': '2802007/2022-01-05/381c32bed7e541c562a04cf7f6428e0e17a3db64', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Rc2ca6Q89T94uaYafHZVcyA9p9tdSm0h'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:52.155590Z', 'territory_id': '2802007'} 2023-11-28 02:52:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-04', 'edition_number': '716', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12ulMTNaNWLRMecA47nfcHWIGvTowRgzs'], 'files': [{'checksum': 'eac76a1335c10955f3df2cebef3fe42a', 'path': '2802007/2022-01-04/a6220d561a072b9572108f5e4aa4b08c998c0893', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12ulMTNaNWLRMecA47nfcHWIGvTowRgzs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:45.787523Z', 'territory_id': '2802007'} 2023-11-28 02:52:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-07-13', 'edition_number': '587', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=116aJsIEaKfvAy0NGYGHjAl7jv5ZC5w1L'], 'files': [{'checksum': 'a4303731d836445eecd845b875253b95', 'path': '2802007/2021-07-13/1e81e974b9067ddfa3271a73934a3acf04bc3a63', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=116aJsIEaKfvAy0NGYGHjAl7jv5ZC5w1L'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:32:00.806216Z', 'territory_id': '2802007'} 2023-11-28 02:52:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-07', 'edition_number': '719', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SmyYurfYTP_n7C6zDX0unH5sycuUmKog'], 'files': [{'checksum': '50df5e178dd2174855e8a758ddcfea1e', 'path': '2802007/2022-01-07/9e44a0f1e4709e8c1286fae78cf7fba0785ccabb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SmyYurfYTP_n7C6zDX0unH5sycuUmKog'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:19.493642Z', 'territory_id': '2802007'} 2023-11-28 02:52:42 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:52:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:52:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-11', 'edition_number': '721', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GIee89ekKjmG5VLyUcXiAZ8l6sxL_xM9'], 'files': [{'checksum': '340e55164a0c3e5a7c15e95f69131874', 'path': '2802007/2022-01-11/b7725c942195c19ec653b37121e899df764448af', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GIee89ekKjmG5VLyUcXiAZ8l6sxL_xM9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:26.662272Z', 'territory_id': '2802007'} 2023-11-28 02:52:50 [scrapy.extensions.logstats] INFO: Crawled 710 pages (at 8 pages/min), scraped 708 items (at 8 items/min) 2023-11-28 02:53:43 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (76426371) larger than download warn size (33554432) in request . 2023-11-28 02:53:48 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:53:50 [scrapy.extensions.logstats] INFO: Crawled 710 pages (at 0 pages/min), scraped 708 items (at 0 items/min) 2023-11-28 02:53:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:53:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-14', 'edition_number': '724', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Fgs8aVsfZkYw_RAN9Ev0WteqVfefTVcm'], 'files': [{'checksum': '3099f8bf15d4d8c64525329e2bc78f82', 'path': '2802007/2022-01-14/e6a0d84d3ce7cb094ce2e74b5f11ca0066cf9c8f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Fgs8aVsfZkYw_RAN9Ev0WteqVfefTVcm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:38.467168Z', 'territory_id': '2802007'} 2023-11-28 02:53:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:53:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-10', 'edition_number': '720', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1efJRE665DPS12AYcSI3WGNcINR0Acfui'], 'files': [{'checksum': 'a9199df63d9ad12edabf56db3e8ab27a', 'path': '2802007/2022-01-10/de6ec0d5f97e1f9786b21e695e4533ae2755f549', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1efJRE665DPS12AYcSI3WGNcINR0Acfui'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:23.561773Z', 'territory_id': '2802007'} 2023-11-28 02:54:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-13', 'edition_number': '723', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ziz5ETvFb2TvbE_B5lcaAbU4vE_Ma2GG'], 'files': [{'checksum': '045fdcc6bf513708375aab7d5cfe4c89', 'path': '2802007/2022-01-13/b0299089b64b1d899a5332b45e057b4e5519744e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ziz5ETvFb2TvbE_B5lcaAbU4vE_Ma2GG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:32.729184Z', 'territory_id': '2802007'} 2023-11-28 02:54:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-18', 'edition_number': '726', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b3cCqnMqutgfaaLrUIt8XB0MtOrbBlIY'], 'files': [{'checksum': '184458921ffaac02f67adc3a3c31bde7', 'path': '2802007/2022-01-18/d94ac0ed323343d8de83cb7fb8514ab6ba18a3bf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b3cCqnMqutgfaaLrUIt8XB0MtOrbBlIY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:44.806743Z', 'territory_id': '2802007'} 2023-11-28 02:54:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-17', 'edition_number': '725', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dwLKaKRhLy2S7pfU6SvEkAmuTmC5yaeE'], 'files': [{'checksum': 'c4ebf597fbf5c41a269476c5cca6b3d5', 'path': '2802007/2022-01-17/97f64cb2fe58bd57b9347137a7d30334d9b218ab', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dwLKaKRhLy2S7pfU6SvEkAmuTmC5yaeE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:41.902833Z', 'territory_id': '2802007'} 2023-11-28 02:54:30 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (34122763) larger than download warn size (33554432) in request . 2023-11-28 02:54:36 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:54:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-19', 'edition_number': '727', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zgdz8k8cdRMi6undrn5kRHS1UkeQ0EDx'], 'files': [{'checksum': '80af56801f2a659f1d8ae3173f0d4686', 'path': '2802007/2022-01-19/90b12a7b3e514f313512dd3cf1c6ccba177db6fb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zgdz8k8cdRMi6undrn5kRHS1UkeQ0EDx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:48.590129Z', 'territory_id': '2802007'} 2023-11-28 02:54:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-21', 'edition_number': '729', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fp0KS9vJ6Yso1AWTWKMxYCcxpznYhWyv'], 'files': [{'checksum': '10e9e3f3e7a920b624435cc69022b567', 'path': '2802007/2022-01-21/5d3802538873b53a7bae721c541be0e55588be97', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fp0KS9vJ6Yso1AWTWKMxYCcxpznYhWyv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:18.152683Z', 'territory_id': '2802007'} 2023-11-28 02:54:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-20', 'edition_number': '728', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xj-vTHGKipckpa7B-8zogb7FPVPMyX4E'], 'files': [{'checksum': '7e50470c1618edc136ace08dabf85a29', 'path': '2802007/2022-01-20/8c5919955819bd102d189167dd690b76e7a589f3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xj-vTHGKipckpa7B-8zogb7FPVPMyX4E'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:51.744020Z', 'territory_id': '2802007'} 2023-11-28 02:54:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-24', 'edition_number': '730', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yAqBvDXfKYYrplpEPtxL3_dVNYUNG_dr'], 'files': [{'checksum': '10e62bbaad63972420c8f468065e29f0', 'path': '2802007/2022-01-24/8a4e8258b8a100adbf10c0a6c64b3d56a73fca5d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yAqBvDXfKYYrplpEPtxL3_dVNYUNG_dr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:19.829541Z', 'territory_id': '2802007'} 2023-11-28 02:54:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-12', 'edition_number': '722', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17K0sQ-8JEx-XjSQoJO1yV32GnyiyhPYi'], 'files': [{'checksum': '54e3d2cfd1f4cb2e747e11d10d64e21f', 'path': '2802007/2022-01-12/23be1bc4e78c40a4e4171117897742f91d23cfea', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17K0sQ-8JEx-XjSQoJO1yV32GnyiyhPYi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:43:30.551024Z', 'territory_id': '2802007'} 2023-11-28 02:54:50 [scrapy.extensions.logstats] INFO: Crawled 720 pages (at 10 pages/min), scraped 718 items (at 10 items/min) 2023-11-28 02:54:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-27', 'edition_number': '733', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zk-4Vn4f35KCXpf3nQU33m0ye6SQ53Jq'], 'files': [{'checksum': 'eefff9b9607c78568f5067ce829b9111', 'path': '2802007/2022-01-27/9d508466153f90af04bdd040938ea4fedf9d612f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zk-4Vn4f35KCXpf3nQU33m0ye6SQ53Jq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:31.987118Z', 'territory_id': '2802007'} 2023-11-28 02:54:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-28', 'edition_number': '734', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aYqax-SYALIGnLuOzFLj3VN1XKsJFRfI'], 'files': [{'checksum': '4304d9e1d7864e69f679fd4b1a751ea7', 'path': '2802007/2022-01-28/53a52c436bfa24221d2b7e5e044e3c3e5ae57ce5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aYqax-SYALIGnLuOzFLj3VN1XKsJFRfI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:35.004095Z', 'territory_id': '2802007'} 2023-11-28 02:54:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-31', 'edition_number': '736', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15obbSdOSksndh0c6oqdXKqxadJiu2vIq'], 'files': [{'checksum': 'fae8caf6e52bad619173ec735e1e2880', 'path': '2802007/2022-01-31/484bd22a5af234a5534c91916224c1bc9e0bc31d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15obbSdOSksndh0c6oqdXKqxadJiu2vIq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:41.204995Z', 'territory_id': '2802007'} 2023-11-28 02:54:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:54:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:54:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-28', 'edition_number': '735', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AvWOhpeBJouA6nQXJgQvWWpdL1LaoB7t'], 'files': [{'checksum': 'c0ac669f0845d737df6005d28df533db', 'path': '2802007/2022-01-28/f89e47a0a75a3837e9ebbeced954d87a33675c8a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AvWOhpeBJouA6nQXJgQvWWpdL1LaoB7t'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:37.530428Z', 'territory_id': '2802007'} 2023-11-28 02:55:00 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:55:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:55:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-26', 'edition_number': '732', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aXQ2g8yR9CjDAbebU7R6jx4nQXZcr3F2'], 'files': [{'checksum': '5c85d49176e74a9b42f2b413263c370d', 'path': '2802007/2022-01-26/ccd7815afc99cc556b38af9092638d5f75c52029', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aXQ2g8yR9CjDAbebU7R6jx4nQXZcr3F2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:27.935854Z', 'territory_id': '2802007'} 2023-11-28 02:55:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:55:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-25', 'edition_number': '731', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Avq1y795-AWSzEoJx4aJ-pq15S3dAt_8'], 'files': [{'checksum': 'd01da2cf24ba4ae70785a99493b23280', 'path': '2802007/2022-01-25/a6c749242eeda38f2e99d7f0d4845c10c0a03075', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Avq1y795-AWSzEoJx4aJ-pq15S3dAt_8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:23.442533Z', 'territory_id': '2802007'} 2023-11-28 02:55:04 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:55:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:55:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-04', 'edition_number': '740', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mloZtQ6UFdzQyV2MxrS9UCvi-aCkyI0-'], 'files': [{'checksum': '79b15379d79c53119ec0f5cae20200de', 'path': '2802007/2022-02-04/1ac6f495343401b8994d63c2695f8b561fb83951', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mloZtQ6UFdzQyV2MxrS9UCvi-aCkyI0-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:56.526708Z', 'territory_id': '2802007'} 2023-11-28 02:55:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:55:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-08', 'edition_number': '742', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14spUA3iN2mSlAbbMggGdKF8g8XbfiWjk'], 'files': [{'checksum': '4c31d4870c7c97a0051df247aeb7e4e0', 'path': '2802007/2022-02-08/1f8b4f8ff7db698a871b442e66c50bb8940b4aca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14spUA3iN2mSlAbbMggGdKF8g8XbfiWjk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:06.483053Z', 'territory_id': '2802007'} 2023-11-28 02:55:50 [scrapy.extensions.logstats] INFO: Crawled 728 pages (at 8 pages/min), scraped 726 items (at 8 items/min) 2023-11-28 02:55:52 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (46836655) larger than download warn size (33554432) in request . 2023-11-28 02:55:57 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:55:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:55:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-09', 'edition_number': '743', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SOhVmAOs4ajZstF7X-M2BjU5lMOipN0F'], 'files': [{'checksum': '0af66ed60d2be53ab02b1f19367ba539', 'path': '2802007/2022-02-09/ec40c5fe35ca47e2e9019f26ae92042d1a975b93', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SOhVmAOs4ajZstF7X-M2BjU5lMOipN0F'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:09.628900Z', 'territory_id': '2802007'} 2023-11-28 02:56:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:56:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-14', 'edition_number': '745', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H1_g9AbGvMniWi_pZunzg4DD2pDv27-5'], 'files': [{'checksum': 'e35c5b7fa1bcb8fb8d466f6c5cf0d630', 'path': '2802007/2022-02-14/9c491224778e0a95a98419769bd72e43eb8d212d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H1_g9AbGvMniWi_pZunzg4DD2pDv27-5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:15.597518Z', 'territory_id': '2802007'} 2023-11-28 02:56:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:56:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-08-12', 'edition_number': '613', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QfP-LVLd72YJXRPxdjXJh9CmillyBMAF'], 'files': [{'checksum': '10cd9f4be344cdb9e47e7f04c172f16d', 'path': '2802007/2021-08-12/d952805906cc056e3407e96e4aa73b1ca0e19e5e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QfP-LVLd72YJXRPxdjXJh9CmillyBMAF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:34:13.611822Z', 'territory_id': '2802007'} 2023-11-28 02:56:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:56:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-16', 'edition_number': '747', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gIqm0Q2Qz8wJxbwEWbPIYE-LLKpPIuF_'], 'files': [{'checksum': 'cecb8b5088b767e892429dd8559b9371', 'path': '2802007/2022-02-16/27e264b6a2b9054cd1c2d64738724db4c89f2d1a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gIqm0Q2Qz8wJxbwEWbPIYE-LLKpPIuF_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:20.576591Z', 'territory_id': '2802007'} 2023-11-28 02:56:16 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:56:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:56:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-15', 'edition_number': '746', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nc-VW5_7Pa7ipgFeEBcn_h3Bulhp1DYd'], 'files': [{'checksum': '49cf0b77b883624d7bd564e252a9cc66', 'path': '2802007/2022-02-15/173bde2985635fcc902d5bda404d920f452900e6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1nc-VW5_7Pa7ipgFeEBcn_h3Bulhp1DYd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:17.615682Z', 'territory_id': '2802007'} 2023-11-28 02:56:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:56:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-17', 'edition_number': '748', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O1j3OmemQZKGfocJPbxScvwD5GkIqh1i'], 'files': [{'checksum': '6815950c687f3b7698037737ce37ccaf', 'path': '2802007/2022-02-17/fbf243a321ba4fe9f774e514171abece66bf6b75', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O1j3OmemQZKGfocJPbxScvwD5GkIqh1i'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:23.276345Z', 'territory_id': '2802007'} 2023-11-28 02:56:50 [scrapy.extensions.logstats] INFO: Crawled 734 pages (at 6 pages/min), scraped 732 items (at 6 items/min) 2023-11-28 02:56:51 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (63575931) larger than download warn size (33554432) in request . 2023-11-28 02:56:56 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:57:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-10', 'edition_number': '744', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uc4PsFnA_LX1IWsDI_CqmJmapWXu2BYO'], 'files': [{'checksum': 'f89486e61491e0d19cb55c4f873834c0', 'path': '2802007/2022-02-10/72a5df48f125ad39473575cd1c0c5483604c7499', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uc4PsFnA_LX1IWsDI_CqmJmapWXu2BYO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:12.609221Z', 'territory_id': '2802007'} 2023-11-28 02:57:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-22', 'edition_number': '751', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A8Om-QSRW-2C_2xp11RrSIBFsrJRBjnV'], 'files': [{'checksum': 'b49df25a20a0cd697ed7fb038c43a82d', 'path': '2802007/2022-02-22/487a61c5cc4f5454619c9c30c11ea232a1fb088e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A8Om-QSRW-2C_2xp11RrSIBFsrJRBjnV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:32.866806Z', 'territory_id': '2802007'} 2023-11-28 02:57:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-21', 'edition_number': '750', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uo9F2yOPSpUO6I0Jcw5cN30u0w7ui339'], 'files': [{'checksum': 'fe91ab1fa3af109394438da140599f2a', 'path': '2802007/2022-02-21/6604cb3a278dac96603bee387d539be26006fc09', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uo9F2yOPSpUO6I0Jcw5cN30u0w7ui339'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:28.481397Z', 'territory_id': '2802007'} 2023-11-28 02:57:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-23', 'edition_number': '752', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Dky4nh0vEf1JDwweHf6SnzJkKdzz8J78'], 'files': [{'checksum': 'fc783405265bc2fc085c5de81cc30a72', 'path': '2802007/2022-02-23/439e0469b98fc414f2a1c5a20585409876d7c26a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Dky4nh0vEf1JDwweHf6SnzJkKdzz8J78'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:17.168442Z', 'territory_id': '2802007'} 2023-11-28 02:57:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-24', 'edition_number': '753', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U3EmrgiOE6qG68ILz51k8ZuMll_i_RJr'], 'files': [{'checksum': 'a426cfda1a24d1bc36080aa3ca78479f', 'path': '2802007/2022-02-24/a6b6675715e9d79ce59423258b65228802254ad2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U3EmrgiOE6qG68ILz51k8ZuMll_i_RJr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:19.999335Z', 'territory_id': '2802007'} 2023-11-28 02:57:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-07', 'edition_number': '741', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S6nzq6TiTM-rXOGhribIbRKRb--rqhWZ'], 'files': [{'checksum': 'c61ad82c2f032249d97559944437c0b7', 'path': '2802007/2022-02-07/4d444d4577ef8e9a626c296900807c7041d21ebb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S6nzq6TiTM-rXOGhribIbRKRb--rqhWZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:05.133585Z', 'territory_id': '2802007'} 2023-11-28 02:57:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-03', 'edition_number': '756', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1k8o9UTNiEbaOW8fG0g6rU3e1grW0U-U3'], 'files': [{'checksum': 'e83d95428eb90ad9cdd13e8bfe4f281c', 'path': '2802007/2022-03-03/d836b7a33990e779bf59d04621c999211ada5b36', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1k8o9UTNiEbaOW8fG0g6rU3e1grW0U-U3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:27.897640Z', 'territory_id': '2802007'} 2023-11-28 02:57:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-25', 'edition_number': '754', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dw07nioICHlVX_U-_eQk6gYl7WECu8Jc'], 'files': [{'checksum': '82a7362b700f62499e0d743dd0cb06a0', 'path': '2802007/2022-02-25/025e03eb83941b728818e98762f20c7e39524c07', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dw07nioICHlVX_U-_eQk6gYl7WECu8Jc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:22.714476Z', 'territory_id': '2802007'} 2023-11-28 02:57:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-07', 'edition_number': '758', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PjVysTo5sBDvFgJy80CM79a8g8wP7kKP'], 'files': [{'checksum': 'e84c67a6a9014c4f973f6bc09ef80fa0', 'path': '2802007/2022-03-07/484c68d8790e7f679005c53653507708efeb4c66', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PjVysTo5sBDvFgJy80CM79a8g8wP7kKP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:31.834665Z', 'territory_id': '2802007'} 2023-11-28 02:57:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-04', 'edition_number': '757', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1beoxEIF9CPAbAgH9bimfMG8h6vS3AWot'], 'files': [{'checksum': 'b7b572e2c7e6d02c245ac5fa1b10927f', 'path': '2802007/2022-03-04/6c8e97bd1c8007cbb7463a02c444f93a5032ee73', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1beoxEIF9CPAbAgH9bimfMG8h6vS3AWot'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:30.071188Z', 'territory_id': '2802007'} 2023-11-28 02:57:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-10', 'edition_number': '761', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1E4fj7AgZ7DNPULloOxu3mRMsOWbqXoWd'], 'files': [{'checksum': 'eda066b9bd3514835acb0559fd68afef', 'path': '2802007/2022-03-10/de4df808aad472231cab960ed663152e0bf552dc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1E4fj7AgZ7DNPULloOxu3mRMsOWbqXoWd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:31.621483Z', 'territory_id': '2802007'} 2023-11-28 02:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-27', 'edition_number': '755', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dpHHqj6XEZ9sJsILAULaiR_qn1tP5c7c'], 'files': [{'checksum': '78e3b930fe026033ad8f878a822b0f04', 'path': '2802007/2022-02-27/8e46f58b968e3e6b9fbf1c9385dc8905ce1b4dc8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dpHHqj6XEZ9sJsILAULaiR_qn1tP5c7c'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:24.559125Z', 'territory_id': '2802007'} 2023-11-28 02:57:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-11', 'edition_number': '762', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1f-zCqyPmJrFCBXIt91uyyklP_BXsUHVb'], 'files': [{'checksum': 'b9b6da39bb82ea790670cb67ef87b52e', 'path': '2802007/2022-03-11/7133e9ff0360beeef93d5ab49f7372f7bbca5235', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1f-zCqyPmJrFCBXIt91uyyklP_BXsUHVb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:35.602767Z', 'territory_id': '2802007'} 2023-11-28 02:57:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-18', 'edition_number': '749', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11veEP9LjGfnhwmkDm60NWigZ7uMskL_W'], 'files': [{'checksum': 'af7591da974b19855d01c25ce59369fe', 'path': '2802007/2022-02-18/a7b1673acb0f2a0ec2787808bb867b4e6955d145', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11veEP9LjGfnhwmkDm60NWigZ7uMskL_W'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:45:25.535268Z', 'territory_id': '2802007'} 2023-11-28 02:57:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-09', 'edition_number': '760', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10axqZEKQ62S1udSsSfbochs-AgMh2Aax'], 'files': [{'checksum': 'c1bc4fd10ebd6a7d7bf52f1bff73b874', 'path': '2802007/2022-03-09/d0c70180e7b52248540fd80be96ca3fe6425a222', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10axqZEKQ62S1udSsSfbochs-AgMh2Aax'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:41.730189Z', 'territory_id': '2802007'} 2023-11-28 02:57:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-08', 'edition_number': '759', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17UK8ao3BkVLMr5EruPVR50wJvSCswuU2'], 'files': [{'checksum': '424770dc22fd374e7ba271fad58ccc60', 'path': '2802007/2022-03-08/89b5149dc37d9816e02218349648fa2b91c92c9b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17UK8ao3BkVLMr5EruPVR50wJvSCswuU2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:46:36.812675Z', 'territory_id': '2802007'} 2023-11-28 02:57:50 [scrapy.extensions.logstats] INFO: Crawled 750 pages (at 16 pages/min), scraped 748 items (at 16 items/min) 2023-11-28 02:57:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-03', 'edition_number': '739', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zk80oL8kmMaFcjR99CJXBJgHx4pMlph7'], 'files': [{'checksum': '67669d888ddf17d0705c2a4e59696d41', 'path': '2802007/2022-02-03/e888e393e61cee29c151fa8aa930336e86227765', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zk80oL8kmMaFcjR99CJXBJgHx4pMlph7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:52.525594Z', 'territory_id': '2802007'} 2023-11-28 02:57:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:57:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:57:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-15', 'edition_number': '765', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qnAEbDzQWC8JU4zq5FA7wG4wIpldAqJL'], 'files': [{'checksum': '38a18fb90f7308cac5b4e65ae6836adc', 'path': '2802007/2022-03-15/ae828a0e1f1dc75b1cd5c53cfd1e45ff01a1d4ca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qnAEbDzQWC8JU4zq5FA7wG4wIpldAqJL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:42.819447Z', 'territory_id': '2802007'} 2023-11-28 02:58:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:58:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-18', 'edition_number': '768', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RrUvyShKBHFDoJj9IPW6HgpND-HrGobz'], 'files': [{'checksum': 'f19fe3368496bd23c7cc403d4d8e62b6', 'path': '2802007/2022-03-18/8deb720ed2399e38fecf6928920c348fa62a6ab3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RrUvyShKBHFDoJj9IPW6HgpND-HrGobz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:50.514074Z', 'territory_id': '2802007'} 2023-11-28 02:58:40 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (66839415) larger than download warn size (33554432) in request . 2023-11-28 02:58:44 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:58:44 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:58:48 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 02:58:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:58:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-17', 'edition_number': '767', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LmcVibqHBKLmLybYWI1yWldjMErCRUw1'], 'files': [{'checksum': '8056ed36f77c84d7c58376012fa684c6', 'path': '2802007/2022-03-17/3fc412c600f406d63ae5f8cf8222857f2551bced', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LmcVibqHBKLmLybYWI1yWldjMErCRUw1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:48.143236Z', 'territory_id': '2802007'} 2023-11-28 02:58:50 [scrapy.extensions.logstats] INFO: Crawled 754 pages (at 4 pages/min), scraped 752 items (at 4 items/min) 2023-11-28 02:59:15 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (34398215) larger than download warn size (33554432) in request . 2023-11-28 02:59:20 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 02:59:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-22', 'edition_number': '770', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11eHpRBnC9kuPPQZaoTt8cj_VHrUqpNSB'], 'files': [{'checksum': 'c9a388a489b6ebb42b29b2698aa5fea7', 'path': '2802007/2022-03-22/492e9d49d3c8d1c31589a863238535304cbd691c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11eHpRBnC9kuPPQZaoTt8cj_VHrUqpNSB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:56.377654Z', 'territory_id': '2802007'} 2023-11-28 02:59:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-25', 'edition_number': '773', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jDDqNSqNgYUuzLOHCIgsu4hX1wK774_o'], 'files': [{'checksum': 'e35b81e50e045869c1f6c88fabbaf177', 'path': '2802007/2022-03-25/4a8f68fe5b128c00134feab1ff868b797a9c0356', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jDDqNSqNgYUuzLOHCIgsu4hX1wK774_o'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:06.802301Z', 'territory_id': '2802007'} 2023-11-28 02:59:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-29', 'edition_number': '775', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jyy2aW2pRXiBUidtppBkdPa9Z0_9by0C'], 'files': [{'checksum': 'a060261c7e50babf14854a5c1f3c8da4', 'path': '2802007/2022-03-29/c90e4225c5cd34c42fd87dd7ae6584d65212635b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jyy2aW2pRXiBUidtppBkdPa9Z0_9by0C'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:13.615177Z', 'territory_id': '2802007'} 2023-11-28 02:59:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-28', 'edition_number': '774', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1d_Xn7Gu5XwxUkn65uxJv7mgakGow7ukg'], 'files': [{'checksum': '73bafe0d1c6b6c8d6528118d9c9e3aa8', 'path': '2802007/2022-03-28/462e5e02fd2345594ca148e8e184c7c253de79b5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1d_Xn7Gu5XwxUkn65uxJv7mgakGow7ukg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:09.711658Z', 'territory_id': '2802007'} 2023-11-28 02:59:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-30', 'edition_number': '776', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dswUb76lLCQBYlT5_Fyw0D6aCLlIAzua'], 'files': [{'checksum': '8cfc9f0689a58fdc8648351863621e01', 'path': '2802007/2022-03-30/d34e3d966ad27c0dafb9000e402ae81403e9f9d7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dswUb76lLCQBYlT5_Fyw0D6aCLlIAzua'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:16.154820Z', 'territory_id': '2802007'} 2023-11-28 02:59:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-31', 'edition_number': '777', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Nxuki7ni9wd3mrxGcm0USn8GFGPYLCHB'], 'files': [{'checksum': '44ff922bbd1f7d1853e54b6aab4e8f76', 'path': '2802007/2022-03-31/5c7d541b45fd7f5679713e3f8a1cb0c1390a3202', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Nxuki7ni9wd3mrxGcm0USn8GFGPYLCHB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:18.831332Z', 'territory_id': '2802007'} 2023-11-28 02:59:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-04', 'edition_number': '779', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BliY56ZDkmSbWdwsHUZ9PbAPiaw3yKWC'], 'files': [{'checksum': '958139dbfa7990701d75fc7470efb766', 'path': '2802007/2022-04-04/efd6d922d82af1275b1f25a2a2e2e71be8be68d9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BliY56ZDkmSbWdwsHUZ9PbAPiaw3yKWC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:48.965704Z', 'territory_id': '2802007'} 2023-11-28 02:59:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-01', 'edition_number': '778', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dDu7n5U5IJiG0l_W-xnAU7urF0uEVRNE'], 'files': [{'checksum': '0fbbb145c553c4f431a845010e1969d6', 'path': '2802007/2022-04-01/fa5f0211d49cf80a147805297407917c1bbd79cc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dDu7n5U5IJiG0l_W-xnAU7urF0uEVRNE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:48.077616Z', 'territory_id': '2802007'} 2023-11-28 02:59:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-05', 'edition_number': '780', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1COZOIhwA4Cq8I4HL46JpBRbKE5tFgizW'], 'files': [{'checksum': 'f6995ecdcd8a6f7f06d1fc6059c93711', 'path': '2802007/2022-04-05/41523fabc4d6e490ab86cdba66ff4ca104cf05b2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1COZOIhwA4Cq8I4HL46JpBRbKE5tFgizW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:52.107351Z', 'territory_id': '2802007'} 2023-11-28 02:59:50 [scrapy.extensions.logstats] INFO: Crawled 763 pages (at 9 pages/min), scraped 761 items (at 9 items/min) 2023-11-28 02:59:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-24', 'edition_number': '772', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Z36Qi2vNanDVv-RELFdoRkDdfP8jbWqu'], 'files': [{'checksum': '927cddb8ffd2cf1577cc27710423dc1c', 'path': '2802007/2022-03-24/e592d32c3ffc0a0d34c16d9fddef844adae6fb54', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Z36Qi2vNanDVv-RELFdoRkDdfP8jbWqu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:03.375079Z', 'territory_id': '2802007'} 2023-11-28 02:59:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-06', 'edition_number': '657', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RdD2_m2Cp2FtybVCWzHJVcM_EQAOkDkU'], 'files': [{'checksum': 'dfe87aa9e367ba80d4e277ed5407272e', 'path': '2802007/2021-10-06/b3f52ab620874355810d187d1343b458eb1e5c81', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RdD2_m2Cp2FtybVCWzHJVcM_EQAOkDkU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:20.279222Z', 'territory_id': '2802007'} 2023-11-28 02:59:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 02:59:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 02:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-08', 'edition_number': '659', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1T4XtvsEzeW2o5BsnIFqNwCN3wnLQ9aTu'], 'files': [{'checksum': '2767fbc51acb7517f8d714dec989ed30', 'path': '2802007/2021-10-08/3a13ef3e844a00327e30695a46489c76befc04d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1T4XtvsEzeW2o5BsnIFqNwCN3wnLQ9aTu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:26.861840Z', 'territory_id': '2802007'} 2023-11-28 03:00:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-06', 'edition_number': '781', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1STMiFiZa8nmbT0RQCY1CLRDGZ3Ky6jLH'], 'files': [{'checksum': '4673f090a977349b28602414e178218d', 'path': '2802007/2022-04-06/8ccf8162da5ad9dade3e7bac2f296bae8a9c7fd7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1STMiFiZa8nmbT0RQCY1CLRDGZ3Ky6jLH'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:49:52.223600Z', 'territory_id': '2802007'} 2023-11-28 03:00:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-07', 'edition_number': '782', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dpTve8YZCjaw5TXCvSW2gQP5A26zvDXy'], 'files': [{'checksum': 'a91efe65c4bf00dc1d954995ccf501a2', 'path': '2802007/2022-04-07/267a54a40383119776f335ea36cdf2307986cd1c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dpTve8YZCjaw5TXCvSW2gQP5A26zvDXy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:49:55.735013Z', 'territory_id': '2802007'} 2023-11-28 03:00:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-08', 'edition_number': '783', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LCCJqDJy0xF8XSQsIMl_UUciSDymerNL'], 'files': [{'checksum': '63d0175ec4add31d1f755dd247fd9d03', 'path': '2802007/2022-04-08/fe55c260dcf1068c6ba545b62200d3ddaf43b6dd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LCCJqDJy0xF8XSQsIMl_UUciSDymerNL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:49:58.648000Z', 'territory_id': '2802007'} 2023-11-28 03:00:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-11', 'edition_number': '784', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yBSBgzpC9gQmCeflksR5jRSXPi9J0GD8'], 'files': [{'checksum': '5be6a75ec34f3073793306ab5e8e23b8', 'path': '2802007/2022-04-11/278b8190495d338e44c53dc9957959615e76063d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yBSBgzpC9gQmCeflksR5jRSXPi9J0GD8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:00.990362Z', 'territory_id': '2802007'} 2023-11-28 03:00:32 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (48384527) larger than download warn size (33554432) in request . 2023-11-28 03:00:37 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 03:00:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-12', 'edition_number': '785', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BZHs8vWXhfHspot8WPOUGti-RpWRaBBS'], 'files': [{'checksum': 'e33bc83c47641eec6e3910d1be9c5903', 'path': '2802007/2022-04-12/b2811e7b10ddc0eb74dfa566f09e3519478a38f9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BZHs8vWXhfHspot8WPOUGti-RpWRaBBS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:05.131602Z', 'territory_id': '2802007'} 2023-11-28 03:00:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-13', 'edition_number': '786', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uk954xdle97yhm47IBto-mTR_qOh98NU'], 'files': [{'checksum': '1b126fdeffb699e9609d18423c5735aa', 'path': '2802007/2022-04-13/89d035d097515efd35e467f82c1b9fab19285a99', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uk954xdle97yhm47IBto-mTR_qOh98NU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:08.084583Z', 'territory_id': '2802007'} 2023-11-28 03:00:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-10-07', 'edition_number': '658', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12kPS71aZWW2W2qGrtowZM7KherOs-jjS'], 'files': [{'checksum': '5daca6619a80c18b1850795588de38fd', 'path': '2802007/2021-10-07/6469352819ee827803a74041dda5dd3002a1a2bc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12kPS71aZWW2W2qGrtowZM7KherOs-jjS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:37:24.571842Z', 'territory_id': '2802007'} 2023-11-28 03:00:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:00:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-18', 'edition_number': '787', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JXtj24SSPVOm5o_UTLAKOLbgSTwaUarc'], 'files': [{'checksum': 'e693e542e07b9b09cc0ba0b74012ad6f', 'path': '2802007/2022-04-18/355f2b226939eac54ce5befc19c9b77580d5d47c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JXtj24SSPVOm5o_UTLAKOLbgSTwaUarc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:10.615763Z', 'territory_id': '2802007'} 2023-11-28 03:00:50 [scrapy.extensions.logstats] INFO: Crawled 774 pages (at 11 pages/min), scraped 772 items (at 11 items/min) 2023-11-28 03:01:04 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (43025404) larger than download warn size (33554432) in request . 2023-11-28 03:01:09 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 03:01:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-23', 'edition_number': '771', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1td9V3n9D5bor9eRSkx7x_IOhzDlbqbe2'], 'files': [{'checksum': '1019694ad8bc44ee78b4f3c223cb4240', 'path': '2802007/2022-03-23/82169cb7595bee772c41efd22f9a19d4c3aa4a6b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1td9V3n9D5bor9eRSkx7x_IOhzDlbqbe2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:48:00.603829Z', 'territory_id': '2802007'} 2023-11-28 03:01:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-20', 'edition_number': '789', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yaeXrlrpJaA1KD14LWQCyrJSRx68RyTL'], 'files': [{'checksum': 'ba4472233e26bd40530af7de51992f3c', 'path': '2802007/2022-04-20/ff502ed0ea1cf90e5b3c02fda8f7fbdb7168b16a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yaeXrlrpJaA1KD14LWQCyrJSRx68RyTL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:28.587686Z', 'territory_id': '2802007'} 2023-11-28 03:01:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-25', 'edition_number': '791', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1stszDN6a2Jc34BPdFKmGJVCs7V3nycs2'], 'files': [{'checksum': 'dee861a2dde659dcde89c7e22f67be75', 'path': '2802007/2022-04-25/9ddb2c492bb0b9ebc7f44c692496161c414e9926', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1stszDN6a2Jc34BPdFKmGJVCs7V3nycs2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:34.515066Z', 'territory_id': '2802007'} 2023-11-28 03:01:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-24', 'edition_number': '790', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ip5I3CPvvGwygUuBbfStHSFaNmK4Jop8'], 'files': [{'checksum': 'b5cede44480928ceb4aef06796004251', 'path': '2802007/2022-04-24/a6adbf35a58fff4cb173b3d1e74391d7317d6635', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ip5I3CPvvGwygUuBbfStHSFaNmK4Jop8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:31.624518Z', 'territory_id': '2802007'} 2023-11-28 03:01:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-19', 'edition_number': '788', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iOjjF2fXsEs4cjfYY1dsFyzMflfy1UvW'], 'files': [{'checksum': '1ffee1355469e9b88411215c210372e1', 'path': '2802007/2022-04-19/ca1badd09d58b6ce901de18b994f931a18e7bfea', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iOjjF2fXsEs4cjfYY1dsFyzMflfy1UvW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:14.158095Z', 'territory_id': '2802007'} 2023-11-28 03:01:26 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:01:29 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:01:36 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:01:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:50 [scrapy.extensions.logstats] INFO: Crawled 780 pages (at 6 pages/min), scraped 777 items (at 5 items/min) 2023-11-28 03:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-21', 'edition_number': '769', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1c2DgwxxDkdlcPJCD5MfsSdRoUyw-zb4O'], 'files': [{'checksum': '0a3261e9e5f6f72306a1d200579fc965', 'path': '2802007/2022-03-21/7a005c85e5a05a9786f36a0797636c31ea004303', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1c2DgwxxDkdlcPJCD5MfsSdRoUyw-zb4O'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:52.688845Z', 'territory_id': '2802007'} 2023-11-28 03:01:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-04', 'edition_number': '798', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1g0XeJ0oO_r5kmsjMuqq9pjgjWvEuJhgS'], 'files': [{'checksum': 'c3eadb29a480bff076085dadbda5d635', 'path': '2802007/2022-05-04/ecbeec18cd34f1071b5992935ff06e4abe99c6d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1g0XeJ0oO_r5kmsjMuqq9pjgjWvEuJhgS'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:51:08.527723Z', 'territory_id': '2802007'} 2023-11-28 03:01:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:01:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-02', 'edition_number': '796', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1j-zDtb4DlToSXvye8OjsaXLh3UIgtac5'], 'files': [{'checksum': 'b87249eac2b3b288d162ac72b94543ff', 'path': '2802007/2022-05-02/8e06bbeba306fb28dfb417c46f82ab1316788589', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1j-zDtb4DlToSXvye8OjsaXLh3UIgtac5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:51:00.789323Z', 'territory_id': '2802007'} 2023-11-28 03:02:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-29', 'edition_number': '795', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16drH1GQ8ytUeSNu-v4TU2VWGcyToI5A2'], 'files': [{'checksum': '05271069c9d75f9e17f8eb0694df028f', 'path': '2802007/2022-04-29/fc2b65bd17428e497107380a4bee6d33e6df1c5b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16drH1GQ8ytUeSNu-v4TU2VWGcyToI5A2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:58.104170Z', 'territory_id': '2802007'} 2023-11-28 03:02:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-06', 'edition_number': '800', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19VUYix96BGTHvR9Q8KGcYPfCCDRobQmw'], 'files': [{'checksum': 'f0186c86086353dab9a6f5275b9ff06f', 'path': '2802007/2022-05-06/18d98926328842bf341b5d7d60946a865c6d10e5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19VUYix96BGTHvR9Q8KGcYPfCCDRobQmw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:51:14.384458Z', 'territory_id': '2802007'} 2023-11-28 03:02:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-22', 'edition_number': '689', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tmcWZZnD3DLaFjZuwsFvnWXcrvJksIzR'], 'files': [{'checksum': '214f8747f15f168ac5252075c295b183', 'path': '2802007/2021-11-22/4b0616d58ff4c993859d7e8e12878e96fbf0decd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tmcWZZnD3DLaFjZuwsFvnWXcrvJksIzR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:23.210543Z', 'territory_id': '2802007'} 2023-11-28 03:02:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-03', 'edition_number': '676', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Z30Nwoou76Z50ftK4x1kijro0YHwFJcY'], 'files': [{'checksum': 'eec6a515aaff632763431d09a1dc5eec', 'path': '2802007/2021-11-03/a8cd9677d0a1023d7bc20ff0e26642508256b462', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Z30Nwoou76Z50ftK4x1kijro0YHwFJcY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:39:07.978215Z', 'territory_id': '2802007'} 2023-11-28 03:02:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-09', 'edition_number': '801', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Xh6aDQ1gHtkAzjyqQc0VCxqV0D__yMVs'], 'files': [{'checksum': 'a9d4392b698beb3719929fdbb7fc8d15', 'path': '2802007/2022-05-09/eab51df1988a1cc8780ac8acdb523500b1db9bff', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Xh6aDQ1gHtkAzjyqQc0VCxqV0D__yMVs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:19.500443Z', 'territory_id': '2802007'} 2023-11-28 03:02:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-10', 'edition_number': '803', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CEDWJWoMxbCMc4v43dfqx9L2nHjOa_HN'], 'files': [{'checksum': '6f90fc91e171c12fb5e960be82195b4d', 'path': '2802007/2022-05-10/bcb4bfa9371872d74eeb8cf52f9940e3776a31d1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CEDWJWoMxbCMc4v43dfqx9L2nHjOa_HN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:26.206302Z', 'territory_id': '2802007'} 2023-11-28 03:02:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-10', 'edition_number': '802', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zsDHzrq45hwTrLANXhYZi8Mnjl9iyCq0'], 'files': [{'checksum': '7cf7361b190259127a87ff56ed2835ce', 'path': '2802007/2022-05-10/9ba2590e0ace2c7d378294a8b6d3c4d130037cf4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zsDHzrq45hwTrLANXhYZi8Mnjl9iyCq0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:21.232984Z', 'territory_id': '2802007'} 2023-11-28 03:02:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-12', 'edition_number': '805', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O7p-7HQqSLDJ_M6NR8hBXJPQ9AXdacJJ'], 'files': [{'checksum': '2d3e04bd929607695dc9a4e8c04159ad', 'path': '2802007/2022-05-12/f0ece9bfb802363bfc3ab4848a00a507f8b2e103', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O7p-7HQqSLDJ_M6NR8hBXJPQ9AXdacJJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:32.775806Z', 'territory_id': '2802007'} 2023-11-28 03:02:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-13', 'edition_number': '806', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Bx57Y4sRZC1Ap_khhIUnrW-82D4Lai3H'], 'files': [{'checksum': '5ec93a50c8efc1a530761e0ef827cff2', 'path': '2802007/2022-05-13/7ae0c03ee8f67e2ea88e9401d46f75b33ca9a3fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Bx57Y4sRZC1Ap_khhIUnrW-82D4Lai3H'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:36.118457Z', 'territory_id': '2802007'} 2023-11-28 03:02:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-18', 'edition_number': '687', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BeqcqJUHP_HhYqlHrQeF7usQqmxEy-1A'], 'files': [{'checksum': '2714b7feb0c6666505970090adbcf7fc', 'path': '2802007/2021-11-18/d7c078c019cfe1fdaf5fe94fd37f0afda0e14da3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BeqcqJUHP_HhYqlHrQeF7usQqmxEy-1A'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:12.554689Z', 'territory_id': '2802007'} 2023-11-28 03:02:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-16', 'edition_number': '807', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xxKnMKf7vUvJq3ZFdlGdYiAg6RVSHoq-'], 'files': [{'checksum': '0fad20b19f9d2dc477fa7dc11c74d05d', 'path': '2802007/2022-05-16/5e4b05b2fe22cd9a05df73ded1888853b7ec918c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xxKnMKf7vUvJq3ZFdlGdYiAg6RVSHoq-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:39.003571Z', 'territory_id': '2802007'} 2023-11-28 03:02:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-11', 'edition_number': '804', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L8qmWwUMwvl65TSmM2BtV8gOkkIPfDFi'], 'files': [{'checksum': '6900fca7c5e39cf9743bce86486048e6', 'path': '2802007/2022-05-11/ea9c59f64ee7e6b2149af4f23c3c1fb16e78bf0a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1L8qmWwUMwvl65TSmM2BtV8gOkkIPfDFi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:28.200272Z', 'territory_id': '2802007'} 2023-11-28 03:02:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-05', 'edition_number': '799', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lPT344iXkv8FwMvbxTrzESsKMncEbiVR'], 'files': [{'checksum': '110d5d89acd8ddb8eebd2a5e3eb23539', 'path': '2802007/2022-05-05/cb1b64c48aa9d06cd537bad4e02acaf59f538718', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lPT344iXkv8FwMvbxTrzESsKMncEbiVR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:51:10.754528Z', 'territory_id': '2802007'} 2023-11-28 03:02:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-18', 'edition_number': '809', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w-M4jYuUvmMtru3HGBBGf5ugxpNg_xXx'], 'files': [{'checksum': 'd32f05a5aa61a1503b8a15f095e62b78', 'path': '2802007/2022-05-18/a4efb41f1e07194455f68766972ba47947af8bba', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w-M4jYuUvmMtru3HGBBGf5ugxpNg_xXx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:53:56.719630Z', 'territory_id': '2802007'} 2023-11-28 03:02:50 [scrapy.extensions.logstats] INFO: Crawled 796 pages (at 16 pages/min), scraped 794 items (at 17 items/min) 2023-11-28 03:02:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-03', 'edition_number': '797', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bbUdrTUG51b57z1S56Xf7wKSr5_E482Z'], 'files': [{'checksum': '1760d95e8cc2e2c17108f378f4ab9978', 'path': '2802007/2022-05-03/524f35976cfa7203cfaa39bddd8274d7df933706', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bbUdrTUG51b57z1S56Xf7wKSr5_E482Z'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:51:03.414364Z', 'territory_id': '2802007'} 2023-11-28 03:02:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-23', 'edition_number': '811', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U5TOHAFzhGyEuhHkN53ZBL3-k9YN2Fus'], 'files': [{'checksum': 'b127ef0596e2871d00b8169fa6dcd0bd', 'path': '2802007/2022-05-23/423045cf95135295c3deec0e604a09dbe9106171', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U5TOHAFzhGyEuhHkN53ZBL3-k9YN2Fus'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:00.217544Z', 'territory_id': '2802007'} 2023-11-28 03:02:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:02:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-24', 'edition_number': '812', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fvx0HGrUQIpHMF4bnkBbDexhj1dG64fX'], 'files': [{'checksum': '5d3568ee0877b3cb53f38e33b45a3438', 'path': '2802007/2022-05-24/d058d1ca36ef84a497110cd781ca9d42eab10ded', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fvx0HGrUQIpHMF4bnkBbDexhj1dG64fX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:02.772468Z', 'territory_id': '2802007'} 2023-11-28 03:03:18 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (35863042) larger than download warn size (33554432) in request . 2023-11-28 03:03:23 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 03:03:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-25', 'edition_number': '813', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gmlVkD_ezsIjF73EUaVfSotRypyY43QT'], 'files': [{'checksum': 'de80b51ec8c076331b59d3b793524f41', 'path': '2802007/2022-05-25/a6f38cd90311cdb80c133fb05856d665d65c29e7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gmlVkD_ezsIjF73EUaVfSotRypyY43QT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:06.061803Z', 'territory_id': '2802007'} 2023-11-28 03:03:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-26', 'edition_number': '814', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FHzAABnGHPVANqSQe1WdgeHK2SETGppJ'], 'files': [{'checksum': 'be2f3ba355ca6baf1d41aa9ceed50e99', 'path': '2802007/2022-05-26/0b9b1c49d9956f8ee3eacf7e6981b2cfbacdde43', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FHzAABnGHPVANqSQe1WdgeHK2SETGppJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:36.386137Z', 'territory_id': '2802007'} 2023-11-28 03:03:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-30', 'edition_number': '816', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ebaHL804JDqi3Ji1wAaLFm5RwGe9x3n0'], 'files': [{'checksum': '90fa0923c5b13e75759494f0827deda1', 'path': '2802007/2022-05-30/138660f083825fefed065e36fb83dc5e46c59684', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ebaHL804JDqi3Ji1wAaLFm5RwGe9x3n0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:42.856768Z', 'territory_id': '2802007'} 2023-11-28 03:03:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-27', 'edition_number': '815', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xDqq-1d8zVpu-EpQLvGzkhs-m9DMfwud'], 'files': [{'checksum': 'dd86c579dee48d0cceb43e27b02d5f40', 'path': '2802007/2022-05-27/2366cfd786f4f1ce884552baf1b9019b1e18015e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xDqq-1d8zVpu-EpQLvGzkhs-m9DMfwud'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:39.070655Z', 'territory_id': '2802007'} 2023-11-28 03:03:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-19', 'edition_number': '810', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11O2FvYN3rr1MF87avPv0fJFQvVrFzPZO'], 'files': [{'checksum': 'dc83ae67e15f2a1859d4817ba24595ff', 'path': '2802007/2022-05-19/a091e966023219cf569dc13cd764b04f980a742f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11O2FvYN3rr1MF87avPv0fJFQvVrFzPZO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:53:59.032116Z', 'territory_id': '2802007'} 2023-11-28 03:03:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-17', 'edition_number': '808', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oqjxug6RQKmmYkAuI28SNevDpNKnzEVf'], 'files': [{'checksum': '9f69a17ebb693ab50cf97fd077fb9fd5', 'path': '2802007/2022-05-17/0c752b522ccf98002599d803173400713a21c7c6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oqjxug6RQKmmYkAuI28SNevDpNKnzEVf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:52:43.197998Z', 'territory_id': '2802007'} 2023-11-28 03:03:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-31', 'edition_number': '818', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11mCHTRROfuLCe-w_EYBJLxsz_LNfsOl6'], 'files': [{'checksum': '87499cc48446596fe86452b9931c29f3', 'path': '2802007/2022-05-31/caacf34d2ede35f52b4a4a011a59407b4794eb9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11mCHTRROfuLCe-w_EYBJLxsz_LNfsOl6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:48.376789Z', 'territory_id': '2802007'} 2023-11-28 03:03:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-01', 'edition_number': '819', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KsUwKBxIP9emAMeuT3Do9tRZGxHP-Y-9'], 'files': [{'checksum': '2af86b22460f47bbacdafd589ca2e7b3', 'path': '2802007/2022-06-01/c6643674814eee16b6be01834b20eb743a337cae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KsUwKBxIP9emAMeuT3Do9tRZGxHP-Y-9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:51.058433Z', 'territory_id': '2802007'} 2023-11-28 03:03:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-03', 'edition_number': '821', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10w0o11RD9DVtjGWhjohgVGC5IESHkHfe'], 'files': [{'checksum': 'b42bad0bb9c4b0e5a83d9a3595768aa1', 'path': '2802007/2022-06-03/350de9e7abae73768f95628c6805dbf217e28331', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10w0o11RD9DVtjGWhjohgVGC5IESHkHfe'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:54.673039Z', 'territory_id': '2802007'} 2023-11-28 03:03:50 [scrapy.extensions.logstats] INFO: Crawled 808 pages (at 12 pages/min), scraped 806 items (at 12 items/min) 2023-11-28 03:03:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-03', 'edition_number': '820', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xAO-O0w__o6eH1JlfJNDSejbqytbsz49'], 'files': [{'checksum': '2b6909a69bd3ca1c62c7a07c7634acce', 'path': '2802007/2022-06-03/db36a55b3d6398b64d246c33db33e799165afc0c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xAO-O0w__o6eH1JlfJNDSejbqytbsz49'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:52.705339Z', 'territory_id': '2802007'} 2023-11-28 03:03:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:03:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-04', 'edition_number': '822', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-p-cFrjwbK3FdTGyqJrwxAqFA6pAw6R9'], 'files': [{'checksum': 'e9e4199e270a06c23b9cd813f760c91d', 'path': '2802007/2022-06-04/79e1deb0ad01177c948426deb270add70914ed78', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-p-cFrjwbK3FdTGyqJrwxAqFA6pAw6R9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:58.471605Z', 'territory_id': '2802007'} 2023-11-28 03:04:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-06', 'edition_number': '823', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ikZ3uo7WHSnekHFuS8p7so9wHb4Ep6aa'], 'files': [{'checksum': 'fe27e46b3131419829ba86ffd31a6466', 'path': '2802007/2022-06-06/bb3500666c0fbfe9e7c2b02c341d1a8a709ac11d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ikZ3uo7WHSnekHFuS8p7so9wHb4Ep6aa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:55:01.219295Z', 'territory_id': '2802007'} 2023-11-28 03:04:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-28', 'edition_number': '712', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K6WrQ_U0c-2PDCzAipI3CrgRlgDJk6y_'], 'files': [{'checksum': '6e57c3d0819f2d593fe10d64dfd135e1', 'path': '2802007/2021-12-28/72fad0150f01bce5ea1b26339e54ea14afdfa944', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K6WrQ_U0c-2PDCzAipI3CrgRlgDJk6y_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:29.199571Z', 'territory_id': '2802007'} 2023-11-28 03:04:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-29', 'edition_number': '713', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11x-u8R24LnOmry0cjRfBHuy5cOSBeJ3R'], 'files': [{'checksum': '089055f9354328ccb6ce0bd5bf8cd50f', 'path': '2802007/2021-12-29/6b1b0f233d3c76ab5dcbfb13ac4acdb3803a6ab7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11x-u8R24LnOmry0cjRfBHuy5cOSBeJ3R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:32.332258Z', 'territory_id': '2802007'} 2023-11-28 03:04:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-07', 'edition_number': '824', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uo7sBHdj-rcJk1b8C95RqY50BxK5UGZI'], 'files': [{'checksum': '12fc66b862120802cb5c026a27dca803', 'path': '2802007/2022-06-07/905de695fdd08502da301bdd069533f572328eb7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Uo7sBHdj-rcJk1b8C95RqY50BxK5UGZI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:55:03.959895Z', 'territory_id': '2802007'} 2023-11-28 03:04:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-08', 'edition_number': '825', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SAqmuVDLRGExPnhfUfl_hEtFJGzAMtAR'], 'files': [{'checksum': '6377f04d789cdeeee52d78a1bafe1b36', 'path': '2802007/2022-06-08/5b9ff2c586e06de68760def63304ee26abea4d91', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SAqmuVDLRGExPnhfUfl_hEtFJGzAMtAR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:55:22.863985Z', 'territory_id': '2802007'} 2023-11-28 03:04:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-09', 'edition_number': '827', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16Owu6GNG_0pHNEPO_LTyfTXNi2uTWbaB'], 'files': [{'checksum': 'abdad4bfdf580224bccdfa854b0beeaa', 'path': '2802007/2022-06-09/318081e190b79ffb0ddef61383bdf79c6725c78a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16Owu6GNG_0pHNEPO_LTyfTXNi2uTWbaB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:55:59.789114Z', 'territory_id': '2802007'} 2023-11-28 03:04:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-09', 'edition_number': '826', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GkSLzsLh5EMgvPhagLhhPLWG9erRyhvY'], 'files': [{'checksum': 'fd4a64aee9fca591dde97de902d08d44', 'path': '2802007/2022-06-09/2ca95803efcd0c53fd928a3779b1c3e2133fa60c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GkSLzsLh5EMgvPhagLhhPLWG9erRyhvY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:55:27.278438Z', 'territory_id': '2802007'} 2023-11-28 03:04:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-10', 'edition_number': '828', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dwoUPwsn_8NeEyZX8tgFzvftHgYD9K7R'], 'files': [{'checksum': '5b488fa4d0f8888813c164ca43b64c8d', 'path': '2802007/2022-06-10/d40c1d31211433c3f1dfef148d5e5544cc5614aa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dwoUPwsn_8NeEyZX8tgFzvftHgYD9K7R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:56:07.273756Z', 'territory_id': '2802007'} 2023-11-28 03:04:50 [scrapy.extensions.logstats] INFO: Crawled 818 pages (at 10 pages/min), scraped 816 items (at 10 items/min) 2023-11-28 03:04:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-13', 'edition_number': '829', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19MoC4Lf4qnr72cFHdnmjmApFJGw7-cnm'], 'files': [{'checksum': '614fcd9c8e64a317fe84f500b3c49cb3', 'path': '2802007/2022-06-13/aa8aab0cbe54a040226569846ca2e972199c0fa2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19MoC4Lf4qnr72cFHdnmjmApFJGw7-cnm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:56:10.169345Z', 'territory_id': '2802007'} 2023-11-28 03:04:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-14', 'edition_number': '830', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HTNkE5fcF3TwfELhCQ3IyB_PmEM9ay9a'], 'files': [{'checksum': '28ec743bb24041ae2de78fdc8889d296', 'path': '2802007/2022-06-14/2f0a79563f9c98566426328a6660ac520136af5e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HTNkE5fcF3TwfELhCQ3IyB_PmEM9ay9a'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:56:13.307582Z', 'territory_id': '2802007'} 2023-11-28 03:04:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:04:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-12-27', 'edition_number': '711', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wwmEzaT3XMeQgCemi67V1nII3ZwjbI4m'], 'files': [{'checksum': '4a2bf3bbb8f40fcfae88f8df3cbadcd1', 'path': '2802007/2021-12-27/d5ce056a48b79fae06a37d03673094e71d723050', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wwmEzaT3XMeQgCemi67V1nII3ZwjbI4m'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:26.599995Z', 'territory_id': '2802007'} 2023-11-28 03:05:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-05-31', 'edition_number': '817', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ClhjoIZD0gSFHIuq4dlemuO9eHQKzWvO'], 'files': [{'checksum': '222032ee2acff53364aae4a3ecbc8031', 'path': '2802007/2022-05-31/2c1c5f31bfb10bcd51346df8da20c5d8d16649bd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ClhjoIZD0gSFHIuq4dlemuO9eHQKzWvO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:54:45.382339Z', 'territory_id': '2802007'} 2023-11-28 03:05:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:05:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-20', 'edition_number': '833', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zVwOv9WSacLRq0M5dMipKa1u1pAN4BbU'], 'files': [{'checksum': 'd438846ca7c37c3064231dbcae5c5994', 'path': '2802007/2022-06-20/74e3e3f89da98d55704539bb6f6108dba6192301', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zVwOv9WSacLRq0M5dMipKa1u1pAN4BbU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:01.523064Z', 'territory_id': '2802007'} 2023-11-28 03:05:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:05:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-17', 'edition_number': '832', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OpfBjcQwHmdM8YVZ2d6KxBcApCt_leca'], 'files': [{'checksum': 'a0c3daa1523d46f8a2d613059686799c', 'path': '2802007/2022-06-17/f909b14dcd89e80b8d5812caeab62f85b640c6a0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OpfBjcQwHmdM8YVZ2d6KxBcApCt_leca'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:56:19.111346Z', 'territory_id': '2802007'} 2023-11-28 03:05:08 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:05:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-23', 'edition_number': '836', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qqcSV4GHilh2iwDKxFH-q4B1RET4yqA4'], 'files': [{'checksum': '5c6005c57dd6b138d489dd39ba829acd', 'path': '2802007/2022-06-23/192fe5497f2786630ade7a1847a06a157c4614bd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qqcSV4GHilh2iwDKxFH-q4B1RET4yqA4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:10.010915Z', 'territory_id': '2802007'} 2023-11-28 03:05:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-15', 'edition_number': '831', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12KBLuK8aB06F2Ys2tWMxxCX0VzCQlTFK'], 'files': [{'checksum': '5dd6dccbbce55973b30ede2cc1407034', 'path': '2802007/2022-06-15/5e903e5d5c60e630c9f2606344d2ab9be5e7f661', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12KBLuK8aB06F2Ys2tWMxxCX0VzCQlTFK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:56:17.217927Z', 'territory_id': '2802007'} 2023-11-28 03:05:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-30', 'edition_number': '840', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KtkYcXEjxluVnYc3VX8P3mkKw3LTENh0'], 'files': [{'checksum': 'bc55873744d1812f1a4abd190c140475', 'path': '2802007/2022-06-30/8531144f14a67846a1f0aeebe8807ae6de8145b6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KtkYcXEjxluVnYc3VX8P3mkKw3LTENh0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:24.675954Z', 'territory_id': '2802007'} 2023-11-28 03:05:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-28', 'edition_number': '839', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A-LPJyu7JWOY6vHeDPHpjqUC-aS0f4am'], 'files': [{'checksum': '3f70f2bc6a18a71d946265ced439552c', 'path': '2802007/2022-06-28/47c298c7fa8d6d803cfe59e3a96ff1972f5de2b6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A-LPJyu7JWOY6vHeDPHpjqUC-aS0f4am'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:20.819849Z', 'territory_id': '2802007'} 2023-11-28 03:05:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-01', 'edition_number': '841', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_nqDWkPn4rA9HjLnxcMzuiLqQMKvrHts'], 'files': [{'checksum': '30b5e2a3c6001a038975f88cffa68474', 'path': '2802007/2022-07-01/7a00f5b91b56aae17c869df7dd7cf89d9d9466f4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_nqDWkPn4rA9HjLnxcMzuiLqQMKvrHts'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:27.670598Z', 'territory_id': '2802007'} 2023-11-28 03:05:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-04', 'edition_number': '842', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Ggxl48aFJ_0lcUQCAZITHlZyu12M4i0'], 'files': [{'checksum': '48ee36c39d51308b65c7f8464ef7d38a', 'path': '2802007/2022-07-04/489929957bde4a6abc3d7a31b33f88efc27ed982', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Ggxl48aFJ_0lcUQCAZITHlZyu12M4i0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:30.622103Z', 'territory_id': '2802007'} 2023-11-28 03:05:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-05', 'edition_number': '843', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bW6PjGcu3VRKcBOUpr4v4t5po3MicxDq'], 'files': [{'checksum': 'd2848fbdbf9d98e55a792fea454a43b2', 'path': '2802007/2022-07-05/13ad7ef26f557e652dfea94648326c8741e4d9d2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bW6PjGcu3VRKcBOUpr4v4t5po3MicxDq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:34.631991Z', 'territory_id': '2802007'} 2023-11-28 03:05:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-27', 'edition_number': '837', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_U-QnQP97pNF7V2-Txtc7JDSxJXc9bm4'], 'files': [{'checksum': 'd732b4ff9fa5b93b12adbbb4cf116bd6', 'path': '2802007/2022-06-27/20b0068656dc97dfb034d565745bbee05cf442e8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_U-QnQP97pNF7V2-Txtc7JDSxJXc9bm4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:14.447017Z', 'territory_id': '2802007'} 2023-11-28 03:05:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-06', 'edition_number': '844', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O0d8KbXpPqwXvnAFiTQdgOsVVIvk0jXZ'], 'files': [{'checksum': '3bcffc59fbc20f0076e8a03be06197af', 'path': '2802007/2022-07-06/3d8f45ff14a9aa7eb753dc39532e7cafcb10db6c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O0d8KbXpPqwXvnAFiTQdgOsVVIvk0jXZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:36.963947Z', 'territory_id': '2802007'} 2023-11-28 03:05:50 [scrapy.extensions.logstats] INFO: Crawled 833 pages (at 15 pages/min), scraped 831 items (at 15 items/min) 2023-11-28 03:05:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-12', 'edition_number': '847', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O_6jZ84EKAfbHfo9qwWCdURGKoEe8slK'], 'files': [{'checksum': '82782cd311b190945ef617abb4404c1d', 'path': '2802007/2022-07-12/0558c6ebf13b7ad7ec17ba965eda0a9791d2f295', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O_6jZ84EKAfbHfo9qwWCdURGKoEe8slK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:46.366616Z', 'territory_id': '2802007'} 2023-11-28 03:05:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-11', 'edition_number': '846', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ciLabM-3vnEAL3als8og15w0ibsJEz1J'], 'files': [{'checksum': '1ec1149706309f6dafd9942102ca5254', 'path': '2802007/2022-07-11/1e2697cb4cc8e27edd1a719a7822c8732b1e8f99', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ciLabM-3vnEAL3als8og15w0ibsJEz1J'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:42.118279Z', 'territory_id': '2802007'} 2023-11-28 03:05:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-13', 'edition_number': '848', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LVXVbSfRvKX--AnSxIAzHiwYs4aMhm5w'], 'files': [{'checksum': 'b73d5324deb20578e8ebab67cff25b85', 'path': '2802007/2022-07-13/a6fbf9f980e6eddf2db0aa6eb8e14c572160361d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LVXVbSfRvKX--AnSxIAzHiwYs4aMhm5w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:49.313507Z', 'territory_id': '2802007'} 2023-11-28 03:05:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:05:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-14', 'edition_number': '849', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AGpChLfqzsQ1gL6hEGagfQjQCvZ5pJUg'], 'files': [{'checksum': '6b14341b75a77cb4de4d1ea2653d468c', 'path': '2802007/2022-07-14/8c989810532f70e70e69a6b7a7775ad48010181f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AGpChLfqzsQ1gL6hEGagfQjQCvZ5pJUg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:52.622087Z', 'territory_id': '2802007'} 2023-11-28 03:06:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-15', 'edition_number': '850', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tF27CJpaeX_XVjPBOcGTZS8sBlLHBfNR'], 'files': [{'checksum': 'f68e4d6cc7b2377577051cbbd8f8ddcc', 'path': '2802007/2022-07-15/f9f28688777de0a0cca7955781630d2bda170122', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tF27CJpaeX_XVjPBOcGTZS8sBlLHBfNR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:57.903907Z', 'territory_id': '2802007'} 2023-11-28 03:06:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-28', 'edition_number': '838', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xZem6brsm7CPmwxzRjfSO9s8xf1d7ldk'], 'files': [{'checksum': '0e4684a9f3a0f00aa772fd2dcec4f345', 'path': '2802007/2022-06-28/6e29c321e19ea2aeb651fe461060f8e82c02af42', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xZem6brsm7CPmwxzRjfSO9s8xf1d7ldk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:16.977019Z', 'territory_id': '2802007'} 2023-11-28 03:06:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-07', 'edition_number': '845', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LeQQPJ_wVjkA2kM9LfDz5eUnT9bDUJtm'], 'files': [{'checksum': '6b7b491c9fa90f6f9c136de471e962ad', 'path': '2802007/2022-07-07/a8730fc75bd1ca20229a921f5eb6da63346d020d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LeQQPJ_wVjkA2kM9LfDz5eUnT9bDUJtm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:39.661068Z', 'territory_id': '2802007'} 2023-11-28 03:06:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-22', 'edition_number': '835', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=184KIcW-wQwgqxJMOI8gJXbo1bafb6ldO'], 'files': [{'checksum': 'e7b7069a3c240a45a422299e6050244a', 'path': '2802007/2022-06-22/d98e307b4b121961da074ac7ff623e1353177f54', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=184KIcW-wQwgqxJMOI8gJXbo1bafb6ldO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:07.633985Z', 'territory_id': '2802007'} 2023-11-28 03:06:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-19', 'edition_number': '853', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17pm_gAQO6QuEf7TGA5UEp6sWa1HICvlH'], 'files': [{'checksum': '5b8c01d7bea19c06b3386f63f17ec80e', 'path': '2802007/2022-07-19/8b121bdf452055cd487e9ba1473548a1a3053019', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17pm_gAQO6QuEf7TGA5UEp6sWa1HICvlH'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:20.767400Z', 'territory_id': '2802007'} 2023-11-28 03:06:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-19', 'edition_number': '852', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vWImArWwQvUzZLJLrccpoTzk_mxiBIcW'], 'files': [{'checksum': '35d74971c7cd246670747267b38370c3', 'path': '2802007/2022-07-19/16a77a8fbf927c5b5069334fdeed7f31e3eabaed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vWImArWwQvUzZLJLrccpoTzk_mxiBIcW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:58:49.629421Z', 'territory_id': '2802007'} 2023-11-28 03:06:28 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): 500 Internal Server Error 2023-11-28 03:06:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-22', 'edition_number': '855', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11qGZiigigNzcPPdoVp8f-ZN97PNc1L8x'], 'files': [{'checksum': 'd0f943d31b950a005072ff7d82f428fc', 'path': '2802007/2022-07-22/f9d5e615388d90e8bdc1ad6cde5dba1250458080', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11qGZiigigNzcPPdoVp8f-ZN97PNc1L8x'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:26.950395Z', 'territory_id': '2802007'} 2023-11-28 03:06:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-25', 'edition_number': '856', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jz7SbnShaEu3NB8N1i5i9CjAYltOErnt'], 'files': [{'checksum': '73d748d5d20ad254221f87a869b53d72', 'path': '2802007/2022-07-25/f3976193cd5736e715765b4df30513f968c0356f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jz7SbnShaEu3NB8N1i5i9CjAYltOErnt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:29.058983Z', 'territory_id': '2802007'} 2023-11-28 03:06:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-20', 'edition_number': '854', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yNgp4sinUMGzfkA7QEYwDyjebYLGX7OM'], 'files': [{'checksum': '4ce5780d441aeb32b10c3b2b86436d73', 'path': '2802007/2022-07-20/f748f7b87bfa7af458757bdefb07a0c74c09e31c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yNgp4sinUMGzfkA7QEYwDyjebYLGX7OM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:23.175368Z', 'territory_id': '2802007'} 2023-11-28 03:06:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-28', 'edition_number': '859', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WyMqmqFnpicCjHEcfxyEvojR9goF3wDW'], 'files': [{'checksum': '3b0d29e75da671b57d851e7bb715352c', 'path': '2802007/2022-07-28/5434f6ab748958054391a34681f9d9d369794ced', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1WyMqmqFnpicCjHEcfxyEvojR9goF3wDW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:37.838797Z', 'territory_id': '2802007'} 2023-11-28 03:06:50 [scrapy.extensions.logstats] INFO: Crawled 847 pages (at 14 pages/min), scraped 845 items (at 14 items/min) 2023-11-28 03:06:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-27', 'edition_number': '858', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KCeDF-cNgIIB-e6fsn0L3MhTE2Nhp4NQ'], 'files': [{'checksum': 'a9bd5d2f1ee52c79fc1769ded98fa97e', 'path': '2802007/2022-07-27/f79f3d1ec2a89cb49a1397202c976dad0838fdfd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KCeDF-cNgIIB-e6fsn0L3MhTE2Nhp4NQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:34.198348Z', 'territory_id': '2802007'} 2023-11-28 03:06:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:06:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-29', 'edition_number': '860', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=134TdmIp0Akx-EkYmhF1dxbQtD7UcBaEn'], 'files': [{'checksum': '4c492a399e6caa335bbe4391ec06ef2e', 'path': '2802007/2022-07-29/1f2adf6864ec0d4b9d3c3144cc5cb50e8bd9e35d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=134TdmIp0Akx-EkYmhF1dxbQtD7UcBaEn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:42.969690Z', 'territory_id': '2802007'} 2023-11-28 03:07:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-02', 'edition_number': '862', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rMAKejFDKxQqiGcH17D2GidNZ3GDA9YV'], 'files': [{'checksum': 'd9bc9ed7a8045ebf836dbc1316c247b3', 'path': '2802007/2022-08-02/7e260d9a34a39fae7bef7e58e008e5c7e6b2591e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rMAKejFDKxQqiGcH17D2GidNZ3GDA9YV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:50.226501Z', 'territory_id': '2802007'} 2023-11-28 03:07:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-01', 'edition_number': '861', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CbloXAjk38shK0vitr92AaikDW-umCES'], 'files': [{'checksum': '137da98d17304a2637c949461903a4ca', 'path': '2802007/2022-08-01/9aa5cafb79a797ef52545a43eb303476dcdbf30a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1CbloXAjk38shK0vitr92AaikDW-umCES'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:46.593304Z', 'territory_id': '2802007'} 2023-11-28 03:07:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-03', 'edition_number': '863', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Et3vfCvxcxsF5MrPTKMTjDZEWZqo-38q'], 'files': [{'checksum': '8d63f512e6535b069937a4849c6784b5', 'path': '2802007/2022-08-03/6ade27f60fe10a1f6b1f8503fcbdc716c4e1ca45', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Et3vfCvxcxsF5MrPTKMTjDZEWZqo-38q'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:54.214290Z', 'territory_id': '2802007'} 2023-11-28 03:07:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-04', 'edition_number': '864', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17HpZi4JhjjyblzG1-QcGjSCmJfKmEN7P'], 'files': [{'checksum': 'c11c0eba48d93c1b9da1441bd77bbfd4', 'path': '2802007/2022-08-04/d063a96abbc7efdfab65388ee0ae6afcb31a958a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17HpZi4JhjjyblzG1-QcGjSCmJfKmEN7P'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:58.854512Z', 'territory_id': '2802007'} 2023-11-28 03:07:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-26', 'edition_number': '857', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oFjeaTx5DgwpBbQfTzQ0LVOWXeEXitxv'], 'files': [{'checksum': '698c25bd93f8101836a3d7880edc7e32', 'path': '2802007/2022-07-26/b13835ab5e17e92f90f6d987833e23c6007f5ece', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oFjeaTx5DgwpBbQfTzQ0LVOWXeEXitxv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:59:31.749329Z', 'territory_id': '2802007'} 2023-11-28 03:07:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-02', 'edition_number': '738', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17ei4JT9uoDb9TVEjkcxXdnO44Eq7Gsyf'], 'files': [{'checksum': '8942427c54f98f7b28dba7d2ebdfadd1', 'path': '2802007/2022-02-02/f4ce0f39c73250b81c4c218a0ab56b8c3434fe72', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17ei4JT9uoDb9TVEjkcxXdnO44Eq7Gsyf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:49.002005Z', 'territory_id': '2802007'} 2023-11-28 03:07:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-07-18', 'edition_number': '851', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16Rbfsrz1o5jva4LFjYdcZgnY2rNkKaLM'], 'files': [{'checksum': '003d45364a3e75f3518f946cd2dcc73a', 'path': '2802007/2022-07-18/c5e38c27afd5ac5e2da909e7de674b646d38f91e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16Rbfsrz1o5jva4LFjYdcZgnY2rNkKaLM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:58:10.753097Z', 'territory_id': '2802007'} 2023-11-28 03:07:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-02-01', 'edition_number': '737', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qsUzaM03dcumV68fLucq6DwMsqId6Lq4'], 'files': [{'checksum': 'ca55d40e8fdcfd55f6702b906aa2b4b8', 'path': '2802007/2022-02-01/9ff1328d33dc5b42b39e749efd7e45f7fbc11bca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1qsUzaM03dcumV68fLucq6DwMsqId6Lq4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:44:45.832928Z', 'territory_id': '2802007'} 2023-11-28 03:07:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-11', 'edition_number': '869', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Dj1M-osTZoqDTYtLdInA7AZdcLYB06c'], 'files': [{'checksum': '041e9766cfc238df109f6572945aea86', 'path': '2802007/2022-08-11/e42cfd3965abe1c2b680d39902c86b681a7c99fd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Dj1M-osTZoqDTYtLdInA7AZdcLYB06c'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:39.696698Z', 'territory_id': '2802007'} 2023-11-28 03:07:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-09', 'edition_number': '867', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A0WTrwk4s2R7LD25OgXHj7IFMAEOcdrO'], 'files': [{'checksum': '16a2c5a4c27a7e96f156ceb371122c79', 'path': '2802007/2022-08-09/28d325dd72036552256628f8923968e2a3a64149', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1A0WTrwk4s2R7LD25OgXHj7IFMAEOcdrO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:08.523332Z', 'territory_id': '2802007'} 2023-11-28 03:07:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-17', 'edition_number': '872', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b52gjweqBSTJUqS2LQOsDXh7ZiMDETxE'], 'files': [{'checksum': '625bc60130bb8bb26ce89cb68b3ec2eb', 'path': '2802007/2022-08-17/9b26933f627475fbd9aa2731824e52004e3db9a5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b52gjweqBSTJUqS2LQOsDXh7ZiMDETxE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:48.868050Z', 'territory_id': '2802007'} 2023-11-28 03:07:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-16', 'edition_number': '871', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jpObEzoyMcpgigePHkG4Ct2pmNCPtzcO'], 'files': [{'checksum': 'ad687c957b38d1f98e9e457ed8b2d657', 'path': '2802007/2022-08-16/5409d5c3458e1e78f7e8142af6e43a1c5801d51d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jpObEzoyMcpgigePHkG4Ct2pmNCPtzcO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:46.320498Z', 'territory_id': '2802007'} 2023-11-28 03:07:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-12', 'edition_number': '870', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dm4aYy8RW0j0b02AK4Gf1nswD6ETDfyD'], 'files': [{'checksum': '59d4e20813cc7f8ae63ba29dd151346c', 'path': '2802007/2022-08-12/2f638d7f765dc9a8436fb6e611488cb0c4de49a6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dm4aYy8RW0j0b02AK4Gf1nswD6ETDfyD'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:43.010597Z', 'territory_id': '2802007'} 2023-11-28 03:07:50 [scrapy.extensions.logstats] INFO: Crawled 862 pages (at 15 pages/min), scraped 860 items (at 15 items/min) 2023-11-28 03:07:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-10', 'edition_number': '868', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NAmlYDsAMIUD9Tukr93Q219wa5y_9rJd'], 'files': [{'checksum': 'df93cfdc76214c5eae0ee2fa65fa0bdd', 'path': '2802007/2022-08-10/d698ac628e56ecdd9ad18cff1e18b96602a30083', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NAmlYDsAMIUD9Tukr93Q219wa5y_9rJd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:12.058843Z', 'territory_id': '2802007'} 2023-11-28 03:07:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-22', 'edition_number': '875', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1stKIl7YS9s1p2clbgudFg-QeaumIXaB-'], 'files': [{'checksum': '9c713ccadba1ef26e660a50d5eb759f5', 'path': '2802007/2022-08-22/4a2467dd555d667928f99720e36466b8afe21e83', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1stKIl7YS9s1p2clbgudFg-QeaumIXaB-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:15.811303Z', 'territory_id': '2802007'} 2023-11-28 03:07:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-19', 'edition_number': '874', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LHGMXrMbMEs0QkANiOtZwO4tpLrNRRTw'], 'files': [{'checksum': '680af798514f6216251970bc5cd816dc', 'path': '2802007/2022-08-19/cbadc548e5451f65736c60a603ddd2b9cf643511', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LHGMXrMbMEs0QkANiOtZwO4tpLrNRRTw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:12.947423Z', 'territory_id': '2802007'} 2023-11-28 03:07:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:07:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-24', 'edition_number': '877', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Fe1hEVuSzbafsEL3ZU1w6yEx5puMnsrE'], 'files': [{'checksum': 'eca5b713e000b6ce997635c09cb0f3ca', 'path': '2802007/2022-08-24/ab9facd5543845b28668f5e30cacd0054a86f746', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Fe1hEVuSzbafsEL3ZU1w6yEx5puMnsrE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:21.026758Z', 'territory_id': '2802007'} 2023-11-28 03:08:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-18', 'edition_number': '873', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EX6Hq7x0j7m_Hif1lkGNRdt8sEI99r6C'], 'files': [{'checksum': '6fb2ae8a3605f8f2331b21da2f000090', 'path': '2802007/2022-08-18/6ce72d60011eee437f71cac69b62180e629392df', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EX6Hq7x0j7m_Hif1lkGNRdt8sEI99r6C'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:10.917964Z', 'territory_id': '2802007'} 2023-11-28 03:08:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-08', 'edition_number': '866', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AVw273Y6Es3JCxG6Xb28OU3pcpyJdmHg'], 'files': [{'checksum': '48a89b7ef3d6df826fe7c4a4feb45d3c', 'path': '2802007/2022-08-08/9e39a15755196705b9c3e962ddbfb5a8d4147bc4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AVw273Y6Es3JCxG6Xb28OU3pcpyJdmHg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:04.243452Z', 'territory_id': '2802007'} 2023-11-28 03:08:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-23', 'edition_number': '876', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NDppkp7qTtG0DriloprCml-DOizmeWNA'], 'files': [{'checksum': 'ea575101f3b9d95c6cadc039b9a76f9d', 'path': '2802007/2022-08-23/06e176aa780ae2e7671edd0f8127476956c5eb4b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NDppkp7qTtG0DriloprCml-DOizmeWNA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:18.396887Z', 'territory_id': '2802007'} 2023-11-28 03:08:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-25', 'edition_number': '878', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kofQsbCMm6DvPKR8MIbgH-5lrDKe_Xzo'], 'files': [{'checksum': 'b3cde6d2ff6c5d3737aafc82d8d30030', 'path': '2802007/2022-08-25/a17a2f2b6a0a83d39f0010d64e11ee77d62d666a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kofQsbCMm6DvPKR8MIbgH-5lrDKe_Xzo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:50.044954Z', 'territory_id': '2802007'} 2023-11-28 03:08:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-14', 'edition_number': '763', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=148FxiHpu7takHAHDnDTfn8HyaSG_ma4R'], 'files': [{'checksum': 'a79b7d36e1456f859ec07aa062bdd90f', 'path': '2802007/2022-03-14/98c2052fc8a7148b7f60dadc50d9d5ccf9a6e377', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=148FxiHpu7takHAHDnDTfn8HyaSG_ma4R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:37.941686Z', 'territory_id': '2802007'} 2023-11-28 03:08:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-29', 'edition_number': '879', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hMlSBUlygvy2l7ykWntQDV9vGYRlFlwR'], 'files': [{'checksum': '1040aaf921c950b14ae73c1e0cee0143', 'path': '2802007/2022-08-29/e9f6c8fc12ca359dd73130742c7c9bb8aa55bf2c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hMlSBUlygvy2l7ykWntQDV9vGYRlFlwR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:52.587468Z', 'territory_id': '2802007'} 2023-11-28 03:08:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-31', 'edition_number': '881', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1C8EsYShbQ9axVk2u9MhgWUkSX8Kdbnf7'], 'files': [{'checksum': '9f7bd69132baccfd391af8fba199aa67', 'path': '2802007/2022-08-31/17d65ccff85aff54540935a187572412dfefbd20', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1C8EsYShbQ9axVk2u9MhgWUkSX8Kdbnf7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:07.522173Z', 'territory_id': '2802007'} 2023-11-28 03:08:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-05', 'edition_number': '865', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1n76S9byg_C2iWvzCuLNtuGxcllhHeYnm'], 'files': [{'checksum': '3edabc793ba23ab73368eb7309645a3c', 'path': '2802007/2022-08-05/1f3e992ec0f469e6035ab05603d7234628b3a053', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1n76S9byg_C2iWvzCuLNtuGxcllhHeYnm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:00:01.026673Z', 'territory_id': '2802007'} 2023-11-28 03:08:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-02', 'edition_number': '883', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PrdoU0IEi7P0ahCYQvlbe3WpFDMLOl_K'], 'files': [{'checksum': '94c4c86135a9a80e665ffdb50eabbe8c', 'path': '2802007/2022-09-02/2af30017360fcf0391b18eb5da60799c670c8723', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PrdoU0IEi7P0ahCYQvlbe3WpFDMLOl_K'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:14.550466Z', 'territory_id': '2802007'} 2023-11-28 03:08:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-05', 'edition_number': '884', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1W7Okael6bekPUJkyyEF9clTj1P3q7vny'], 'files': [{'checksum': 'a35a3ae56a56e02b415893f8b307ffa0', 'path': '2802007/2022-09-05/677d3612f538fda18b74878e2f77532700c71946', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1W7Okael6bekPUJkyyEF9clTj1P3q7vny'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:18.628681Z', 'territory_id': '2802007'} 2023-11-28 03:08:41 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): 500 Internal Server Error 2023-11-28 03:08:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-06', 'edition_number': '885', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wioBnWZOQSdod1Aek9-cpMkVPg_Qps4V'], 'files': [{'checksum': 'd99f9fa489d4046a8372f6e45bfa68ed', 'path': '2802007/2022-09-06/b8d75297e673a60363a4bb76c7140811cfa5b911', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wioBnWZOQSdod1Aek9-cpMkVPg_Qps4V'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:20.414058Z', 'territory_id': '2802007'} 2023-11-28 03:08:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-09', 'edition_number': '887', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10bhIoNc25Ep1mSyd6UQGQyp6rkwvTh7y'], 'files': [{'checksum': '65e73510b4145f436237a1954bb6185f', 'path': '2802007/2022-09-09/44548b154d8da9fe2a5e47c6ece283ad9354c0fb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10bhIoNc25Ep1mSyd6UQGQyp6rkwvTh7y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:28.521428Z', 'territory_id': '2802007'} 2023-11-28 03:08:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-08', 'edition_number': '886', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H9EUWtDN9UulOaL-B_zUYgVGsS_Osuwa'], 'files': [{'checksum': 'eade05a1620dd21921279889729395dc', 'path': '2802007/2022-09-08/40508f8f538735e77e7b5c18f341a91cd466ca77', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H9EUWtDN9UulOaL-B_zUYgVGsS_Osuwa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:25.661023Z', 'territory_id': '2802007'} 2023-11-28 03:08:50 [scrapy.extensions.logstats] INFO: Crawled 879 pages (at 17 pages/min), scraped 877 items (at 17 items/min) 2023-11-28 03:08:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-13', 'edition_number': '889', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ph3Q0ltr0IZexGqFPVKlXb9eqrQtQiaF'], 'files': [{'checksum': '6a43f4f8885c03894845fecea777dbd0', 'path': '2802007/2022-09-13/1450305ab1fd9286ab543abcd47d200e7e3a104b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ph3Q0ltr0IZexGqFPVKlXb9eqrQtQiaF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:34.387941Z', 'territory_id': '2802007'} 2023-11-28 03:08:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:08:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-01', 'edition_number': '882', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MBe-R6XQTqQq_TxKcHGggK2ERZP0V-HB'], 'files': [{'checksum': '5102a06ed323639d6b15336a17b22824', 'path': '2802007/2022-09-01/eee0cae93158848b60a0a7d2129643c3837f27bf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MBe-R6XQTqQq_TxKcHGggK2ERZP0V-HB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:10.985064Z', 'territory_id': '2802007'} 2023-11-28 03:08:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:08:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-12', 'edition_number': '888', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xc0y8EZv0Nv_XSJMxo_daJDf3bUmdbG_'], 'files': [{'checksum': '979bc1d253c41f49589411bd52bb4c7e', 'path': '2802007/2022-09-12/4d6b5b531fd111cf65bd1f2ba63e7ec272455850', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xc0y8EZv0Nv_XSJMxo_daJDf3bUmdbG_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:30.311187Z', 'territory_id': '2802007'} 2023-11-28 03:09:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:01 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-16', 'edition_number': '891', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lfgARq235ZP_JZgF7ZRqDTywF5ANzTai'], 'files': [{'checksum': 'b65b522d52d639f1cd9528cedbc0cdbe', 'path': '2802007/2022-09-16/033c001774e5cf349dadac0bb999f2175dfbbd0b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lfgARq235ZP_JZgF7ZRqDTywF5ANzTai'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:42.842017Z', 'territory_id': '2802007'} 2023-11-28 03:09:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-22', 'edition_number': '895', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O-Uw2GwV3Iv97GeV1rFfcbPZcbxCrLAb'], 'files': [{'checksum': 'f9588328a43e7a0c8d28a17b02f69bda', 'path': '2802007/2022-09-22/113186ac933e9de6dbf158505cf9eee2bdc5d8b3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O-Uw2GwV3Iv97GeV1rFfcbPZcbxCrLAb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:53.494552Z', 'territory_id': '2802007'} 2023-11-28 03:09:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-21', 'edition_number': '894', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bL18ZPldBRqT5884OlDWOPeEbrIA8lTf'], 'files': [{'checksum': '08c84cb54748dc4f0e536958d150e16a', 'path': '2802007/2022-09-21/0b85204c08a8aad45d5339f18a57d1cc27a6b16d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bL18ZPldBRqT5884OlDWOPeEbrIA8lTf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:49.706517Z', 'territory_id': '2802007'} 2023-11-28 03:09:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-26', 'edition_number': '896', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ceu03-wpeV6hzR58IZDBw6ga7MHKije0'], 'files': [{'checksum': '130caa16b18ab89f35ce57587e04d54a', 'path': '2802007/2022-09-26/fa56550fb130d1fd89dcc0175f60992ba865b013', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ceu03-wpeV6hzR58IZDBw6ga7MHKije0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:56.053246Z', 'territory_id': '2802007'} 2023-11-28 03:09:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-20', 'edition_number': '893', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zw1jV8MM4yh7nYK0AyjeEJ2PpPIRn2om'], 'files': [{'checksum': 'af0cdbe0aca4f44cddcfc35effe40519', 'path': '2802007/2022-09-20/62b149150878febbaf77871958a91e70124340fa', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zw1jV8MM4yh7nYK0AyjeEJ2PpPIRn2om'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:47.334875Z', 'territory_id': '2802007'} 2023-11-28 03:09:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-30', 'edition_number': '899', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KMrqLaMSv98MbLm1eCN711E3xg-Ak7ta'], 'files': [{'checksum': '50c273b51477c30c10a559ae6d27c3df', 'path': '2802007/2022-09-30/c3dc1e003824cfa80c17404c7c23e8b82ad713e3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KMrqLaMSv98MbLm1eCN711E3xg-Ak7ta'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:27.290814Z', 'territory_id': '2802007'} 2023-11-28 03:09:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-14', 'edition_number': '890', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a53E83JHjYHtsfDGJFJF3N-K4gMufYJT'], 'files': [{'checksum': '527cd32bee5cf1afd28e7d8504b0a71e', 'path': '2802007/2022-09-14/1eb34ae1bce58c99f883920c800c36d311568432', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a53E83JHjYHtsfDGJFJF3N-K4gMufYJT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:38.601195Z', 'territory_id': '2802007'} 2023-11-28 03:09:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-01', 'edition_number': '900', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=121Mak1VcH-PyaTkN5V7FuhzpiBKj812Y'], 'files': [{'checksum': 'e71afc7b064af9f9f5ef6db73dba54d0', 'path': '2802007/2022-10-01/d1096977a7505baca897bb4c87e2c775de428721', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=121Mak1VcH-PyaTkN5V7FuhzpiBKj812Y'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:30.053130Z', 'territory_id': '2802007'} 2023-11-28 03:09:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-19', 'edition_number': '892', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zWxGUZdnVRhQvAGLcy6rfeMOm3lHnNzm'], 'files': [{'checksum': '4302fff791845bbd0e9e27bf1886ddea', 'path': '2802007/2022-09-19/744005e7883b35524f66aafa100c58f757f94617', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zWxGUZdnVRhQvAGLcy6rfeMOm3lHnNzm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:45.152042Z', 'territory_id': '2802007'} 2023-11-28 03:09:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-28', 'edition_number': '897', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Sl19x8hhJZ5fBXtxxhJRxVWHXkAIAEoM'], 'files': [{'checksum': 'e9eae65b1c6f609fdbfa09e33ec6efa4', 'path': '2802007/2022-09-28/ecf233e700529fbdd52652f896abdd40cf1532bb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Sl19x8hhJZ5fBXtxxhJRxVWHXkAIAEoM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:02:59.810073Z', 'territory_id': '2802007'} 2023-11-28 03:09:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-03', 'edition_number': '901', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jg-TyO2CFgQB7r9KFuiI_StTzQ4x10GV'], 'files': [{'checksum': '4ba21f2f1cbd72112affc9bf5ed2630d', 'path': '2802007/2022-10-03/1ad6d4bc690309afb50963ac48540d70ce3df884', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jg-TyO2CFgQB7r9KFuiI_StTzQ4x10GV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:33.067880Z', 'territory_id': '2802007'} 2023-11-28 03:09:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-06', 'edition_number': '904', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bxPWrm_pxxtijKHIR6whM1vkHdOHupb6'], 'files': [{'checksum': 'c970f128d8501a96bb5764afc8293c16', 'path': '2802007/2022-10-06/feaf7e13e9625b220d0e8909de490ab4bf95c834', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1bxPWrm_pxxtijKHIR6whM1vkHdOHupb6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:42.112730Z', 'territory_id': '2802007'} 2023-11-28 03:09:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-05', 'edition_number': '903', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uT61gvSfneaYaTYnKs5yReGKeVYdYF4w'], 'files': [{'checksum': 'c0d99788568b3f7b997d0728322608b1', 'path': '2802007/2022-10-05/e4cf32b6873b19369323b4f6d38a4abbffa70cc9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uT61gvSfneaYaTYnKs5yReGKeVYdYF4w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:39.814654Z', 'territory_id': '2802007'} 2023-11-28 03:09:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-04', 'edition_number': '902', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_qrq1M-0x06Xn3NPYKgPTBCWb-y6J4dz'], 'files': [{'checksum': 'f834e24ddfcffbc20831c3430ae9a870', 'path': '2802007/2022-10-04/71691d7eb86705ce1ed755a7ead4d40ff0e64652', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_qrq1M-0x06Xn3NPYKgPTBCWb-y6J4dz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:36.338244Z', 'territory_id': '2802007'} 2023-11-28 03:09:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-11', 'edition_number': '906', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FA167nCE-5A8VpKXn0d3WnwWfcQsyryy'], 'files': [{'checksum': '030b6b99565e8c90f986eda7753cff83', 'path': '2802007/2022-10-11/6843ddd40fc38ff2c4fa283a5d8ae40f281e68cd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FA167nCE-5A8VpKXn0d3WnwWfcQsyryy'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:50.024610Z', 'territory_id': '2802007'} 2023-11-28 03:09:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-18', 'edition_number': '909', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_wXI1jaNBrABbX-Ylq8MiHl0Vii9jS2a'], 'files': [{'checksum': '13313a128b10b73aa605391a7a88b4fa', 'path': '2802007/2022-10-18/0c7944e9b04bb935a944bd98ec3a761d16ed7557', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_wXI1jaNBrABbX-Ylq8MiHl0Vii9jS2a'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:00.688675Z', 'territory_id': '2802007'} 2023-11-28 03:09:50 [scrapy.extensions.logstats] INFO: Crawled 898 pages (at 19 pages/min), scraped 896 items (at 19 items/min) 2023-11-28 03:09:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-13', 'edition_number': '907', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NkCvNOiKIdep19UEMiC-ofX0_qkJ8sRZ'], 'files': [{'checksum': 'd67e2c167f1b4a2489839d840f505a59', 'path': '2802007/2022-10-13/7e84c32943aea36a11e4dfe4c7c010c3b67c103e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NkCvNOiKIdep19UEMiC-ofX0_qkJ8sRZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:53.471590Z', 'territory_id': '2802007'} 2023-11-28 03:09:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-19', 'edition_number': '910', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10GUxokm4Zh4BywpRTZ0ysZzRQ6qw59Nd'], 'files': [{'checksum': '4fff7c8104fd9d54f97c1dc27b6be5ef', 'path': '2802007/2022-10-19/f7f7eaaa44100714d8901e04e9ef5bd3a7cca754', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10GUxokm4Zh4BywpRTZ0ysZzRQ6qw59Nd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:02.510357Z', 'territory_id': '2802007'} 2023-11-28 03:09:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:09:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-21', 'edition_number': '911', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gt-EVzq74w20qU4NOql-CVycjQxd-zmr'], 'files': [{'checksum': '75efcb8ef0554c47041ad86fdecf0b4b', 'path': '2802007/2022-10-21/32a5543b1fb136920a135d5b075fc3b7d1519693', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gt-EVzq74w20qU4NOql-CVycjQxd-zmr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:07.140306Z', 'territory_id': '2802007'} 2023-11-28 03:10:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-24', 'edition_number': '912', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TaRyuXR7_bgH5Gg1VAAc9tIdKAugO6kW'], 'files': [{'checksum': '9d339ef29908b33ee9279f76aee4b0ef', 'path': '2802007/2022-10-24/e092eb42bddbb3bf928895d131488dd4fbf087a1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TaRyuXR7_bgH5Gg1VAAc9tIdKAugO6kW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:31.794043Z', 'territory_id': '2802007'} 2023-11-28 03:10:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-25', 'edition_number': '913', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XU_g1QSAZ1KgU7ySTTOxi2wAmlZqy3F_'], 'files': [{'checksum': '03ee0b13deab1597dd72dbba0e726987', 'path': '2802007/2022-10-25/17e2fdb2659c1d8733bf55b66ff89a7e9bc002a9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XU_g1QSAZ1KgU7ySTTOxi2wAmlZqy3F_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:35.833727Z', 'territory_id': '2802007'} 2023-11-28 03:10:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-17', 'edition_number': '908', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dsWNrymaIgsnWigV1eerFAaYCIj4SUl0'], 'files': [{'checksum': 'acc645b962a9ae711caa5176a3dc5f5d', 'path': '2802007/2022-10-17/16693d8955878eb533e1e787140e7a3fa0340e0d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dsWNrymaIgsnWigV1eerFAaYCIj4SUl0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:56.996938Z', 'territory_id': '2802007'} 2023-11-28 03:10:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-27', 'edition_number': '915', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16nJBrz6cqDO5D3xssFSJlOcnXsEGefBl'], 'files': [{'checksum': 'b8bcb1456a8117f0abcc28dcf0a7ec5b', 'path': '2802007/2022-10-27/fac6c99d7b3e1ac06e0d9db5a754d78ebf56c1b3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16nJBrz6cqDO5D3xssFSJlOcnXsEGefBl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:43.998490Z', 'territory_id': '2802007'} 2023-11-28 03:10:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-07', 'edition_number': '905', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wOuP_f7xG6n9o474ukH8hQJRnGmPYlfz'], 'files': [{'checksum': '4b2b47187a72c94a8098018f6ce61d16', 'path': '2802007/2022-10-07/cd30162ca55587054d4cc04ec3e00b40fa27d28b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wOuP_f7xG6n9o474ukH8hQJRnGmPYlfz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:48.873237Z', 'territory_id': '2802007'} 2023-11-28 03:10:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-09-29', 'edition_number': '898', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18ZtR16QvV95AYxSkOxQYkyl8d-XhrErg'], 'files': [{'checksum': 'bfadab3d2a86fbc50bbc7a6d78586e46', 'path': '2802007/2022-09-29/6aa53340186f8c66bb8050afac6014ea55cd43fe', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18ZtR16QvV95AYxSkOxQYkyl8d-XhrErg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:03:23.797698Z', 'territory_id': '2802007'} 2023-11-28 03:10:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-26', 'edition_number': '914', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LaBGW30Y4vULTXhsdDSEzjfisyw-BuT0'], 'files': [{'checksum': '992da488f618ccf463e76e3720b0ab9f', 'path': '2802007/2022-10-26/06c502b12b4a7399de0de4d93f717182abe44f90', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LaBGW30Y4vULTXhsdDSEzjfisyw-BuT0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:40.945875Z', 'territory_id': '2802007'} 2023-11-28 03:10:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-07', 'edition_number': '919', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M7GvmwE_iFm_5vdftcgPQlhykK5rbIDa'], 'files': [{'checksum': 'f3378df5549f17d6c74b5e649ba8f042', 'path': '2802007/2022-11-07/06a5b568588b881adf3d02e31577cfb5920736a8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M7GvmwE_iFm_5vdftcgPQlhykK5rbIDa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:57.265727Z', 'territory_id': '2802007'} 2023-11-28 03:10:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-08-30', 'edition_number': '880', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Unz2Zun-apmwdyHb11pn-1ak58LYSkQA'], 'files': [{'checksum': 'a3d2b1dab7fedb75c05b737e024a1673', 'path': '2802007/2022-08-30/85c1c3e2921e2a3251a9c4e705944c87c1146a6e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Unz2Zun-apmwdyHb11pn-1ak58LYSkQA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:01:55.333102Z', 'territory_id': '2802007'} 2023-11-28 03:10:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-16', 'edition_number': '766', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S5vruqQjrcCNOxXZ6_4mSToRHMOlK9ik'], 'files': [{'checksum': 'f593aabc06fe19ad5e8143e889bb0bdb', 'path': '2802007/2022-03-16/141dbeb036d860de8b360a5978aeca7fdfc830ed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S5vruqQjrcCNOxXZ6_4mSToRHMOlK9ik'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:45.184853Z', 'territory_id': '2802007'} 2023-11-28 03:10:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-03-15', 'edition_number': '764', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Hxb1EzJdm0VglqW7w_0Qr-rPhHNbeAUo'], 'files': [{'checksum': '0987ac6c967c24e5b031d500f0af27b3', 'path': '2802007/2022-03-15/7ccb5e8f6939e74f04ceca520875293100c58f6c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Hxb1EzJdm0VglqW7w_0Qr-rPhHNbeAUo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:47:39.981413Z', 'territory_id': '2802007'} 2023-11-28 03:10:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-10', 'edition_number': '922', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13PnFqZurzqyxkz3LfhPpVpS7hvSCs_93'], 'files': [{'checksum': '1d4416ffefd462c1c4e282729100ce74', 'path': '2802007/2022-11-10/98c3529fa93466cbe2e31d59182330f627b586f8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13PnFqZurzqyxkz3LfhPpVpS7hvSCs_93'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:08.098518Z', 'territory_id': '2802007'} 2023-11-28 03:10:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-26', 'edition_number': '792', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dsC5UYcPCzUikOt8Q97hsxMsq1KkECDw'], 'files': [{'checksum': 'dd46e452aa876088e601d53b97306e02', 'path': '2802007/2022-04-26/c53634e8d9e3bd071a94e8ab7c0d596a8dcb9bdf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dsC5UYcPCzUikOt8Q97hsxMsq1KkECDw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:37.358765Z', 'territory_id': '2802007'} 2023-11-28 03:10:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-27', 'edition_number': '793', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1t5xR4iI-9-p6F-xDGb0nFRt2Xt0n7xBX'], 'files': [{'checksum': 'ad5eb4e54905bde8cd25fad288b85bff', 'path': '2802007/2022-04-27/2e869176d009a9e424718f93bcf54461d22887b6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1t5xR4iI-9-p6F-xDGb0nFRt2Xt0n7xBX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:52.262928Z', 'territory_id': '2802007'} 2023-11-28 03:10:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-19', 'edition_number': '924', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iTd0RsaFZtjLsP1ns15YFIwmBx1N9nd6'], 'files': [{'checksum': 'e7afbd124afda65383fe1e59708435bb', 'path': '2802007/2022-11-19/d07015d2f35e4a61a6774b7c9767fb09b92bf4b2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iTd0RsaFZtjLsP1ns15YFIwmBx1N9nd6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:15.835547Z', 'territory_id': '2802007'} 2023-11-28 03:10:50 [scrapy.extensions.logstats] INFO: Crawled 916 pages (at 18 pages/min), scraped 914 items (at 18 items/min) 2023-11-28 03:10:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:10:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-21', 'edition_number': '925', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dKlC6Jg0nNEwlMomV_LGnaxbTec0uOEp'], 'files': [{'checksum': '911629a398bddfb47a0c72a96386ae05', 'path': '2802007/2022-11-21/c939420bc84ea6680427ed9184b6ad0841176b74', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dKlC6Jg0nNEwlMomV_LGnaxbTec0uOEp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:21.918279Z', 'territory_id': '2802007'} 2023-11-28 03:11:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-08', 'edition_number': '920', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ik6gCNI6ZxoSAcZwAYDQPbH5WQ7FUC7d'], 'files': [{'checksum': '15cc52014a8e39286982701f2c6ff886', 'path': '2802007/2022-11-08/8ca00573db815037998ea5c52d2c2459d88d936a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ik6gCNI6ZxoSAcZwAYDQPbH5WQ7FUC7d'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:00.587469Z', 'territory_id': '2802007'} 2023-11-28 03:11:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-09', 'edition_number': '921', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JGoVe71GBRlh54X8UfkxV_DL1eQNew7A'], 'files': [{'checksum': '6eaecd4654fec77b0d87ab4cdf959c9b', 'path': '2802007/2022-11-09/bf38724a096028196fe0c98677ae6ac3ad971460', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JGoVe71GBRlh54X8UfkxV_DL1eQNew7A'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:04.762627Z', 'territory_id': '2802007'} 2023-11-28 03:11:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-01', 'edition_number': '917', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Jz8gVC9fRwrzYahICc9ZpUYVpALR-Klm'], 'files': [{'checksum': '0c437b6754aeccf96fc83f7c0934fe39', 'path': '2802007/2022-11-01/09102db1384f637b1221ac1d64c446cc985430a0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Jz8gVC9fRwrzYahICc9ZpUYVpALR-Klm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:51.175993Z', 'territory_id': '2802007'} 2023-11-28 03:11:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-30', 'edition_number': '929', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lHTXmRYQci9z8dpR3ry9rSiDtR_XbXk8'], 'files': [{'checksum': '35f799ca6805c995586f21360d8ba8f2', 'path': '2802007/2022-11-30/beee75a89bd025ba8a411e0c815b9245f2d4f023', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lHTXmRYQci9z8dpR3ry9rSiDtR_XbXk8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:35.789618Z', 'territory_id': '2802007'} 2023-11-28 03:11:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-01', 'edition_number': '930', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KvYg8i-09svwI2NSFlduSJf4HDUIE1cm'], 'files': [{'checksum': '17112f97138b52c3c1583393ee9df619', 'path': '2802007/2022-12-01/4c83e5e92c4ab7bcb87e0b351f63ebce24d6f6b4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KvYg8i-09svwI2NSFlduSJf4HDUIE1cm'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:40.162578Z', 'territory_id': '2802007'} 2023-11-28 03:11:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-02', 'edition_number': '931', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kGE_BXDzHWupIoQXBuUs8vNK9O3rAXZp'], 'files': [{'checksum': 'eba157ac22fa9b594077fc319d01657c', 'path': '2802007/2022-12-02/78155eb390a7a0ff5bfaf4202aae0e73ce1249be', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kGE_BXDzHWupIoQXBuUs8vNK9O3rAXZp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:41.655847Z', 'territory_id': '2802007'} 2023-11-28 03:11:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-29', 'edition_number': '928', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GaQX1GpsJnVhwbyr9LE8s0pHla6DtF-X'], 'files': [{'checksum': '2cc6eaad65d003ec9dc1c61874719247', 'path': '2802007/2022-11-29/e8d5740ccde617148a5edc74bac745456d5fce29', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GaQX1GpsJnVhwbyr9LE8s0pHla6DtF-X'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:32.005705Z', 'territory_id': '2802007'} 2023-11-28 03:11:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-06', 'edition_number': '933', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uROjTxRpqYUGvNU8bq-aIy2gmHAMGErI'], 'files': [{'checksum': '2dad34910943c16ff4fed4ee6da4c49f', 'path': '2802007/2022-12-06/95db38dac19290907ef7f8a65bcaff510b350524', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uROjTxRpqYUGvNU8bq-aIy2gmHAMGErI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:53.756074Z', 'territory_id': '2802007'} 2023-11-28 03:11:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-05', 'edition_number': '932', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1n9pJ6yLEEgn0PGAdxomUfOCFb7q3tb2j'], 'files': [{'checksum': '097ec8d1c595a95b78dc99d586868359', 'path': '2802007/2022-12-05/bba073cc3c3bdef0c822fee6df57c73534ebb554', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1n9pJ6yLEEgn0PGAdxomUfOCFb7q3tb2j'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:50.648464Z', 'territory_id': '2802007'} 2023-11-28 03:11:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-23', 'edition_number': '927', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hlJyNoM-KoZwPsnaf3dB6IWuw9mHwiFx'], 'files': [{'checksum': '40434bd9855fc23eea17bfd226b83983', 'path': '2802007/2022-11-23/8348245c3f33c8c2468785606c64b09f1cd0df36', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hlJyNoM-KoZwPsnaf3dB6IWuw9mHwiFx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:28.009678Z', 'territory_id': '2802007'} 2023-11-28 03:11:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-22', 'edition_number': '926', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S7TDJWQasaPJuffQxzrDMJbTbkNRjseW'], 'files': [{'checksum': 'd886907e63b3032a7712dc1e25ea0bda', 'path': '2802007/2022-11-22/8253f1be779e35e26e1d8c43911caeaa64147c1a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1S7TDJWQasaPJuffQxzrDMJbTbkNRjseW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:25.212191Z', 'territory_id': '2802007'} 2023-11-28 03:11:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-08', 'edition_number': '934', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iWu6cU5CehdC7xP4gJv3BVo3InMHq4In'], 'files': [{'checksum': '35378e73102c645771835554e062bb3c', 'path': '2802007/2022-12-08/6effa10bc70c800cdc60f25f5085f78680117b48', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1iWu6cU5CehdC7xP4gJv3BVo3InMHq4In'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:55.853301Z', 'territory_id': '2802007'} 2023-11-28 03:11:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-09', 'edition_number': '935', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jCVTTzRMHz-UTsYi8Ve3e2iPDYKwfKDX'], 'files': [{'checksum': '5f481aaec5ffd40205a27d69eb6cbf30', 'path': '2802007/2022-12-09/a06b2f8f613444ef014f0f61517b7dd6a3f2a6a5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jCVTTzRMHz-UTsYi8Ve3e2iPDYKwfKDX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:58.508646Z', 'territory_id': '2802007'} 2023-11-28 03:11:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-13', 'edition_number': '937', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l2XG8hzlSGQZvsetpv6eVK7pmbKaXh_5'], 'files': [{'checksum': 'd15e4d6012081c03250e41e59c7a8fb1', 'path': '2802007/2022-12-13/0e45318092e23cbbaa41122f7154266b11247f0e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l2XG8hzlSGQZvsetpv6eVK7pmbKaXh_5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:03.569038Z', 'territory_id': '2802007'} 2023-11-28 03:11:50 [scrapy.extensions.logstats] INFO: Crawled 931 pages (at 15 pages/min), scraped 929 items (at 15 items/min) 2023-11-28 03:11:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:11:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-19', 'edition_number': '940', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U1PhuFWjc47hERSBRuloFpODTGnjOeSc'], 'files': [{'checksum': 'dcf118f31ccd40fce723b4284b1d885d', 'path': '2802007/2022-12-19/7ecac7e90c57773f903d1e62a3c073e4bcbf5cc8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U1PhuFWjc47hERSBRuloFpODTGnjOeSc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:14.638898Z', 'territory_id': '2802007'} 2023-11-28 03:12:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-16', 'edition_number': '939', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IRrkFPN9YTJ_TIVsYGK0kLY-yTp8No8a'], 'files': [{'checksum': 'caaa126c70987aeee3752c7a16af8f68', 'path': '2802007/2022-12-16/5446b28e0a72f30a2546a04665d193de421f8583', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IRrkFPN9YTJ_TIVsYGK0kLY-yTp8No8a'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:10.775192Z', 'territory_id': '2802007'} 2023-11-28 03:12:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-20', 'edition_number': '941', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Vj0wSA2kL9rIjDV_sP5lXKzJD2wro_Qq'], 'files': [{'checksum': 'ecde71c58846b4fbe4d6a66b880eef0e', 'path': '2802007/2022-12-20/cdb684a71747e128807360e6ce819837456f33a6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Vj0wSA2kL9rIjDV_sP5lXKzJD2wro_Qq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:17.964845Z', 'territory_id': '2802007'} 2023-11-28 03:12:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2021-11-26', 'edition_number': '693', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17jJk8sFrbdqwKSM_xAYGWn54HBqWQfuY'], 'files': [{'checksum': 'ebc93ecfba0fb86ac964f43e01996717', 'path': '2802007/2021-11-26/deadd24ddf7b7266f7d909c222c54effdd35a19b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17jJk8sFrbdqwKSM_xAYGWn54HBqWQfuY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:40:35.341738Z', 'territory_id': '2802007'} 2023-11-28 03:12:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-21', 'edition_number': '942', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18nUB7BAcQM6Z2Z69SvpzRfPbt2y-tJd9'], 'files': [{'checksum': '010a983269787e93171ae779c67c4b29', 'path': '2802007/2022-12-21/21c00938f59029f5df2eaf04d78e918e36d7f032', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18nUB7BAcQM6Z2Z69SvpzRfPbt2y-tJd9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:40.033754Z', 'territory_id': '2802007'} 2023-11-28 03:12:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-26', 'edition_number': '944', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l2Mu8eUtyJPV7CzBrLDC0ljPCEJoiYOJ'], 'files': [{'checksum': '25dcb5356772d017ab73a9606ba2ad49', 'path': '2802007/2022-12-26/83698352d7139025cdc17af6580369f7215bd6e0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1l2Mu8eUtyJPV7CzBrLDC0ljPCEJoiYOJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:46.177595Z', 'territory_id': '2802007'} 2023-11-28 03:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-14', 'edition_number': '938', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Yr1ncwZDBLVCjF0g9qPjpx7MABNlXvpN'], 'files': [{'checksum': '3a79dd4a83e0d0792cb2a984cf0a25de', 'path': '2802007/2022-12-14/aeb2ac001b14f54ce869c3df6e3278262baa9335', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Yr1ncwZDBLVCjF0g9qPjpx7MABNlXvpN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:07.788346Z', 'territory_id': '2802007'} 2023-11-28 03:12:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-23', 'edition_number': '943', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11t7U-bEY-K3Tu9xEt5kdcrr1zjaKfxrq'], 'files': [{'checksum': 'e35190a59e84d27c6002eeb3d83e4a6a', 'path': '2802007/2022-12-23/f709bd9084c4a31e1b5d6d5a5fa6dedefe14f8b7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11t7U-bEY-K3Tu9xEt5kdcrr1zjaKfxrq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:43.840353Z', 'territory_id': '2802007'} 2023-11-28 03:12:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-29', 'edition_number': '946', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1V_GefpXNvTvngRgh3wbEv_FIWJU-yWhV'], 'files': [{'checksum': '4d3c51b5bc420b95d3da6a7befae5c8e', 'path': '2802007/2022-12-29/e989fc39668c85a37616907396ab211788d40c82', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1V_GefpXNvTvngRgh3wbEv_FIWJU-yWhV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:52.533201Z', 'territory_id': '2802007'} 2023-11-28 03:12:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-12', 'edition_number': '936', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13D8wT0nOMfGTikdhkmKRXTRhHwv0Hv92'], 'files': [{'checksum': '68b983ea82734260717c7b193d20dd9f', 'path': '2802007/2022-12-12/12785c451a9c6ad13ab26838bc396ac33c64faa0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13D8wT0nOMfGTikdhkmKRXTRhHwv0Hv92'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:00.601050Z', 'territory_id': '2802007'} 2023-11-28 03:12:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:40 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-03', 'edition_number': '949', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12XOsPTO9y64EvEgJ2_J_LY3qTU0IbCmR'], 'files': [{'checksum': 'dea5bff7eea327115da475fefc5217e2', 'path': '2802007/2023-01-03/a93b8084f4cfd1af25574469d5efebee7803c160', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12XOsPTO9y64EvEgJ2_J_LY3qTU0IbCmR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:05.519351Z', 'territory_id': '2802007'} 2023-11-28 03:12:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-02', 'edition_number': '948', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12gKM3SSxHNSU_TjUzR6yp_LB2yY0jzWK'], 'files': [{'checksum': 'dc6692db3b4bbfd128a7ce901073354a', 'path': '2802007/2023-01-02/a1a385fb4b1aefd153ccfc8cc134eccc80191854', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=12gKM3SSxHNSU_TjUzR6yp_LB2yY0jzWK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:01.107982Z', 'territory_id': '2802007'} 2023-11-28 03:12:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-04', 'edition_number': '950', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DnKjKgw1mYLeRYyyx9FkunuaYrOAkpF9'], 'files': [{'checksum': '396ea8abb31bcb142a2dcec2ee8ebf13', 'path': '2802007/2023-01-04/7787ec479d5e6f58a740406a487d1d23ae502012', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DnKjKgw1mYLeRYyyx9FkunuaYrOAkpF9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:09.840436Z', 'territory_id': '2802007'} 2023-11-28 03:12:50 [scrapy.extensions.logstats] INFO: Crawled 944 pages (at 13 pages/min), scraped 942 items (at 13 items/min) 2023-11-28 03:12:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-05', 'edition_number': '951', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vYD9kvbEkpqJ4qIO2N9X_CeFjZ7xvqQe'], 'files': [{'checksum': 'dcd453aa8d381b78f1672a2e7223e930', 'path': '2802007/2023-01-05/b16d12bb7a610e7af6a6856ea6e7553500004e4f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vYD9kvbEkpqJ4qIO2N9X_CeFjZ7xvqQe'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:13.941456Z', 'territory_id': '2802007'} 2023-11-28 03:12:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:12:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-06', 'edition_number': '952', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Vp0Mm3ac9X_q9Q_W4uRYcXwo2YHngiUE'], 'files': [{'checksum': '5ba9ffa0d7afc70ba709e889f36de6a3', 'path': '2802007/2023-01-06/6bb4c2453d69c2315aef9317555c45eca356bfd9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Vp0Mm3ac9X_q9Q_W4uRYcXwo2YHngiUE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:17.594366Z', 'territory_id': '2802007'} 2023-11-28 03:13:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-09', 'edition_number': '953', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DS7n55YtvWr1quG2KJnJawqtrWlRkLgE'], 'files': [{'checksum': 'e79ab16bad4d2b7fd678fef9c3d5be00', 'path': '2802007/2023-01-09/dc185ac4c5bc7ee69072f2720155f548d66bc55e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DS7n55YtvWr1quG2KJnJawqtrWlRkLgE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:20.920265Z', 'territory_id': '2802007'} 2023-11-28 03:13:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-30', 'edition_number': '947', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Rsp1j6rqXTiwRPh6bIZAD1WfjtFlqira'], 'files': [{'checksum': '421d867cfe24073b816b83bf00e6f7bd', 'path': '2802007/2022-12-30/f057de1608d75dd55606fe6a9d299d5d5279170e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Rsp1j6rqXTiwRPh6bIZAD1WfjtFlqira'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:55.631596Z', 'territory_id': '2802007'} 2023-11-28 03:13:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-12', 'edition_number': '956', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13-sGb576apfCcqrILzS4cF-LNoTEk2SN'], 'files': [{'checksum': 'd393c2560be41e2a4368f486f6d430e1', 'path': '2802007/2023-01-12/bd722f7f78eb20d9c19086621ead0a9c06b94361', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13-sGb576apfCcqrILzS4cF-LNoTEk2SN'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:31.159991Z', 'territory_id': '2802007'} 2023-11-28 03:13:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-12-28', 'edition_number': '945', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O3aUhQ7gMypD_ZNqTtIhJfOssmJ5fVtA'], 'files': [{'checksum': '62547e40defa3084848a11a56528ad60', 'path': '2802007/2022-12-28/f652c3281e634658cd455825a324318e2d9fae50', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1O3aUhQ7gMypD_ZNqTtIhJfOssmJ5fVtA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:06:49.223791Z', 'territory_id': '2802007'} 2023-11-28 03:13:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-17', 'edition_number': '923', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gbNgRFgbTVEch05Py5_F0vT5xsU9JqCB'], 'files': [{'checksum': 'bf3e7e3ed8909e3fe5e422cdcd9e5b9b', 'path': '2802007/2022-11-17/a53b67caffb6ca2a52841078bbd9dde9448c5e48', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gbNgRFgbTVEch05Py5_F0vT5xsU9JqCB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:05:11.823594Z', 'territory_id': '2802007'} 2023-11-28 03:13:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-17', 'edition_number': '959', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZLFeaWWobvGFyiB_k83Iz7YUW_dq2AY2'], 'files': [{'checksum': '195576b7db11e10c3df62f7a42e27b2f', 'path': '2802007/2023-01-17/46b053e15b87475383bb181af036d9d51f4911c2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZLFeaWWobvGFyiB_k83Iz7YUW_dq2AY2'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:42.799456Z', 'territory_id': '2802007'} 2023-11-28 03:13:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-16', 'edition_number': '958', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w5eMbNR_wEVh5ylrul9cr1SOWNkHcgTV'], 'files': [{'checksum': '90421a0a9ed11d54158eb27ec6b7fb22', 'path': '2802007/2023-01-16/cf29e10294f89478d10aaa097098b57f8742ed9a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w5eMbNR_wEVh5ylrul9cr1SOWNkHcgTV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:38.902995Z', 'territory_id': '2802007'} 2023-11-28 03:13:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-13', 'edition_number': '957', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p9JzA9-RJChrowJ-BWhR-jomqjkS6D9Z'], 'files': [{'checksum': '1b0aa80262d51de1dd15d74f6f2a07e8', 'path': '2802007/2023-01-13/fbdc922c344d479c2b628ae2db19859d03a4ce7b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1p9JzA9-RJChrowJ-BWhR-jomqjkS6D9Z'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:35.000091Z', 'territory_id': '2802007'} 2023-11-28 03:13:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-20', 'edition_number': '962', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZutsLyrJBT2gfm0KQZJzw3XAgxUmmeTu'], 'files': [{'checksum': 'a5f2b847f408018cdb18876a570c3b10', 'path': '2802007/2023-01-20/60ad6d2649ba0fead56b435c55e84350736a66e6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZutsLyrJBT2gfm0KQZJzw3XAgxUmmeTu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:52.871680Z', 'territory_id': '2802007'} 2023-11-28 03:13:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-19', 'edition_number': '961', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eqiAknGbhoiJd8laHZkh9FVKn8UEtCMM'], 'files': [{'checksum': '6dde02b709a851ce67fc2487bfd6af19', 'path': '2802007/2023-01-19/8d04e28567b0f875cde34c42ac3aa8a5234cfee3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1eqiAknGbhoiJd8laHZkh9FVKn8UEtCMM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:50.334762Z', 'territory_id': '2802007'} 2023-11-28 03:13:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-23', 'edition_number': '963', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1F3whktZBvJQq7vVVvmSd8LFM9VD8GQE4'], 'files': [{'checksum': '30d57374a5e3e0d578fb9c91582ecd62', 'path': '2802007/2023-01-23/bb0f6bf900856bc3e3f1b6fb7f07e5bf74b89042', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1F3whktZBvJQq7vVVvmSd8LFM9VD8GQE4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:56.104850Z', 'territory_id': '2802007'} 2023-11-28 03:13:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-24', 'edition_number': '964', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fokkuKCmZeezfCMIanXwzVWy2dPZu42H'], 'files': [{'checksum': 'f084a79b611b12db892506a189298107', 'path': '2802007/2023-01-24/8cd77f84cd7ae69b363681926818458f8e4eb99a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fokkuKCmZeezfCMIanXwzVWy2dPZu42H'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:59.450672Z', 'territory_id': '2802007'} 2023-11-28 03:13:50 [scrapy.extensions.logstats] INFO: Crawled 958 pages (at 14 pages/min), scraped 956 items (at 14 items/min) 2023-11-28 03:13:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:13:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-25', 'edition_number': '965', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uwKqD-jV7Tl7-Lrg7nrD4QUIdAbqlPp_'], 'files': [{'checksum': 'a39daa337ecba91be32975f3ea8c5039', 'path': '2802007/2023-01-25/d186205c19628a41cfde4ff5558df7b43512567d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uwKqD-jV7Tl7-Lrg7nrD4QUIdAbqlPp_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:03.025404Z', 'territory_id': '2802007'} 2023-11-28 03:13:56 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:14:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-26', 'edition_number': '966', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mGlb-_DWnJ8I0pgSRczs3uVnO_zjzRN7'], 'files': [{'checksum': 'a6956bda8fab08b8a589565cf6ae3775', 'path': '2802007/2023-01-26/7c9e18e501611523cd4e2fdf895acb0bf490b99b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mGlb-_DWnJ8I0pgSRczs3uVnO_zjzRN7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:05.380881Z', 'territory_id': '2802007'} 2023-11-28 03:14:03 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:14:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-27', 'edition_number': '967', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yzbkFH4S7c3QAjxZngtNRxUMfsUoxMIV'], 'files': [{'checksum': 'e47f911f02180c5b605f7b745990d5c9', 'path': '2802007/2023-01-27/c37fdf09a3ff56a812de54195ba672418a9e05a5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yzbkFH4S7c3QAjxZngtNRxUMfsUoxMIV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:08.561464Z', 'territory_id': '2802007'} 2023-11-28 03:14:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-31', 'edition_number': '970', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1suXJTNT8JsekAITdKUHtIe2IQ-xILSI_'], 'files': [{'checksum': 'f34cb8bccef8a4e28678ea7fd8959786', 'path': '2802007/2023-01-31/fb664674269c900b897151dd6bc655a7ddbc5e76', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1suXJTNT8JsekAITdKUHtIe2IQ-xILSI_'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:17.797748Z', 'territory_id': '2802007'} 2023-11-28 03:14:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-28', 'edition_number': '968', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IH1O1WHFDU0MerHP6wSFoqQM2C4r8O27'], 'files': [{'checksum': 'c8fee6a389f47f5aadb69f8140fd3413', 'path': '2802007/2023-01-28/fc7f5a14a695a932b082dae4774965e55a6b6ea3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IH1O1WHFDU0MerHP6wSFoqQM2C4r8O27'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:11.132550Z', 'territory_id': '2802007'} 2023-11-28 03:14:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-02', 'edition_number': '972', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zeX4LAOCHX1sAf3eMkJwomrNCb0Vssd1'], 'files': [{'checksum': 'ce935cc7f40fd220841bd3726da9fb3f', 'path': '2802007/2023-02-02/ca67f7b5a488bc186f4372bcfdc167b9b6b80908', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zeX4LAOCHX1sAf3eMkJwomrNCb0Vssd1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:31.952607Z', 'territory_id': '2802007'} 2023-11-28 03:14:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-07', 'edition_number': '974', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yBM4XOib70YSXc5pV3Y5XWe9VSQN0nJ3'], 'files': [{'checksum': 'cb0ef01da59314255f270f965f62becb', 'path': '2802007/2023-02-07/53e86df4a3e7a63665aca795c8ec385b3313eca6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yBM4XOib70YSXc5pV3Y5XWe9VSQN0nJ3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:38.158675Z', 'territory_id': '2802007'} 2023-11-28 03:14:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-01', 'edition_number': '971', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oiCR_IcnGMavkB9G3e0A4BwTT0j0ugYp'], 'files': [{'checksum': '243b1030f1f66a0b28cfa3d1851fc781', 'path': '2802007/2023-02-01/8db02f615a0bfd1addaf6be76aa6fcf14a79266a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oiCR_IcnGMavkB9G3e0A4BwTT0j0ugYp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:31.401637Z', 'territory_id': '2802007'} 2023-11-28 03:14:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-18', 'edition_number': '960', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14DkDeSjL4XepnNAK-E9HKqyMH_LQDp7n'], 'files': [{'checksum': '026c058eb943fe9f75b4d7d2cb78d9cf', 'path': '2802007/2023-01-18/00f6d55925fe94b45055e7ef9e7bd3eae635d927', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14DkDeSjL4XepnNAK-E9HKqyMH_LQDp7n'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:48.179680Z', 'territory_id': '2802007'} 2023-11-28 03:14:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-08', 'edition_number': '975', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1q_yaM9TiR1La0wMEts_BrKmU6B9DRB71'], 'files': [{'checksum': 'bfcad09d899b891d8c07b3b921546f96', 'path': '2802007/2023-02-08/51dca2730af18afb94869b6242e12ea030a03731', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1q_yaM9TiR1La0wMEts_BrKmU6B9DRB71'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:42.580502Z', 'territory_id': '2802007'} 2023-11-28 03:14:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 2 times): 500 Internal Server Error 2023-11-28 03:14:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-09', 'edition_number': '976', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B09MR819KsrAh1VC2n10SbJS6tEjhhaU'], 'files': [{'checksum': '8190251eca7e8ca58bf8fb5270d969f8', 'path': '2802007/2023-02-09/1f0163f1e2fef9ede5f020854e5ab5ace50f2c88', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1B09MR819KsrAh1VC2n10SbJS6tEjhhaU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:43.759303Z', 'territory_id': '2802007'} 2023-11-28 03:14:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-01-06', 'edition_number': '718', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZSKucx-IXIt5V4aO0YngRfito8-PADMr'], 'files': [{'checksum': '07a32609cacbeb9737ceedee004bb217', 'path': '2802007/2022-01-06/77344676379d378d2202994047b1cbfd2bdd5a90', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZSKucx-IXIt5V4aO0YngRfito8-PADMr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:42:54.421901Z', 'territory_id': '2802007'} 2023-11-28 03:14:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-06-21', 'edition_number': '834', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gpY5yg7pZ4frK5OavdQlYGwvMHvB5l5O'], 'files': [{'checksum': 'e47c4dc6fe9735bbfb6e77c39784d961', 'path': '2802007/2022-06-21/d2a1a5a1852c476a88eddf1a42e354b97a42b46f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1gpY5yg7pZ4frK5OavdQlYGwvMHvB5l5O'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:57:03.205618Z', 'territory_id': '2802007'} 2023-11-28 03:14:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-10', 'edition_number': '977', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yZZ1geskEIrbaM6-MawagDOJTuNmyCtM'], 'files': [{'checksum': '233620f9275b29f86f843fdaea11a1e4', 'path': '2802007/2023-02-10/003ffb55cb5f5660a1579235cc891cfc5dfd4f1d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1yZZ1geskEIrbaM6-MawagDOJTuNmyCtM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:47.417627Z', 'territory_id': '2802007'} 2023-11-28 03:14:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-06', 'edition_number': '973', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1y5CNkSrcVhdbF1Xwobh_m6RxNxh_HVGi'], 'files': [{'checksum': '7ec8029584004bbadac9225b701c32b0', 'path': '2802007/2023-02-06/55b6b1d3acac63450c1548a7eeda6247ae865633', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1y5CNkSrcVhdbF1Xwobh_m6RxNxh_HVGi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:34.972071Z', 'territory_id': '2802007'} 2023-11-28 03:14:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-11', 'edition_number': '978', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10At4Lae0VssAtoIqq915b2TmEe0he7VG'], 'files': [{'checksum': 'cbc4a31ddcc53574845ec510e4b51613', 'path': '2802007/2023-02-11/7cdda01f036db85080fcde35701fea9df949f4de', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10At4Lae0VssAtoIqq915b2TmEe0he7VG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:51.206688Z', 'territory_id': '2802007'} 2023-11-28 03:14:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-16', 'edition_number': '982', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xwWO3zV0GqLx4B32TNMPQxpuUPV4fEk7'], 'files': [{'checksum': 'dbb724ebd5fde32312eda1275f194f55', 'path': '2802007/2023-02-16/0eae2c93ef733cc5613cba02b5da7b48cb166fe5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xwWO3zV0GqLx4B32TNMPQxpuUPV4fEk7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:05.537897Z', 'territory_id': '2802007'} 2023-11-28 03:14:50 [scrapy.extensions.logstats] INFO: Crawled 975 pages (at 17 pages/min), scraped 973 items (at 17 items/min) 2023-11-28 03:14:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-17', 'edition_number': '983', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pCObeCDmnhlewcu5AfJJe7t7mvBiktj5'], 'files': [{'checksum': '2d451d99af4c8631dd505c0cda085ed0', 'path': '2802007/2023-02-17/6b244d8caea9fa2e07b768cc26fe34abe1c37f66', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pCObeCDmnhlewcu5AfJJe7t7mvBiktj5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:09.283405Z', 'territory_id': '2802007'} 2023-11-28 03:14:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-15', 'edition_number': '981', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LMjWt3GbbmYYPiP6zbwWHI1gUZLvuK_3'], 'files': [{'checksum': '843e3672079831beed9ebf02539c3ea2', 'path': '2802007/2023-02-15/2aeba9c1a33e07a3c6c6d3e8ae449a20d995eeb3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1LMjWt3GbbmYYPiP6zbwWHI1gUZLvuK_3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:01.713886Z', 'territory_id': '2802007'} 2023-11-28 03:14:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:14:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-14', 'edition_number': '980', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uCzbQPmoTe118yxmL6SAsSKHvBOH5c2o'], 'files': [{'checksum': '964ecd9d5421d350d07ab8dccb9dc97b', 'path': '2802007/2023-02-14/a3d260f3b5afc6ff734b70ee6db43f7da564ea5b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uCzbQPmoTe118yxmL6SAsSKHvBOH5c2o'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:58.157920Z', 'territory_id': '2802007'} 2023-11-28 03:15:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-24', 'edition_number': '985', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19CL_5OGI426orFaikI3J0D1uDerBCwR9'], 'files': [{'checksum': '5f70999d9c05ce9f91ddc90f28e4e7aa', 'path': '2802007/2023-02-24/c1b0631fa828bebeca4f72b6e2bad0d46d953b3f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19CL_5OGI426orFaikI3J0D1uDerBCwR9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:13.790148Z', 'territory_id': '2802007'} 2023-11-28 03:15:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-13', 'edition_number': '979', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cIbGS9x2bWPvaeO9CArKNSg9XCA_aB1f'], 'files': [{'checksum': '1e2e79d23b2e4750257106eedfab272b', 'path': '2802007/2023-02-13/c0a8cc3a9ae4d353d2cf34f5a7d6e4c79097345d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cIbGS9x2bWPvaeO9CArKNSg9XCA_aB1f'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:54.396045Z', 'territory_id': '2802007'} 2023-11-28 03:15:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-03', 'edition_number': '989', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=175BFFy89lhKkxWAlVDFodgRPcLy3Acrq'], 'files': [{'checksum': '6aa63c03c9d33e0d6b5068e5be0d379f', 'path': '2802007/2023-03-03/a02f93c0f25ceede2e03dccd0f033dab794ee0ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=175BFFy89lhKkxWAlVDFodgRPcLy3Acrq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:25.251763Z', 'territory_id': '2802007'} 2023-11-28 03:15:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-23', 'edition_number': '984', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vd1GG1nlMmLd6c6rEBN5VdfpXqTgdHfi'], 'files': [{'checksum': 'e7116a516679482f53c9aa2a33b198fc', 'path': '2802007/2023-02-23/dd79db00030e1e3974720828352ce2afd3902eb7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vd1GG1nlMmLd6c6rEBN5VdfpXqTgdHfi'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:11.863509Z', 'territory_id': '2802007'} 2023-11-28 03:15:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-28', 'edition_number': '987', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vjC3X3HZd9SP9VoZv6-K2PtCarLCmeHn'], 'files': [{'checksum': '55fde1ea07330e0ffc9f13ee7defdfa7', 'path': '2802007/2023-02-28/351526a480120bdcd541e8b80e3960cfb9c45124', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vjC3X3HZd9SP9VoZv6-K2PtCarLCmeHn'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:20.889943Z', 'territory_id': '2802007'} 2023-11-28 03:15:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-02-27', 'edition_number': '986', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HZ9bT77F6ac4-g6q0B-fh3cvFvUBC8B7'], 'files': [{'checksum': '456cf304b767a00d4afa8ec95f630644', 'path': '2802007/2023-02-27/1a374d6e16dea12e99842f94484fc81f76505d09', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HZ9bT77F6ac4-g6q0B-fh3cvFvUBC8B7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:18.427907Z', 'territory_id': '2802007'} 2023-11-28 03:15:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-09', 'edition_number': '993', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hutbilzMef_Y0cjKPA8863z7SWh9AvE5'], 'files': [{'checksum': 'eb6eb2370a4e102ea0f2e49fa74df9dd', 'path': '2802007/2023-03-09/ad68bcd531ead83272ac9c09c4af1dc28953669e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hutbilzMef_Y0cjKPA8863z7SWh9AvE5'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:38.037104Z', 'territory_id': '2802007'} 2023-11-28 03:15:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-08', 'edition_number': '992', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hYx1Fbk0PK2zuRDmVoJNZhZSkrkvxll7'], 'files': [{'checksum': '42735ee2b2c621bdf58c9a1e58eaf715', 'path': '2802007/2023-03-08/1d42d222586fc288465e1f4940abc8d67d6b7864', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hYx1Fbk0PK2zuRDmVoJNZhZSkrkvxll7'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:35.003083Z', 'territory_id': '2802007'} 2023-11-28 03:15:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-07', 'edition_number': '991', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PBla49UN_uVVrtsgzHNIGw9YiWM2cVzq'], 'files': [{'checksum': 'a420cfeb441b7213b7e5107483552048', 'path': '2802007/2023-03-07/184a1a201bb1568bf085e2ff51f6962e8247e43d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1PBla49UN_uVVrtsgzHNIGw9YiWM2cVzq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:32.129068Z', 'territory_id': '2802007'} 2023-11-28 03:15:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-10', 'edition_number': '994', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vopOcY-Iyg-gaqiilLrZwNWFe8vtxJOV'], 'files': [{'checksum': '825c3b4a2abc889d03b6b8b19f33fc80', 'path': '2802007/2023-03-10/a1699beb10bec9a9705a57b0a8d85fadecaa8b96', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vopOcY-Iyg-gaqiilLrZwNWFe8vtxJOV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:39.692646Z', 'territory_id': '2802007'} 2023-11-28 03:15:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-14', 'edition_number': '996', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11FUWrDbCyXScZ628E3JWRvbBFvKbLCTs'], 'files': [{'checksum': 'a60346c36dc61ce3f570ca29995b1fdf', 'path': '2802007/2023-03-14/9e62a48d39ebd551603da989dba6bd13d07e9015', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=11FUWrDbCyXScZ628E3JWRvbBFvKbLCTs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:45.668059Z', 'territory_id': '2802007'} 2023-11-28 03:15:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-06', 'edition_number': '990', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Fe7TCDsZYkRZHihtSCgfdyhtIw7F9tj'], 'files': [{'checksum': '4f0f74045e47e1ee58c67636fe826f92', 'path': '2802007/2023-03-06/7627b510370c1ef9290bb82d5806df220427af9e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15Fe7TCDsZYkRZHihtSCgfdyhtIw7F9tj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:28.007094Z', 'territory_id': '2802007'} 2023-11-28 03:15:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-16', 'edition_number': '998', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AKUd-_JunpXmW36_pUp5cpGJNdBlZDpA'], 'files': [{'checksum': 'a1eda3c18ab57d100ad11774c89517d3', 'path': '2802007/2023-03-16/de8751f96febb6cc59b2d8864515d26d26cb8f1c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AKUd-_JunpXmW36_pUp5cpGJNdBlZDpA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:54.254127Z', 'territory_id': '2802007'} 2023-11-28 03:15:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-21', 'edition_number': '1000', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FJsOKtEIzC0R1x-95Z1dYvG_KAp9dIXB'], 'files': [{'checksum': '9e7b729913f9b5b5f44e29e260ba83ae', 'path': '2802007/2023-03-21/6ad46366572f3981504016e393ec1b947c8782d7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FJsOKtEIzC0R1x-95Z1dYvG_KAp9dIXB'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:01.075823Z', 'territory_id': '2802007'} 2023-11-28 03:15:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-17', 'edition_number': '999', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13JyAtmG8fDzCpbkjE6trAzftFxDLlgDO'], 'files': [{'checksum': 'af89e88953097abb0fa682a50eb919cc', 'path': '2802007/2023-03-17/c88a32cc3de89222d011e0742bf4ff73ab6f6ae9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13JyAtmG8fDzCpbkjE6trAzftFxDLlgDO'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:57.391299Z', 'territory_id': '2802007'} 2023-11-28 03:15:50 [scrapy.extensions.logstats] INFO: Crawled 993 pages (at 18 pages/min), scraped 991 items (at 18 items/min) 2023-11-28 03:15:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-22', 'edition_number': '1001', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19NyeIm10W-RIyTOnRbloANTjwgDbjnta'], 'files': [{'checksum': '6196c0b308844a3ad1743c35c565f130', 'path': '2802007/2023-03-22/3d57699ec212376020f26ea188fae9b71ac9e18b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19NyeIm10W-RIyTOnRbloANTjwgDbjnta'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:03.478364Z', 'territory_id': '2802007'} 2023-11-28 03:15:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-23', 'edition_number': '1002', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Grod7mgKsK9RhuxJmdqzRqdVl-cdhsPw'], 'files': [{'checksum': '76ef9e94c9c92352a484646ff089f4c4', 'path': '2802007/2023-03-23/e185061bc0a03d0a4b34c3d42a5739083a630921', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Grod7mgKsK9RhuxJmdqzRqdVl-cdhsPw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:06.536415Z', 'territory_id': '2802007'} 2023-11-28 03:15:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:15:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:15:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-13', 'edition_number': '995', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IERMp04mqyuRRD9C7W-hU0qacwfpHXgx'], 'files': [{'checksum': '3299f3ac1138fa6c9e426f62e60b3f44', 'path': '2802007/2023-03-13/974607384373bf98bd911ea7e478bc7c664fb2d4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IERMp04mqyuRRD9C7W-hU0qacwfpHXgx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:43.102962Z', 'territory_id': '2802007'} 2023-11-28 03:16:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-15', 'edition_number': '997', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rDmXUwykJ9c4Eu2a5vpdSX42HtFdtuRo'], 'files': [{'checksum': '1114701e6fbed1e059bf89b098b0cfbc', 'path': '2802007/2023-03-15/672facaf01557aae266fb05ddab01aef2fc4b0cc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rDmXUwykJ9c4Eu2a5vpdSX42HtFdtuRo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:50.540724Z', 'territory_id': '2802007'} 2023-11-28 03:16:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-27', 'edition_number': '1005', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GFJxbWRavhZyivCtiQbnCG5K-xKv_lW9'], 'files': [{'checksum': '56c7eb5f0e570e330ab1d9e3060b86ea', 'path': '2802007/2023-03-27/ea51f7229947dd4538e75fceab3cbb7c5c1a1e80', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GFJxbWRavhZyivCtiQbnCG5K-xKv_lW9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:16.990059Z', 'territory_id': '2802007'} 2023-11-28 03:16:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-27', 'edition_number': '1004', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OwPJt_8g7hMwgsRVREBFSHjbiP4P877X'], 'files': [{'checksum': '9da20eb4b5e338308e2d4d3bd66a05dd', 'path': '2802007/2023-03-27/e5de4eb562e847c69a20eb2d1a1d656a6f027261', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OwPJt_8g7hMwgsRVREBFSHjbiP4P877X'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:13.525851Z', 'territory_id': '2802007'} 2023-11-28 03:16:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-24', 'edition_number': '1003', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tKsFEoaajHWQHcdgCRMjuKyHpD01wnxz'], 'files': [{'checksum': 'e58381969a94690df7d4d427f401afeb', 'path': '2802007/2023-03-24/f82138360290d49d49e21155881de65850a1fdfc', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tKsFEoaajHWQHcdgCRMjuKyHpD01wnxz'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:10.656450Z', 'territory_id': '2802007'} 2023-11-28 03:16:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-29', 'edition_number': '1007', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Yu8BM4OyO82qcGuG3KjGVQ19Sfx5Em_U'], 'files': [{'checksum': '49238e363f365deb9d0881c4f5791f76', 'path': '2802007/2023-03-29/d4a0e1b3dca3283cdee367fc39aee0853b5222ca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Yu8BM4OyO82qcGuG3KjGVQ19Sfx5Em_U'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:22.792173Z', 'territory_id': '2802007'} 2023-11-28 03:16:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-28', 'edition_number': '1006', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Id9RzA2PLsxx0wBGOGWdp0DzUVBZ5RwX'], 'files': [{'checksum': 'c47d1dc759e398a98069f3a2349f2966', 'path': '2802007/2023-03-28/f6e9ca376d3de13369e198e711ff7ce27aba7ae9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Id9RzA2PLsxx0wBGOGWdp0DzUVBZ5RwX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:19.263421Z', 'territory_id': '2802007'} 2023-11-28 03:16:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-30', 'edition_number': '1008', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YyU2O0Nt4eCYg1uYwGjvpJ-sxaNg_Cmb'], 'files': [{'checksum': '5d74d9f8846d014a2f9902fd0189514e', 'path': '2802007/2023-03-30/79a1c8eb8b7359de5eddb52b3291b8a5e70695ee', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1YyU2O0Nt4eCYg1uYwGjvpJ-sxaNg_Cmb'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:25.239994Z', 'territory_id': '2802007'} 2023-11-28 03:16:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-02', 'edition_number': '988', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KJla1SdRR-QLH_4u0etHPmPF0AtKd09d'], 'files': [{'checksum': 'ee76e438f32c7571cd1a21dc364c322a', 'path': '2802007/2023-03-02/3eb82cbfb620fed9c1d969d1bb6a5a46ff5db7a6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KJla1SdRR-QLH_4u0etHPmPF0AtKd09d'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:09:22.676880Z', 'territory_id': '2802007'} 2023-11-28 03:16:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-30', 'edition_number': '969', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aOAgEzfjbyh3mIN2qe-0ZccGOqi0FRai'], 'files': [{'checksum': '13e0d16294a14b7487003a44d8400ecc', 'path': '2802007/2023-01-30/40c0eb840cccfbd62a64538ecfd927e05093570a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1aOAgEzfjbyh3mIN2qe-0ZccGOqi0FRai'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:08:13.881590Z', 'territory_id': '2802007'} 2023-11-28 03:16:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-10', 'edition_number': '1013', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1apI_JJMQQzEwYB9THT9XCkbDH71vKMLg'], 'files': [{'checksum': '69a4f305125260644d7ac07e4d6e1545', 'path': '2802007/2023-04-10/7c53497b3b92e1ae909ee5b6c2106c6a492d125c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1apI_JJMQQzEwYB9THT9XCkbDH71vKMLg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:43.534828Z', 'territory_id': '2802007'} 2023-11-28 03:16:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-05', 'edition_number': '1012', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15sZ1I_N6M_VqibwNU16W_qVpRZZPjtsG'], 'files': [{'checksum': '909b35d2f221b18829d287e74c5ac9d9', 'path': '2802007/2023-04-05/511a791d3e1c1bc7543378fb18f338ca50863be0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15sZ1I_N6M_VqibwNU16W_qVpRZZPjtsG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:39.835945Z', 'territory_id': '2802007'} 2023-11-28 03:16:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-13', 'edition_number': '1015', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1us-8wXr7tZwuM5pCT28UwtRCfF-C8_7M'], 'files': [{'checksum': '89f8210af0e5085f299b0fd4fe343f3d', 'path': '2802007/2023-04-13/c0175b315cee7c4e4ee1468903e38fe2fadae68c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1us-8wXr7tZwuM5pCT28UwtRCfF-C8_7M'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:57.826761Z', 'territory_id': '2802007'} 2023-11-28 03:16:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:16:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-14', 'edition_number': '1016', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jTI59XdsIFbqXErxOLlr18MPU_5_dHbY'], 'files': [{'checksum': '4a7901a1b1a04fd46c9f0806b94b3bd4', 'path': '2802007/2023-04-14/01e78cb33a25d9f8ad4845d0ce0d65adff7b9aa4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1jTI59XdsIFbqXErxOLlr18MPU_5_dHbY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:01.111048Z', 'territory_id': '2802007'} 2023-11-28 03:16:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-17', 'edition_number': '1017', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U38SozqH75ONoqGotU6RZuvb5aeq9v3B'], 'files': [{'checksum': 'f93eaf93ea4acc6eff95ef20c6486763', 'path': '2802007/2023-04-17/f245669a60c4386c2f8743c18803a3b0b8084810', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1U38SozqH75ONoqGotU6RZuvb5aeq9v3B'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:03.395176Z', 'territory_id': '2802007'} 2023-11-28 03:16:50 [scrapy.extensions.logstats] INFO: Crawled 1010 pages (at 17 pages/min), scraped 1008 items (at 17 items/min) 2023-11-28 03:16:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-18', 'edition_number': '1018', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oTy5i5N3z3fvTKW4OmxJPjHrMOLgn9sv'], 'files': [{'checksum': 'e5a5420aff9b9a593f15ff707165ea94', 'path': '2802007/2023-04-18/922bac2437f892221e7f3cf3d2eb5a2dcf81fe93', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1oTy5i5N3z3fvTKW4OmxJPjHrMOLgn9sv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:07.270604Z', 'territory_id': '2802007'} 2023-11-28 03:16:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-20', 'edition_number': '1020', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16KcTwqhZWdx3iyNVvDeA8X0vAlmmOV51'], 'files': [{'checksum': '21722256fc296289e6e8a7cd2abdb03d', 'path': '2802007/2023-04-20/001956261326a66bdc8f46913bfb6c133024b01a', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16KcTwqhZWdx3iyNVvDeA8X0vAlmmOV51'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:14.542835Z', 'territory_id': '2802007'} 2023-11-28 03:16:55 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:16:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:16:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:16:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-11', 'edition_number': '1014', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hI9X2oPwuLnj2L9KyeDOLYRX6QLnOiPV'], 'files': [{'checksum': 'a321764584814de558b813b3084ba217', 'path': '2802007/2023-04-11/3161f34ad905291e8827d395c596531fa6ddcc2e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hI9X2oPwuLnj2L9KyeDOLYRX6QLnOiPV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:49.840949Z', 'territory_id': '2802007'} 2023-11-28 03:17:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-04', 'edition_number': '1011', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zsXVLRFW3JLEmb60FYjBVQtR-s7fGNFI'], 'files': [{'checksum': '2fb4f0cc0af849d1727ff1975a787f86', 'path': '2802007/2023-04-04/71be80b7550e92d8d797d6fd9bedfdc0de866693', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zsXVLRFW3JLEmb60FYjBVQtR-s7fGNFI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:37.265323Z', 'territory_id': '2802007'} 2023-11-28 03:17:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-27', 'edition_number': '1024', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1e6d8TrkJZkajiMteJMx3gb4KzYoAmm9L'], 'files': [{'checksum': 'befab2f648a26867b995d1fdce14a1a0', 'path': '2802007/2023-04-27/4ca90e264a48379347b16a333549ed9a8679783e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1e6d8TrkJZkajiMteJMx3gb4KzYoAmm9L'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:25.913181Z', 'territory_id': '2802007'} 2023-11-28 03:17:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-28', 'edition_number': '1025', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gtyi7LmfCx5N_0mOl6M7vKA7jWZ7LIzC'], 'files': [{'checksum': 'cb1088c5a6017d4bf3cbbbda5e90fd10', 'path': '2802007/2023-04-28/bdce6ff5092b9eece9a48ddb6ceac2cfeff3544b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Gtyi7LmfCx5N_0mOl6M7vKA7jWZ7LIzC'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:29.503083Z', 'territory_id': '2802007'} 2023-11-28 03:17:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-04', 'edition_number': '1027', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SZd3nSso01PbVGJIbXNmvw0LVvpuXRxh'], 'files': [{'checksum': 'b63d15d6cf4703a065ffa56b4725d62b', 'path': '2802007/2023-05-04/7a964878f88a4cac6d441f216cd3a57428cc752f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SZd3nSso01PbVGJIbXNmvw0LVvpuXRxh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:35.668143Z', 'territory_id': '2802007'} 2023-11-28 03:17:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-26', 'edition_number': '1023', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K_GVbxhjIDqxlTgX64-LXh17Ub7r-Jic'], 'files': [{'checksum': '155cfd5446e6d7db0ec037bd45f2896c', 'path': '2802007/2023-04-26/f9f1db03170721e8e152fadd7cbdcc6a02d5d785', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1K_GVbxhjIDqxlTgX64-LXh17Ub7r-Jic'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:24.059274Z', 'territory_id': '2802007'} 2023-11-28 03:17:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:19 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-25', 'edition_number': '1022', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FCAZ2CXJSXQZYEKfYHVSVWLfTvg-vX2S'], 'files': [{'checksum': '606ee07b248063f5f4f388a70fd5a284', 'path': '2802007/2023-04-25/e98c413211112631063a65c81c5095bf83afdd7c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FCAZ2CXJSXQZYEKfYHVSVWLfTvg-vX2S'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:20.684402Z', 'territory_id': '2802007'} 2023-11-28 03:17:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-08', 'edition_number': '1029', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14WutqGNPJUXC0_2E5jiEf-Sg9jq157kc'], 'files': [{'checksum': '779a49b8f3b9b0536c6f2b76c2a47472', 'path': '2802007/2023-05-08/b4c0e3667b346ddce1003bfa37def101948dbfc4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=14WutqGNPJUXC0_2E5jiEf-Sg9jq157kc'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:40.472303Z', 'territory_id': '2802007'} 2023-11-28 03:17:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-03', 'edition_number': '1026', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1m5IBR3utzcVmlEoOW5tLl8tMZjbiip8j'], 'files': [{'checksum': 'fccde6d06bebce44a082aef681789084', 'path': '2802007/2023-05-03/c74dbc0342856d0083f5c89d788fcde61dd751cb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1m5IBR3utzcVmlEoOW5tLl8tMZjbiip8j'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:31.332811Z', 'territory_id': '2802007'} 2023-11-28 03:17:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-24', 'edition_number': '1021', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=189beiruI-TDmgFtJMlViJhDpf_ml_AaL'], 'files': [{'checksum': '5124446da15a2360efdeb3560c2333da', 'path': '2802007/2023-04-24/fe16ab739d1e39172dbb649cdeb64771365c5f77', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=189beiruI-TDmgFtJMlViJhDpf_ml_AaL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:18.307035Z', 'territory_id': '2802007'} 2023-11-28 03:17:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-11', 'edition_number': '1032', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HDordSGfT1RJ6wSJM8zg-Oj8jDXkpyCo'], 'files': [{'checksum': '3971e0cbd4aa039fdb469ccf5fcab3a2', 'path': '2802007/2023-05-11/f05d27c3568e9d1f468141d8d64e9ac4faef2852', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HDordSGfT1RJ6wSJM8zg-Oj8jDXkpyCo'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:17.408616Z', 'territory_id': '2802007'} 2023-11-28 03:17:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-05', 'edition_number': '1028', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Std1alV23qIoK4New9oNkqzxeIdiIr41'], 'files': [{'checksum': 'a01777d870fed5facdb95814c092b814', 'path': '2802007/2023-05-05/3866e4b64656c4f6184d07c96fbd3609fbb8cfec', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Std1alV23qIoK4New9oNkqzxeIdiIr41'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:37.519236Z', 'territory_id': '2802007'} 2023-11-28 03:17:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-09', 'edition_number': '1030', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xWoBjI2KjaxGwKE21njXZmNkvkf1nN0H'], 'files': [{'checksum': '1c423dd9c2149a72943c59325c276120', 'path': '2802007/2023-05-09/1b3146502b7659d3b3e73b2f656ea7527dfab376', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xWoBjI2KjaxGwKE21njXZmNkvkf1nN0H'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:59.300738Z', 'territory_id': '2802007'} 2023-11-28 03:17:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-16', 'edition_number': '1035', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IDEbQ9n2e05Md4a1oCQpx3_p_fzKmhfG'], 'files': [{'checksum': '89e83befee96f2472aac6a74a2dd3eb4', 'path': '2802007/2023-05-16/2c03ef097a950f029269fe55a7b6b5f97f7a55ee', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IDEbQ9n2e05Md4a1oCQpx3_p_fzKmhfG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:26.104151Z', 'territory_id': '2802007'} 2023-11-28 03:17:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-19', 'edition_number': '1019', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b41RqHeB6abrx4AlZbWagSLx9jgh4vo6'], 'files': [{'checksum': 'f676fd477b2d812fc049f4b14b24f5c3', 'path': '2802007/2023-04-19/34d4f8e13aa52f5f209b68d78d39716c6ae14953', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b41RqHeB6abrx4AlZbWagSLx9jgh4vo6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:11:10.863498Z', 'territory_id': '2802007'} 2023-11-28 03:17:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-12', 'edition_number': '1033', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DdGSQiKYW0JECEVzLVxQ04GS4dO_kFOd'], 'files': [{'checksum': '37295b32da5da39b81072f1a5896059e', 'path': '2802007/2023-05-12/aee0a5f355fca001c79e4ea02e8fe86e495e85db', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1DdGSQiKYW0JECEVzLVxQ04GS4dO_kFOd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:21.193436Z', 'territory_id': '2802007'} 2023-11-28 03:17:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:48 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-15', 'edition_number': '1034', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1owaoL3KWWSn1a7-5FHa581ooOJ0FZ7WY'], 'files': [{'checksum': '8d12ca329f528df85fb81099f6c19e10', 'path': '2802007/2023-05-15/52efe262b228ce31371078567e8a20cdc853c702', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1owaoL3KWWSn1a7-5FHa581ooOJ0FZ7WY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:23.774069Z', 'territory_id': '2802007'} 2023-11-28 03:17:50 [scrapy.extensions.logstats] INFO: Crawled 1029 pages (at 19 pages/min), scraped 1027 items (at 19 items/min) 2023-11-28 03:17:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-10', 'edition_number': '1031', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BCi4ziUc7UEDvT8O_fUcm2F33QmHirQw'], 'files': [{'checksum': '16bf8f130e0b9051a69adfa839ef63e6', 'path': '2802007/2023-05-10/e9b034aa31ce1acd754fe582606286897edb8266', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BCi4ziUc7UEDvT8O_fUcm2F33QmHirQw'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:15.594433Z', 'territory_id': '2802007'} 2023-11-28 03:17:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-18', 'edition_number': '1037', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H1RbMGu3g58NmsDFnxXHPMKBHzKztJq8'], 'files': [{'checksum': 'a1630afa053385f3c0340d7152b28151', 'path': '2802007/2023-05-18/a57d6909872ee65000fd09adbc857f671a882daf', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1H1RbMGu3g58NmsDFnxXHPMKBHzKztJq8'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:30.585653Z', 'territory_id': '2802007'} 2023-11-28 03:17:53 [scrapy.pipelines.files] DEBUG: File (uptodate): Downloaded file from referred in 2023-11-28 03:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-20', 'edition_number': '1129', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10bG7N1dhvTOYaKNpoi_KlnJDwnUxo2rW'], 'files': [{'checksum': '7cd1fe3f30404a46f5b6d4edcd6934c3', 'path': '2802007/2023-11-20/2c3cdc595e67b3eedb72bcd050be8b47202ce592', 'status': 'uptodate', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10bG7N1dhvTOYaKNpoi_KlnJDwnUxo2rW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:53.389678Z', 'territory_id': '2802007'} 2023-11-28 03:17:53 [scrapy.pipelines.files] DEBUG: File (uptodate): Downloaded file from referred in 2023-11-28 03:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-22', 'edition_number': '1130', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Cfq_rn8NSDSEfM2hyZnLYI6KTPWCMSUJ'], 'files': [{'checksum': 'fbfcef2318a4b4acd45908de07ed6938', 'path': '2802007/2023-11-22/3e47fb2513cbb5da3f21d418d5b286cd4e30fc2b', 'status': 'uptodate', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Cfq_rn8NSDSEfM2hyZnLYI6KTPWCMSUJ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:53.502118Z', 'territory_id': '2802007'} 2023-11-28 03:17:53 [scrapy.pipelines.files] DEBUG: File (uptodate): Downloaded file from referred in 2023-11-28 03:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-23', 'edition_number': '1131', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1g2I1EkNhArVg_deVAcOzInbf8J90HNUt'], 'files': [{'checksum': '349b4952a1535c839ecb47a0847ea8a6', 'path': '2802007/2023-11-23/d0be62dbf143a36c878f7ac2088d99235e83512c', 'status': 'uptodate', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1g2I1EkNhArVg_deVAcOzInbf8J90HNUt'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:53.784285Z', 'territory_id': '2802007'} 2023-11-28 03:17:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:17:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:17:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-04-03', 'edition_number': '1010', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Cgnf13S8F3i8LCZBQTFSWw6muMwVGAz6'], 'files': [{'checksum': '965390c2fece27ad8c0e7db9008265cd', 'path': '2802007/2023-04-03/c42f1191e0810a9a730d25bee3d473982ada35b7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Cgnf13S8F3i8LCZBQTFSWw6muMwVGAz6'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:33.643180Z', 'territory_id': '2802007'} 2023-11-28 03:18:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-25', 'edition_number': '1042', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17sQXvob4XyWOMciNMNTsnyIkmzgx0lrp'], 'files': [{'checksum': 'dae5c8aa1ebc3046cb4c8ed05091a1c1', 'path': '2802007/2023-05-25/2459ec97a51cb0a0f130f823aa1b10794c5541ae', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17sQXvob4XyWOMciNMNTsnyIkmzgx0lrp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:46.803492Z', 'territory_id': '2802007'} 2023-11-28 03:18:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-24', 'edition_number': '1041', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AYMzszj3rtdLJadDsqEi3XxAB6zAaGd0'], 'files': [{'checksum': '8b0524006f851563d4222de12bcd5a57', 'path': '2802007/2023-05-24/9bff93abc79b1c4c5a282ce3f05d85210d498cb6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1AYMzszj3rtdLJadDsqEi3XxAB6zAaGd0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:44.126970Z', 'territory_id': '2802007'} 2023-11-28 03:18:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-29', 'edition_number': '1044', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NfW2PTKf0xuAfiKe9QDOQKbcwddPJ4ZH'], 'files': [{'checksum': '23f15bcd3f7a5764f0a786ae4df06c43', 'path': '2802007/2023-05-29/f638297a631ca97e34a77ab16b958d75ea5637e2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NfW2PTKf0xuAfiKe9QDOQKbcwddPJ4ZH'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:55.302574Z', 'territory_id': '2802007'} 2023-11-28 03:18:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:12 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-26', 'edition_number': '1043', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Rh26Ct_GVnvDBnV31tLPMdn_RCPyV3SY'], 'files': [{'checksum': '5074f46d78e16a065c771bbce43cab16', 'path': '2802007/2023-05-26/f2a76e86ddd83926f4ecdf807f727cb614d7d322', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Rh26Ct_GVnvDBnV31tLPMdn_RCPyV3SY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:52.359386Z', 'territory_id': '2802007'} 2023-11-28 03:18:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:15 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-31', 'edition_number': '1046', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vHLjVHGdNC185H5EgNBVCgojudpvo371'], 'files': [{'checksum': '2581150d7b50666f8c22013cd6f9edd0', 'path': '2802007/2023-05-31/2fc033b4f7a0f2e70ebb9941f63a3383bd07da9d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vHLjVHGdNC185H5EgNBVCgojudpvo371'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:08.679801Z', 'territory_id': '2802007'} 2023-11-28 03:18:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-02', 'edition_number': '1048', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=166eBvRag7mRRAS_vanHcvq3KXSsx4jDT'], 'files': [{'checksum': '711b17ec296d794e61538096ce778902', 'path': '2802007/2023-06-02/fa0d7a2c4df72dd44f098cc768e5fde164c91fd0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=166eBvRag7mRRAS_vanHcvq3KXSsx4jDT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:16.075930Z', 'territory_id': '2802007'} 2023-11-28 03:18:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-05', 'edition_number': '1049', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lkx_807fu4CEf_mf0dovNW7DMFphZNrp'], 'files': [{'checksum': '671312172f8686e9e3641e23cdaac5c1', 'path': '2802007/2023-06-05/44eaa3de5ff7710767dd02d583712aab9e0af526', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lkx_807fu4CEf_mf0dovNW7DMFphZNrp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:19.024520Z', 'territory_id': '2802007'} 2023-11-28 03:18:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-06', 'edition_number': '1050', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19yESKQHcfs3_EHiS0E5Fq0Q_zSL-dQXu'], 'files': [{'checksum': '91737077dc54e30c046ebd0861f7af05', 'path': '2802007/2023-06-06/4f5d81e2e9aa88a390e43cd2e33ad16f2444d604', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19yESKQHcfs3_EHiS0E5Fq0Q_zSL-dQXu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:24.446217Z', 'territory_id': '2802007'} 2023-11-28 03:18:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:29 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-07', 'edition_number': '1051', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fkmbxJq3E-OEv1bTiiPbfe6TIeJr_eWV'], 'files': [{'checksum': '44b77309e620dba14ec66b69ec089286', 'path': '2802007/2023-06-07/604de7e5459274527e389dde4446018ae9691cd0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fkmbxJq3E-OEv1bTiiPbfe6TIeJr_eWV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:27.662204Z', 'territory_id': '2802007'} 2023-11-28 03:18:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-01', 'edition_number': '1047', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xBKLTa7NJN9F2A-8d14hFvQwLm0TnKxK'], 'files': [{'checksum': 'a3a112e07f70d1c46b3b9cdb49d23f85', 'path': '2802007/2023-06-01/a5406d4920a4923401148dd8063be034c15759f6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1xBKLTa7NJN9F2A-8d14hFvQwLm0TnKxK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:12.611963Z', 'territory_id': '2802007'} 2023-11-28 03:18:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-30', 'edition_number': '1045', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RlvME3mIlu6BnJ5PK2qUyt1UhIewXOxF'], 'files': [{'checksum': '8d7e1abe07232e16c71bf96270b21497', 'path': '2802007/2023-05-30/25b29dfe7d51507cd950a9469c48387f32303700', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1RlvME3mIlu6BnJ5PK2qUyt1UhIewXOxF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:05.410845Z', 'territory_id': '2802007'} 2023-11-28 03:18:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-22', 'edition_number': '1040', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cmteVeIyzNAVa_GibUIArjwcFw9gqdLf'], 'files': [{'checksum': 'd44119b9314a78700a3b4bc5b054b536', 'path': '2802007/2023-05-22/e2b9f1d02386194dae375e8b2a24e3c9ebffaa54', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1cmteVeIyzNAVa_GibUIArjwcFw9gqdLf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:40.415118Z', 'territory_id': '2802007'} 2023-11-28 03:18:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-19', 'edition_number': '1039', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hO4NJwXDfkyal7az0AZqHVNSd1LD4Oq-'], 'files': [{'checksum': 'cf60efeff3da9ff3b87416d026506429', 'path': '2802007/2023-05-19/6607f693cc438858f147f7bd4175360a2cd838a5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hO4NJwXDfkyal7az0AZqHVNSd1LD4Oq-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:38.316049Z', 'territory_id': '2802007'} 2023-11-28 03:18:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:45 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-15', 'edition_number': '1055', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GcPGxwQW05ky_l7an6ceb2scNvHdAh7T'], 'files': [{'checksum': '8ff756c305d919f44ccda6841d39f884', 'path': '2802007/2023-06-15/e1000f1a706b897d93f0f21596a7b8998684ab25', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GcPGxwQW05ky_l7an6ceb2scNvHdAh7T'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:41.359746Z', 'territory_id': '2802007'} 2023-11-28 03:18:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-16', 'edition_number': '1056', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1d69rnocraL_QUtq_0Cdea1iGl4t98RwA'], 'files': [{'checksum': '384605ca2e0467c1dd6718b0b0948a20', 'path': '2802007/2023-06-16/29a92281d058f5cec4ee187a3caf4dcf77499f3d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1d69rnocraL_QUtq_0Cdea1iGl4t98RwA'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:45.816451Z', 'territory_id': '2802007'} 2023-11-28 03:18:50 [scrapy.extensions.logstats] INFO: Crawled 1047 pages (at 18 pages/min), scraped 1048 items (at 21 items/min) 2023-11-28 03:18:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-19', 'edition_number': '1057', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QKnbTUUSTpqFWaPiFWvLISOOUV8YsYTk'], 'files': [{'checksum': '0c03f35a38c59c4faef8905734073d77', 'path': '2802007/2023-06-19/7e57a0b6c121e19afc8e274e6a20b3eb0479e015', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QKnbTUUSTpqFWaPiFWvLISOOUV8YsYTk'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:55.281551Z', 'territory_id': '2802007'} 2023-11-28 03:18:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:55 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-14', 'edition_number': '1054', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b_chgmxWwVjUcdeEvgzRnqgU2Z-_hdXd'], 'files': [{'checksum': '15acecf05730d6169f4890b7775bdb54', 'path': '2802007/2023-06-14/c23d70e5dd5c9c3e2a16242e63bd992df1bdc588', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1b_chgmxWwVjUcdeEvgzRnqgU2Z-_hdXd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:38.138958Z', 'territory_id': '2802007'} 2023-11-28 03:18:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-10-31', 'edition_number': '916', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZFbCaIKMmVGGAa-PM0_DWqR2RXKjEVzs'], 'files': [{'checksum': '6b09837583222b2c62f62cf5a30feb25', 'path': '2802007/2022-10-31/55f347c6ccb594b1aad23480a2fddd33d2f81a1f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ZFbCaIKMmVGGAa-PM0_DWqR2RXKjEVzs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:48.993194Z', 'territory_id': '2802007'} 2023-11-28 03:18:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:18:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:18:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-11-04', 'edition_number': '918', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MjPOtwjgOg76-HVHP6HtlybjYoWdE6nq'], 'files': [{'checksum': '14a304d1b574c0c0a5b5380ff3def0dd', 'path': '2802007/2022-11-04/e0a71a5cc4a3b7fd432ca2568676f5f42bcca5b0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MjPOtwjgOg76-HVHP6HtlybjYoWdE6nq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:04:54.742507Z', 'territory_id': '2802007'} 2023-11-28 03:19:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-21', 'edition_number': '1059', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tWbgp60AExa2HuKlUvF27DtckCq_U_Mx'], 'files': [{'checksum': 'e05344bc7aa7b4af39cb9a39f0919558', 'path': '2802007/2023-06-21/9ecdddcf7c8d5e4451df0c5f00abc7220336a845', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tWbgp60AExa2HuKlUvF27DtckCq_U_Mx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:06.309065Z', 'territory_id': '2802007'} 2023-11-28 03:19:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-20', 'edition_number': '1058', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J3N-cBSyeh60GLn_XcCt3Xck9hdTjbTM'], 'files': [{'checksum': 'b48313afcfb51a31314d87583c6a2f4b', 'path': '2802007/2023-06-20/0d15157ca6e1d335073c2e65e1f4d0b8b8097e01', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1J3N-cBSyeh60GLn_XcCt3Xck9hdTjbTM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:00.203341Z', 'territory_id': '2802007'} 2023-11-28 03:19:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-26', 'edition_number': '1061', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zb6wnrSfJB0o-fHR3ukmz1-j8dOaEeb4'], 'files': [{'checksum': '40bda1ed4bcc90c36c584890f383e85f', 'path': '2802007/2023-06-26/57f116d2405375ee4c1a48c274058d6a9ed73863', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1zb6wnrSfJB0o-fHR3ukmz1-j8dOaEeb4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:10.684865Z', 'territory_id': '2802007'} 2023-11-28 03:19:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-22', 'edition_number': '1060', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uFREf0WBN2IDXrCm_sRAzTLxGiFUXkic'], 'files': [{'checksum': 'e129c614ab5a42eb07a1474e710baed4', 'path': '2802007/2023-06-22/36968fca3f8bdc7e6719e8b2388e1bf146b615a6', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1uFREf0WBN2IDXrCm_sRAzTLxGiFUXkic'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:08.509858Z', 'territory_id': '2802007'} 2023-11-28 03:19:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-03', 'edition_number': '1064', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=145RoIvOZRb2yNd-0d_ozMbjMjMumh3zU'], 'files': [{'checksum': '853b41fd67b8b8d15609a9fce0fbe74a', 'path': '2802007/2023-07-03/e0e9989f77bfea5e046deb83a524a72785b51c80', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=145RoIvOZRb2yNd-0d_ozMbjMjMumh3zU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:19.387109Z', 'territory_id': '2802007'} 2023-11-28 03:19:35 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (39596269) larger than download warn size (33554432) in request . 2023-11-28 03:19:41 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request . 2023-11-28 03:19:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:42 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-04', 'edition_number': '1065', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1d6OEDPuo4yp5BvWAudcemvj32nmoSY3R'], 'files': [{'checksum': 'f85a83ae2d87329f64f1bd32a62b2160', 'path': '2802007/2023-07-04/d56070cc3cc7d4ff2747dab1422325f424768644', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1d6OEDPuo4yp5BvWAudcemvj32nmoSY3R'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:23.592684Z', 'territory_id': '2802007'} 2023-11-28 03:19:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-28', 'edition_number': '1063', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SnC8I8vpoSyzDKcEl2p5U6L5L_Qe5fKF'], 'files': [{'checksum': 'a4f4ed7f31eeb6e12c54a43a2796f250', 'path': '2802007/2023-06-28/91d3d00f845dbb1804b71d8712504df275c0ffd1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SnC8I8vpoSyzDKcEl2p5U6L5L_Qe5fKF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:16.523169Z', 'territory_id': '2802007'} 2023-11-28 03:19:50 [scrapy.extensions.logstats] INFO: Crawled 1058 pages (at 11 pages/min), scraped 1059 items (at 11 items/min) 2023-11-28 03:19:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-05', 'edition_number': '1066', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y_MuGLBah2n80eZ7pjnSBFNdcbMqCFvh'], 'files': [{'checksum': '8d4c1a3a051698c37c705a2d7790cdbc', 'path': '2802007/2023-07-05/67aeaee057c3e940c2d2269f5d9a9d58a627cc23', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Y_MuGLBah2n80eZ7pjnSBFNdcbMqCFvh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:25.805505Z', 'territory_id': '2802007'} 2023-11-28 03:19:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:54 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2022-04-28', 'edition_number': '794', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wwcFcByIw_R2hrwuCumHLGGBRchhVEze'], 'files': [{'checksum': 'ffbaf1c1b511742f9827cb4f3f4d6b07', 'path': '2802007/2022-04-28/2345e7d1c8200fdf9bb96ef2121a6a88fbcb16f5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1wwcFcByIw_R2hrwuCumHLGGBRchhVEze'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T05:50:56.717516Z', 'territory_id': '2802007'} 2023-11-28 03:19:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:19:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:19:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-06', 'edition_number': '1067', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XC8UVaLpJVqrw0Df8THW7oSqtGx6IZ0p'], 'files': [{'checksum': 'e2d0f208612327720cfe9c1cb8f4fce6', 'path': '2802007/2023-07-06/7a73d385392018d0fafaefc3f077d460698b97ad', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1XC8UVaLpJVqrw0Df8THW7oSqtGx6IZ0p'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:30.289955Z', 'territory_id': '2802007'} 2023-11-28 03:20:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:03 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-27', 'edition_number': '1062', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10lwc56xN9_JE9Qm8-39gkpuqoedyB9_V'], 'files': [{'checksum': '0b35451616e1ad1e1690e98bac94900a', 'path': '2802007/2023-06-27/cdfce700411a47b11e195de916e8d2a2b0cb4d7f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10lwc56xN9_JE9Qm8-39gkpuqoedyB9_V'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:12.653812Z', 'territory_id': '2802007'} 2023-11-28 03:20:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:20:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:07 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-12', 'edition_number': '1070', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IYLCpnrD4JfWZI1I1DoYzAUvElG5lVYv'], 'files': [{'checksum': '9d83f03ef78214b233d0c8755ce96e04', 'path': '2802007/2023-07-12/52afffc0e943ad428c62036a60c45108e86be235', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IYLCpnrD4JfWZI1I1DoYzAUvElG5lVYv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:39.506099Z', 'territory_id': '2802007'} 2023-11-28 03:20:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-13', 'edition_number': '1071', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fc_Q9E6YSBgf-O2PRoW-zH_76EIyMdo9'], 'files': [{'checksum': 'd48e5b9649e5efb480002d0f80dbc097', 'path': '2802007/2023-07-13/39a97a1c9be1b56181e28f778c3d306ca3181ab8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fc_Q9E6YSBgf-O2PRoW-zH_76EIyMdo9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:42.385074Z', 'territory_id': '2802007'} 2023-11-28 03:20:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-17', 'edition_number': '1072', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kNPv8MRFVwKwiG8vdg5fXnPSljpO9Hip'], 'files': [{'checksum': '5472769ced429564ef7d70203cc4b7ea', 'path': '2802007/2023-07-17/cd1c4a743c824ab3053703ac41f4c60e51244c39', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kNPv8MRFVwKwiG8vdg5fXnPSljpO9Hip'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:44.415413Z', 'territory_id': '2802007'} 2023-11-28 03:20:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-11', 'edition_number': '1069', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ncHgAsrMVGktz6BBUFuEMJGJP8ODneXI'], 'files': [{'checksum': 'a89c086bc781f4b59f9e0cd08acecabc', 'path': '2802007/2023-07-11/b2165390120285b65347cd063970fdeddfa96eeb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1ncHgAsrMVGktz6BBUFuEMJGJP8ODneXI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:36.118118Z', 'territory_id': '2802007'} 2023-11-28 03:20:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-20', 'edition_number': '1074', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NqnzTZg3JBNPMxIIDct2FJ0mzF0mjuc9'], 'files': [{'checksum': '6c54e20f8061b8993fe4441442684272', 'path': '2802007/2023-07-20/e8dae364b11d28c956edd7a3df90ee5a6035efc2', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1NqnzTZg3JBNPMxIIDct2FJ0mzF0mjuc9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:51.783210Z', 'territory_id': '2802007'} 2023-11-28 03:20:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-19', 'edition_number': '1073', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rhLqgUBfqO4AF9wznIgBIm4RwU4QCWZx'], 'files': [{'checksum': 'c5550c8f1eec7beca4e41307db3fde94', 'path': '2802007/2023-07-19/2eb983812fc8d1eeaba5e9eb4cc396928c0c98e9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rhLqgUBfqO4AF9wznIgBIm4RwU4QCWZx'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:47.397927Z', 'territory_id': '2802007'} 2023-11-28 03:20:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-26', 'edition_number': '1076', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TixyVE2KlkUAYMysDAaJYCOod69AwIyV'], 'files': [{'checksum': 'e2435cb0ac1b81985782d5708a932a69', 'path': '2802007/2023-07-26/87f49326ecd5e163163fc818324bcfba526ed849', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TixyVE2KlkUAYMysDAaJYCOod69AwIyV'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:58.497554Z', 'territory_id': '2802007'} 2023-11-28 03:20:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-25', 'edition_number': '1075', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17teE75D2MvEtaErnwD9Ip-1vfZoVIAoT'], 'files': [{'checksum': 'f175656460786ecb364737bb25516053', 'path': '2802007/2023-07-25/5010a1071f7177fe1b37f40ec33a2e7622a08f85', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17teE75D2MvEtaErnwD9Ip-1vfZoVIAoT'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:55.996577Z', 'territory_id': '2802007'} 2023-11-28 03:20:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-31', 'edition_number': '1077', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HtUfpecx03xEoYMERX25Pmb5bH0VifPU'], 'files': [{'checksum': '3a00e76130536f818e8a4e78b21e5ac8', 'path': '2802007/2023-07-31/fed692baba3790108671b9f7078905e6aafb5658', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1HtUfpecx03xEoYMERX25Pmb5bH0VifPU'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:01.125048Z', 'territory_id': '2802007'} 2023-11-28 03:20:50 [scrapy.extensions.logstats] INFO: Crawled 1071 pages (at 13 pages/min), scraped 1072 items (at 13 items/min) 2023-11-28 03:20:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:20:58 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-07-07', 'edition_number': '1068', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SZYbv86NzQAodVBANL49dj0vDcJlaS1T'], 'files': [{'checksum': '8e3ab5592387b532798b6ae7b6573e25', 'path': '2802007/2023-07-07/fd28d37f5e173c28a95bebff9b61cc236022abca', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1SZYbv86NzQAodVBANL49dj0vDcJlaS1T'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:14:32.057247Z', 'territory_id': '2802007'} 2023-11-28 03:21:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-13', 'edition_number': '1053', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-T1TbD_z4vBEV4nWWAr4NAlBWcSZLl09'], 'files': [{'checksum': '8e565ede8f2c268fd2c45ca983510013', 'path': '2802007/2023-06-13/21ef680bbef04ec4bef10ddb3fee18d8aa7474af', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1-T1TbD_z4vBEV4nWWAr4NAlBWcSZLl09'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:34.263743Z', 'territory_id': '2802007'} 2023-11-28 03:21:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:05 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-06-12', 'edition_number': '1052', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vCalS79g3FuuItoLNybDdrKGDPDXXYDg'], 'files': [{'checksum': '675ece860197671ceae72ef177d24091', 'path': '2802007/2023-06-12/5af94101c45d5bd70dd4592629f67d0b6281ab05', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1vCalS79g3FuuItoLNybDdrKGDPDXXYDg'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:13:30.723569Z', 'territory_id': '2802007'} 2023-11-28 03:21:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-04', 'edition_number': '1081', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kTQEa-v8of99d5X7YD8vl883DIM8Q8b4'], 'files': [{'checksum': '219cf874edad8d73f637c97e8a1d4c8a', 'path': '2802007/2023-08-04/6c0bc8d91d4841fb39fcca3930b2564bd588fa2d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1kTQEa-v8of99d5X7YD8vl883DIM8Q8b4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:14.906987Z', 'territory_id': '2802007'} 2023-11-28 03:21:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:11 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-10', 'edition_number': '1084', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pZbhbcBJsEzw7-qFNhB6cjNl8-E8NaVp'], 'files': [{'checksum': '0b3683f0044c8570818362887fd39a5f', 'path': '2802007/2023-08-10/5f4826c9f8bfe7f390e3b2705558cfc1c8961bd1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1pZbhbcBJsEzw7-qFNhB6cjNl8-E8NaVp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:25.138023Z', 'territory_id': '2802007'} 2023-11-28 03:21:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-08', 'edition_number': '1082', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dCWY82od-kGtdTL6dJb8R7Owgm8z40LF'], 'files': [{'checksum': '8d86021fe5aefa623191aa2b6a3fd2f6', 'path': '2802007/2023-08-08/40bb30a34db3e8bb22f957ba98db700834a6a016', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1dCWY82od-kGtdTL6dJb8R7Owgm8z40LF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:19.402543Z', 'territory_id': '2802007'} 2023-11-28 03:21:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:17 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-09', 'edition_number': '1083', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fyqgvSSri_1Z7iz89_9hWSyZfHvOTU33'], 'files': [{'checksum': '76afa6b92dac4375a6d2793d53e11c1b', 'path': '2802007/2023-08-09/64e79ea2debd3df203bed9a7f318388002c2de88', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fyqgvSSri_1Z7iz89_9hWSyZfHvOTU33'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:22.849581Z', 'territory_id': '2802007'} 2023-11-28 03:21:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-03', 'edition_number': '1080', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GVVIAo-h6Mu2d6_Zz40roazQ9nhgYvbG'], 'files': [{'checksum': 'dfa73af167c248f7b0e75f1afb225dfd', 'path': '2802007/2023-08-03/60ed7d6cf8d8357acef9240a9d5c728740e0585d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1GVVIAo-h6Mu2d6_Zz40roazQ9nhgYvbG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:12.130302Z', 'territory_id': '2802007'} 2023-11-28 03:21:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-16', 'edition_number': '1087', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tgmL9_sTr13eusjA7eiGcqEvVwYfLzt-'], 'files': [{'checksum': 'bd27794ca4446f4ddc478ccf17840fb9', 'path': '2802007/2023-08-16/8526961756ddf25160ca89e23cd46d0b1e45902d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1tgmL9_sTr13eusjA7eiGcqEvVwYfLzt-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:34.202634Z', 'territory_id': '2802007'} 2023-11-28 03:21:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-14', 'edition_number': '1085', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s3jUtnXp6wqWMfnkGgY-Ivmy-AQg7eXs'], 'files': [{'checksum': '71ab570cab4a253292d5df9d4e11b091', 'path': '2802007/2023-08-14/edb9c0366197eadd5d6fde1902b19c027930e39c', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s3jUtnXp6wqWMfnkGgY-Ivmy-AQg7eXs'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:28.013873Z', 'territory_id': '2802007'} 2023-11-28 03:21:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:21:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-21', 'edition_number': '1088', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BBKLu1QPsgz-WTUvklnM-jFxg7w9ePYr'], 'files': [{'checksum': '4432144f6ff6db301a900aea9cb31e57', 'path': '2802007/2023-08-21/39b3db8ba0ccf0c6f3bd47633d342ffb45f94c12', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BBKLu1QPsgz-WTUvklnM-jFxg7w9ePYr'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:36.155486Z', 'territory_id': '2802007'} 2023-11-28 03:21:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-30', 'edition_number': '1091', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hCbEu4eEHRYFEq8d8Zk4kzk-UYEQBhIh'], 'files': [{'checksum': 'b8a178febcd50cbac8feb4cfdda87609', 'path': '2802007/2023-08-30/44ccdc1bfcff986cd063a19dda172c2dd3420056', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hCbEu4eEHRYFEq8d8Zk4kzk-UYEQBhIh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:48.920974Z', 'territory_id': '2802007'} 2023-11-28 03:21:33 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): 500 Internal Server Error 2023-11-28 03:21:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-01', 'edition_number': '1092', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16DLJ8yO_JkBYjwP2j_yf-aA2d2cyaOzI'], 'files': [{'checksum': 'eb260c55105eeacfb3742529cb968a62', 'path': '2802007/2023-09-01/3b11bf6d1967cbe2e36e08306329ec701dc547ff', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16DLJ8yO_JkBYjwP2j_yf-aA2d2cyaOzI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:52.553529Z', 'territory_id': '2802007'} 2023-11-28 03:21:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-02', 'edition_number': '1079', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ai0WftqEGwJ1Pr52Dwm0OCJspT15mkD1'], 'files': [{'checksum': '97ddc484e90135ff48309ae361a52836', 'path': '2802007/2023-08-02/e1fe62bf4b709c28e5979e5fe258ea91c42060a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Ai0WftqEGwJ1Pr52Dwm0OCJspT15mkD1'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:07.743676Z', 'territory_id': '2802007'} 2023-11-28 03:21:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-24', 'edition_number': '1089', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OaLJVdaGQ2p2hSXpWDvmF2gPaL6CSFua'], 'files': [{'checksum': 'f92f77c75d38582cafc7efa45a09d8df', 'path': '2802007/2023-08-24/c27c4dfb2e6e8301447b2c9f976dab556e048aa7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OaLJVdaGQ2p2hSXpWDvmF2gPaL6CSFua'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:39.624807Z', 'territory_id': '2802007'} 2023-11-28 03:21:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:44 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-11', 'edition_number': '1096', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1486Nrx7taRh71BusF7uB58bNqoSwuIXq'], 'files': [{'checksum': '03cb10ffe8cc57865c721da2bd3b5560', 'path': '2802007/2023-09-11/286019d6906230568b4b227f1275e3a17dbcf6c3', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1486Nrx7taRh71BusF7uB58bNqoSwuIXq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:06.570649Z', 'territory_id': '2802007'} 2023-11-28 03:21:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-05', 'edition_number': '1094', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10wVzohMqRAuGznPkJ2_4osVVFe5bQnv9'], 'files': [{'checksum': 'fdc5c440d4ccd4e0cfecc2e182c49ffe', 'path': '2802007/2023-09-05/822a21ef9d6e019ad582ee54e8ce38d77e2c4e21', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10wVzohMqRAuGznPkJ2_4osVVFe5bQnv9'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:58.738041Z', 'territory_id': '2802007'} 2023-11-28 03:21:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:49 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-13', 'edition_number': '1099', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TrCF1OpmmT2ne_wQkukzqZTx5Ul0ae5U'], 'files': [{'checksum': 'a1fb7d3e5e0ba48946559d2f794f10c8', 'path': '2802007/2023-09-13/e015a9b701c3432828c0dbd86a48ed0c328c0da7', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1TrCF1OpmmT2ne_wQkukzqZTx5Ul0ae5U'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:19.177496Z', 'territory_id': '2802007'} 2023-11-28 03:21:50 [scrapy.extensions.logstats] INFO: Crawled 1089 pages (at 18 pages/min), scraped 1090 items (at 18 items/min) 2023-11-28 03:21:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-04', 'edition_number': '1093', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mtJjMv4jHtOeWZwdpjRspFD8fZCJynF4'], 'files': [{'checksum': '64a2a44a166eabba213d894494f9f0c7', 'path': '2802007/2023-09-04/7343ce4fde35512e957331bc9859c2b8ed409fa9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mtJjMv4jHtOeWZwdpjRspFD8fZCJynF4'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:54.585144Z', 'territory_id': '2802007'} 2023-11-28 03:21:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-12', 'edition_number': '1097', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rMNHkuVqWQuWYsCvUR_BJmtkioL65m1t'], 'files': [{'checksum': 'e87be3bd962e806ba535e04205250bd0', 'path': '2802007/2023-09-12/6260f4862203e79e667df38b2addda8432f29f7f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1rMNHkuVqWQuWYsCvUR_BJmtkioL65m1t'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:12.426877Z', 'territory_id': '2802007'} 2023-11-28 03:21:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:21:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-12', 'edition_number': '1098', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10Kd_51vsCsThRX-gx91KA0jf8XeCdJ4s'], 'files': [{'checksum': '8cc9336e9e5c6bf9dc42076284a0964e', 'path': '2802007/2023-09-12/12779108b8e4346cd93a88cabb35dbe7ab7de269', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10Kd_51vsCsThRX-gx91KA0jf8XeCdJ4s'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:15.637867Z', 'territory_id': '2802007'} 2023-11-28 03:22:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:04 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-21', 'edition_number': '1102', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1td_TLFfS3MhK1WHvtqTkRoV-Ak44UNnu'], 'files': [{'checksum': '69a0aad3170298dfffaf4e1bd99e8123', 'path': '2802007/2023-09-21/00b16154af64d1900524b2c98b3c35cec473a3c5', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1td_TLFfS3MhK1WHvtqTkRoV-Ak44UNnu'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:29.123682Z', 'territory_id': '2802007'} 2023-11-28 03:22:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-22', 'edition_number': '1103', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UNw57GgI-GtJCO6GfS12UxTByvu_PeGq'], 'files': [{'checksum': '9b36b11026c35084e5e2f9ac2465617a', 'path': '2802007/2023-09-22/d7e95e020e6cbcbd75c73057eee634abb3fc566d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1UNw57GgI-GtJCO6GfS12UxTByvu_PeGq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:32.711559Z', 'territory_id': '2802007'} 2023-11-28 03:22:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:08 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-20', 'edition_number': '1101', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M6SuZ0aaN7oxnKBWSH2WIwQGJkle_znQ'], 'files': [{'checksum': 'e27ef8edda2222945e2a2ae8af134715', 'path': '2802007/2023-09-20/0d80a1f4e92a9772ceb39ed03b3318e74105d800', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1M6SuZ0aaN7oxnKBWSH2WIwQGJkle_znQ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:26.061322Z', 'territory_id': '2802007'} 2023-11-28 03:22:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-29', 'edition_number': '1106', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u4IWqwtIQvmVP60-d-t9U3xMiH7s7kbR'], 'files': [{'checksum': '8421db2a1a496b063b31188ebaccded3', 'path': '2802007/2023-09-29/3c8c3df97b5a986ef2262daa49f70b8c22c19fd8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1u4IWqwtIQvmVP60-d-t9U3xMiH7s7kbR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:42.338481Z', 'territory_id': '2802007'} 2023-11-28 03:22:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:14 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-10', 'edition_number': '954', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s8DFGW5wZpfqX0CFv6lfXzQmLnXveerP'], 'files': [{'checksum': 'afd58032141ee4e5759aa7612a6aab05', 'path': '2802007/2023-01-10/4a469984f71d6109e5c70a261a614d4122326625', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1s8DFGW5wZpfqX0CFv6lfXzQmLnXveerP'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:24.670172Z', 'territory_id': '2802007'} 2023-11-28 03:22:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:20 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-19', 'edition_number': '1100', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Cb6kpq0MyCx0-oIDtLvFwCAocDkFwMkv'], 'files': [{'checksum': 'ea7a76f93a7262add0b07adeb3aff4c9', 'path': '2802007/2023-09-19/18a23894ad04bc341fe594988b4369d3350deb95', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Cb6kpq0MyCx0-oIDtLvFwCAocDkFwMkv'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:22.294213Z', 'territory_id': '2802007'} 2023-11-28 03:22:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-02', 'edition_number': '1107', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hdCKtEhQaceZCkBeEREYaTMg7LAtKJEa'], 'files': [{'checksum': '98b3f210ba29c899b42c6da02b84785e', 'path': '2802007/2023-10-02/4b0bc98acb6f7517fea264035bb483192bb414eb', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1hdCKtEhQaceZCkBeEREYaTMg7LAtKJEa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:45.793022Z', 'territory_id': '2802007'} 2023-11-28 03:22:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-06', 'edition_number': '1095', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KJ_8d8_XCsyYVFWqbuipmx1yWB318Gap'], 'files': [{'checksum': 'deabfd9ed99b3370bfef87eb195f6a4b', 'path': '2802007/2023-09-06/15ef5c12f066aa4e107265533a0163a4826dabbe', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1KJ_8d8_XCsyYVFWqbuipmx1yWB318Gap'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:04.106223Z', 'territory_id': '2802007'} 2023-11-28 03:22:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-05', 'edition_number': '1108', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lPxJAMBwDJ3Cpqm2XobDyrSuDlLHZGPW'], 'files': [{'checksum': '605fb8b82ef12a6202c3ab999ab7d429', 'path': '2802007/2023-10-05/9cebc74a5b0334c123f0921dda49b447a0ea4fb1', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lPxJAMBwDJ3Cpqm2XobDyrSuDlLHZGPW'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:48.106774Z', 'territory_id': '2802007'} 2023-11-28 03:22:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:28 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-06', 'edition_number': '1110', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19F3lwbhrYP03u3MzlSN2ojJQq3hrf9wa'], 'files': [{'checksum': 'f9557be881deb3e9a0e085bdf26b5f56', 'path': '2802007/2023-10-06/64c46d405e78887b617784c7f91271febe808969', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19F3lwbhrYP03u3MzlSN2ojJQq3hrf9wa'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:55.134008Z', 'territory_id': '2802007'} 2023-11-28 03:22:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-09', 'edition_number': '1111', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lDTsGy_PcbX2_g-KUi6xx5rw-SOrXTEI'], 'files': [{'checksum': '6371fbd54896fd617891aba78d7c9dbc', 'path': '2802007/2023-10-09/2eee533fe6c1f0ca6edd5bd7e8a4f13c0e6555ed', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lDTsGy_PcbX2_g-KUi6xx5rw-SOrXTEI'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:59.316932Z', 'territory_id': '2802007'} 2023-11-28 03:22:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-01-11', 'edition_number': '955', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13HGwfQNcpvFzVB9DShlbZA35ZSrtVgOM'], 'files': [{'checksum': 'd36d8a8d57a86429cfacd0361172cde0', 'path': '2802007/2023-01-11/c4e9d0d2b09dde508ed48a811041326e3e756d23', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=13HGwfQNcpvFzVB9DShlbZA35ZSrtVgOM'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:07:27.889558Z', 'territory_id': '2802007'} 2023-11-28 03:22:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:37 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-29', 'edition_number': '1090', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18D0epYVeANnVovDoQGxyCB0MDcUBSHgd'], 'files': [{'checksum': '4ee385e612cf30a6a5f6c38326d1e83b', 'path': '2802007/2023-08-29/cbce39f752f2effc9e3e643e1be8cd4c7396beef', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=18D0epYVeANnVovDoQGxyCB0MDcUBSHgd'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:43.540384Z', 'territory_id': '2802007'} 2023-11-28 03:22:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:39 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-13', 'edition_number': '1114', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1toQzJNz8HNPIb8rtSRNL11CB0lUn63gq'], 'files': [{'checksum': '3a8df09d195e62d7fbf8c3ed901bc33e', 'path': '2802007/2023-10-13/7a754dc6c311a9addbf9e0e6d2e5ca7429bc1ece', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1toQzJNz8HNPIb8rtSRNL11CB0lUn63gq'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:09.971949Z', 'territory_id': '2802007'} 2023-11-28 03:22:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-17', 'edition_number': '1115', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IIaWRgopK3w_lvagYqwEcoxNc4XcT9be'], 'files': [{'checksum': '762eea61bdc4c1f5acdfdf1bf562b26e', 'path': '2802007/2023-10-17/58f065c6b54a14e57b086350d50798536daad19f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IIaWRgopK3w_lvagYqwEcoxNc4XcT9be'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:13.370706Z', 'territory_id': '2802007'} 2023-11-28 03:22:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:46 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-18', 'edition_number': '1116', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MAy47-hQqL700ousoAFkWTGs4REdWx0-'], 'files': [{'checksum': 'f2cc7eb4ba9d73bb74829f5202b78a1d', 'path': '2802007/2023-10-18/f26efc1a3a4eda34a70fe027dceef6316e51c64b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1MAy47-hQqL700ousoAFkWTGs4REdWx0-'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:17.740961Z', 'territory_id': '2802007'} 2023-11-28 03:22:50 [scrapy.extensions.logstats] INFO: Crawled 1108 pages (at 19 pages/min), scraped 1109 items (at 19 items/min) 2023-11-28 03:22:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:52 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-23', 'edition_number': '1117', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fs3mTIk5HWMJ8k-ONortgt7Dfc6D0VTl'], 'files': [{'checksum': 'e0865856a956824432cf7ce8af38663b', 'path': '2802007/2023-10-23/5385a25c8d9ef51e8c31d14db60b4a3d52d0c9a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1fs3mTIk5HWMJ8k-ONortgt7Dfc6D0VTl'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:19.793053Z', 'territory_id': '2802007'} 2023-11-28 03:22:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:53 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-11', 'edition_number': '1113', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lo07s6whhBD1IJkdRoxtReAEBMElaguf'], 'files': [{'checksum': '3904f439dad500e25bf1748e13d81c74', 'path': '2802007/2023-10-11/bcd7b391807d6935275184d1c5151dd6db0bb8b0', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1lo07s6whhBD1IJkdRoxtReAEBMElaguf'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:06.293835Z', 'territory_id': '2802007'} 2023-11-28 03:22:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:56 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-10', 'edition_number': '1112', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zxuafq7D4kTxWeV6zRU8YB2b5j-mLohL'], 'files': [{'checksum': 'd31ddc70d26f67f798e688084f0ea0c5', 'path': '2802007/2023-10-10/5e492ac9c5d1c019d664143f69827287eb4df1f9', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Zxuafq7D4kTxWeV6zRU8YB2b5j-mLohL'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:02.378030Z', 'territory_id': '2802007'} 2023-11-28 03:22:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:57 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-05', 'edition_number': '1109', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IiXzla9oBCvKsTMH3rWRp6QpAaTA5zq3'], 'files': [{'checksum': '75e49073e21a86a94244d3b609157a82', 'path': '2802007/2023-10-05/87ea85e9ddd253e20a42651667649403a8d0a21e', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1IiXzla9oBCvKsTMH3rWRp6QpAaTA5zq3'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:51.305544Z', 'territory_id': '2802007'} 2023-11-28 03:22:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:22:59 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:22:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-31', 'edition_number': '1121', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16yd5S1Y6QNs8uj5qNhXAfSy3tmGP3Pkh'], 'files': [{'checksum': 'ad768a5b4f07ef19e95f7ca574b1f218', 'path': '2802007/2023-10-31/88a980944f42438accca46e5a051c370fa5336d8', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=16yd5S1Y6QNs8uj5qNhXAfSy3tmGP3Pkh'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:33.839814Z', 'territory_id': '2802007'} 2023-11-28 03:23:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:10 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-28', 'edition_number': '1105', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17d0KF_RjDoaitlOEKLlJtx-vrjcOMN8W'], 'files': [{'checksum': '312285a4b9fdf406292bec348b274ce6', 'path': '2802007/2023-09-28/f0e2d1a5c8848c47ca331516d935828643c73c07', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=17d0KF_RjDoaitlOEKLlJtx-vrjcOMN8W'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:38.597147Z', 'territory_id': '2802007'} 2023-11-28 03:23:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-01', 'edition_number': '1122', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OV_5pZlMpA7GCC1fKGWf9cg3h1QUVWSE'], 'files': [{'checksum': 'b29b104c20cb8f6d2c06bd69da8fd99a', 'path': '2802007/2023-11-01/faef57332d75058f0de65392f4c5ea47f9e0cfdd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1OV_5pZlMpA7GCC1fKGWf9cg3h1QUVWSE'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:35.634376Z', 'territory_id': '2802007'} 2023-11-28 03:23:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:18 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-09-26', 'edition_number': '1104', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_oZdli2IRtxgE8-Ar2FRzHTlfg9zdV7N'], 'files': [{'checksum': '43533fdc45408bb6923bd90ce9d51cdb', 'path': '2802007/2023-09-26/1ffd8ab5a670254ad7270ab2616e1f6478849f9b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1_oZdli2IRtxgE8-Ar2FRzHTlfg9zdV7N'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:16:36.467673Z', 'territory_id': '2802007'} 2023-11-28 03:23:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:21 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-07', 'edition_number': '1124', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FAyk5x_E0NcmkyN4ZJMJkhAvfEypGAW0'], 'files': [{'checksum': '04b82c3bba2157d468b5c8253b5b0eed', 'path': '2802007/2023-11-07/3b4eb6465151f38401d8a8acae3091a0b3e0cb09', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1FAyk5x_E0NcmkyN4ZJMJkhAvfEypGAW0'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:42.194220Z', 'territory_id': '2802007'} 2023-11-28 03:23:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-06', 'edition_number': '1123', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QCnv99LOqkrzsu9qedO6NcuT1fIozpQj'], 'files': [{'checksum': '801ec90857fd77da82752ab56fdcb3c1', 'path': '2802007/2023-11-06/3bb5c87ff98330a2f72bcb7892a6caaec8055a1d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1QCnv99LOqkrzsu9qedO6NcuT1fIozpQj'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:37.949829Z', 'territory_id': '2802007'} 2023-11-28 03:23:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:27 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-31', 'edition_number': '1120', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10nAzXMFFb3WW639L8G6ZzAoBaXhHuDgZ'], 'files': [{'checksum': '38966747a63e1161d4dcee35b81e7a29', 'path': '2802007/2023-10-31/977c593b7c57def329d56429cdd41717c5225372', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=10nAzXMFFb3WW639L8G6ZzAoBaXhHuDgZ'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:30.318618Z', 'territory_id': '2802007'} 2023-11-28 03:23:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:30 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-16', 'edition_number': '1127', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15JuQPv9SPa3ezg9f6R5xnQLPIy1SKyCR'], 'files': [{'checksum': '11758caae89163a4610370ac6ba94e57', 'path': '2802007/2023-11-16/8d63023a614385b3d4d07160a8b2beb1aeb33f9b', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=15JuQPv9SPa3ezg9f6R5xnQLPIy1SKyCR'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:48.145752Z', 'territory_id': '2802007'} 2023-11-28 03:23:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:38 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-08', 'edition_number': '1125', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w6TFv9cnEY4aVK9Ij1KARxAwjdfhfFsY'], 'files': [{'checksum': 'b0df1cff19d3a1a91a991a5bbb143d41', 'path': '2802007/2023-11-08/e1f30530a9169f5f2056502a46ce4e4f833dc004', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1w6TFv9cnEY4aVK9Ij1KARxAwjdfhfFsY'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:44.061963Z', 'territory_id': '2802007'} 2023-11-28 03:23:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:41 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-27', 'edition_number': '1118', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1F5lHDUJivOqOt_zUqDPyVMpVnD3l8euX'], 'files': [{'checksum': 'b6b359cef8ee06863123f38856a9c603', 'path': '2802007/2023-10-27/41234de0bd145e62eb45bd927d758c077047f380', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1F5lHDUJivOqOt_zUqDPyVMpVnD3l8euX'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:24.243550Z', 'territory_id': '2802007'} 2023-11-28 03:23:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:43 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-27', 'edition_number': '1132', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EHnJTIHGZVydtRRAE0nBNYX6b9Eyn0Ec'], 'files': [{'checksum': '620b60c22aa3a3053d4e5da9843dad0f', 'path': '2802007/2023-11-27/f88f62c8908800eeb4005a67219d523e2415726f', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1EHnJTIHGZVydtRRAE0nBNYX6b9Eyn0Ec'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:53.897927Z', 'territory_id': '2802007'} 2023-11-28 03:23:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:47 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-17', 'edition_number': '1036', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mw6yr13OiV_6ySw5zyoq2BO5OqJ46z-D'], 'files': [{'checksum': '7fbe7e7ee10271940af05b723cc22b28', 'path': '2802007/2023-05-17/dd81593d24f071ae375a2c8a824be7892d412a74', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mw6yr13OiV_6ySw5zyoq2BO5OqJ46z-D'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:28.496787Z', 'territory_id': '2802007'} 2023-11-28 03:23:50 [scrapy.extensions.logstats] INFO: Crawled 1124 pages (at 16 pages/min), scraped 1125 items (at 16 items/min) 2023-11-28 03:23:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:23:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:23:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-05-18', 'edition_number': '1038', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BNS-eR-s7NgwokuglTFlDjKxV3jtmENF'], 'files': [{'checksum': '5f07b0499342d1fb4361d4086c06213c', 'path': '2802007/2023-05-18/0f53a5c0fce936e2bf9d66f0558338d6b8bd32a4', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1BNS-eR-s7NgwokuglTFlDjKxV3jtmENF'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:12:34.098195Z', 'territory_id': '2802007'} 2023-11-28 03:24:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:24:00 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:24:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-03-31', 'edition_number': '1009', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19CU7sO9iMiKV4J4OX1cz_NV6p3mdKx6v'], 'files': [{'checksum': '2eac44595858e1d3c76ee45f3d23ed15', 'path': '2802007/2023-03-31/1f652624b7c791b2e6908ce670fb80e5a5041ebd', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=19CU7sO9iMiKV4J4OX1cz_NV6p3mdKx6v'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:10:30.802750Z', 'territory_id': '2802007'} 2023-11-28 03:24:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:24:02 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:24:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-17', 'edition_number': '1128', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mJRp1uhMI4rEQmLNx2nbAIXn-cJBnB0X'], 'files': [{'checksum': 'e862e60d1391b321ca1e6effa48ee287', 'path': '2802007/2023-11-17/1da399f9f6e970e9d231216513492e61bd47a260', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1mJRp1uhMI4rEQmLNx2nbAIXn-cJBnB0X'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:51.451895Z', 'territory_id': '2802007'} 2023-11-28 03:24:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:24:06 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:24:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-10-30', 'edition_number': '1119', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Udill_zigrZn2KjfiuNW27FlpXpG9Qtp'], 'files': [{'checksum': '0a5644383c5ccd49eb168358bcc88d1f', 'path': '2802007/2023-10-30/62a61e406be465ab97cd8c9f6192c9d805966874', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1Udill_zigrZn2KjfiuNW27FlpXpG9Qtp'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:26.573231Z', 'territory_id': '2802007'} 2023-11-28 03:24:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:24:09 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:24:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-11-10', 'edition_number': '1126', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a7hhW6o3xHFTt_hsUSlEZMQH3cQjKCnG'], 'files': [{'checksum': 'f0eef80bd6bff66499d32af5c1068730', 'path': '2802007/2023-11-10/0183e854a95bf76305e6b932a136a8f8b3b89536', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1a7hhW6o3xHFTt_hsUSlEZMQH3cQjKCnG'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:17:45.582971Z', 'territory_id': '2802007'} 2023-11-28 03:24:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:24:13 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:24:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-15', 'edition_number': '1086', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JMm4Ee2IsDMENTsP3FqASuMn83zPcZ7w'], 'files': [{'checksum': '77e3b699f3dc4514b85ca82277c55202', 'path': '2802007/2023-08-15/5c1dc48e7440259bcb673776de35ebdc39167483', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JMm4Ee2IsDMENTsP3FqASuMn83zPcZ7w'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:30.597433Z', 'territory_id': '2802007'} 2023-11-28 03:24:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-11-28 03:24:16 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2023-11-28 03:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial> {'date': '2023-08-01', 'edition_number': '1078', 'file_urls': ['https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JMUXDwTdrTlwUwrRdej2DNZpgjnQ02vK'], 'files': [{'checksum': '6ea7a104f2b560fd82fe0b4876503dc6', 'path': '2802007/2023-08-01/fcfc0bea7ea51760987d8977f1e7d86b1a3bfa7d', 'status': 'downloaded', 'url': 'https://www.municipioonline.com.br/se/prefeitura/divinapastora/cidadao/diariooficial/diario?n=diario.pdf&l=1JMUXDwTdrTlwUwrRdej2DNZpgjnQ02vK'}], 'is_extra_edition': False, 'power': 'executive', 'scraped_at': '2023-11-28T06:15:03.518172Z', 'territory_id': '2802007'} 2023-11-28 03:24:16 [scrapy.core.engine] INFO: Closing spider (finished) 2023-11-28 03:24:16 [scrapy.extensions.feedexport] INFO: Stored csv feed (1132 items) in: se_divina_pastora_completa.csv 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] Comparison Between Executions/Days without gazettes... OK 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] Requests/Items Ratio/Ratio of requests over items scraped count... OK 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] Error Count Monitor/test_stat_monitor... SKIPPED (Unable to find 'log_count/ERROR' in job stats.) 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] ---------------------------------------------------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] 5 monitors in 0.019s 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] OK (skipped=2) 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] ---------------------------------------------------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] 0 actions in 0.000s 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] OK 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] ---------------------------------------------------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] 0 actions in 0.000s 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] OK 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] ---------------------------------------------------------------------- 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] 1 action in 0.000s 2023-11-28 03:24:16 [se_divina_pastora] INFO: [Spidermon] OK (skipped=1) 2023-11-28 03:24:16 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 712712, 'downloader/request_count': 1194, 'downloader/request_method_count/GET': 1193, 'downloader/request_method_count/POST': 1, 'downloader/response_bytes': 5097149557, 'downloader/response_count': 1194, 'downloader/response_status_count/200': 1131, 'downloader/response_status_count/500': 63, 'elapsed_time_seconds': 5186.484789, 'feedexport/success_count/FileFeedStorage': 1, 'file_count': 1132, 'file_status_count/downloaded': 1129, 'file_status_count/uptodate': 3, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2023, 11, 28, 6, 24, 16, 494670, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 1871160, 'httpcompression/response_count': 2, 'item_scraped_count': 1132, 'log_count/DEBUG': 3459, 'log_count/INFO': 118, 'log_count/WARNING': 49, 'memusage/max': 276766720, 'memusage/startup': 109948928, 'request_depth_max': 1, 'response_received_count': 1131, 'retry/count': 63, 'retry/reason_count/500 Internal Server Error': 63, 'scheduler/dequeued': 2, 'scheduler/dequeued/memory': 2, 'scheduler/enqueued': 2, 'scheduler/enqueued/memory': 2, 'spidermon/validation/fields': 9056, 'spidermon/validation/items': 1132, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_time': datetime.datetime(2023, 11, 28, 4, 57, 50, 9881, tzinfo=datetime.timezone.utc)} 2023-11-28 03:24:16 [scrapy.core.engine] INFO: Spider closed (finished)