2023-12-11 15:27:11.105 c.d.s.b.FetcherBolt FetcherThread #87 [INFO] [Fetcher #71] Fetched https://www.breitbart.com/sitemap_news-2015-05-05.xml with status 200 in msec 1799 2023-12-11 15:27:11.105 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.breitbart.com/sitemap_news-2015-05-05.xml detected as news sitemap based on content 2023-12-11 15:27:11.108 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 148 links, 148 skipped): https://www.breitbart.com/sitemap_news-2015-05-05.xml 2023-12-11 15:27:11.325 c.d.s.b.FetcherBolt FetcherThread #94 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/sitemaps/news.xml with status 200 in msec 1130 2023-12-11 15:27:11.326 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.derstandard.at/sitemaps/news.xml detected as news sitemap based on content 2023-12-11 15:27:11.331 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 206 links, 0 skipped): https://www.derstandard.at/sitemaps/news.xml 2023-12-11 15:27:11.923 c.d.s.b.FetcherBolt FetcherThread #80 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTR/ideas with status 200 in msec 639 2023-12-11 15:27:11.925 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VTR/ideas HTTP/2 2023-12-11 15:27:13.073 c.d.s.b.FetcherBolt FetcherThread #50 [INFO] [Fetcher #71] Fetched https://www.usmagazine.com/entertainment/news/golden-globes-2024-nominations-see-the-complete-list/ with status 200 in msec 481 2023-12-11 15:27:13.075 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /entertainment/news/golden-globes-2024-nominations-see-the-complete-list/ HTTP/2 2023-12-11 15:27:13.459 c.d.s.b.FetcherBolt FetcherThread #88 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/millions-netflix-subscribers-get-free-upgrade-boosts-wifi-speeds-19956004/ with status 200 in msec 200 2023-12-11 15:27:13.462 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/millions-netflix-subscribers-get-free-upgrade-boosts-wifi-speeds-19956004/ HTTP/2 2023-12-11 15:27:13.811 c.d.s.b.FetcherBolt FetcherThread #58 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/medical-devices-report-of-eu5-glucose-monitoring-market-outlook-to-2022-773421.htm with status 200 in msec 73 2023-12-11 15:27:15.442 c.d.s.b.FetcherBolt FetcherThread #43 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTR/news with status 200 in msec 518 2023-12-11 15:27:15.445 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VTR/news HTTP/2 2023-12-11 15:27:15.604 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48956] : items 20, waitAck 0, acked 20, failed 0 2023-12-11 15:27:16.121 c.d.s.b.FetcherBolt FetcherThread #23 [INFO] [Fetcher #71] Fetched https://www.usmagazine.com/entertainment/pictures/winter-tv-preview-2023-inside-must-watch-new-and-returning-shows/ with status 200 in msec 48 2023-12-11 15:27:16.123 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /entertainment/pictures/winter-tv-preview-2023-inside-must-watch-new-and-returning-shows/ HTTP/2 2023-12-11 15:27:17.305 c.d.s.b.FetcherBolt FetcherThread #71 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/overview-of-combined-heat-and-power-chp-market-size-segmentation-regulations-and-key-country-analysis-to-2025-773418.htm with status 200 in msec 493 2023-12-11 15:27:17.476 c.d.s.b.FetcherBolt FetcherThread #70 [INFO] [Fetcher #71] Fetched https://metro.co.uk/feed/ with status 200 in msec 1016 2023-12-11 15:27:17.483 c.d.s.b.FeedParserBolt Thread-75-feed-executor[67, 70] [INFO] Feed parser done https://metro.co.uk/feed/ 2023-12-11 15:27:19.152 c.d.s.b.FetcherBolt FetcherThread #18 [INFO] [Fetcher #71] Fetched https://www.usmagazine.com/shop-with-us/news/festive-dresses-under-25/ with status 200 in msec 30 2023-12-11 15:27:19.154 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /shop-with-us/news/festive-dresses-under-25/ HTTP/2 2023-12-11 15:27:19.467 c.d.s.b.FetcherBolt FetcherThread #43 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VRTX with status 200 in msec 1023 2023-12-11 15:27:19.469 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VRTX HTTP/2 2023-12-11 15:27:19.491 o.a.s.h.c.HDFSWriter Thread-62-warc-executor[111, 111] [INFO] Attempting to sync all data to filesystem 2023-12-11 15:27:20.406 c.d.s.b.FetcherBolt FetcherThread #71 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/future-of-global-growth-self-injection-delivery-systems-market-2016-2026-773430.htm with status 200 in msec 99 2023-12-11 15:27:20.605 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48957] : items 13, waitAck 0, acked 13, failed 0 2023-12-11 15:27:21.842 c.d.s.e.p.AggregationSpout Thread-40-spout-executor[86, 86] [INFO] [spout #8] Populating buffer with nextFetchDate <= 2023-12-11T15:27:06Z 2023-12-11 15:27:21.845 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #8] ES query returned 0 hits from 0 buckets in 3 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:21.877 c.d.s.e.p.AggregationSpout Thread-89-spout-executor[88, 88] [INFO] [spout #10] Populating buffer with nextFetchDate <= 2023-12-11T15:27:21Z 2023-12-11 15:27:21.879 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #10] ES query returned 0 hits from 0 buckets in 2 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:22.184 c.d.s.b.FetcherBolt FetcherThread #18 [INFO] [Fetcher #71] Fetched https://www.usmagazine.com/shop-with-us/news/lululemon-sports-bra-my-favorite/ with status 200 in msec 30 2023-12-11 15:27:22.185 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /shop-with-us/news/lululemon-sports-bra-my-favorite/ HTTP/2 2023-12-11 15:27:22.331 c.d.s.e.p.AggregationSpout Thread-125-spout-executor[89, 89] [INFO] [spout #11] Populating buffer with nextFetchDate <= 2023-12-11T15:26:37Z 2023-12-11 15:27:22.345 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #11] ES query returned 8 hits from 1 buckets in 13 msec with 4 already being processed. Took 1.625 msec per doc on average. 2023-12-11 15:27:22.520 c.d.s.e.p.AggregationSpout Thread-131-spout-executor[81, 81] [INFO] [spout #3] Populating buffer with nextFetchDate <= 2023-12-11T15:26:37Z 2023-12-11 15:27:22.538 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #3] ES query returned 8 hits from 1 buckets in 17 msec with 4 already being processed. Took 2.125 msec per doc on average. 2023-12-11 15:27:22.846 c.d.s.e.p.AggregationSpout Thread-124-spout-executor[93, 93] [INFO] [spout #15] Populating buffer with nextFetchDate <= 2023-12-11T15:27:22Z 2023-12-11 15:27:22.848 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #15] ES query returned 2 hits from 2 buckets in 2 msec with 0 already being processed. Took 1.0 msec per doc on average. 2023-12-11 15:27:23.079 c.d.s.b.FetcherBolt FetcherThread #32 [INFO] [Fetcher #71] Fetched https://www.iol.co.za/tags/abuse-of-power/sitemap.xml with status 200 in msec 217 2023-12-11 15:27:23.079 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.iol.co.za/tags/abuse-of-power/sitemap.xml detected as news sitemap based on content 2023-12-11 15:27:23.084 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 290 links, 266 skipped): https://www.iol.co.za/tags/abuse-of-power/sitemap.xml 2023-12-11 15:27:23.155 c.d.s.e.p.AggregationSpout Thread-39-spout-executor[90, 90] [INFO] [spout #12] Populating buffer with nextFetchDate <= 2023-12-11T15:27:23Z 2023-12-11 15:27:23.158 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #12] ES query returned 1 hits from 1 buckets in 3 msec with 0 already being processed. Took 3.0 msec per doc on average. 2023-12-11 15:27:23.301 c.d.s.b.FetcherBolt FetcherThread #68 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VRTX/guidance with status 200 in msec 834 2023-12-11 15:27:23.304 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VRTX/guidance HTTP/2 2023-12-11 15:27:23.430 c.d.s.b.FetcherBolt FetcherThread #43 [INFO] [Fetcher #71] Fetched https://www.thesun.ie/sitemap.xml?yyyy=2019&mm=04&dd=06 with status 200 in msec 260 2023-12-11 15:27:23.430 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.thesun.ie/sitemap.xml?yyyy=2019&mm=04&dd=06 detected as news sitemap based on content 2023-12-11 15:27:23.437 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 299 links, 299 skipped): https://www.thesun.ie/sitemap.xml?yyyy=2019&mm=04&dd=06 2023-12-11 15:27:23.492 c.d.s.b.FetcherBolt FetcherThread #71 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/global-automotive-battery-cable-sales-market-to-remain-progressive-through-2021-773429.htm with status 200 in msec 84 2023-12-11 15:27:23.567 c.d.s.b.FetcherBolt FetcherThread #14 [INFO] [Fetcher #71] Fetched https://www.omanobserver.om/rssFeed/24/100 with status 200 in msec 705 2023-12-11 15:27:23.568 c.d.s.b.FeedParserBolt Thread-75-feed-executor[67, 70] [INFO] Feed parser done https://www.omanobserver.om/rssFeed/24/100 2023-12-11 15:27:23.699 c.d.s.e.p.AggregationSpout Thread-42-spout-executor[82, 82] [INFO] [spout #4] Populating buffer with nextFetchDate <= 2023-12-11T15:27:23Z 2023-12-11 15:27:23.701 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #4] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:23.711 c.d.s.e.p.AggregationSpout Thread-84-spout-executor[80, 80] [INFO] [spout #2] Populating buffer with nextFetchDate <= 2023-12-11T15:27:23Z 2023-12-11 15:27:23.714 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #2] ES query returned 2 hits from 2 buckets in 2 msec with 0 already being processed. Took 1.0 msec per doc on average. 2023-12-11 15:27:23.721 c.d.s.e.p.AggregationSpout Thread-63-spout-executor[87, 87] [INFO] [spout #9] Populating buffer with nextFetchDate <= 2023-12-11T15:27:08Z 2023-12-11 15:27:23.723 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #9] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:23.803 c.d.s.b.FetcherBolt FetcherThread #76 [INFO] [Fetcher #71] Fetched https://abc7news.com/entertainment/golden-globes-2024-see-the-full-list-of-nominees/14166368/ with status 301 in msec 74 2023-12-11 15:27:23.820 c.d.s.e.p.AggregationSpout Thread-90-spout-executor[84, 84] [INFO] [spout #6] Populating buffer with nextFetchDate <= 2023-12-11T15:27:08Z 2023-12-11 15:27:23.823 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #6] ES query returned 0 hits from 0 buckets in 3 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:23.854 c.d.s.e.p.AggregationSpout Thread-57-spout-executor[83, 83] [INFO] [spout #5] Populating buffer with nextFetchDate <= 2023-12-11T15:27:08Z 2023-12-11 15:27:23.855 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #5] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:23.999 c.d.s.e.p.AggregationSpout Thread-43-spout-executor[78, 78] [INFO] [spout #0] Populating buffer with nextFetchDate <= 2023-12-11T15:27:23Z 2023-12-11 15:27:24.001 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #0] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:24.041 c.d.s.b.FetcherBolt FetcherThread #3 [INFO] [Fetcher #71] Fetched https://www.ocregister.com/sitemap.xml?yyyy=2007&mm=12&dd=27 with status 200 in msec 312 2023-12-11 15:27:24.042 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.ocregister.com/sitemap.xml?yyyy=2007&mm=12&dd=27 detected as news sitemap based on content 2023-12-11 15:27:24.044 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 168 links, 168 skipped): https://www.ocregister.com/sitemap.xml?yyyy=2007&mm=12&dd=27 2023-12-11 15:27:24.299 c.d.s.e.p.AggregationSpout Thread-87-spout-executor[92, 92] [INFO] [spout #14] Populating buffer with nextFetchDate <= 2023-12-11T15:27:09Z 2023-12-11 15:27:24.302 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #14] ES query returned 0 hits from 0 buckets in 2 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:24.355 c.d.s.e.p.AggregationSpout Thread-60-spout-executor[79, 79] [INFO] [spout #1] Populating buffer with nextFetchDate <= 2023-12-11T15:27:24Z 2023-12-11 15:27:24.358 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #1] ES query returned 7 hits from 3 buckets in 2 msec with 0 already being processed. Took 0.2857143 msec per doc on average. 2023-12-11 15:27:24.387 c.d.s.e.p.AggregationSpout Thread-61-spout-executor[91, 91] [INFO] [spout #13] Populating buffer with nextFetchDate <= 2023-12-11T15:27:09Z 2023-12-11 15:27:24.389 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #13] ES query returned 3 hits from 1 buckets in 1 msec with 3 already being processed. Took 0.33333334 msec per doc on average. 2023-12-11 15:27:24.507 c.d.s.b.FetcherBolt FetcherThread #82 [INFO] [Fetcher #71] Fetched https://www.thedailymeal.com/?getfeed=google with status 200 in msec 132 2023-12-11 15:27:24.508 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.thedailymeal.com/?getfeed=google detected as news sitemap based on content 2023-12-11 15:27:24.510 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 74 links, 0 skipped): https://www.thedailymeal.com/?getfeed=google 2023-12-11 15:27:24.536 c.d.s.b.FetcherBolt FetcherThread #20 [INFO] [Fetcher #71] Fetched https://www.cbsnews.com/boston/news/angry-patrick-mahomes-andy-reid-await-patriots-chiefs/ with status 200 in msec 161 2023-12-11 15:27:24.536 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /boston/news/angry-patrick-mahomes-andy-reid-await-patriots-chiefs/ HTTP/2 2023-12-11 15:27:24.822 c.d.s.b.FetcherBolt FetcherThread #44 [INFO] [Fetcher #71] Fetched https://www.bbc.co.uk/news/articles/cje0971j94zo with status 200 in msec 447 2023-12-11 15:27:24.824 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /news/articles/cje0971j94zo HTTP/2 2023-12-11 15:27:25.187 c.d.s.e.p.AggregationSpout Thread-123-spout-executor[85, 85] [INFO] [spout #7] Populating buffer with nextFetchDate <= 2023-12-11T15:27:10Z 2023-12-11 15:27:25.190 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #7] ES query returned 0 hits from 0 buckets in 2 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:25.374 o.a.s.h.c.HDFSWriter Thread-62-warc-executor[111, 111] [INFO] Attempting to sync all data to filesystem 2023-12-11 15:27:25.377 c.d.s.b.FetcherBolt FetcherThread #37 [INFO] [Fetcher #71] Fetched https://www.usmagazine.com/shop-with-us/news/serious-skincare-trendy-ultra-mare-creme-on-sale-today/ with status 200 in msec 192 2023-12-11 15:27:25.378 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /shop-with-us/news/serious-skincare-trendy-ultra-mare-creme-on-sale-today/ HTTP/2 2023-12-11 15:27:25.605 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48958] : items 14, waitAck 0, acked 14, failed 0 2023-12-11 15:27:26.564 c.d.s.b.FetcherBolt FetcherThread #71 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/growth-3d-cardiac-mapping-system-market-2016-2026-773433.htm with status 200 in msec 71 2023-12-11 15:27:27.307 c.d.s.b.FetcherBolt FetcherThread #59 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTRKF with status 200 in msec 1005 2023-12-11 15:27:27.310 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VTRKF HTTP/2 2023-12-11 15:27:27.552 c.d.s.b.FetcherBolt FetcherThread #20 [INFO] [Fetcher #71] Fetched https://www.cbsnews.com/boston/news/boston-massachusetts-rain-totals-december-11-2023/ with status 200 in msec 15 2023-12-11 15:27:27.555 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /boston/news/boston-massachusetts-rain-totals-december-11-2023/ HTTP/2 2023-12-11 15:27:28.651 c.d.s.b.FetcherBolt FetcherThread #36 [INFO] [Fetcher #71] Fetched https://www.usmagazine.com/feed/gallery-sitemap/?slug=charlotte-olympia-x-barbie-collaboration-photos-prices-w438213 with status 200 in msec 273 2023-12-11 15:27:28.652 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.usmagazine.com/feed/gallery-sitemap/?slug=charlotte-olympia-x-barbie-collaboration-photos-prices-w438213 detected as news sitemap based on content 2023-12-11 15:27:28.653 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 1 links, 1 skipped): https://www.usmagazine.com/feed/gallery-sitemap/?slug=charlotte-olympia-x-barbie-collaboration-photos-prices-w438213 2023-12-11 15:27:29.640 c.d.s.b.FetcherBolt FetcherThread #71 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/release-liner-market/release-773431.htm with status 200 in msec 74 2023-12-11 15:27:30.604 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48959] : items 5, waitAck 0, acked 5, failed 0 2023-12-11 15:27:30.634 c.d.s.b.FetcherBolt FetcherThread #8 [INFO] [Fetcher #71] Fetched https://www.cbsnews.com/boston/news/golden-globe-awards-nominations-2024-show/ with status 200 in msec 82 2023-12-11 15:27:30.636 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /boston/news/golden-globe-awards-nominations-2024-show/ HTTP/2 2023-12-11 15:27:30.665 c.d.s.b.FetcherBolt FetcherThread #76 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTRKF/earnings with status 200 in msec 358 2023-12-11 15:27:30.666 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VTRKF/earnings HTTP/2 2023-12-11 15:27:32.719 c.d.s.b.FetcherBolt FetcherThread #30 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/uv-cure-printing-inks-market/release-773434.htm with status 200 in msec 78 2023-12-11 15:27:33.650 c.d.s.b.FetcherBolt FetcherThread #80 [INFO] [Fetcher #71] Fetched https://www.cbsnews.com/boston/news/mini-rotaries-somerville-massachusetts-traffic-circles/ with status 200 in msec 14 2023-12-11 15:27:33.653 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /boston/news/mini-rotaries-somerville-massachusetts-traffic-circles/ HTTP/2 2023-12-11 15:27:34.088 c.d.s.b.FetcherBolt FetcherThread #67 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTRKF/ideas with status 200 in msec 422 2023-12-11 15:27:34.089 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VTRKF/ideas HTTP/2 2023-12-11 15:27:34.095 o.a.s.h.c.HDFSWriter Thread-62-warc-executor[111, 111] [INFO] Attempting to sync all data to filesystem 2023-12-11 15:27:35.604 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48960] : items 5, waitAck 0, acked 5, failed 0 2023-12-11 15:27:35.790 c.d.s.b.FetcherBolt FetcherThread #19 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/future-of-global-video-laryngoscopes-market-2016-2026-773435.htm with status 200 in msec 71 2023-12-11 15:27:36.667 c.d.s.b.FetcherBolt FetcherThread #80 [INFO] [Fetcher #71] Fetched https://www.cbsnews.com/boston/news/new-england-trail-national-park-massachusetts-scenic-hiking/ with status 200 in msec 15 2023-12-11 15:27:36.670 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /boston/news/new-england-trail-national-park-massachusetts-scenic-hiking/ HTTP/2 2023-12-11 15:27:36.852 c.d.s.e.p.AggregationSpout Thread-40-spout-executor[86, 86] [INFO] [spout #8] Populating buffer with nextFetchDate <= 2023-12-11T15:27:36Z 2023-12-11 15:27:36.855 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #8] ES query returned 8 hits from 2 buckets in 2 msec with 0 already being processed. Took 0.25 msec per doc on average. 2023-12-11 15:27:36.885 c.d.s.e.p.AggregationSpout Thread-89-spout-executor[88, 88] [INFO] [spout #10] Populating buffer with nextFetchDate <= 2023-12-11T15:27:36Z 2023-12-11 15:27:36.887 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #10] ES query returned 0 hits from 0 buckets in 2 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:37.070 c.d.s.b.FetcherBolt FetcherThread #42 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/charlotte-flair-pulled-wwe-events-suffering-scary-injury-19957911/ with status 200 in msec 204 2023-12-11 15:27:37.072 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/charlotte-flair-pulled-wwe-events-suffering-scary-injury-19957911/ HTTP/2 2023-12-11 15:27:37.120 c.d.s.b.FetcherBolt FetcherThread #97 [INFO] [Fetcher #71] Fetched https://www.pennlive.com/arc/outboundfeeds/news-sitemap/?outputType=xml&from=100 with status 200 in msec 254 2023-12-11 15:27:37.121 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.pennlive.com/arc/outboundfeeds/news-sitemap/?outputType=xml&from=100 detected as news sitemap based on content 2023-12-11 15:27:37.124 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 100 links, 0 skipped): https://www.pennlive.com/arc/outboundfeeds/news-sitemap/?outputType=xml&from=100 2023-12-11 15:27:37.338 c.d.s.e.p.AggregationSpout Thread-125-spout-executor[89, 89] [INFO] [spout #11] Populating buffer with nextFetchDate <= 2023-12-11T15:26:37Z 2023-12-11 15:27:37.355 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #11] ES query returned 8 hits from 1 buckets in 16 msec with 4 already being processed. Took 2.0 msec per doc on average. 2023-12-11 15:27:37.527 c.d.s.e.p.AggregationSpout Thread-131-spout-executor[81, 81] [INFO] [spout #3] Populating buffer with nextFetchDate <= 2023-12-11T15:26:37Z 2023-12-11 15:27:37.547 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #3] ES query returned 8 hits from 1 buckets in 19 msec with 4 already being processed. Took 2.375 msec per doc on average. 2023-12-11 15:27:37.856 c.d.s.e.p.AggregationSpout Thread-124-spout-executor[93, 93] [INFO] [spout #15] Populating buffer with nextFetchDate <= 2023-12-11T15:27:22Z 2023-12-11 15:27:37.858 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #15] ES query returned 0 hits from 0 buckets in 2 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:38.163 c.d.s.e.p.AggregationSpout Thread-39-spout-executor[90, 90] [INFO] [spout #12] Populating buffer with nextFetchDate <= 2023-12-11T15:27:23Z 2023-12-11 15:27:38.166 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #12] ES query returned 0 hits from 0 buckets in 3 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:38.709 c.d.s.e.p.AggregationSpout Thread-42-spout-executor[82, 82] [INFO] [spout #4] Populating buffer with nextFetchDate <= 2023-12-11T15:27:38Z 2023-12-11 15:27:38.710 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #4] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:38.721 c.d.s.e.p.AggregationSpout Thread-84-spout-executor[80, 80] [INFO] [spout #2] Populating buffer with nextFetchDate <= 2023-12-11T15:27:23Z 2023-12-11 15:27:38.722 c.d.s.e.p.AggregationSpout Thread-63-spout-executor[87, 87] [INFO] [spout #9] Populating buffer with nextFetchDate <= 2023-12-11T15:27:38Z 2023-12-11 15:27:38.723 c.d.s.e.p.AggregationSpout I/O dispatcher 149 [INFO] [spout #2] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:38.724 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #9] ES query returned 0 hits from 0 buckets in 2 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:38.828 c.d.s.e.p.AggregationSpout Thread-90-spout-executor[84, 84] [INFO] [spout #6] Populating buffer with nextFetchDate <= 2023-12-11T15:27:38Z 2023-12-11 15:27:38.832 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #6] ES query returned 5 hits from 2 buckets in 3 msec with 0 already being processed. Took 0.6 msec per doc on average. 2023-12-11 15:27:38.863 c.d.s.e.p.AggregationSpout Thread-57-spout-executor[83, 83] [INFO] [spout #5] Populating buffer with nextFetchDate <= 2023-12-11T15:27:38Z 2023-12-11 15:27:38.864 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #5] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:38.867 c.d.s.b.FetcherBolt FetcherThread #56 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/global-mobilephone-lcd-market-2017-tzt-international-cooyear-technology-mek-trading-jst-electronic-jt-electronic-technology-772210.htm with status 200 in msec 77 2023-12-11 15:27:39.010 c.d.s.e.p.AggregationSpout Thread-43-spout-executor[78, 78] [INFO] [spout #0] Populating buffer with nextFetchDate <= 2023-12-11T15:27:39Z 2023-12-11 15:27:39.011 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #0] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:39.136 c.d.s.b.FetcherBolt FetcherThread #71 [INFO] [Fetcher #71] Fetched https://observer.com/sitemap.xml?yyyy=2011&mm=11&dd=15 with status 200 in msec 291 2023-12-11 15:27:39.137 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://observer.com/sitemap.xml?yyyy=2011&mm=11&dd=15 detected as news sitemap based on content 2023-12-11 15:27:39.138 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 119 links, 119 skipped): https://observer.com/sitemap.xml?yyyy=2011&mm=11&dd=15 2023-12-11 15:27:39.157 c.d.s.b.FetcherBolt FetcherThread #5 [INFO] [Fetcher #71] Fetched https://www.dailynews.com/sitemap.xml?yyyy=2012&mm=07&dd=02 with status 200 in msec 312 2023-12-11 15:27:39.157 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.dailynews.com/sitemap.xml?yyyy=2012&mm=07&dd=02 detected as news sitemap based on content 2023-12-11 15:27:39.159 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 89 links, 89 skipped): https://www.dailynews.com/sitemap.xml?yyyy=2012&mm=07&dd=02 2023-12-11 15:27:39.309 c.d.s.e.p.AggregationSpout Thread-87-spout-executor[92, 92] [INFO] [spout #14] Populating buffer with nextFetchDate <= 2023-12-11T15:27:39Z 2023-12-11 15:27:39.312 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #14] ES query returned 2 hits from 2 buckets in 2 msec with 0 already being processed. Took 1.0 msec per doc on average. 2023-12-11 15:27:39.360 c.d.s.e.p.AggregationSpout Thread-60-spout-executor[79, 79] [INFO] [spout #1] Populating buffer with nextFetchDate <= 2023-12-11T15:27:24Z 2023-12-11 15:27:39.363 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #1] ES query returned 1 hits from 1 buckets in 2 msec with 1 already being processed. Took 2.0 msec per doc on average. 2023-12-11 15:27:39.396 c.d.s.e.p.AggregationSpout Thread-61-spout-executor[91, 91] [INFO] [spout #13] Populating buffer with nextFetchDate <= 2023-12-11T15:27:09Z 2023-12-11 15:27:39.397 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #13] ES query returned 0 hits from 0 buckets in 1 msec with 0 already being processed. Took Infinity msec per doc on average. 2023-12-11 15:27:39.962 c.d.s.b.FetcherBolt FetcherThread #53 [INFO] [Fetcher #71] Fetched https://www.pressherald.com/business/feed/ with status 200 in msec 637 2023-12-11 15:27:39.967 c.d.s.b.FeedParserBolt Thread-75-feed-executor[67, 70] [INFO] Feed parser done https://www.pressherald.com/business/feed/ 2023-12-11 15:27:40.121 c.d.s.b.FetcherBolt FetcherThread #76 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/chelsea-boss-mauricio-pochettino-targets-three-new-players-january-19957518/ with status 200 in msec 50 2023-12-11 15:27:40.123 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/chelsea-boss-mauricio-pochettino-targets-three-new-players-january-19957518/ HTTP/2 2023-12-11 15:27:40.140 c.d.s.b.FetcherBolt FetcherThread #58 [INFO] [Fetcher #71] Fetched https://www.breitbart.com/sitemap_news-2022-06-19.xml with status 200 in msec 814 2023-12-11 15:27:40.140 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.breitbart.com/sitemap_news-2022-06-19.xml detected as news sitemap based on content 2023-12-11 15:27:40.141 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 62 links, 62 skipped): https://www.breitbart.com/sitemap_news-2022-06-19.xml 2023-12-11 15:27:40.196 c.d.s.e.p.AggregationSpout Thread-123-spout-executor[85, 85] [INFO] [spout #7] Populating buffer with nextFetchDate <= 2023-12-11T15:27:40Z 2023-12-11 15:27:40.198 c.d.s.e.p.AggregationSpout I/O dispatcher 141 [INFO] [spout #7] ES query returned 8 hits from 1 buckets in 2 msec with 0 already being processed. Took 0.25 msec per doc on average. 2023-12-11 15:27:40.214 c.d.s.b.FetcherBolt FetcherThread #17 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199016/was-man-bei-kauf-und-pflege-von-weihnachtsbaeumen-beachten-sollte 2023-12-11 15:27:40.298 c.d.s.b.FetcherBolt FetcherThread #17 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199016/was-man-bei-kauf-und-pflege-von-weihnachtsbaeumen-beachten-sollte with status 302 in msec 84 2023-12-11 15:27:40.375 o.a.s.h.c.HDFSWriter Thread-62-warc-executor[111, 111] [INFO] Attempting to sync all data to filesystem 2023-12-11 15:27:40.606 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48961] : items 55, waitAck 0, acked 55, failed 0 2023-12-11 15:27:41.298 c.d.s.b.FetcherBolt FetcherThread #93 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199063/russland-griff-abermals-kiew-mit-langstreckenraketen-an 2023-12-11 15:27:41.347 c.d.s.b.FetcherBolt FetcherThread #93 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199063/russland-griff-abermals-kiew-mit-langstreckenraketen-an with status 302 in msec 49 2023-12-11 15:27:41.938 c.d.s.b.FetcherBolt FetcherThread #51 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/global-wireless-building-management-services-market-analysis-to-grow-at-cagr-of-2718-over-period-2017-2021-772260.htm with status 200 in msec 71 2023-12-11 15:27:42.347 c.d.s.b.FetcherBolt FetcherThread #93 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199067/ockerere-regeln-fuer-gentechnik-agrarminister-sind-uneinig 2023-12-11 15:27:42.364 c.d.s.b.FetcherBolt FetcherThread #93 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199067/ockerere-regeln-fuer-gentechnik-agrarminister-sind-uneinig with status 302 in msec 17 2023-12-11 15:27:42.366 c.d.s.b.FetcherBolt FetcherThread #5 [INFO] [Fetcher #71] Fetched https://www.dailynews.com/sitemap.xml?yyyy=2008&mm=01&dd=05 with status 200 in msec 207 2023-12-11 15:27:42.367 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://www.dailynews.com/sitemap.xml?yyyy=2008&mm=01&dd=05 detected as news sitemap based on content 2023-12-11 15:27:42.369 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 139 links, 139 skipped): https://www.dailynews.com/sitemap.xml?yyyy=2008&mm=01&dd=05 2023-12-11 15:27:42.582 c.d.s.b.FetcherBolt FetcherThread #23 [INFO] [Fetcher #71] Fetched https://observer.com/sitemap.xml?yyyy=2007&mm=03&dd=19 with status 200 in msec 445 2023-12-11 15:27:42.582 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://observer.com/sitemap.xml?yyyy=2007&mm=03&dd=19 detected as news sitemap based on content 2023-12-11 15:27:42.583 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 86 links, 86 skipped): https://observer.com/sitemap.xml?yyyy=2007&mm=03&dd=19 2023-12-11 15:27:43.158 c.d.s.b.FetcherBolt FetcherThread #76 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/lesser-known-floral-baby-names-expected-bloom-2024-19957675/ with status 200 in msec 35 2023-12-11 15:27:43.160 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/lesser-known-floral-baby-names-expected-bloom-2024-19957675/ HTTP/2 2023-12-11 15:27:43.364 c.d.s.b.FetcherBolt FetcherThread #53 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199088/schummelvorwuerfe-eine-halbfertige-ki-google-hat-den-gemini-launch-vergeigt 2023-12-11 15:27:43.443 c.d.s.b.FetcherBolt FetcherThread #53 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199088/schummelvorwuerfe-eine-halbfertige-ki-google-hat-den-gemini-launch-vergeigt with status 302 in msec 79 2023-12-11 15:27:44.443 c.d.s.b.FetcherBolt FetcherThread #8 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199131/manunited-droht-im-cl-hit-gegen-bayern-naechster-rueckschlag 2023-12-11 15:27:44.454 c.d.s.b.FetcherBolt FetcherThread #8 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199131/manunited-droht-im-cl-hit-gegen-bayern-naechster-rueckschlag with status 302 in msec 11 2023-12-11 15:27:45.454 c.d.s.b.FetcherBolt FetcherThread #3 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199135/georg-kodek-wird-neuer-ogh-pr228sident 2023-12-11 15:27:45.491 c.d.s.b.FetcherBolt FetcherThread #3 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199135/georg-kodek-wird-neuer-ogh-pr228sident with status 302 in msec 37 2023-12-11 15:27:45.606 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48962] : items 14, waitAck 0, acked 14, failed 0 2023-12-11 15:27:45.620 o.a.s.e.s.SpoutExecutor Thread-60-spout-executor[79, 79] [INFO] Deactivating spout spout:[79] 2023-12-11 15:27:45.620 o.a.s.e.s.SpoutExecutor Thread-81-filespout-executor[72, 72] [INFO] Deactivating spout filespout:[72] 2023-12-11 15:27:45.621 o.a.s.e.s.SpoutExecutor Thread-90-spout-executor[84, 84] [INFO] Deactivating spout spout:[84] 2023-12-11 15:27:45.621 o.a.s.e.s.SpoutExecutor Thread-61-spout-executor[91, 91] [INFO] Deactivating spout spout:[91] 2023-12-11 15:27:45.621 o.a.s.e.s.SpoutExecutor Thread-57-spout-executor[83, 83] [INFO] Deactivating spout spout:[83] 2023-12-11 15:27:45.621 o.a.s.e.s.SpoutExecutor Thread-123-spout-executor[85, 85] [INFO] Deactivating spout spout:[85] 2023-12-11 15:27:45.621 o.a.s.e.s.SpoutExecutor Thread-131-spout-executor[81, 81] [INFO] Deactivating spout spout:[81] 2023-12-11 15:27:45.622 o.a.s.e.s.SpoutExecutor Thread-40-spout-executor[86, 86] [INFO] Deactivating spout spout:[86] 2023-12-11 15:27:45.623 o.a.s.e.s.SpoutExecutor Thread-125-spout-executor[89, 89] [INFO] Deactivating spout spout:[89] 2023-12-11 15:27:45.623 o.a.s.e.s.SpoutExecutor Thread-42-spout-executor[82, 82] [INFO] Deactivating spout spout:[82] 2023-12-11 15:27:45.624 o.a.s.e.s.SpoutExecutor Thread-89-spout-executor[88, 88] [INFO] Deactivating spout spout:[88] 2023-12-11 15:27:45.625 o.a.s.e.s.SpoutExecutor Thread-87-spout-executor[92, 92] [INFO] Deactivating spout spout:[92] 2023-12-11 15:27:45.625 o.a.s.e.s.SpoutExecutor Thread-39-spout-executor[90, 90] [INFO] Deactivating spout spout:[90] 2023-12-11 15:27:45.626 o.a.s.e.s.SpoutExecutor Thread-63-spout-executor[87, 87] [INFO] Deactivating spout spout:[87] 2023-12-11 15:27:45.626 o.a.s.e.s.SpoutExecutor Thread-43-spout-executor[78, 78] [INFO] Deactivating spout spout:[78] 2023-12-11 15:27:45.626 o.a.s.e.s.SpoutExecutor Thread-84-spout-executor[80, 80] [INFO] Deactivating spout spout:[80] 2023-12-11 15:27:45.627 o.a.s.e.s.SpoutExecutor Thread-124-spout-executor[93, 93] [INFO] Deactivating spout spout:[93] 2023-12-11 15:27:45.730 c.d.s.b.FetcherBolt FetcherThread #73 [INFO] [Fetcher #71] Fetched https://observer.com/sitemap.xml?yyyy=2018&mm=11&dd=15 with status 200 in msec 148 2023-12-11 15:27:45.731 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] https://observer.com/sitemap.xml?yyyy=2018&mm=11&dd=15 detected as news sitemap based on content 2023-12-11 15:27:45.731 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 11 links, 11 skipped): https://observer.com/sitemap.xml?yyyy=2018&mm=11&dd=15 2023-12-11 15:27:46.193 c.d.s.b.FetcherBolt FetcherThread #76 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/manchester-united-richard-keys-apologises-bruno-fernandes-claim-19957762/ with status 200 in msec 33 2023-12-11 15:27:46.195 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/manchester-united-richard-keys-apologises-bruno-fernandes-claim-19957762/ HTTP/2 2023-12-11 15:27:46.492 c.d.s.b.FetcherBolt FetcherThread #13 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199139/salzburgs-struber-will-im-showdown-mit-benfica-keinesfalls-taktieren 2023-12-11 15:27:46.503 c.d.s.b.FetcherBolt FetcherThread #13 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199139/salzburgs-struber-will-im-showdown-mit-benfica-keinesfalls-taktieren with status 302 in msec 11 2023-12-11 15:27:47.503 c.d.s.b.FetcherBolt FetcherThread #13 [INFO] Crawl delay for queue: derstandard.at is set to 1000 as per robots.txt. url: https://www.derstandard.at/story/3000000199142/deutsche-bahn-vorstand-k246nnte-millionen-boni-f252r-2022-bekommen 2023-12-11 15:27:47.514 c.d.s.b.FetcherBolt FetcherThread #13 [INFO] [Fetcher #71] Fetched https://www.derstandard.at/story/3000000199142/deutsche-bahn-vorstand-k246nnte-millionen-boni-f252r-2022-bekommen with status 302 in msec 10 2023-12-11 15:27:49.225 c.d.s.b.FetcherBolt FetcherThread #33 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/marcus-rashford-anthony-martial-miss-manchester-united-training-ahead-bayern-munich-clash-19957732/ with status 200 in msec 32 2023-12-11 15:27:49.228 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/marcus-rashford-anthony-martial-miss-manchester-united-training-ahead-bayern-munich-clash-19957732/ HTTP/2 2023-12-11 15:27:50.605 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48963] : items 7, waitAck 0, acked 7, failed 0 2023-12-11 15:27:50.644 c.d.s.b.FetcherBolt FetcherThread #28 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/sitemap-list.php?id=410 with status 200 in msec 5705 2023-12-11 15:27:50.645 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] http://www.sbwire.com/press-releases/sitemap-list.php?id=410 detected as news sitemap based on content 2023-12-11 15:27:50.658 o.c.s.n.NewsSiteMapParserBolt Thread-106-sitemap-executor[76, 77] [INFO] Sitemap (found 1000 links, 0 skipped): http://www.sbwire.com/press-releases/sitemap-list.php?id=410 2023-12-11 15:27:52.259 c.d.s.b.FetcherBolt FetcherThread #68 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/specialist-chefs-really-make-in-flight-airline-food-19956184/ with status 200 in msec 34 2023-12-11 15:27:52.261 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/specialist-chefs-really-make-in-flight-airline-food-19956184/ HTTP/2 2023-12-11 15:27:53.745 c.d.s.b.FetcherBolt FetcherThread #51 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/customers-highly-recommend-phils-auto-care-incs-affordable-auto-repair-service-772906.htm with status 200 in msec 100 2023-12-11 15:27:55.292 c.d.s.b.FetcherBolt FetcherThread #86 [INFO] [Fetcher #71] Fetched https://metro.co.uk/2023/12/11/troubled-former-child-star-unrecognisable-bold-new-look-19957092/ with status 200 in msec 33 2023-12-11 15:27:55.294 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /2023/12/11/troubled-former-child-star-unrecognisable-bold-new-look-19957092/ HTTP/2 2023-12-11 15:27:55.374 o.a.s.h.c.HDFSWriter Thread-62-warc-executor[111, 111] [INFO] Attempting to sync all data to filesystem 2023-12-11 15:27:55.607 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [WARN] The id 500d8e6066127f18da1994e02fbe79cab4b9ae1371f71947239a50dcea378c94 would result in an ack and a failure. Using only the ack for processing. 2023-12-11 15:27:55.607 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48964] : items 36, waitAck 0, acked 37, failed 0 2023-12-11 15:27:56.827 c.d.s.b.FetcherBolt FetcherThread #51 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/flexible-substrates-market/release-772739.htm with status 200 in msec 80 2023-12-11 15:27:59.898 c.d.s.b.FetcherBolt FetcherThread #96 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/global-prenatal-vitamins-supplements-market-key-trends-industry-forecast-2016-2024-772560.htm with status 200 in msec 71 2023-12-11 15:28:00.607 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48965] : items 2, waitAck 0, acked 2, failed 0 2023-12-11 15:28:02.969 c.d.s.b.FetcherBolt FetcherThread #6 [INFO] [Fetcher #71] Fetched http://www.sbwire.com/press-releases/variable-air-volume-systems-market-expected-value-up-to-1344-billion-usd-by-2021-772139.htm with status 200 in msec 70 2023-12-11 15:28:05.606 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48966] : items 1, waitAck 0, acked 1, failed 0 2023-12-11 15:28:07.089 c.d.s.b.FetcherBolt FetcherThread #47 [INFO] Exception while fetching https://www.benzinga.com/quote/VRTX/ideas -> java.net.SocketTimeoutException 2023-12-11 15:28:10.374 o.a.s.h.c.HDFSWriter Thread-62-warc-executor[111, 111] [INFO] Attempting to sync all data to filesystem 2023-12-11 15:28:10.608 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48967] : items 1, waitAck 0, acked 1, failed 0 2023-12-11 15:28:11.212 c.d.s.b.FetcherBolt FetcherThread #47 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VRTX/key-statistics with status 200 in msec 1121 2023-12-11 15:28:11.215 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VRTX/key-statistics HTTP/2 2023-12-11 15:28:14.440 c.d.s.b.FetcherBolt FetcherThread #39 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTRKF/key-statistics with status 200 in msec 227 2023-12-11 15:28:14.442 c.d.s.w.WARCRequestRecordFormat Thread-62-warc-executor[111, 111] [INFO] GET /quote/VTRKF/key-statistics HTTP/2 2023-12-11 15:28:15.606 c.d.s.e.p.StatusUpdaterBolt I/O dispatcher 14 [INFO] Bulk response [48968] : items 2, waitAck 0, acked 2, failed 0 2023-12-11 15:28:16.503 o.a.s.u.Utils ShutdownHook-sleepKill-3s [INFO] Halting after 3 seconds 2023-12-11 15:28:16.503 o.a.s.d.w.Worker ShutdownHook-shutdownFunc [INFO] Shutting down worker NewsCrawl-2-1702072143 52f119e7-9a8d-4896-bf8c-23bf66974e2e-10.128.0.34 6800 2023-12-11 15:28:16.503 o.a.s.d.w.Worker ShutdownHook-shutdownFunc [INFO] Terminating messaging context 2023-12-11 15:28:16.503 o.a.s.d.w.Worker ShutdownHook-shutdownFunc [INFO] Shutting down executors 2023-12-11 15:28:16.503 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[42, 42] 2023-12-11 15:28:16.504 o.a.s.u.Utils Thread-13-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[42, 42] [INFO] Async loop interrupted! 2023-12-11 15:28:16.504 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[42, 42] 2023-12-11 15:28:16.504 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[34, 34] 2023-12-11 15:28:16.505 o.a.s.u.Utils Thread-14-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[34, 34] [INFO] Async loop interrupted! 2023-12-11 15:28:16.507 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[34, 34] 2023-12-11 15:28:16.507 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[30, 30] 2023-12-11 15:28:16.507 o.a.s.u.Utils Thread-15-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[30, 30] [INFO] Async loop interrupted! 2023-12-11 15:28:16.509 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[30, 30] 2023-12-11 15:28:16.509 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[38, 38] 2023-12-11 15:28:16.510 o.a.s.u.Utils Thread-16-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[38, 38] [INFO] Async loop interrupted! 2023-12-11 15:28:16.510 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[38, 38] 2023-12-11 15:28:16.510 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[50, 50] 2023-12-11 15:28:16.512 o.a.s.u.Utils Thread-17-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[50, 50] [INFO] Async loop interrupted! 2023-12-11 15:28:16.512 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[50, 50] 2023-12-11 15:28:16.512 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[54, 54] 2023-12-11 15:28:16.512 o.a.s.u.Utils Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[54, 54] [INFO] Async loop interrupted! 2023-12-11 15:28:16.512 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[54, 54] 2023-12-11 15:28:16.512 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[46, 46] 2023-12-11 15:28:16.513 o.a.s.u.Utils Thread-21-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[46, 46] [INFO] Async loop interrupted! 2023-12-11 15:28:16.513 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[46, 46] 2023-12-11 15:28:16.513 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[58, 58] 2023-12-11 15:28:16.513 o.a.s.u.Utils Thread-24-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[58, 58] [INFO] Async loop interrupted! 2023-12-11 15:28:16.514 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[58, 58] 2023-12-11 15:28:16.514 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[26, 26] 2023-12-11 15:28:16.514 o.a.s.u.Utils Thread-26-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[26, 26] [INFO] Async loop interrupted! 2023-12-11 15:28:16.516 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[26, 26] 2023-12-11 15:28:16.516 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[18, 18] 2023-12-11 15:28:16.516 o.a.s.u.Utils Thread-28-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[18, 18] [INFO] Async loop interrupted! 2023-12-11 15:28:16.520 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[18, 18] 2023-12-11 15:28:16.520 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[14, 14] 2023-12-11 15:28:16.520 o.a.s.u.Utils Thread-29-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[14, 14] [INFO] Async loop interrupted! 2023-12-11 15:28:16.522 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[14, 14] 2023-12-11 15:28:16.522 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[22, 22] 2023-12-11 15:28:16.522 o.a.s.u.Utils Thread-30-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[22, 22] [INFO] Async loop interrupted! 2023-12-11 15:28:16.524 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[22, 22] 2023-12-11 15:28:16.524 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[10, 10] 2023-12-11 15:28:16.524 o.a.s.u.Utils Thread-31-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[10, 10] [INFO] Async loop interrupted! 2023-12-11 15:28:16.527 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[10, 10] 2023-12-11 15:28:16.527 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __eventlogger:[2, 2] 2023-12-11 15:28:16.527 o.a.s.u.Utils Thread-32-__eventlogger-executor[2, 2] [INFO] Async loop interrupted! 2023-12-11 15:28:16.528 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __eventlogger:[2, 2] 2023-12-11 15:28:16.528 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[6, 6] 2023-12-11 15:28:16.529 o.a.s.u.Utils Thread-33-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[6, 6] [INFO] Async loop interrupted! 2023-12-11 15:28:16.531 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[6, 6] 2023-12-11 15:28:16.531 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[66, 66] 2023-12-11 15:28:16.531 o.a.s.u.Utils Thread-34-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[66, 66] [INFO] Async loop interrupted! 2023-12-11 15:28:16.531 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[66, 66] 2023-12-11 15:28:16.531 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[62, 62] 2023-12-11 15:28:16.535 o.a.s.u.Utils Thread-35-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[62, 62] [INFO] Async loop interrupted! 2023-12-11 15:28:16.535 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[62, 62] 2023-12-11 15:28:16.535 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor partitioner:[74, 74] 2023-12-11 15:28:16.535 o.a.s.u.Utils Thread-36-partitioner-executor[74, 74] [INFO] Async loop interrupted! 2023-12-11 15:28:16.535 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor partitioner:[74, 74] 2023-12-11 15:28:16.535 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[90, 90] 2023-12-11 15:28:16.535 o.a.s.u.Utils Thread-39-spout-executor[90, 90] [INFO] Async loop interrupted! 2023-12-11 15:28:16.540 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[90, 90] 2023-12-11 15:28:16.540 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[86, 86] 2023-12-11 15:28:16.540 o.a.s.u.Utils Thread-40-spout-executor[86, 86] [INFO] Async loop interrupted! 2023-12-11 15:28:16.540 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[86, 86] 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor ssb:[94, 94] 2023-12-11 15:28:16.541 o.a.s.u.Utils Thread-41-ssb-executor[94, 94] [INFO] Async loop interrupted! 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor ssb:[94, 94] 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[82, 82] 2023-12-11 15:28:16.541 o.a.s.u.Utils Thread-42-spout-executor[82, 82] [INFO] Async loop interrupted! 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[82, 82] 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[78, 78] 2023-12-11 15:28:16.541 o.a.s.u.Utils Thread-43-spout-executor[78, 78] [INFO] Async loop interrupted! 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[78, 78] 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[43, 43] 2023-12-11 15:28:16.541 o.a.s.u.Utils Thread-44-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[43, 43] [INFO] Async loop interrupted! 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[43, 43] 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[35, 35] 2023-12-11 15:28:16.541 o.a.s.u.Utils Thread-45-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[35, 35] [INFO] Async loop interrupted! 2023-12-11 15:28:16.541 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[35, 35] 2023-12-11 15:28:16.542 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[31, 31] 2023-12-11 15:28:16.542 o.a.s.u.Utils Thread-46-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[31, 31] [INFO] Async loop interrupted! 2023-12-11 15:28:16.547 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[31, 31] 2023-12-11 15:28:16.547 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[39, 39] 2023-12-11 15:28:16.547 o.a.s.u.Utils Thread-49-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[39, 39] [INFO] Async loop interrupted! 2023-12-11 15:28:16.547 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[39, 39] 2023-12-11 15:28:16.547 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[59, 59] 2023-12-11 15:28:16.548 o.a.s.u.Utils Thread-50-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[59, 59] [INFO] Async loop interrupted! 2023-12-11 15:28:16.548 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[59, 59] 2023-12-11 15:28:16.548 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[55, 55] 2023-12-11 15:28:16.548 o.a.s.u.Utils Thread-51-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[55, 55] [INFO] Async loop interrupted! 2023-12-11 15:28:16.548 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[55, 55] 2023-12-11 15:28:16.548 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor fetch:[71, 71] 2023-12-11 15:28:16.548 o.a.s.u.Utils Thread-52-fetch-executor[71, 71] [INFO] Async loop interrupted! 2023-12-11 15:28:16.549 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor fetch:[71, 71] 2023-12-11 15:28:16.549 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[63, 63] 2023-12-11 15:28:16.549 o.a.s.u.Utils Thread-54-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[63, 63] [INFO] Async loop interrupted! 2023-12-11 15:28:16.549 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[63, 63] 2023-12-11 15:28:16.549 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor prefilter:[75, 75] 2023-12-11 15:28:16.549 o.a.s.u.Utils Thread-55-prefilter-executor[75, 75] [INFO] Async loop interrupted! 2023-12-11 15:28:16.549 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor prefilter:[75, 75] 2023-12-11 15:28:16.549 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[83, 83] 2023-12-11 15:28:16.549 o.a.s.u.Utils Thread-57-spout-executor[83, 83] [INFO] Async loop interrupted! 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[83, 83] 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[79, 79] 2023-12-11 15:28:16.550 o.a.s.u.Utils Thread-60-spout-executor[79, 79] [INFO] Async loop interrupted! 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[79, 79] 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[91, 91] 2023-12-11 15:28:16.550 o.a.s.u.Utils Thread-61-spout-executor[91, 91] [INFO] Async loop interrupted! 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[91, 91] 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor warc:[111, 111] 2023-12-11 15:28:16.550 o.a.s.u.Utils Thread-62-warc-executor[111, 111] [INFO] Async loop interrupted! 2023-12-11 15:28:16.550 c.d.s.w.GzipHdfsBolt ShutdownHook-shutdownFunc [INFO] Cleanup called on bolt 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor warc:[111, 111] 2023-12-11 15:28:16.550 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[87, 87] 2023-12-11 15:28:16.551 o.a.s.u.Utils Thread-63-spout-executor[87, 87] [INFO] Async loop interrupted! 2023-12-11 15:28:16.551 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[87, 87] 2023-12-11 15:28:16.551 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[51, 51] 2023-12-11 15:28:16.553 o.a.s.u.Utils Thread-64-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[51, 51] [INFO] Async loop interrupted! 2023-12-11 15:28:16.553 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[51, 51] 2023-12-11 15:28:16.554 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[47, 47] 2023-12-11 15:28:16.554 o.a.s.u.Utils Thread-65-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[47, 47] [INFO] Async loop interrupted! 2023-12-11 15:28:16.554 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[47, 47] 2023-12-11 15:28:16.554 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[27, 27] 2023-12-11 15:28:16.554 o.a.s.u.Utils Thread-66-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[27, 27] [INFO] Async loop interrupted! 2023-12-11 15:28:16.555 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[27, 27] 2023-12-11 15:28:16.555 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[19, 19] 2023-12-11 15:28:16.555 o.a.s.u.Utils Thread-68-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[19, 19] [INFO] Async loop interrupted! 2023-12-11 15:28:16.557 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[19, 19] 2023-12-11 15:28:16.558 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[15, 15] 2023-12-11 15:28:16.558 o.a.s.u.Utils Thread-70-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[15, 15] [INFO] Async loop interrupted! 2023-12-11 15:28:16.561 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[15, 15] 2023-12-11 15:28:16.561 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[23, 23] 2023-12-11 15:28:16.561 o.a.s.u.Utils Thread-71-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[23, 23] [INFO] Async loop interrupted! 2023-12-11 15:28:16.563 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[23, 23] 2023-12-11 15:28:16.563 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[11, 11] 2023-12-11 15:28:16.563 o.a.s.u.Utils Thread-72-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[11, 11] [INFO] Async loop interrupted! 2023-12-11 15:28:16.565 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[11, 11] 2023-12-11 15:28:16.565 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[3, 3] 2023-12-11 15:28:16.565 o.a.s.u.Utils Thread-73-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[3, 3] [INFO] Async loop interrupted! 2023-12-11 15:28:16.567 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[3, 3] 2023-12-11 15:28:16.567 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[7, 7] 2023-12-11 15:28:16.567 o.a.s.u.Utils Thread-74-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[7, 7] [INFO] Async loop interrupted! 2023-12-11 15:28:16.569 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[7, 7] 2023-12-11 15:28:16.569 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor feed:[67, 70] 2023-12-11 15:28:16.569 o.a.s.u.Utils Thread-75-feed-executor[67, 70] [INFO] Async loop interrupted! 2023-12-11 15:28:16.569 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor feed:[67, 70] 2023-12-11 15:28:16.569 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor status:[95, 110] 2023-12-11 15:28:16.569 o.a.s.u.Utils Thread-76-status-executor[95, 110] [INFO] Async loop interrupted! 2023-12-11 15:28:16.588 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor status:[95, 110] 2023-12-11 15:28:16.588 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[52, 52] 2023-12-11 15:28:16.588 o.a.s.u.Utils Thread-77-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[52, 52] [INFO] Async loop interrupted! 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[52, 52] 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __system:[-1, -1] 2023-12-11 15:28:16.589 o.a.s.u.Utils Thread-78-__system-executor[-1, -1] [INFO] Async loop interrupted! 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __system:[-1, -1] 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[60, 60] 2023-12-11 15:28:16.589 o.a.s.u.Utils Thread-79-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[60, 60] [INFO] Async loop interrupted! 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[60, 60] 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor filespout:[72, 72] 2023-12-11 15:28:16.589 o.a.s.u.Utils Thread-81-filespout-executor[72, 72] [INFO] Async loop interrupted! 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor filespout:[72, 72] 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[64, 64] 2023-12-11 15:28:16.589 o.a.s.u.Utils Thread-82-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[64, 64] [INFO] Async loop interrupted! 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[64, 64] 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[80, 80] 2023-12-11 15:28:16.589 o.a.s.u.Utils Thread-84-spout-executor[80, 80] [INFO] Async loop interrupted! 2023-12-11 15:28:16.589 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[80, 80] 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[56, 56] 2023-12-11 15:28:16.590 o.a.s.u.Utils Thread-86-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[56, 56] [INFO] Async loop interrupted! 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[56, 56] 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[92, 92] 2023-12-11 15:28:16.590 o.a.s.u.Utils Thread-87-spout-executor[92, 92] [INFO] Async loop interrupted! 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[92, 92] 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[88, 88] 2023-12-11 15:28:16.590 o.a.s.u.Utils Thread-89-spout-executor[88, 88] [INFO] Async loop interrupted! 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[88, 88] 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[84, 84] 2023-12-11 15:28:16.590 o.a.s.u.Utils Thread-90-spout-executor[84, 84] [INFO] Async loop interrupted! 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[84, 84] 2023-12-11 15:28:16.590 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[28, 28] 2023-12-11 15:28:16.590 o.a.s.u.Utils Thread-91-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[28, 28] [INFO] Async loop interrupted! 2023-12-11 15:28:16.591 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[28, 28] 2023-12-11 15:28:16.591 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[24, 24] 2023-12-11 15:28:16.591 o.a.s.u.Utils Thread-92-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[24, 24] [INFO] Async loop interrupted! 2023-12-11 15:28:16.591 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[24, 24] 2023-12-11 15:28:16.591 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[32, 32] 2023-12-11 15:28:16.592 o.a.s.u.Utils Thread-93-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[32, 32] [INFO] Async loop interrupted! 2023-12-11 15:28:16.592 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[32, 32] 2023-12-11 15:28:16.592 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[20, 20] 2023-12-11 15:28:16.592 o.a.s.u.Utils Thread-94-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[20, 20] [INFO] Async loop interrupted! 2023-12-11 15:28:16.593 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[20, 20] 2023-12-11 15:28:16.593 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[12, 12] 2023-12-11 15:28:16.593 o.a.s.u.Utils Thread-95-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[12, 12] [INFO] Async loop interrupted! 2023-12-11 15:28:16.594 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[12, 12] 2023-12-11 15:28:16.594 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[8, 8] 2023-12-11 15:28:16.594 o.a.s.u.Utils Thread-96-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[8, 8] [INFO] Async loop interrupted! 2023-12-11 15:28:16.594 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[8, 8] 2023-12-11 15:28:16.595 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[16, 16] 2023-12-11 15:28:16.595 o.a.s.u.Utils Thread-97-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[16, 16] [INFO] Async loop interrupted! 2023-12-11 15:28:16.595 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[16, 16] 2023-12-11 15:28:16.595 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[4, 4] 2023-12-11 15:28:16.595 o.a.s.u.Utils Thread-98-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[4, 4] [INFO] Async loop interrupted! 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[4, 4] 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[36, 36] 2023-12-11 15:28:16.596 o.a.s.u.Utils Thread-99-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[36, 36] [INFO] Async loop interrupted! 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[36, 36] 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[44, 44] 2023-12-11 15:28:16.596 o.a.s.u.Utils Thread-100-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[44, 44] [INFO] Async loop interrupted! 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[44, 44] 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[40, 40] 2023-12-11 15:28:16.596 o.a.s.u.Utils Thread-102-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[40, 40] [INFO] Async loop interrupted! 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[40, 40] 2023-12-11 15:28:16.596 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[48, 48] 2023-12-11 15:28:16.596 o.a.s.u.Utils Thread-104-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[48, 48] [INFO] Async loop interrupted! 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[48, 48] 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor sitemap:[76, 77] 2023-12-11 15:28:16.597 o.a.s.u.Utils Thread-106-sitemap-executor[76, 77] [INFO] Async loop interrupted! 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor sitemap:[76, 77] 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[45, 45] 2023-12-11 15:28:16.597 o.a.s.u.Utils Thread-108-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[45, 45] [INFO] Async loop interrupted! 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[45, 45] 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[37, 37] 2023-12-11 15:28:16.597 o.a.s.u.Utils Thread-109-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[37, 37] [INFO] Async loop interrupted! 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[37, 37] 2023-12-11 15:28:16.597 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[33, 33] 2023-12-11 15:28:16.597 o.a.s.u.Utils Thread-111-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[33, 33] [INFO] Async loop interrupted! 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[33, 33] 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[41, 41] 2023-12-11 15:28:16.598 o.a.s.u.Utils Thread-113-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[41, 41] [INFO] Async loop interrupted! 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[41, 41] 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[53, 53] 2023-12-11 15:28:16.598 o.a.s.u.Utils Thread-114-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[53, 53] [INFO] Async loop interrupted! 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[53, 53] 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[49, 49] 2023-12-11 15:28:16.598 o.a.s.u.Utils Thread-116-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[49, 49] [INFO] Async loop interrupted! 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[49, 49] 2023-12-11 15:28:16.598 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[29, 29] 2023-12-11 15:28:16.598 o.a.s.u.Utils Thread-117-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[29, 29] [INFO] Async loop interrupted! 2023-12-11 15:28:16.599 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[29, 29] 2023-12-11 15:28:16.599 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[21, 21] 2023-12-11 15:28:16.599 o.a.s.u.Utils Thread-119-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[21, 21] [INFO] Async loop interrupted! 2023-12-11 15:28:16.600 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[21, 21] 2023-12-11 15:28:16.600 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[17, 17] 2023-12-11 15:28:16.600 o.a.s.u.Utils Thread-121-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[17, 17] [INFO] Async loop interrupted! 2023-12-11 15:28:16.600 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[17, 17] 2023-12-11 15:28:16.600 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[25, 25] 2023-12-11 15:28:16.600 o.a.s.u.Utils Thread-122-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[25, 25] [INFO] Async loop interrupted! 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[25, 25] 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[85, 85] 2023-12-11 15:28:16.601 o.a.s.u.Utils Thread-123-spout-executor[85, 85] [INFO] Async loop interrupted! 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[85, 85] 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[93, 93] 2023-12-11 15:28:16.601 o.a.s.u.Utils Thread-124-spout-executor[93, 93] [INFO] Async loop interrupted! 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[93, 93] 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[89, 89] 2023-12-11 15:28:16.601 o.a.s.u.Utils Thread-125-spout-executor[89, 89] [INFO] Async loop interrupted! 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[89, 89] 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[61, 61] 2023-12-11 15:28:16.601 o.a.s.u.Utils Thread-126-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[61, 61] [INFO] Async loop interrupted! 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[61, 61] 2023-12-11 15:28:16.601 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[65, 65] 2023-12-11 15:28:16.601 o.a.s.u.Utils Thread-127-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[65, 65] [INFO] Async loop interrupted! 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[65, 65] 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor filter:[73, 73] 2023-12-11 15:28:16.602 o.a.s.u.Utils Thread-128-filter-executor[73, 73] [INFO] Async loop interrupted! 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor filter:[73, 73] 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor spout:[81, 81] 2023-12-11 15:28:16.602 o.a.s.u.Utils Thread-131-spout-executor[81, 81] [INFO] Async loop interrupted! 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor spout:[81, 81] 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[57, 57] 2023-12-11 15:28:16.602 o.a.s.u.Utils Thread-132-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[57, 57] [INFO] Async loop interrupted! 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_org.apache.storm.metric.LoggingMetricsConsumer:[57, 57] 2023-12-11 15:28:16.602 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[5, 5] 2023-12-11 15:28:16.602 o.a.s.u.Utils Thread-133-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[5, 5] [INFO] Async loop interrupted! 2023-12-11 15:28:16.603 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[5, 5] 2023-12-11 15:28:16.603 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[9, 9] 2023-12-11 15:28:16.603 o.a.s.u.Utils Thread-135-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[9, 9] [INFO] Async loop interrupted! 2023-12-11 15:28:16.603 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[9, 9] 2023-12-11 15:28:16.603 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __acker:[1, 1] 2023-12-11 15:28:16.604 o.a.s.u.Utils Thread-136-__acker-executor[1, 1] [INFO] Async loop interrupted! 2023-12-11 15:28:16.604 o.a.s.d.Acker ShutdownHook-shutdownFunc [INFO] Acker: cleanup successfully 2023-12-11 15:28:16.604 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __acker:[1, 1] 2023-12-11 15:28:16.604 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shutting down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[13, 13] 2023-12-11 15:28:16.604 o.a.s.u.Utils Thread-137-__metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer-executor[13, 13] [INFO] Async loop interrupted! 2023-12-11 15:28:16.604 o.a.s.e.ExecutorShutdown ShutdownHook-shutdownFunc [INFO] Shut down executor __metrics_com.digitalpebble.stormcrawler.elasticsearch.metrics.MetricsConsumer:[13, 13] 2023-12-11 15:28:16.604 o.a.s.d.w.Worker ShutdownHook-shutdownFunc [INFO] Shut down executors 2023-12-11 15:28:16.604 o.a.s.d.w.Worker ShutdownHook-shutdownFunc [INFO] Shutting down transfer thread 2023-12-11 15:28:17.755 c.d.s.b.FetcherBolt FetcherThread #82 [INFO] [Fetcher #71] Fetched https://www.benzinga.com/quote/VTRKF/news with status 200 in msec 315 2023-12-11 15:28:19.513 o.a.s.u.Utils ShutdownHook-sleepKill-3s [WARN] Forcing Halt... "FetcherThread #74" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "MetricRegistryTimer" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//org.apache.storm.utils.Time.sleep(Time.java:100) at app//org.apache.storm.StormTimer$StormTimerTask.run(StormTimer.java:236) "FetcherThread #57" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #76" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #80" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-13" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "FetcherThread #59" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "Finalizer" (DAEMON) lock: java.lang.ref.ReferenceQueue$Lock@d503110 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) at java.base@11.0.21/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176) at java.base@11.0.21/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170) "FetcherThread #15" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #82" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #41" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #84" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #17" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #46" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #69" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #2" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "metric/stat timer" (DAEMON) lock: java.util.TaskQueue@dee7026 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.Object.wait(Object.java:328) at java.base@11.0.21/java.util.TimerThread.mainLoop(Timer.java:527) at java.base@11.0.21/java.util.TimerThread.run(Timer.java:506) "OkHttp www.dailynews.com" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.net.SocketInputStream.socketRead0(Native Method) at java.base@11.0.21/java.net.SocketInputStream.socketRead(SocketInputStream.java:115) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:168) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:140) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1459) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070) at app//okio.InputStreamSource.read(JvmOkio.kt:94) at app//okio.AsyncTimeout$source$1.read(AsyncTimeout.kt:125) at app//okio.RealBufferedSource.request(RealBufferedSource.kt:206) at app//okio.RealBufferedSource.require(RealBufferedSource.kt:199) at app//okhttp3.internal.http2.Http2Reader.nextFrame(Http2Reader.kt:89) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:618) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:609) at app//okhttp3.internal.concurrent.TaskQueue$execute$1.runOnce(TaskQueue.kt:98) at app//okhttp3.internal.concurrent.TaskRunner.runTask(TaskRunner.kt:116) at app//okhttp3.internal.concurrent.TaskRunner.access$runTask(TaskRunner.kt:42) at app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:65) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #90" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #75" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #50" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp TaskRunner" (DAEMON) lock: java.util.concurrent.SynchronousQueue$TransferStack@7a48295e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@11.0.21/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "Curator-Framework-0" (DAEMON) lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@74f2849c owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.21/java.util.concurrent.DelayQueue.take(DelayQueue.java:217) at java.base@11.0.21/java.util.concurrent.DelayQueue.take(DelayQueue.java:77) at app//org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:938) at app//org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:66) at app//org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:346) at java.base@11.0.21/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base@11.0.21/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #88" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #94" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #70" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "main-EventThread" (DAEMON) lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6d9e7cb8 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.21/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at app//org.apache.storm.shade.org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) "FetcherThread #1" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner" (DAEMON) lock: java.lang.ref.ReferenceQueue$Lock@49b5f6e owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) at java.base@11.0.21/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176) at app//org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3698) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "OkHttp observer.com" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.net.SocketInputStream.socketRead0(Native Method) at java.base@11.0.21/java.net.SocketInputStream.socketRead(SocketInputStream.java:115) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:168) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:140) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1459) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070) at app//okio.InputStreamSource.read(JvmOkio.kt:94) at app//okio.AsyncTimeout$source$1.read(AsyncTimeout.kt:125) at app//okio.RealBufferedSource.request(RealBufferedSource.kt:206) at app//okio.RealBufferedSource.require(RealBufferedSource.kt:199) at app//okhttp3.internal.http2.Http2Reader.nextFrame(Http2Reader.kt:89) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:618) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:609) at app//okhttp3.internal.concurrent.TaskQueue$execute$1.runOnce(TaskQueue.kt:98) at app//okhttp3.internal.concurrent.TaskRunner.runTask(TaskRunner.kt:116) at app//okhttp3.internal.concurrent.TaskRunner.access$runTask(TaskRunner.kt:42) at app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:65) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #21" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "Log4j2-TF-6-Scheduled-1" (DAEMON) lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3fd8d7ab owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.21/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) at java.base@11.0.21/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "globalEventExecutor-1-42013" lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3430a44e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.21/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458) at app//org.apache.storm.shade.io.netty.util.concurrent.GlobalEventExecutor.takeTask(GlobalEventExecutor.java:92) at app//org.apache.storm.shade.io.netty.util.concurrent.GlobalEventExecutor$TaskRunner.run(GlobalEventExecutor.java:245) at app//org.apache.storm.shade.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #6" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #65" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #85" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #20" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp www.derstandard.at" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.net.SocketInputStream.socketRead0(Native Method) at java.base@11.0.21/java.net.SocketInputStream.socketRead(SocketInputStream.java:115) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:168) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:140) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1459) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070) at app//okio.InputStreamSource.read(JvmOkio.kt:94) at app//okio.AsyncTimeout$source$1.read(AsyncTimeout.kt:125) at app//okio.RealBufferedSource.request(RealBufferedSource.kt:206) at app//okio.RealBufferedSource.require(RealBufferedSource.kt:199) at app//okhttp3.internal.http2.Http2Reader.nextFrame(Http2Reader.kt:89) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:618) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:609) at app//okhttp3.internal.concurrent.TaskQueue$execute$1.runOnce(TaskQueue.kt:98) at app//okhttp3.internal.concurrent.TaskRunner.runTask(TaskRunner.kt:116) at app//okhttp3.internal.concurrent.TaskRunner.access$runTask(TaskRunner.kt:42) at app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:65) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "ShutdownHook-shutdownFunc" lock: org.apache.storm.shade.io.netty.util.concurrent.DefaultPromise@5ae756ab owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.Object.wait(Object.java:328) at app//org.apache.storm.shade.io.netty.util.concurrent.DefaultPromise.awaitUninterruptibly(DefaultPromise.java:253) at app//org.apache.storm.shade.io.netty.util.concurrent.DefaultPromise.awaitUninterruptibly(DefaultPromise.java:33) at app//org.apache.storm.messaging.netty.Context.term(Context.java:94) at app//org.apache.storm.daemon.worker.Worker.shutdown(Worker.java:544) at app//org.apache.storm.daemon.worker.Worker$$Lambda$108/0x00000008401ac840.run(Unknown Source) at app//org.apache.storm.utils.Utils.lambda$addShutdownHookWithDelayedForceKill$1(Utils.java:357) at app//org.apache.storm.utils.Utils$$Lambda$110/0x00000008401ad440.run(Unknown Source) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #31" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #36" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #77" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #66" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #11" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ShutdownHook-sleepKill-3s" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.lang.Thread.dumpThreads(Native Method) at java.base@11.0.21/java.lang.Thread.getAllStackTraces(Thread.java:1653) at app//org.apache.storm.utils.Utils.threadDump(Utils.java:1290) at app//org.apache.storm.utils.Utils.lambda$addShutdownHookWithDelayedForceKill$0(Utils.java:347) at app//org.apache.storm.utils.Utils$$Lambda$109/0x00000008401ad040.run(Unknown Source) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #0" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "client-worker-1" lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.21/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) at java.base@11.0.21/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.21/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) at app//org.apache.storm.shade.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) at app//org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753) at app//org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:408) at app//org.apache.storm.shade.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "main-SendThread(10.142.0.17:2181)" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/sun.nio.ch.EPoll.wait(Native Method) at java.base@11.0.21/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) at java.base@11.0.21/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.21/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) at app//org.apache.storm.shade.org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:347) at app//org.apache.storm.shade.org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) "OkHttp TaskRunner" (DAEMON) lock: okhttp3.internal.concurrent.TaskRunner@4d91971 owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.Object.wait(Object.java:462) at app//okhttp3.internal.concurrent.TaskRunner$RealBackend.coordinatorWait(TaskRunner.kt:294) at app//okhttp3.internal.concurrent.TaskRunner.awaitTaskToRun(TaskRunner.kt:218) at app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:59) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #87" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #7" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #42" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #62" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #78" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-3" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "FetcherThread #92" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #32" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #44" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #23" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #38" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #95" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-11" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "FetcherThread #5" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #8" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #16" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #86" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #93" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #39" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-15" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkUntil(LockSupport.java:275) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1619) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "SIGTERM handler" (DAEMON) lock: java.lang.Thread@e260766 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.Thread.join(Thread.java:1300) at java.base@11.0.21/java.lang.Thread.join(Thread.java:1375) at java.base@11.0.21/java.lang.ApplicationShutdownHooks.runHooks(ApplicationShutdownHooks.java:107) at java.base@11.0.21/java.lang.ApplicationShutdownHooks$1.run(ApplicationShutdownHooks.java:46) at java.base@11.0.21/java.lang.Shutdown.runHooks(Shutdown.java:130) at java.base@11.0.21/java.lang.Shutdown.exit(Shutdown.java:174) at java.base@11.0.21/java.lang.Terminator$1.handle(Terminator.java:51) at java.base@11.0.21/jdk.internal.misc.Signal$1.run(Signal.java:220) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #60" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #83" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #73" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "DestroyJavaVM" lock: null owner: null java.lang.Thread.State: RUNNABLE "FetcherThread #12" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #54" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #67" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #89" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #96" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #27" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp TaskRunner" (DAEMON) lock: java.util.concurrent.SynchronousQueue$TransferStack@7a48295e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@11.0.21/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #63" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #58" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #3" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #35" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "Curator-ConnectionStateManager-0" (DAEMON) lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@46a9fab7 owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at java.base@11.0.21/java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) at app//org.apache.storm.shade.org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:272) at app//org.apache.storm.shade.org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:44) at app//org.apache.storm.shade.org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:133) at java.base@11.0.21/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #9" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #4" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #19" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #56" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #18" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "Okio Watchdog" (DAEMON) lock: java.lang.Class@6e6bbe2e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at app//okio.AsyncTimeout$Companion.awaitTimeout$okio(AsyncTimeout.kt:302) at app//okio.AsyncTimeout$Watchdog.run(AsyncTimeout.kt:183) "Common-Cleaner" (DAEMON) lock: java.lang.ref.ReferenceQueue$Lock@3435a807 owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Object.wait(Native Method) at java.base@11.0.21/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) at java.base@11.0.21/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) at java.base@11.0.21/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:161) "FetcherThread #13" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-9" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "FetcherThread #52" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #33" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #53" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp TaskRunner" (DAEMON) lock: java.util.concurrent.SynchronousQueue$TransferStack@7a48295e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@11.0.21/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #79" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #34" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp metro.co.uk" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.net.SocketInputStream.socketRead0(Native Method) at java.base@11.0.21/java.net.SocketInputStream.socketRead(SocketInputStream.java:115) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:168) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:140) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1459) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070) at app//okio.InputStreamSource.read(JvmOkio.kt:94) at app//okio.AsyncTimeout$source$1.read(AsyncTimeout.kt:125) at app//okio.RealBufferedSource.request(RealBufferedSource.kt:206) at app//okio.RealBufferedSource.require(RealBufferedSource.kt:199) at app//okhttp3.internal.http2.Http2Reader.nextFrame(Http2Reader.kt:89) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:618) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:609) at app//okhttp3.internal.concurrent.TaskQueue$execute$1.runOnce(TaskQueue.kt:98) at app//okhttp3.internal.concurrent.TaskRunner.runTask(TaskRunner.kt:116) at app//okhttp3.internal.concurrent.TaskRunner.access$runTask(TaskRunner.kt:42) at app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:65) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #24" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #37" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #29" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #64" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #30" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #40" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #43" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #55" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "Reference Handler" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.lang.ref.Reference.waitForReferencePendingList(Native Method) at java.base@11.0.21/java.lang.ref.Reference.processPendingReferences(Reference.java:241) at java.base@11.0.21/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213) "FetcherThread #28" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #48" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #25" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #91" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp TaskRunner" (DAEMON) lock: java.util.concurrent.SynchronousQueue$TransferStack@7a48295e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@11.0.21/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #22" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #81" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #26" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #14" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #97" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #49" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #99" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp TaskRunner" (DAEMON) lock: java.util.concurrent.SynchronousQueue$TransferStack@7a48295e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@11.0.21/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #71" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-7" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "FetcherThread #68" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #61" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #72" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #98" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "ForkJoinPool.commonPool-worker-5" (DAEMON) lock: java.util.concurrent.ForkJoinPool@1afe88f9 owner: null java.lang.Thread.State: WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.21/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628) at java.base@11.0.21/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) "OkHttp www.benzinga.com" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE at java.base@11.0.21/java.net.SocketInputStream.socketRead0(Native Method) at java.base@11.0.21/java.net.SocketInputStream.socketRead(SocketInputStream.java:115) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:168) at java.base@11.0.21/java.net.SocketInputStream.read(SocketInputStream.java:140) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478) at java.base@11.0.21/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1459) at java.base@11.0.21/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070) at app//okio.InputStreamSource.read(JvmOkio.kt:94) at app//okio.AsyncTimeout$source$1.read(AsyncTimeout.kt:125) at app//okio.RealBufferedSource.request(RealBufferedSource.kt:206) at app//okio.RealBufferedSource.require(RealBufferedSource.kt:199) at app//okhttp3.internal.http2.Http2Reader.nextFrame(Http2Reader.kt:89) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:618) at app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:609) at app//okhttp3.internal.concurrent.TaskQueue$execute$1.runOnce(TaskQueue.kt:98) at app//okhttp3.internal.concurrent.TaskRunner.runTask(TaskRunner.kt:116) at app//okhttp3.internal.concurrent.TaskRunner.access$runTask(TaskRunner.kt:42) at app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:65) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "Signal Dispatcher" (DAEMON) lock: null owner: null java.lang.Thread.State: RUNNABLE "FetcherThread #51" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #47" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "OkHttp TaskRunner" (DAEMON) lock: java.util.concurrent.SynchronousQueue$TransferStack@7a48295e owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.21/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@11.0.21/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@11.0.21/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.21/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.21/java.lang.Thread.run(Thread.java:829) "FetcherThread #10" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478) "FetcherThread #45" (DAEMON) lock: null owner: null java.lang.Thread.State: TIMED_WAITING at java.base@11.0.21/java.lang.Thread.sleep(Native Method) at app//com.digitalpebble.stormcrawler.bolt.FetcherBolt$FetcherThread.run(FetcherBolt.java:478)