node index.js -c conf2.json Running Crawl From Config File conf2.json With great power comes great responsibility! Squidwarc is not responsible for ill behaved user supplied scripts! Crawler Operating In page-all-links mode Crawler Will Be Preserving 1 Seeds Crawler Will Be Generating WARC Files Using the filenamified url Crawler Generated WARCs Will Be Placed At C:\Users\setth\Squidwarc Crawler Navigating To https://www.instagram.com/visit_berlin/ Crawler Navigated To https://www.instagram.com/visit_berlin/ Running user script Crawler Generating WARC Crawler Has 67 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=follow Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=follow Running user script Crawler Generating WARC Crawler Has 66 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=profile_posts Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=profile_posts Running user script Crawler Generating WARC Crawler Has 65 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2Ffollowers%2F&source=followed_by_list Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2Ffollowers%2F&source=followed_by_list Running user script Crawler Generating WARC Crawler Has 64 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2Ffollowing%2F&source=follows_list Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2Ffollowing%2F&source=follows_list Running user script Crawler Generating WARC Crawler Has 63 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/explore/tags/visit_berlin/ Crawler Navigated To https://www.instagram.com/explore/tags/visit_berlin/ Running user script Crawler Generating WARC Crawler Has 62 Seeds Left To Crawl Crawler Navigating To https://l.instagram.com/?u=https%3A%2F%2Fwww.visitberlin.de%2Fen%2Fabout-berlin&e=ATNzxY25nd9GDPD-x-5m3uKdVHv_RyFL0YVWLwyb5yZF8MhJ2DgBSg8cJTloXY6LbCCtthHodJE5DIBLtON6vn3r Crawler Navigated To https://l.instagram.com/?u=https%3A%2F%2Fwww.visitberlin.de%2Fen%2Fabout-berlin&e=ATNzxY25nd9GDPD-x-5m3uKdVHv_RyFL0YVWLwyb5yZF8MhJ2DgBSg8cJTloXY6LbCCtthHodJE5DIBLtON6vn3r Running user script An exception was thrown while running the user script Error: Execution context was destroyed, most likely because of a navigation. - ExecutionContext.js:162 rewriteError [Squidwarc]/[puppeteer]/lib/ExecutionContext.js:162:15 - next_tick.js:68 process._tickCallback internal/process/next_tick.js:68:7 - -- ASYNC -- - helper.js:144 ExecutionContext. [Squidwarc]/[puppeteer]/lib/helper.js:144:27 - ExecutionContext.js:58 ExecutionContext.evaluate [Squidwarc]/[puppeteer]/lib/ExecutionContext.js:58:31 - helper.js:145 ExecutionContext. [Squidwarc]/[puppeteer]/lib/helper.js:145:23 - FrameManager.js:447 Frame.evaluate [Squidwarc]/[puppeteer]/lib/FrameManager.js:447:20 - next_tick.js:68 process._tickCallback internal/process/next_tick.js:68:7 - -- ASYNC -- - helper.js:144 Frame. [Squidwarc]/[puppeteer]/lib/helper.js:144:27 - Page.js:777 Page.evaluate [Squidwarc]/[puppeteer]/lib/Page.js:777:43 - helper.js:145 Page. [Squidwarc]/[puppeteer]/lib/helper.js:145:23 - userFns.js:11 Object.module.exports [as script] C:/Users/setth/Squidwarc/userFns.js:11:36 - puppeteer.js:176 PuppeteerCrawler.runUserScript C:/Users/setth/Squidwarc/lib/crawler/puppeteer.js:176:28 - puppeteerRunner.js:67 puppeteerRunner C:/Users/setth/Squidwarc/lib/runners/puppeteerRunner.js:67:21 - next_tick.js:68 process._tickCallback internal/process/next_tick.js:68:7 Crawler Generating WARC Crawler Has 61 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2Ftagged%2F&source=profile_tagged_tab Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2Ftagged%2F&source=profile_tagged_tab Running user script Crawler Generating WARC Crawler Has 60 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmsibpggOqc/ Crawler Navigated To https://www.instagram.com/p/BmsibpggOqc/ Running user script Crawler Generating WARC Crawler Has 59 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmlArzmAdCa/ Crawler Navigated To https://www.instagram.com/p/BmlArzmAdCa/ Running user script Crawler Generating WARC Crawler Has 58 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmitAIdA9lO/ Crawler Navigated To https://www.instagram.com/p/BmitAIdA9lO/ Running user script Crawler Generating WARC Crawler Has 57 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmfqOOmAdrI/ Crawler Navigated To https://www.instagram.com/p/BmfqOOmAdrI/ Running user script Crawler Generating WARC Crawler Has 56 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bmd6dtOACE7/ Crawler Navigated To https://www.instagram.com/p/Bmd6dtOACE7/ Running user script Crawler Generating WARC Crawler Has 55 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmcsNVgABgT/ Crawler Navigated To https://www.instagram.com/p/BmcsNVgABgT/ Running user script Crawler Generating WARC Crawler Has 54 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bmaj66xgqI-/ Crawler Navigated To https://www.instagram.com/p/Bmaj66xgqI-/ Running user script Crawler Generating WARC Crawler Has 53 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmTXwI9gnqP/ Crawler Navigated To https://www.instagram.com/p/BmTXwI9gnqP/ Running user script Crawler Generating WARC Crawler Has 52 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmQ_L5rAl2U/ Crawler Navigated To https://www.instagram.com/p/BmQ_L5rAl2U/ Running user script Crawler Generating WARC Crawler Has 51 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmOHIFsAjyc/ Crawler Navigated To https://www.instagram.com/p/BmOHIFsAjyc/ Running user script Crawler Generating WARC Crawler Has 50 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmL5dP2g5ZJ/ Crawler Navigated To https://www.instagram.com/p/BmL5dP2g5ZJ/ Running user script Crawler Generating WARC Crawler Has 49 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmKq7VcAmvp/ Crawler Navigated To https://www.instagram.com/p/BmKq7VcAmvp/ Running user script Crawler Generating WARC Crawler Has 48 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmIpQqFgqCe/ Crawler Navigated To https://www.instagram.com/p/BmIpQqFgqCe/ Running user script Crawler Generating WARC Crawler Has 47 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BmBXKtqAKmS/ Crawler Navigated To https://www.instagram.com/p/BmBXKtqAKmS/ Running user script Crawler Generating WARC Crawler Has 46 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bl-y5fQgu23/ Crawler Navigated To https://www.instagram.com/p/Bl-y5fQgu23/ Running user script Crawler Generating WARC Crawler Has 45 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bl7nJxMg7oW/ Crawler Navigated To https://www.instagram.com/p/Bl7nJxMg7oW/ Running user script Crawler Generating WARC Crawler Has 44 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bl4lRrcAoOI/ Crawler Navigated To https://www.instagram.com/p/Bl4lRrcAoOI/ Running user script Crawler Generating WARC Crawler Has 43 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bl2iEJagXAT/ Crawler Navigated To https://www.instagram.com/p/Bl2iEJagXAT/ Running user script Crawler Generating WARC Crawler Has 42 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlvQRliAWXR/ Crawler Navigated To https://www.instagram.com/p/BlvQRliAWXR/ Running user script Crawler Generating WARC Crawler Has 41 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlsfkSOgj4A/ Crawler Navigated To https://www.instagram.com/p/BlsfkSOgj4A/ Running user script Crawler Generating WARC Crawler Has 40 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlqEPiLA5XD/ Crawler Navigated To https://www.instagram.com/p/BlqEPiLA5XD/ Running user script Crawler Generating WARC Crawler Has 39 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlniQo8AHka/ Crawler Navigated To https://www.instagram.com/p/BlniQo8AHka/ Running user script Crawler Generating WARC Crawler Has 38 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlkkKr5AoTG/ Crawler Navigated To https://www.instagram.com/p/BlkkKr5AoTG/ Running user script Crawler Generating WARC Crawler Has 37 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Blh7V0vgBXZ/ Crawler Navigated To https://www.instagram.com/p/Blh7V0vgBXZ/ Running user script Crawler Generating WARC Crawler Has 36 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BldU45SAKl7/ Crawler Navigated To https://www.instagram.com/p/BldU45SAKl7/ Running user script Crawler Generating WARC Crawler Has 35 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlaKxn8gVmR/ Crawler Navigated To https://www.instagram.com/p/BlaKxn8gVmR/ Running user script Crawler Generating WARC Crawler Has 34 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlYF3nOgjyF/ Crawler Navigated To https://www.instagram.com/p/BlYF3nOgjyF/ Running user script Crawler Generating WARC Crawler Has 33 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlUicjVgr8T/ Crawler Navigated To https://www.instagram.com/p/BlUicjVgr8T/ Running user script Crawler Generating WARC Crawler Has 32 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlTOGwuAvbl/ Crawler Navigated To https://www.instagram.com/p/BlTOGwuAvbl/ Running user script Crawler Generating WARC Crawler Has 31 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlQogcWAQbb/ Crawler Navigated To https://www.instagram.com/p/BlQogcWAQbb/ Running user script Crawler Generating WARC Crawler Has 30 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlK6e53gh_1/ Crawler Navigated To https://www.instagram.com/p/BlK6e53gh_1/ Running user script Crawler Generating WARC Crawler Has 29 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlIs-ewAWmC/ Crawler Navigated To https://www.instagram.com/p/BlIs-ewAWmC/ Running user script Crawler Generating WARC Crawler Has 28 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlGuaPXgdYH/ Crawler Navigated To https://www.instagram.com/p/BlGuaPXgdYH/ Running user script Crawler Generating WARC Crawler Has 27 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlDbTo_A0nR/ Crawler Navigated To https://www.instagram.com/p/BlDbTo_A0nR/ Running user script Crawler Generating WARC Crawler Has 26 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BlA7-ssgLGI/ Crawler Navigated To https://www.instagram.com/p/BlA7-ssgLGI/ Running user script Crawler Generating WARC Crawler Has 25 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bk9nEbtgkoK/ Crawler Navigated To https://www.instagram.com/p/Bk9nEbtgkoK/ Running user script Crawler Generating WARC Crawler Has 24 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bk5Ul35gvBN/ Crawler Navigated To https://www.instagram.com/p/Bk5Ul35gvBN/ Running user script Crawler Generating WARC Crawler Has 23 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BkzKjBZgaW8/ Crawler Navigated To https://www.instagram.com/p/BkzKjBZgaW8/ Running user script Crawler Generating WARC Crawler Has 22 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bkxelmygf2L/ Crawler Navigated To https://www.instagram.com/p/Bkxelmygf2L/ Running user script Crawler Generating WARC Crawler Has 21 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bku7rqrFYu3/ Crawler Navigated To https://www.instagram.com/p/Bku7rqrFYu3/ Running user script Crawler Generating WARC Crawler Has 20 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BknFu1sgIkr/ Crawler Navigated To https://www.instagram.com/p/BknFu1sgIkr/ Running user script Crawler Generating WARC Crawler Has 19 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BkkAkJwF7fS/ Crawler Navigated To https://www.instagram.com/p/BkkAkJwF7fS/ Running user script Crawler Generating WARC Crawler Has 18 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BkiOx4AFWnq/ Crawler Navigated To https://www.instagram.com/p/BkiOx4AFWnq/ Running user script Crawler Generating WARC Crawler Has 17 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/Bkf8rT1lfWn/ Crawler Navigated To https://www.instagram.com/p/Bkf8rT1lfWn/ Running user script Crawler Generating WARC Crawler Has 16 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/p/BkedCy1lKh0/ Crawler Navigated To https://www.instagram.com/p/BkedCy1lKh0/ Running user script Crawler Generating WARC Crawler Has 15 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/ Crawler Navigated To https://www.instagram.com/ Running user script Crawler Generating WARC Crawler Has 14 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=logged_out_half_sheet Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=logged_out_half_sheet Running user script Crawler Generating WARC Crawler Has 13 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=desktop_nav Crawler Navigated To https://www.instagram.com/accounts/login/?next=%2Fvisit_berlin%2F&source=desktop_nav Running user script Crawler Generating WARC Crawler Has 12 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/accounts/emailsignup/ Crawler Navigated To https://www.instagram.com/accounts/emailsignup/ Running user script Crawler Generating WARC Crawler Has 11 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/about/us/ Crawler Navigated To https://www.instagram.com/about/us/ Running user script Crawler Generating WARC Crawler Has 10 Seeds Left To Crawl Crawler Navigating To https://help.instagram.com/ Crawler Navigated To https://help.instagram.com/ Running user script Crawler Generating WARC Crawler Has 9 Seeds Left To Crawl Crawler Navigating To https://instagram-press.com/ Crawler Navigated To https://instagram-press.com/ Running user script Crawler Generating WARC Crawler Has 8 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/developer/ Crawler Navigated To https://www.instagram.com/developer/ Running user script Crawler Generating WARC Crawler Has 7 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/about/jobs/ Crawler Navigated To https://www.instagram.com/about/jobs/ Running user script Crawler Generating WARC Crawler Has 6 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/legal/privacy/ Crawler Navigated To https://www.instagram.com/legal/privacy/ Running user script Crawler Generating WARC Crawler Has 5 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/legal/terms/ Crawler Navigated To https://www.instagram.com/legal/terms/ Running user script Crawler Generating WARC Crawler Has 4 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/explore/locations/ Crawler Navigated To https://www.instagram.com/explore/locations/ Running user script Crawler Generating WARC Crawler Has 3 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/directory/profiles/ Crawler Navigated To https://www.instagram.com/directory/profiles/ Running user script Crawler Generating WARC Crawler Has 2 Seeds Left To Crawl Crawler Navigating To https://www.instagram.com/directory/hashtags/ Crawler Navigated To https://www.instagram.com/directory/hashtags/ Running user script Crawler Generating WARC Crawler Has 1 Seeds Left To Crawl Crawler Navigating To https://l.facebook.com/l.php?u=https%3A%2F%2Fon.fb.me%2F1mXNHhm&h=AT2J6ahDyG_FYQiHAV0WEZiYag7P01Y7pUCeVc66M7B7wYncnvmHmefXrGubud8utDOF4X_YLJz-5oOjkv3SHqaq-JVvpiILe0U5YLFmDQ7vxxE2xZ8ugKGb4JWrUgpGgOuAfpjDBcPYBLO8 Crawler Navigated To https://l.facebook.com/l.php?u=https%3A%2F%2Fon.fb.me%2F1mXNHhm&h=AT2J6ahDyG_FYQiHAV0WEZiYag7P01Y7pUCeVc66M7B7wYncnvmHmefXrGubud8utDOF4X_YLJz-5oOjkv3SHqaq-JVvpiILe0U5YLFmDQ7vxxE2xZ8ugKGb4JWrUgpGgOuAfpjDBcPYBLO8 Running user script Crawler Generating WARC Crawler Has 0 Seeds Left To Crawl Crawler shutting down. Have nice day :)