Replies: 1 comment 1 reply
-
Are you on latest version? Namely v3.3.3 could help with this issue. Few notes:
|
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello! I have a crawler which needs to be invoked and cleanly completed multiple times. I'm using
{purgeOnStart:true}
so I would expect the crawler to start everything 'fresh'. And it works for 20-50 times that the crawler is called, but eventually starts throwing this error:AutoscaledPool: isTaskReadyFunction failed
. Is there a way to either A) prevent the crawler from deleting any requestQueues it's using or B) to prevent it from referencing some older request queue or C) catch this error and ignore this missing queue?PlaywrightCrawler:AutoscaledPool: isTaskReadyFunction failed
Error: ENOENT: no such file or directory, open '/Users/admin/CodeProjects/IGScraper/storage/request_queues/default/dDL0pGj5X9jotg9.json'
Beta Was this translation helpful? Give feedback.
All reactions