GUIDE: leverage cache: file
(timesaver)
#60
dynabler
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Scenario: you went through the hassle of collecting 1000s of data point and 100K pages, but you forget to get one more data point.
Flyscrape has a nice feature whereby it caches all the pages you scrape. It's stored in a file named after your script. For example:
script.js
cache is namedscript.cache
. There's also a video to see it in action: Learn Flyscrape in 10 minGenerate a new JSON without actually scraping again
export const config
export default function
andreturn
flyscrape run script.js
Beta Was this translation helpful? Give feedback.
All reactions