Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically update database data periodically #3

Open
dustinvtran opened this issue Jan 30, 2022 · 2 comments
Open

Automatically update database data periodically #3

dustinvtran opened this issue Jan 30, 2022 · 2 comments
Labels

Comments

@dustinvtran
Copy link
Collaborator

Due to updates, our scraped database data should be synced with the online databases every once in a while. One way this can be be achieved is with a crontab that calls the scraper script every, say, 3 months.

@dustinvtran dustinvtran added the p2 label Jan 30, 2022
@ghost
Copy link

ghost commented Feb 5, 2022

You would probably need to run a script on an external server if you wanted to do that because netlify doesn't really have good support for that. Pro plan ($19/month/member) has background functions, but even background functions may only run for up to 15 minutes. It'd be fairly simple, just clone the repo, npm install, add the .env file and run the script.

@ghost
Copy link

ghost commented Feb 5, 2022

Subtasks

  • Write script that updates database entries
  • Have that script run every 3 months on a server

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant