Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Smarter refreshing via machine learning #18

Open
KeithCu opened this issue Feb 12, 2020 · 0 comments
Open

Smarter refreshing via machine learning #18

KeithCu opened this issue Feb 12, 2020 · 0 comments

Comments

@KeithCu
Copy link
Owner

KeithCu commented Feb 12, 2020

Currently the system fetches usually every hour, or every 6 hours (for sites that usually update just once per day.) It does this 24/7.

It should be possible to apply some machine learning per feed to have the system figure out when the site usually updates, and then only make requests around then. This could be done manually (by keeping track of a week's worth of updates), or by applying some machine learning algorithms. It would be great if it could keep learning over time.

This would also be better for the sites that update once per day, because it could try to catch them soon after they are usually posted, rather than up to 6 hours later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant