Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom scheduling based on metadata #283

Closed
jnioche opened this issue May 6, 2016 · 2 comments
Closed

Custom scheduling based on metadata #283

jnioche opened this issue May 6, 2016 · 2 comments
Assignees
Milestone

Comments

@jnioche
Copy link
Member

jnioche commented May 6, 2016

The default scheduler determines when a page should be re-fetched based on its status only and the same value is used regardless of the nature of a page e.g. RSS feed, sitemap, content page etc...

We could add a basic mechanism where a page could use an arbitrary key value in its metadata to set its nextFetchDate when it has been successfully fetched.

@jnioche jnioche self-assigned this May 6, 2016
@jnioche jnioche added this to the 0.10 milestone May 6, 2016
@jnioche
Copy link
Member Author

jnioche commented Jun 8, 2016

This could be used initially for #291 so that feed URLs get refetched more frequently than the pages they point to

jnioche added a commit that referenced this issue Jun 9, 2016
@jnioche
Copy link
Member Author

jnioche commented Jun 9, 2016

Implemented in [e3ed3bb]

# custom fetch interval to be used when a document has the key/value in its metadata
# and has been fetched succesfully (value in minutes)
# fetchInterval.isFeed=true: 10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant