Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Priority List for provider #33

Closed
lucius100 opened this issue Apr 23, 2024 · 1 comment
Closed

Add Priority List for provider #33

lucius100 opened this issue Apr 23, 2024 · 1 comment

Comments

@lucius100
Copy link

Can we add priority list to the provider ?
I mean the order of scraping, instead of get data from the fastest provider, it will search the priority provider
for example
It will go first from r18-javdb-javdatabase-javlibrary in the way we arrange / setting the priority, because each site has different category / tags, make the data seems complicated

it will search first from r18, if no result it goes to javdb, then the next, not just random scraping the fastest.

@iamrony777
Copy link
Owner

it will search first from r18, if no result it goes to javdb, then the next, not just random scraping the fastest.

This approach will increase response time, but instead of prioritizing requests, I think I can prioritize responses. For example, fetch all responses at once, then return the result according to priority.

iamrony777 added a commit that referenced this issue May 1, 2024
- As discussed in #33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants