Feature Request: Add rate limit for URL based on regex #2282
boydaihungst
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The reason is there are some webs which have rate limit 1, that means only 1 site load at a time/IP. So we have to manually recheck for those sites (e.g, import multiple https://subscene.com links). Retry also an option, but it could lead to bad result if we have too many URLs (e.g: temporary banned, trigger cloudflare). So we need an option to set rate limit or queue check. This feature could affect
time between check
when we have many URLs in queue list.Rate limit can capture use regex: e.g:
/.*github.com.*/
, and an Input box type=number for how many request of URLs, which matched this regex, at a time. (-1 or 0 unlimited)Beta Was this translation helpful? Give feedback.
All reactions