Add captcha bypass, retry logic, and search improvements#26
Merged
thumpersecure merged 1 commit intomainfrom Feb 18, 2026
Merged
Add captcha bypass, retry logic, and search improvements#26thumpersecure merged 1 commit intomainfrom
thumpersecure merged 1 commit intomainfrom
Conversation
- Add captcha/block detection: scans responses for captcha indicators (recaptcha, hcaptcha, Cloudflare challenges, rate limit pages) and retries with exponential backoff and fresh headers - Add request_with_retry() wrapper with configurable max retries, exponential backoff, and Retry-After header support - Add DuckDuckGo HTML search fallback: when the Instant Answer API returns few/no results (common for phone numbers), falls back to scraping html.duckduckgo.com/html/ for actual web results - Add adaptive rate limiting (AdaptiveRateLimiter): automatically increases delays when blocks are detected and decreases on sustained success, replacing the fixed 3-5s random delay - Add requests.Session with connection pooling for better performance and less suspicious traffic patterns - Improve request headers: add Sec-Fetch-*, Accept-Encoding with br, randomized Accept-Language, optional Referer rotation, and separate API-tuned headers (get_api_headers) - Add result deduplication across all format groups by normalized URL - Fix mismatched parenthesis in phone format generation: replace the buggy "(215) 555-1234)" format with dot-separated "215.555.1234" - Update User-Agent strings to Chrome 122, Firefox 123, Safari 17.2 - Apply all improvements to telespotx.py async variant (v0.2-alpha): async_request_with_retry(), captcha detection, DDG HTML fallback, result deduplication, improved headers https://claude.ai/code/session_01E465rJBkinkSYJLBvJACJX
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
(recaptcha, hcaptcha, Cloudflare challenges, rate limit pages) and
retries with exponential backoff and fresh headers
exponential backoff, and Retry-After header support
returns few/no results (common for phone numbers), falls back to
scraping html.duckduckgo.com/html/ for actual web results
increases delays when blocks are detected and decreases on sustained
success, replacing the fixed 3-5s random delay
and less suspicious traffic patterns
randomized Accept-Language, optional Referer rotation, and separate
API-tuned headers (get_api_headers)
buggy "(215) 555-1234)" format with dot-separated "215.555.1234"
async_request_with_retry(), captcha detection, DDG HTML fallback,
result deduplication, improved headers