Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Selectable browser / ability to add extra browser connections (good for scraping browsers etc) #1943

Merged
merged 19 commits into from
Nov 13, 2023

Conversation

dgtlmoon
Copy link
Owner

@dgtlmoon dgtlmoon commented Nov 7, 2023

It will be possible to connect with special scraping browsers as supplied by Bright Data and Oxylabs

Often many websites will attempt to fingerprint the actual browser hardware to detect if its a robot or not, as well as, BrightData and others offer built in 'touch and hold' type captcha fixing (or other captcha beating methods)

This is different to a 'proxy'

This will be an extra config below 'proxies' - just paste in the URL

image

Then you can select which Browser you want the watch to use

image

I can confirm this works so far with https://www.totalwine.com/search/all?text=eh%20taylor and bright data's scraping browser as the setting.

image

todo

  • needs internal test code
  • misc tidyups around error catching
  • tweak css for field layout on small viewports

@dgtlmoon dgtlmoon merged commit 5229094 into master Nov 13, 2023
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant