Automation Script is triggering "slider" captcha using uc mode and proxy

[cohnhead66]

I had a working automation script using standard selenium that was working for some time until the target web site was upgraded causing my automation to trigger a slider Captcha.

even if I solve it manually, it still throws a block.

I transitioned script to seleniumbase, using uc mode and proxy with authorization with the same results as I was getting with standard selenium. I am able to login and navigate as necessary until i get to the page where the captcha kicks in. Proxy is definitely working because every time i run script it reports a different ip.

Here is code:

from seleniumbase import Driver
driver = Driver(uc=True, proxy=proxy, undetectable=True, )
driver.uc_open_with_reconnect(webSite, reconnect_time=10)
driver.sleep(10)
driver.type("#lgUserName", memberNumber)
driver.type("#lgPassword", password+"\n")
driver.click("#hovDiv")
driver.sleep(5)
driver.click('a:contains('+memberName+')')
driver.sleep(5)
timer = driver.get_text('#tt1_left > p > span.serverClock > span > b',by="css selector")
print(timer)
driver.click('a:contains("21")') ### this triggers Captcha
driver.sleep(5)
input()
driver.quit()

Any help is appreciated. I think i am going to love using Seleniumbase if I can get a solution
I can share web site and log in credentials as needed to help solve.

[mdmintz]

If you need clicks to go undetected, try the UC Mode examples that click undetected:

• https://github.com/seleniumbase/SeleniumBase/blob/master/examples/raw_turnstile.py
• https://github.com/seleniumbase/SeleniumBase/blob/master/examples/raw_form_turnstile.py

That means you'll definitely need to use:

driver.uc_click(selector)

And maybe you'll need to use:

driver.reconnect(timeout)

Full UC Mode special method list:

driver.uc_open_with_tab(url)
driver.uc_open_with_reconnect(url, reconnect_time=None)
driver.reconnect(timeout)
driver.uc_click(selector)
driver.uc_switch_to_frame(frame)

UC Mode docs: SeleniumBase/help_docs/uc_mode.md

Make sure you're not using a proxy address that has already been blacklisted.
(Most of the ones found online on random sites have been.)

For combining UC Mode with manual actions, use "breakpoint" for the value of reconnect_time.
(More on that here: #2383 (comment) and #2384)

[cohnhead66]

Thanks for the fast response.

• Had already tried uc_click for all button clicks with no change
• Regarding driver.reconnect(timeout), when would you suggest i use that method
• Regarding proxy, paid proxy service so should be good, get a different ip address every time I run the script. Access site manually without using a proxy, without issue, so I know home ip is clean, and still get captcha with script without using proxy.

[mdmintz]

Use driver.reconnect(timeout) when you need to hide any trace of Selenium in the browser, usually after you perform actions if you haven't yet been detected.

A simple test would be:

driver.uc_open_with_reconnect(URL, "breakpoint")

Then perform manual actions while in the breakpoint and see if you were detected. If you weren't, then you know there's a way if you set the timings correctly and use uc_click() as needed. Type c and press ENTER to continue from the breakpoint.

[jkoestner]

@cohnhead66 did you ever figure this out?

[cohnhead66]

Not really. I believe the Captcha is triggered by using Chromium browser as opposed to Chrome. I found a Chrome extension for automation that didn't trigger the captcha and i am using that for now. Not nearly as flexible as a selenium solution, but it is working.

[vermaisrahul]

@cohnhead66 Please tell the solution and name the extension and your approach. I a facing same problem with datadome

[mdmintz]

See the examples for bypassing Datadome-protected sites with CDP Mode:

• examples/cdp_mode/raw_bestwestern.py
• examples/cdp_mode/raw_priceline.py

[cohnhead66]

CDP Mode is working for me and not triggering the captcha using a Windows machine without proxy. I have yet to try using linux as that is my preferred environment, but never was able to get past captcha in linux with UC Mode.

12/9 update -- CDP Mode works perfectly on Linux in either headed or headless mode. no need to use xvfb=true in my script. Also note, was able to use CDP Mode in a docker container hosted on google cloud with headded=false without triggering captcha. Everything working great. Thanks mdimintz.

[mdmintz]

On Linux, don't use headless mode. Use xvfb=True instead.
Also, GitHub Actions runs on residential IPs, so use that if you're blocked via IP Address.

[vermaisrahul]

@mdmintz Great Fan of yours, you have saved me a lot in last few days. Can we implement cdp in normal driver mode
like
driver = Driver(uc=True)

[mdmintz]

Driver() is for WebDriver. CDP Mode doesn't use WebDriver at all.