Please help with remote webdriver

[tann3r4k]

I'm just so sorry if this is nooby or not the place to ask questions but I'm new to using seleniumbase & selenium and I'm afraid I'm just going to have to ask anyway l0lz...

I'm trying to deploy my project and I just started up a remote chrome node on railway (https://railway.app/template/XXPeWN)

Is it possible to actually go ahead and use it with the driver I already have kinda like this??

    from seleniumbase import Driver
    from selenium.webdriver.common.by import By


    driver = Driver(uc=True,
                    headless2=True,
                    remote_url='https://standalone-chrome-production-9873.up.railway.app',
                    port=4444)

Also sorry if if this is the complete wrong thing to be using but I tried to run this on another django deployment and it told me:
Chrome not found! Install it first!
Please tell me the right approach if I'm trying to do this completely wrong

Appreciate it,
Tanner

[mdmintz]

Duplicate of #2675 (comment) and #2285 (reply in thread).

See the Selenium Grid ReadMe SeleniumBase/seleniumbase/utilities/selenium_grid/ReadMe.md for using SeleniumBase with a Selenium Grid, and then see SeleniumBase/examples/capabilities for examples of configuring it.

(Note that Selenium Grid is not compatible with UC Mode.)

The original undetected-chromedriver doesn't support Selenium Grid either:
https://github.com/search?q=repo%3Aultrafunkamsterdam%2Fundetected-chromedriver+grid&type=issues

Selenium Grid is a problem for UC Mode because while the Grid controls chromedriver, the Grid does not have the root control that is needed. UC Mode requires raw control for modifying a local chromedriver (renamed to uc_driver), as well as for disconnecting the driver from Chrome, and reconnecting to it a short time later.

[tann3r4k]

Thanks for the quick reply and again, sorry if i'm misunderstanding how to use this entirely or it seems like i'm trying to use you as my personal chatgpt but can you tell me what I'm doing wrong real quick? This is the code i'm using:

   from seleniumbase import Driver
    from selenium.webdriver.common.by import By


    driver = Driver(servername='standalone-chrome-production-9873.up.railway.app', port=4444)

but it ends up telling me:

 urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='standalone-chrome-production-9873.up.railway.app', port=4444): Max retries exceeded w
ith url: /wd/hub/session (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x0000018B71A2AD90>, 'Connection to standalone-chrome-production-9873.up.railway.app timed out. (connect timeout=None)'))

It seems to be working fine as I can see the website perfectly fine at https://standalone-chrome-production-9873.up.railway.app/grid/console and the last line in the logs is:

07:19:27.956 INFO [Standalone.execute] - Started Selenium Standalone 4.22.0 (revision c5f3146703): http://10.250.15.240:4444/

Again, sorry if it seems like i'm using you as a personal chatgpt but after reading the grid readme, I'm still pretty confused as i'm not using pytest and not exactly sure where I would even run those commands for example: (seleniumbase grid-hub {start|stop|restart} [OPTIONS]) Would it be in the django server which has the view that would be starting the driver? Or do I have to create another dockerfile deployment just for that?

Thanks so much,
Tanner

[mdmintz]

If your railway link is a valid Selenium Grid on a server that accepts incoming network connections, then it should work if you provide the correct address and the correct port. Check your connection details.

It's easy to spin up your own Selenium Grid for testing:
seleniumbase grid-hub start
seleniumbase grid-node start

[tann3r4k]

Hey so I managed to get it working, but what would you recommend to bypass the cloudflare turnstile if you can't use UC mode with a selenium grid?

[juanfrilla]

seleniumbase grid-hub start
seleniumbase grid-node start

@mdmintz Do I need to add those commands? Can't I connect to an existing launched selenium grid through docker-compose?
It looks that I can't with this:

driver = Driver(
    browser="chrome",
    servername="http://juanito:5678@127.0.0.1",
    port=4444,
    headless=False,
)

driver.get("https://google.com/ncr")

where my remote url of my running grid is this remote_url = http://juanito:5678@127.0.0.1:4444

[mdmintz]

I spun up a Selenium Grid on localhost, and this was enough to connect to it:
driver = Driver(servername="127.0.0.1:4444", port="4444")
Make sure your Selenium Grid is accepting connections.