Huge bug in undetected-chromedriver v2 #384

Avnsx · 2021-12-05T00:19:56Z

it's unironically so big that I can't even load up undetected chromedriver v2 with the basic code from your ReadMe

import undetected_chromedriver.v2 as uc
driver = uc.Chrome()
driver.get('https://nowsecure.nl')

ouput:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\spawn.py", line 125, in _main
    prepare(preparation_data)
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "C:\ProgramData\Miniconda3\lib\runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "C:\ProgramData\Miniconda3\lib\runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "C:\ProgramData\Miniconda3\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\canmi\Desktop\seleniumwire_red.py", line 391, in <module>
    driver = uc.Chrome()
  File "C:\ProgramData\Miniconda3\lib\site-packages\undetected_chromedriver\v2.py", line 299, in __init__
    self.browser_pid = start_detached(options.binary_location, *options.arguments)
  File "C:\ProgramData\Miniconda3\lib\site-packages\undetected_chromedriver\dprocess.py", line 30, in start_detached
    multiprocessing.Process(target=_start_detached, args=(executable, *args), kwargs={'writer': writer},
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\process.py", line 121, in start
    self._popen = self._Popen(self)
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\context.py", line 224, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\context.py", line 327, in _Popen
    return Popen(process_obj)
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\popen_spawn_win32.py", line 45, in __init__
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "C:\ProgramData\Miniconda3\lib\multiprocessing\spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Exception ignored in: <function Chrome.__del__ at 0x000001EBDEECB1F0>
Traceback (most recent call last):
  File "C:\ProgramData\Miniconda3\lib\site-packages\undetected_chromedriver\v2.py", line 647, in __del__
  File "C:\ProgramData\Miniconda3\lib\site-packages\undetected_chromedriver\v2.py", line 604, in quit
AttributeError: 'Chrome' object has no attribute 'service'

I did find a solution and that is just writing it into main:

if __name__ == '__main__':
    import undetected_chromedriver.v2 as uc
    driver = uc.Chrome()
    driver.get('https://nowsecure.nl')

but this is unacceptable and it is restricting me in freely formatting my code, also forcing me to use an entry point.
I'm encountering this bug in latest version of uc v2 and python 3.8.10 for windows 10
Please fix this as soon as possible @ultrafunkamsterdam 🙏🏼

crane-denny · 2021-12-05T11:26:31Z

@ultrafunkamsterdam
For some reasons I don't understand yet you are spawning a second instance of Chrome. At least I assume this because of a new user-data-dir. And the moment this happens it breaks.

I am now not sure what to do next. It could be that this lib is really not selenium 4 ready like you said in the readme. But then I would expect it to be set in setup.py to avoid conflicts.
I will leave this up to your hands since you know your code better then me. :)

wildangunawan · 2021-12-11T12:18:19Z

Downgrade to 3.0.3 as in this issue suggestion.

Also don't use Python 3.10 if you don't want to face another undetected-chromedriver bug

koljaoh · 2021-12-15T18:38:33Z

Hope this gets a real fix soon (there are reasons why I can't use 3.0.3 and the if name == 'main': doesnt work in all cases)

ultrafunkamsterdam · 2021-12-22T13:26:42Z

all fixed

Charcadet · 2021-12-23T13:58:08Z

all fixed

I'm still having the same issue.
UC 3.1.1
Python 3.7.8

import undetected_chromedriver as uc
driver = uc.Chrome()
driver.get('https://nowsecure.nl')

Gives me:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 105, in spawn_main
    exitcode = _main(fd)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 114, in _main
    prepare(preparation_data)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 225, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 277, in _fixup_main_from_path
    run_name="__mp_main__")
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 263, in run_path
    pkg_name=pkg_name, script_name=fname)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 96, in _run_module_code
    mod_name, mod_spec, pkg_name, script_name)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Users\Rico\Downloads\auto-bumper-master\auto-bumper\test.py", line 2, in <module>
    driver = uc.Chrome()
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 339, in __init__
    self.browser_pid = start_detached(options.binary_location, *options.arguments)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\dprocess.py", line 34, in start_detached
    daemon=True,
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\process.py", line 112, in start
    self._popen = self._Popen(self)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\context.py", line 223, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\context.py", line 322, in _Popen
    return Popen(process_obj)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\popen_spawn_win32.py", line 46, in __init__
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 143, in get_preparation_data
    _check_not_importing_main()
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 136, in _check_not_importing_main
    is not going to be frozen to produce an executable.''')
RuntimeError:
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Exception ignored in: <function Chrome.__del__ at 0x000002862E2C5948>
Traceback (most recent call last):
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 583, in __del__
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 539, in quit
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 367, in __getattribute__
AttributeError: 'Chrome' object has no attribute 'service'

ultrafunkamsterdam · 2021-12-23T15:07:30Z

you are clearly having multiple versions installed and not using the correct one.
"undetected_chromedriver\v2.py", line 604, in quit..."
v2.py only has 3 lines

TheCamer1 · 2021-12-23T15:21:02Z

I am having exactly the same error, I'm on a fresh install of python 3.10 and undetected-chromedriver 3.0.3. @ultrafunkamsterdam could you please explain what the correct version is? I've been trying every answer in all these threads on this issue and it is not solving it.

Charcadet · 2021-12-23T15:41:46Z

you are clearly having multiple versions installed and not using the correct one. "undetected_chromedriver\v2.py", line 604, in quit..." v2.py only has 3 lines

Even after fully uninstalling undetected_chromedriver

C:\Users\Rico>pip uninstall undetected_chromedriver
Found existing installation: undetected-chromedriver 3.1.1
Uninstalling undetected-chromedriver-3.1.1:
  Would remove:
    c:\users\rico\appdata\local\programs\python\python37\lib\site-packages\undetected_chromedriver-3.1.1-py3.7.egg-info
    c:\users\rico\appdata\local\programs\python\python37\lib\site-packages\undetected_chromedriver\*
Proceed (y/n)? y
  Successfully uninstalled undetected-chromedriver-3.1.1

C:\Users\Rico>pip uninstall undetected_chromedriver
WARNING: Skipping undetected-chromedriver as it is not installed.

PS C:\Users\Rico\Downloads\auto-bumper-master\auto-bumper> py .\test.py
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 105, in spawn_main
    exitcode = _main(fd)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 114, in _main
    prepare(preparation_data)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 225, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 277, in _fixup_main_from_path
    run_name="__mp_main__")
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 263, in run_path
    pkg_name=pkg_name, script_name=fname)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 96, in _run_module_code
    mod_name, mod_spec, pkg_name, script_name)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Users\Rico\Downloads\auto-bumper-master\auto-bumper\test.py", line 2, in <module>
    driver = uc.Chrome()
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 339, in __init__
    self.browser_pid = start_detached(options.binary_location, *options.arguments)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\dprocess.py", line 34, in start_detached
    daemon=True,
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\process.py", line 112, in start
    self._popen = self._Popen(self)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\context.py", line 223, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\context.py", line 322, in _Popen
    return Popen(process_obj)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\popen_spawn_win32.py", line 46, in __init__
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 143, in get_preparation_data
    _check_not_importing_main()
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\multiprocessing\spawn.py", line 136, in _check_not_importing_main
    is not going to be frozen to produce an executable.''')
RuntimeError:
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Exception ignored in: <function Chrome.__del__ at 0x00000239F56F58B8>
Traceback (most recent call last):
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 583, in __del__
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 539, in quit
  File "C:\Users\Rico\AppData\Local\Programs\Python\Python37\lib\site-packages\undetected_chromedriver\__init__.py", line 367, in __getattribute__
AttributeError: 'Chrome' object has no attribute 'service'

This is still the code:

import undetected_chromedriver as uc
driver = uc.Chrome()
# known url using cloudflare's "under attack mode"
driver.get('https://nowsecure.nl')

Python 3.7.8 (tags/v3.7.8:4b47a5b6ba, Jun 28 2020, 08:53:46) [MSC v.1916 64 bit (AMD64)] on win32
Windows 10 Pro Version 20H2 (19043.928)
undetected-chromedriver-3.1.1

ultrafunkamsterdam · 2021-12-23T16:50:08Z

1 - A script called test.py is not a great idea.
2 - In fact this makes perfect sense.
Your program is simply exiting before chrome is fully spawned. if your program exits, chromedriver exits.. never been different except for the error, which is justifyable since some multiprocess black magic makes sure Chrome has no parent process.

It seems to me that what you're really looking for is a interactive session.
in that case, use ipython.

That all being said. I was able to reproduce, although it being an edge case, I have a "fix" for this, but i need to test it first. will commit later.

Charcadet · 2021-12-23T18:01:02Z

1 - A script called test.py is not a great idea. 2 - In fact this makes perfect sense. Your program is simply exiting before chrome is fully spawned. if your program exits, chromedriver exits.. never been different except for the error, which is justifyable since some multiprocess black magic makes sure Chrome has no parent process.

It seems to me that what you're really looking for is a interactive session. in that case, use ipython.

That all being said. I was able to reproduce, although it being an edge case, I have a "fix" for this, but i need to test it first. will commit later.

Even when running my main project I'm trying to use this with, which doesn't insta exit and is pretty long it doesn't run at all and throws the same error. Works fine with just selenium.

sunny9495-dev · 2022-01-26T08:34:15Z

Temporary Solution :
Install Python 3.7.9
Install 3.0.3(pip install -Iv undetected-chromedriver==3.0.3)
Use the code
import undetected_chromedriver.v2 as uc
driver = uc.Chrome(executable_path=r'drivers/chromedriver.exe', options=options, version_main=97)

Avnsx · 2022-01-26T10:54:34Z

Temporary Solution : Install Python 3.7.9 Install 3.0.3(pip install -Iv undetected-chromedriver==3.0.3) Use the code import undetected_chromedriver.v2 as uc driver = uc.Chrome(executable_path=r'drivers/chromedriver.exe', options=options, version_main=97)

Nah he actually fixed it in newest version, you just have to write uc.Chrome(use_subprocess=True)

sunny9495-dev · 2022-01-26T10:58:45Z

Temporary Solution : Install Python 3.7.9 Install 3.0.3(pip install -Iv undetected-chromedriver==3.0.3) Use the code import undetected_chromedriver.v2 as uc driver = uc.Chrome(executable_path=r'drivers/chromedriver.exe', options=options, version_main=97)

Nah he actually fixed it in newest version, you just have to write uc.Chrome(use_subprocess=True)

Tried with 3.1.3, didnt worked Avnsx, all the time i get
Error Permission denied 13 chromedriver.exe
whenever i select more than 1 thread

Avnsx · 2022-02-26T16:14:24Z

Temporary Solution : Install Python 3.7.9 Install 3.0.3(pip install -Iv undetected-chromedriver==3.0.3) Use the code import undetected_chromedriver.v2 as uc driver = uc.Chrome(executable_path=r'drivers/chromedriver.exe', options=options, version_main=97)

Nah he actually fixed it in newest version, you just have to write uc.Chrome(use_subprocess=True)

Tried with 3.1.3, didnt worked Avnsx, all the time i get Error Permission denied 13 chromedriver.exe whenever i select more than 1 thread

Error Permission denied 13 chromedriver.exe

not an issue with UC, but with your threading code

st681 · 2022-03-15T07:18:06Z

Temporary Solution : Install Python 3.7.9 Install 3.0.3(pip install -Iv undetected-chromedriver==3.0.3) Use the code import undetected_chromedriver.v2 as uc driver = uc.Chrome(executable_path=r'drivers/chromedriver.exe', options=options, version_main=97)

Nah he actually fixed it in newest version, you just have to write uc.Chrome(use_subprocess=True)

Fixed for me. Thank you so much bro !

JMJAJ · 2022-04-11T17:03:09Z

Guys, I love u. This help so much. Thanks

shafeeralip · 2022-09-29T05:19:35Z

Temporary Solution : Install Python 3.7.9 Install 3.0.3(pip install -Iv undetected-chromedriver==3.0.3) Use the code import undetected_chromedriver.v2 as uc driver = uc.Chrome(executable_path=r'drivers/chromedriver.exe', options=options, version_main=97)

Nah he actually fixed it in newest version, you just have to write uc.Chrome(use_subprocess=True)

Fixed for me Thank you

Avnsx changed the title ~~Huge bug in undetected-chromedriver~~ Huge bug in undetected-chromedriver v2 Dec 5, 2021

crane-denny mentioned this issue Dec 5, 2021

FileNotFoundError when creating Chrome driver #378

Closed

Avnsx mentioned this issue Dec 5, 2021

enable_cdp_events not working with execute_cdp_cmd in uc v2 #387

Closed

ultrafunkamsterdam closed this as completed Dec 23, 2021

Avnsx mentioned this issue Jan 3, 2022

Same RuntimeError in "fixed" 3.1.3 version as before #432

Closed

wanghaisheng mentioned this issue Apr 18, 2022

RuntimeError by running the basic example #570

Open

Andrej-VB mentioned this issue May 5, 2022

Runtime Error w/ Suggested Usage #621

Open

sebdelsol mentioned this issue May 5, 2022

UC chromedriver doesn't run if called from another script #622

Open

sebdelsol mentioned this issue May 15, 2022

I keep getting this error when i run this code #628

Open

sebdelsol mentioned this issue Jun 2, 2022

Not Support all options like webdriver #660

Open

useragents mentioned this issue Dec 7, 2022

lol useragents/Zefoy-TikTok-Automator#50

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Huge bug in undetected-chromedriver v2 #384

Huge bug in undetected-chromedriver v2 #384

Avnsx commented Dec 5, 2021 •

edited

crane-denny commented Dec 5, 2021

wildangunawan commented Dec 11, 2021

koljaoh commented Dec 15, 2021

ultrafunkamsterdam commented Dec 22, 2021

Charcadet commented Dec 23, 2021 •

edited

ultrafunkamsterdam commented Dec 23, 2021

TheCamer1 commented Dec 23, 2021

Charcadet commented Dec 23, 2021

ultrafunkamsterdam commented Dec 23, 2021

Charcadet commented Dec 23, 2021

sunny9495-dev commented Jan 26, 2022 •

edited

Avnsx commented Jan 26, 2022

sunny9495-dev commented Jan 26, 2022 •

edited

Avnsx commented Feb 26, 2022

st681 commented Mar 15, 2022

JMJAJ commented Apr 11, 2022

shafeeralip commented Sep 29, 2022

Huge bug in undetected-chromedriver v2 #384

Huge bug in undetected-chromedriver v2 #384

Comments

Avnsx commented Dec 5, 2021 • edited

crane-denny commented Dec 5, 2021

wildangunawan commented Dec 11, 2021

koljaoh commented Dec 15, 2021

ultrafunkamsterdam commented Dec 22, 2021

Charcadet commented Dec 23, 2021 • edited

ultrafunkamsterdam commented Dec 23, 2021

TheCamer1 commented Dec 23, 2021

Charcadet commented Dec 23, 2021

ultrafunkamsterdam commented Dec 23, 2021

Charcadet commented Dec 23, 2021

sunny9495-dev commented Jan 26, 2022 • edited

Avnsx commented Jan 26, 2022

sunny9495-dev commented Jan 26, 2022 • edited

Avnsx commented Feb 26, 2022

st681 commented Mar 15, 2022

JMJAJ commented Apr 11, 2022

shafeeralip commented Sep 29, 2022

Avnsx commented Dec 5, 2021 •

edited

Charcadet commented Dec 23, 2021 •

edited

sunny9495-dev commented Jan 26, 2022 •

edited

sunny9495-dev commented Jan 26, 2022 •

edited