(Solved) Superbooga Blues - How to run? I've never been able to use this juicy feature :(

[nbollman]

Ive installed requirements.txt in Superbooga, and Whisper_stt requirements.txt

2023-10-12 16:18:46 ERROR:Failed to load the extension "superbooga".
Traceback (most recent call last):
  File "/home/jsnow/text-generation-webui/modules/extensions.py", line 36, in load_extensions
    exec(f"import extensions.{name}.script")
  File "<string>", line 1, in <module>
  File "/home/jsnow/text-generation-webui/extensions/superbooga/script.py", line 10, in <module>
    from .chromadb import add_chunks_to_collector, make_collector
  File "/home/jsnow/text-generation-webui/extensions/superbooga/chromadb.py", line 1, in <module>
    import chromadb
  File "/home/jsnow/miniconda3/envs/textgen/lib/python3.10/site-packages/chromadb/__init__.py", line 1, in <module>
    import chromadb.config
  File "/home/jsnow/miniconda3/envs/textgen/lib/python3.10/site-packages/chromadb/config.py", line 1, in <module>
    from pydantic import BaseSettings
  File "/home/jsnow/miniconda3/envs/textgen/lib/python3.10/site-packages/pydantic/__init__.py", line 218, in __getattr__    return _getattr_migration(attr_name)
  File "/home/jsnow/miniconda3/envs/textgen/lib/python3.10/site-packages/pydantic/_migration.py", line 294, in wrapper
    raise PydanticImportError(
pydantic.errors.PydanticImportError: `BaseSettings` has been moved to the `pydantic-settings` package. See https://docs.pydantic.dev/2.4/migration/#basesettings-has-moved-to-pydantic-settings for more details.
For further information visit https://errors.pydantic.dev/2.4/u/import-error

I tried updating pydantic, 'pip install -U pydantic' and then updated the call under chromadb/config.py from "from pydantic" to "from pydantic_settings"

Now Im getting this error...

2023-10-12 17:47:19 ERROR:Failed to load the extension "superbooga".
Traceback (most recent call last):
  File "/home/jsnow/text-generation-webui/modules/extensions.py", line 36, in load_extensions
    exec(f"import extensions.{name}.script")
  File "<string>", line 1, in <module>
  File "/home/jsnow/text-generation-webui/extensions/superbooga/script.py", line 10, in <module>
    from .chromadb import add_chunks_to_collector, make_collector
  File "/home/jsnow/text-generation-webui/extensions/superbooga/chromadb.py", line 1, in <module>
    import chromadb
  File "/home/jsnow/miniconda3/envs/textgen/lib/python3.10/site-packages/chromadb/__init__.py", line 8, in <module>
    __settings = chromadb.config.Settings()
AttributeError: partially initialized module 'chromadb' has no attribute 'config' (most likely due to a circular import)
/home/jsnow/miniconda3/envs/textgen/lib/python3.10/site-packages/gradio/components/dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: english or set allow_custom_value=True.
  warnings.warn(

This feels like progress? Am I on the right path? Can someone point me in the right direction?

[nbollman]

Anyone up for an installer guide for superbooga?

[nbollman]

Superbooga finally running!
Ive always manually created my text-generation-webui installs and they work with everything except superbooga. I suspect there may be some important information missing when running a manual install... so I tried an auto installler...
(Windows 11 WSL)
I had to delete my conda environment, proceeded with a fresh install, used the wsl.sh to autogenerate the environment, cloned the /env into 'textgen' for easy access, activated textgen environment, claude.ai wrote a script for me that will install all requirements.txt from the extensions folder (extentension-requirements.py):

import os
import subprocess
import sys

extensions_dir = 'extensions'
report_file = 'ext-req-report.txt'

with open(report_file, 'w') as f:
    f.write('Extension Requirements Report\n')
    f.write('=============================\n\n') 

for root, dirs, files in os.walk(extensions_dir):
    if 'requirements.txt' in files:
        extension = os.path.basename(root)
        print(f'Installing requirements for {extension}')
        
        result = subprocess.run(['pip', 'install', '-r', os.path.join(root, 'requirements.txt')], 
                                stdout=subprocess.PIPE, stderr=subprocess.PIPE, text=True)
        
        if result.stderr:
            f.write(f'{extension}:\n')
            f.write(result.stderr)
            f.write('\n\n')
            
        if result.stdout:
            print(result.stdout)import os
import subprocess
import sys

extensions_dir = 'extensions'
report_file = 'ext-req-report.txt'

with open(report_file, 'w') as f:
    f.write('Extension Requirements Report\n')
    f.write('=============================\n\n') 

for root, dirs, files in os.walk(extensions_dir):
    if 'requirements.txt' in files:
        extension = os.path.basename(root)
        print(f'Installing requirements for {extension}')
        
        result = subprocess.run(['pip', 'install', '-r', os.path.join(root, 'requirements.txt')], 
                                stdout=subprocess.PIPE, stderr=subprocess.PIPE, text=True)
        
        if result.stderr:
            f.write(f'{extension}:\n')
            f.write(result.stderr)
            f.write('\n\n')
            
        if result.stdout:
            print(result.stdout)

After that it worked* one last step had to run 'python -m spacy download en_core_web_sm' to get the model or spacy to work! Can't wait to see what comes next with superbooga! (time to toot my own horn)

[edwhiskey]

Thank you so much for your sharing. But I am a bit lost for your instruction.
It will be great if you can expand the steps for us to follow.
Thank you!

[realDGK]

i have never gotten superbooga to work, why is it even preloaded as an extension option if it takes this much effort to even work?

[GitHub1712]

Its not much work to install, its just an error in the installer because dependencies changed.

[GitHub1712]

For me it works after installing chromadb 0.3.29 and pydantic 1.10.13, now superbooga and superboogav2 are working.