Skip to content

2.0.168

Choose a tag to compare

View all tags
@metantonio metantonio released this 06 Nov 16:54
· 3 commits to master since this release
2.0.168
8a1485d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

QLX GPT 2.0.168 (with experimental features)

Important

Before install QLX-GPT be sure of:

  • Have installed CMake
  • Have installed 7zip
  • Have installed Visual Studio Community and during installation choose Universal Windows Platform development and C++ CMake tools for Windows.
  • By default QLX-GPT will use CPU for LLM inference, but if you want to use the GPU inference you will need to have installed CUDA (NVIDIA GPU needed for this, recommended with minimum of 8GB VRAM):
    • For Installer Type, choose exe (network).
    • During the installation, choose Custom (Advanced).
    • The only required components are:
    • Cuda
      • Runtime
      • Development
      • Integration with Visual Studio
    • Driver components
      • Display driver
  • SO: Windows 10/11 with 64-bits architecture
  • Have at least 15GB of free space on disk just to install QLX-GPT with default LLM, database, embedding models and vector store.
  • Have at least 16GB RAM.
  • CPU with AVX2 instruction capabilities if you are planning to use the CPU for LLM inference, or NVIDIA RTX GPU if you are planning to use the GPU for LLM inference.

Tip

After installation, when you execute QLX-GPT app for the very first time:

  • It will download a portable version of python for this specific app... be patient
  • Backend windows will rebuild some python libraries for your specific CPU/GPU.
  • LLM model and Embedding models will be downloaded, be patient.
  • First Time the relational database will need to be created; it will create it automatically with SQLite. If you want to use another, add the string connection to the .env file. Note that this database will register users, prompts and path to documents and embeddings, by default MySQL is supported, if need another you will need to install a python library to be able to connect to it.
  • On the front-end, create a new account (click on Have an account? ). Then upload any document for the first time, this will enable the LLM to answer

Each time you open the application:

  • Wait for backend to be ready (it could take 30-60 seconds).
  • When LLM is asked for the first time (each time you open the app) it could take some seconds, or minutes, to be loaded on memory depending on your hardware. After being loaded in memory, it will be running as intended depending on your hardware.

Warning

When you make updates through the automatic updater, please be sure to have closed the backend windows before install any updates. Failing on doing this could cause potential corruption of the application, making necessary uninstall it and re-install again.

[!Troubleshooting]
If need to reinstall the python libraries on the portable python version:

Navigate to the `C:/python_embedded` folder (or the corresponding path if you have changed it).
Open the installation_log.txt file
Change the variable to true: BuildLlama=True
Open the app normally. The libraries will be reinstalled automatically.

If need to reinstall or reset the local database (SQLite):

Navigate to the C:/python_embedded folder (or the corresponding path if you have changed it).
Open the installation_log.txt file
Change the variable to true: CreateDB=True
Navigate to the C:/ folder (or the corresponding path if you have changed it).
Delete the migration folder
Delete the qlxgpt.db file
Open the app normally. The database will be reinstalled automatically.

If the database was reset and you want to reset the vector store to forget the current knowledge, follow these steps:

Navigate to the C:/qlx_models/local_data/vectorDB folder (or the corresponding path if you have changed it).
Delete all the contents of the folder.
Vector store will be created the next time you ingest documents

Note

Changelogs 2.0.168-2.0.163:

  • Added Node Resize for Text Node
  • Improved logic when saving workflow json data for SSH Nodes
  • Improved visuals for SSH node terminal output
  • Improved visuals for Concatenation Text node.
  • Improved visuals for Text node.
  • General fix of known bugs

Changelogs 2.0.163-2.0.120:

  • Added the SSH Node (with backend and frontend functionalities)
  • Added Node Resize for Concatenation Text Node and SSH Node
  • Improved logic when loading workflow json data for SSH Nodes
  • Improved visuals
  • General fix of known bugs

Changelogs 2.0.120-2.0.109:

  • Enabled headers for the API Request Node
  • Enabled toggle side bar button for workflow
  • Improved workflow data that is being saved into a json file
  • Improved styles for easier reading
  • Added version text to welcome view.
  • Added License when installing for the first time.

Changelogs 2.0.108-2.0.98:

  • Added API Request Node, basic mode is able to do: GET, POST, PUT and PATCH Methods, using JSON format or equivalent Key-Value format. API's response can be use as output for the Concatenation Text Node and Prompting Node

Changelogs 2.0.97-2.0.62:

  • Added Text node
  • Added Concatenation node
  • Added dark, light and system theme
  • Refactorized nodeTypes and nodeVariables in one file
  • Added save and load buttons to save workspace into a json file locally.
  • Improved frontend logic when loading json files for the workspace

Changelogs 2.0.72-2.0.61:

  • Added prompt node
  • Prompt node works with socket connection, and now each node has separated socket thread
  • Added new functions and visualizations for workflow with nodes
  • Improved backend logic to manage sockets of each node

Changelogs 2.0.60:

  • Changed backend windows when open the app
  • Added ReactFlow library as main framework for nodes workflow
  • Added custom nodes and basic workflow window in electron to integrate ReactFlow to QLX-GPT

Changelogs 2.0.46-2.0.59:

  • Added new chunk text function for web scraping feature.
  • Changed Parsed body for more readability for the LLM

Changelogs 2.0.45:

  • Added feature to add directly to selected folder, the web scraping/youtube video to import.
  • Changed the user input, that was missing on recent updates.
  • Tested new option to write the folder's name.

Changelogs 2.0.30-2.0.42:

  • Added a parser for the web-scraping option, this should improve the readability of the websites for LLMs.
  • Added ftfy library to process non-unicode text
  • Added clean_utf8_text function
  • Added redundant text cleaning when injecting to vector database
  • Added cleaning function for characters not found due to language
  • Added more text cleaning features in based on printable characters
  • Added function to test utf-8 compatibility and extract website apparent encoding
  • Force utf-8 encoding when a document is ingested and then converted to binary

Changelogs 2.0.29:

  • Added web-scraping option, saving scraped websites into embeddings.

Changelogs 2.0.28 - 2.0.0:

  • Changed how updates are made making the process easier.
  • Added torch and torchvision for CPU/GPU, enabling experimental multi-modal vision, aiming to do OCR with it.
  • Eliminated notification when you have the latest version.
  • Added experimental tab, enabled only on development mode due to compatibility issues.
  • Added byaldi library.

Changelogs 1.12.0:

  • Changed where upload folder could be, can be changed at .env file

Changelogs 1.11.1:

  • Added bootstrap to the preloader, this should fix dropdowns and accordions behaviors.

Changelogs 1.11.0:

  • Vector store folder will be at C:\qlx_models\local_data path, this will help to keep the same vector store when installing updates.
  • The settings.yml file is changed to have C:\qlx_models\local_data as path for the vectorDB with qdrant

Changelogs 1.10.0:

  • Changed how initial installation is started, this was necessary when app is updated through updater.

Changelogs 1.9.0:

  • Database now will be at C:\ root, this will help to keep the same database when installing updates.
  • Python embedded changed to C:\, this will help to keep the same database when installing updates.
  • Added auto-updater
  • Refactorized some code in order to made easier future changes

Changelogs 1.8.0:

  • When you executed it for a second time, you had to press N on the backend window to complete the installation, now is automatic
  • The Installation and download of necessary files are now fully automatic when you open the app for the very first time.
  • The SQLite database installed on C:/Windows/System32 folder was changed to the project folder
  • The sensitive_words.json created at C:/Windows/System32 folder was changed to the project folder

Changelogs 1.6.0 and 1.7.0:

  • Fixed the download and open of documents with authentication for this desktop version

Changelogs 1.5.0:

  • Added execution policy
  • Added and implemented a semi-automatic setup of LLM when app is opened for the very first time.
Assets 7
Loading