It's a Chrome extension that allows you to summarize any article.
Performance and ease of use are at the core of Nyxt.
It's powered NVIDIA® TensorRT LLM, enabling nearly instantaneous summaries.
Nyxt features beautiful, soothing animations as summaries are generated.
Nyxt is built with accessibility in mind.
- You could increase and decrease font sizes
- You could scale the window to your liking
- Nyxt's typeface of choice is Atkinson Hyperlegible. A font optimized for readability, created by the Braille Institute.
I've made every effort to make the installation process as easy as possible.
Here's a Youtube video showcasing how to install Nyxt: https://www.youtube.com/watch?v=QJt7szR6kxw
In summary ;)
Download and run the setup.ps1 powershell script as as administrator. https://www.nyxt.ai/setup.ps1
- This will install all TensorRT LLM dependencies (aside from cuDNN).
- It'll also download the extension, inference server and its required tokenizer and engine. These will be downloaded from huggingface. https://huggingface.co/thisisphan/nyxt
- You could skip any dependencies you already have by using flags when calling the script
Available flags
-skipCUDA,
-skipPython,
-skipMPI,
-skipGit,
-skipLFS
Ex:
.\setup.ps1 -skipCUDA -skipPython
Download and install cuDNN version 8.9.7
- Create an Nvidia developer account.
- Download cuDNN 8.9.7 zip
- https://developer.nvidia.com/downloads/compute/cudnn/secure/8.9.7/local_installers/12.x/cudnn-windows-x86_64-8.9.7.29_cuda12-archive.zip/
- Unzip the file
- Create a folder named cuDNN at C:\
- Copy bin/ and lib/ to C:\cuDNN\
- Add these folders to the system path
- https://www.architectryan.com/2018/03/17/add-to-the-path-on-windows-10/
- The paths that you add should be:
- C:\cudNN\bin
- C:\cuDNN\lib
Install the extension
- Go to chrome extension -> manage extension
- load unpack
- go to the nyxt/ folder downloaded by
setup.ps1
- load the nyxt/extension/ folder.
This project was created for the Nvidia Gen AI on RTX PCs contest.
It's submitted under the Text-Based Applications category.
It utilizes TensorRT LLM + Mistral 7b 4bit to allow for nearly instaneous summaries.
https://www.nvidia.com/en-us/ai-data-science/generative-ai/rtx-developer-contest/
- Windows 10
- TensorRT LLM 0.7.1
- Python 3.10.11
- Cuda 12.2
- cuDNN 8.9.7
- MPI 10.1.1
RTX 4090
However, the engine provided should work on any Ada series GPU.
Powershell installation script failed.
You could perform all the steps the installation script goes through manually:
- Install TensorRT LLM dependencies
- Cuda 12.2
- Microsoft MPI 10.11.1
- Python 3.10.11
- cuDNN 8.9.7
- TensorRT LLM 0.7.1
- Clone the Nyxt huggingface repo that contains everything needed to install the extension and run the inference server: https://huggingface.co/thisisphan/nyxt
- Install Git and Git LFS
- cd into the cloned directory and run
pip install -r requirements.txt
- Run the inference server with
python server.py
(Be sure to disable Powershell quick edit mode so you don't accidentally pause the inference server!) - Install the extension
- Open chrome -> settings -> extension -> manage extensions.
- Enable developer mode
- Click on "load unpacked", load the folder named
extension
inside of the nyxt cloned repo.
- Done!
The extension is perma loading.
This probably is because Powershell quick edit is on and you've accidentally clicked inside the powershell window, which pauses the inference server.
You could right click the powershell window title -> properties -> disable quick edit mode.
Re run the script, refresh the page, and regenerate the summary.