Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add LLM Toolkit #1259

Merged
merged 18 commits into from
May 12, 2024
Merged

Add LLM Toolkit #1259

merged 18 commits into from
May 12, 2024

Conversation

yogeshojha
Copy link
Owner

@yogeshojha yogeshojha commented May 12, 2024

Forked from @ErdemOzgen PR #1116

Original Work from @ErdemOzgen

* Added ollama with docker container
* GPTVulnerabilityReportGenerator : Retrieves an OpenAI API key and sets the model to 'gpt-3.5-turbo'. If the API key is not available, it initializes an Ollama instance for local use.
* GPTAttackSuggestionGenerator: Similar to the GPTVulnerabilityReportGenerator, it retrieves an OpenAI API key and sets the model to 'gpt-3.5-turbo', or initializes an Ollama instance if the API key is not available.
* Changed makefile make up and make down sections.
* After docker container up it will run command to pull llama2-uncensored llm model and serve model 

Changes

  • Modified it to have LLM toolkit that allows us to download and update models from the UI
  • Allows selection of models between OpenAI GPT and Locally Installed models such as llama2.
  • Allows deleting the locally installed models

@ErdemOzgen
Copy link
Contributor

Fantastic work thanks a lot mate

@yogeshojha yogeshojha changed the title Add LLM Toolkit DRAFT: Add LLM Toolkit May 12, 2024
@yogeshojha yogeshojha changed the title DRAFT: Add LLM Toolkit Add LLM Toolkit May 12, 2024
@yogeshojha yogeshojha merged commit 56da132 into release/2.1.0 May 12, 2024
1 check passed
@yogeshojha yogeshojha mentioned this pull request May 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants