Skip to content
This repository has been archived by the owner on Sep 15, 2024. It is now read-only.

Custom Endpoint Groq not Working [Bug] #305

Open
1 of 3 tasks
senja24 opened this issue Mar 7, 2024 · 6 comments
Open
1 of 3 tasks

Custom Endpoint Groq not Working [Bug] #305

senja24 opened this issue Mar 7, 2024 · 6 comments
Labels
bug Something isn't working todo

Comments

@senja24
Copy link

senja24 commented Mar 7, 2024

Bug Description

Screenshot_2024-03-07-22-11-38-803_com android chrome
Just set custom endpoint for groq but its not working

Stuck over there
Screenshot_2024-03-07-22-11-51-623_com android chrome

Steps to Reproduce

  1. Enable custom endpoint
  2. Input groq api key
  3. Set endpoint https://api.groq.com/openai/
  4. Custom model mixtral-8x7b-32768,llama2-70b-4096

Expected Behavior

Working as fine. Get result fast

Screenshots

No response

Deployment Method

  • Docker
  • Vercel
  • Server

Desktop OS

No response

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

@senja24 senja24 added the bug Something isn't working label Mar 7, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: Custom Endpoint Groq not Working [Bug]

@H0llyW00dzZ
Copy link
Owner

Bug Description

Screenshot_2024-03-07-22-11-38-803_com android chrome Just set custom endpoint for groq but its not working

Stuck over there Screenshot_2024-03-07-22-11-51-623_com android chrome

Steps to Reproduce

  1. Enable custom endpoint
  2. Input groq api key
  3. Set endpoint https://api.groq.com/openai/
  4. Custom model mixtral-8x7b-32768,llama2-70b-4096

Expected Behavior

Working as fine. Get result fast

Screenshots

No response

Deployment Method

  • Docker
  • Vercel
  • Server

Desktop OS

No response

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

This isn't a bug. I had disabled it before, but I might enable it again when I have free time.

@H0llyW00dzZ
Copy link
Owner

H0llyW00dzZ commented Mar 7, 2024

@senja24 try turn off/untick this for now, that you using custom model

image

@senja24
Copy link
Author

senja24 commented Mar 7, 2024

Screenshot_2024-03-08-05-18-45-650_com android chrome
Already did to try this and same. Cannot using custom endpoint

@Scipline
Copy link

I have the same problem.Specifying provider information directly in the customModels string is not supported. Provider information needs to be specified through predefined models.

@H0llyW00dzZ
Copy link
Owner

I haven't addressed this issue yet, as I'm currently focusing on full-stack Golang development.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working todo
Projects
None yet
Development

No branches or pull requests

4 participants