Skip to content

issues Search Results · repo:hyperonym/basaran language:Python

Filter by

59 results
 (90 ms)

59 results

inhyperonym/basaran (press backspace or delete to remove)

hyperonym/basaran
401 error on llama2 model while access granted

Hello, Trying to get llama-2-7b-chat-hf working but getting this error : docker run -p 80:80 -e MODEL=meta-llama/Llama-2-7b-chat-hf hyperonym/basaran:0.21.1 Traceback (most recent call last): File /usr/local/lib/python3.8/dist-packages/huggingface_hub/utils/_errors.py ...
question
  • tomtomtomtom44
  • Opened 
    on Dec 16, 2023
  • #289

hyperonym/basaran
Runpod Serverless

Is there a plan or an implementation of basaran for the runpod serverless environment?
question
  • stonejohnson
  • 1
  • Opened 
    on Dec 15, 2023
  • #288

hyperonym/basaran
Loading basaran on multiple gpus leads to error

Getting error: RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1! I am running basaran with default params and llama 2 model.
question
  • tanmaylaud
  • Opened 
    on Nov 30, 2023
  • #280

hyperonym/basaran
Can you create a Gradio app for this Trained model

Can you create a Gradio app for this Trained model
  • yhammadmufin
  • Opened 
    on Nov 14, 2023
  • #276

hyperonym/basaran
Suggestion: Passthrough to OpenAI GPT3.5 for testing

If you could just pass on requests to OpenAI, you d have a quicker way to test connecting apps.
  • FetchFast
  • Opened 
    on Nov 1, 2023
  • #273

hyperonym/basaran
Tried multiple different models but get "The model weights are not tied..." error every time..

Hi, I m running Basaran via Docker and I have now tried using several different models at this point but every time after its downloaded and load everything, I m facing with this error: The model weights ...
question
  • jontstaz
  • Opened 
    on Sep 30, 2023
  • #266

hyperonym/basaran
Strong need for multiple `models` in a single deployment

As mentioned in #179, users need multiple models. On a multi-GPU on-prem machine, I want to write a config file that s like: CUDA_VISIBLE_DEVICES=0 MODEL=meta-llama/Llama-2-7b-chat-hf CUDA_VISIBLE_DEVICES=1,2,3 ...
enhancement
  • KastanDay
  • 3
  • Opened 
    on Sep 21, 2023
  • #263

hyperonym/basaran
Use basaran API as Langchain LLM

Is there already any support to use the basaran API as an LLM in Langchain?
question
  • brightebyte
  • Opened 
    on Sep 8, 2023
  • #256

hyperonym/basaran
TypeError: issubclass() arg 1 must be a class

I m getting this error with version 0.21.1 docker run -p 80:80 -e MODEL=smallcloudai/Refact-1_6B-fim -e MODEL_TRUST_REMOTE_CODE=true hyperonym/basaran:0.21.1 but not with version 0.19.0 docker run -p ...
bug
  • gsuuon
  • 1
  • Opened 
    on Sep 4, 2023
  • #253

hyperonym/basaran
How to send Audio Inputs to the Basaran

Hi Team, I am trying to replicate this text-completion behaviour with OpenAI Whisper Model, how can I send audio inputs to the basaran so that it can generate streaming output
enhancement
  • Tushar-ml
  • 3
  • Opened 
    on Jul 27, 2023
  • #234
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub