feat: add bark and AutoGPTQ

[mudler]

Description

This PR fixes #866 and partially #796

AutoGPTQ

It is a first stab at supporting AutoGPTQ. Note that there are further enhancements that can be done down the line, such as exposing more parameters and a revision branch where to pick the model from - however this is a first take at it laying down the funtamental pieces to make the link between LocalAI and AutoGPTQ using transformers.

Usage

via API endpoint:

curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
     "model": "TheBloke/orca_mini_v2_13b-GPTQ",
     "messages": [{"role": "user", "content": "### System:\nYou are an AI assistant that follows instruction extremely well. Help as much as you can.\n \n### User: \ntell me about AI \n### Response:"}],
     "backend": "autogptq", "model_base_name": "orca_mini_v2_13b-GPTQ-4bit-128g.no-act.order"
}'

Or configure the model in the YAML config file:

name: _your_model_name_
backend: autogptq
model_base_name: "orca_mini_v2_13b-GPTQ-4bit-128g.no-act.order"
parameters:
  model: "TheBloke/orca_mini_v2_13b-GPTQ"
# ...

Caveats:

• Token stream is not implemented yet, fallbacks to sending everything in the first batch

Bark

curl http://localhost:8080/tts -H "Content-Type: application/json" -d '{         
     "backend": "bark",
     "input":"Hello!"
   }' | aplay

To specify a model ( https://github.com/suno-ai/bark#-voice-presets ) pass it as model:

curl http://localhost:8080/tts -H "Content-Type: application/json" -d '{         
     "backend": "bark",
     "input":"Hello!",
     "model": "v2/en_speaker_1"
   }' | aplay

Notes for Reviewers

Signed commits

• Yes, I signed my commits.