Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@hiro-v
Copy link
Contributor

@hiro-v hiro-v commented Dec 16, 2023

Follow up on #205 - #59

Changes:

  • CI on all platforms for new build with llama.cpp and whisper.cpp with e2e testing
  • OpenAI compatible API - see audio.md
  • Acceleration - Mac silicon with Metal & CoreML
  • Acceleration - Windows/ Linux on CUDA with Cublas
  • Normal x86 support for Mac/ Windows/ Linux
  • Tested with 1 LLM and 1 audio running at once

Reference

@hiro-v hiro-v added P1: important Important feature / fix type: feature request A new feature labels Dec 16, 2023
@hiro-v hiro-v self-assigned this Dec 16, 2023
@hiro-v hiro-v marked this pull request as draft December 16, 2023 05:55
@hiro-v hiro-v changed the title feat: Add /v1/audio/transcriptions with llama.cpp feat: Add /v1/audio/transcriptions and /v1/audio/translations with llama.cpp Dec 17, 2023
@hiro-v hiro-v changed the title feat: Add /v1/audio/transcriptions and /v1/audio/translations with llama.cpp feat: Add /v1/audio/transcriptions and /v1/audio/translations with whisper.cpp Dec 17, 2023
@hiro-v hiro-v added this to the Jan can Hear milestone Dec 20, 2023
@freelerobot freelerobot removed this from the Jan can Hear milestone Jan 15, 2024
@hiro-v hiro-v marked this pull request as ready for review January 26, 2024 17:12
Copy link
Contributor

@tikikun tikikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hiro-v hiro-v merged commit 1d3798d into main Jan 28, 2024
@hiro-v hiro-v deleted the feat/nitro_whisperccp branch January 30, 2024 16:37
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

P1: important Important feature / fix type: feature request A new feature

Projects

No open projects
Archived in project

Development

Successfully merging this pull request may close these issues.

4 participants