Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Multilang Subtitles for Videos using AI Models #184

Open
1 task done
swve opened this issue Mar 31, 2024 · 0 comments
Open
1 task done

Support Multilang Subtitles for Videos using AI Models #184

swve opened this issue Mar 31, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed javascript Pull requests that update Javascript code python Pull requests that update Python code

Comments

@swve
Copy link
Contributor

swve commented Mar 31, 2024

Verified issue

  • Someone from the team allowed me to create an issue here

Issue Content

Hi Everyone,
Thanks for your interest in LearnHouse, this is a good first issue for anyone that want to contribute.

Issue Description:

Ability to get Transcriptions (CC) from hosted videos on the Backend.

Difficulty Level: Easy/Intermediate/Advanced

Advanced

Expected Benefits:

  • Being able to get multilang subtitles for Videos hosted through the Backend

Implementation

  • Any AI model would expect .mp3 files to be uploaded with a prompt to detect audio, for that reason the mp3 sound should be extracted from the video before upload, use FFmpeg for this.
  • Endpoints would be part of /ai
  • Multiple subtitles would be produced from an mp3, for at least 4 languages.
  • Video upload should be the priority in the operation, you can use BackgroundTasks for this.
  • Use langchain and OpenAI's Speech To Text for now
  • This Issue will serve as a discussion to work together on this feature

Future Implementations

  • Get the subtitles to show on the upcoming video player
@swve swve added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed python Pull requests that update Python code javascript Pull requests that update Javascript code labels Mar 31, 2024
@swve swve self-assigned this Mar 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed javascript Pull requests that update Javascript code python Pull requests that update Python code
Projects
None yet
Development

No branches or pull requests

1 participant