Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

any way to add srt file in the source? #34

Open
ZeppDK opened this issue Mar 29, 2024 · 8 comments
Open

any way to add srt file in the source? #34

ZeppDK opened this issue Mar 29, 2024 · 8 comments

Comments

@ZeppDK
Copy link

ZeppDK commented Mar 29, 2024

hi,
translating directly from danish to english is never working correctly with anything i have tried,
but can get AI translated subtitless that is 70-80% correct, and then modify them to be understandable in english.
so is there any way to either modify whatever SoniTranslate translates, or get it to take an srt file with timing into account when generating new audio?

@R3gm
Copy link
Owner

R3gm commented Mar 30, 2024

Hello, I am improving the quality of the translation, and in the future, I will add other translation options.

  • To modify the translated text: check the "Edit generated subtitles" option and then press the "GET SUBTITLES AND EDIT" button. This will give you the transcription which you can edit. Once you have finished editing, you can use the "TRANSLATE" button to obtain the final video.
  • To use an SRT file instead of the transcription: in "Advanced Settings," you will see a section with a field containing the text "Upload an SRT subtitle file (will be used instead of the transcription of Whisper)." You can upload your SRT file in this place. In the same section of "Advanced Settings," you can deactivate the translation since you already have the subtitles in the desired language, in the "Translation process" select "disable_translation".

@ZeppDK
Copy link
Author

ZeppDK commented Mar 30, 2024

this is absolutly awsome... i spun it up yesterday on an ubuntu live disc, and only thing i cant get to work is the voice cloning.
and if i use my own subtitles i cant load them and edit them, but i think i can get around this by being more precise when i edit in youtubes editor and change the time codes to allow for longer time slots when deleting unused subs, and making existing subs longer (as the smaller timeframes gives speed ups in the generated audio)

on a side node, it would be awsome with an easy way for running this in windows along site all my video editing, but for now its just going to be dual boot 🎉

@coinnbit
Copy link

coinnbit commented May 20, 2024

Hi. I upload my SRT or ASS file in UTF-8 encoding, I tried different subtitle languages (English, Russian, French), there is no difference, I get an error - - Error, To use an SRT file, you need to specify its original language (Source language) ; Warning
Make sure to select a 'TTS Speaker' suitable for the translation language to avoid errors with the TTS.

@R3gm
Copy link
Owner

R3gm commented May 20, 2024

Hi. I upload my SRT or ASS file in UTF-8 encoding, I tried different subtitle languages (English, Russian, French), there is no difference, I get an error - - Error, To use an SRT file, you need to specify its original language (Source language) ; Warning Make sure to select a 'TTS Speaker' suitable for the translation language to avoid errors with the TTS.

Hi
Maybe I need to improve the message. When you use a subtitle file, you have to specify its language here:
imagen_2024-05-20_155125276

because automatic language detection is not used with subtitles.

@coinnbit
Copy link

Maybe I need to improve the message. When you use a subtitle file, you have to specify its language here:

Yes, there is a nuance, it is not logical - "This is the original language of the video" and the language of the subtitles are different categories and different meanings

@coinnbit
Copy link

Another important point is that in the uploaded ASS subtitles, the assembly does not read the distribution by roles. That is, in the editor window, you have to reassign voices for voice-over again. For a long file, this is a serious problem, forcing you to spend considerable time again, and perform tedious manual work.

@R3gm
Copy link
Owner

R3gm commented May 20, 2024

Maybe I need to improve the message. When you use a subtitle file, you have to specify its language here:

Yes, there is a nuance, it is not logical - "This is the original language of the video" and the language of the subtitles are different categories and different meanings

In the initial version, only videos were supported, which is why the description was necessary.

Another important point is that in the uploaded ASS subtitles, the assembly does not read the distribution by roles. That is, in the editor window, you have to reassign voices for voice-over again. For a long file, this is a serious problem, forcing you to spend considerable time again, and perform tedious manual work.

Role recognition relies on audio using Pyannote, assigning speakers. Therefore, if there's no audio, the process of identifying speakers can't be carried out.

@coinnbit
Copy link

In the initial version, only videos were supported, which is why the description was necessary.

We are talking about an extreme release, why would the user know what happened?

Role recognition relies on audio using Pyannote, assigning speakers. Therefore, if there's no audio, the process of identifying speakers can't be carried out.

I pointed out the problem to you as a user, and you answer me about the work of processing algorithms. Who are you doing this for? If it's just your toy, then there are no more questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants