Support OneRingTranslator and multiple language engines to estimate

[janvarev]

Hi, guys!

Thanks for interesting project - I worked on something the same with Russian-English translation.

I thinks, you may be interested in use in your project one my project https://github.com/janvarev/OneRingTranslator
OneRingTranslator provide single REST interface to different translation language.

It seems to be integrated in your workflow in two cases:

1. Get other translations in a universal way to compare with. Now it support FB NLLB model, so you can compare with it and get BLEU scores.
2. If you transfer your solution as a plugin to OneRingTranslator (or easily add others like DeepL), you'll be able to get all translations in one interface to compare with.
3. As a solution to run your lora/model throw REST interface you can use https://github.com/LostRuins/koboldcpp/releases, that provides REST API interface to loaded ggml model.

I think it's a good idea to have one interface with multiple plugins to play with.

Good luck anywhere!