Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what aspects of language get considered while evaluating the translation by COMET. as far as I am aware of MQM metrics are covered in it. Interested in knowing other terminology/features of language gets in COMET. I am looking for metric along with COMET that can assess the translated content for cosmetic domain data. please suggest. #175

Open
suyogkute opened this issue Oct 25, 2023 · 1 comment
Labels
question Further information is requested

Comments

@suyogkute
Copy link

No description provided.

@suyogkute suyogkute added the question Further information is requested label Oct 25, 2023
@suyogkute suyogkute changed the title whar aspects of language gets considered while evaluating the tranlsation by COMET. as far as I am aware of MQM metric sare covered in it. Interested to know other terminolofy/features of language gets in COMET. I am looking for metric alongwith COMET that can assess the trsnalted content for cosmetic domain data. please suggest. what aspects of language get considered while evaluating the translation by COMET. as far as I am aware of MQM metrics are covered in it. Interested in knowing other terminology/features of language gets in COMET. I am looking for metric along with COMET that can assess the translated content for cosmetic domain data. please suggest. Oct 25, 2023
@ricardorei
Copy link
Collaborator

I am not sure I understand the question very well. Can you give a specific example of what you want to evaluate?

COMET models are trained with different signals. Most models are trained with DA which basically measure adequacy of the output. Other models are trained with MQM. Models trained with MQM should ideally model all dimensions covered by the MQM typology.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants