New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

multibyte characters issue #38 #39

Merged

lbeurerkellner merged 1 commit into eth-sri:main from laiso:fix_38

May 3, 2023

Contributor

laiso commented Apr 22, 2023 •

edited

argmax
    "Q: あなたは誰？\n"
    "A: [WHAT]"
from
    "chatgpt"

> lmql run test.lmql 

Q: あなたは誰？
A:  私はAIアシスタントです。

 valid=True, final=fin


          multibyte characters issue eth-sri#38

07f184e

laiso mentioned this pull request

LMQL not supporting multibyte characters, causing garbled output for Japanese queries #38

Closed

Collaborator

lbeurerkellner commented May 3, 2023

Thanks, this seems to work as far as I could tell :) Merging it.

lbeurerkellner merged commit 2b3ea60 into eth-sri:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment