This repository has been archived by the owner on Apr 11, 2019. It is now read-only.

Handle tokenizer errors correctly #5

Closed

gcampax opened this issue Feb 21, 2019 · 1 comment

Labels

bug

Contributor

gcampax commented Feb 21, 2019

Right now, if the tokenizer fails with an error, we crash trying to read "tokens" from a response that won't have it.

gcampax added the bug label

gcampax mentioned this issue

Support tokenizing for a language that has no model #6

Closed

Contributor Author

gcampax commented Apr 11, 2019

This is handled correctly now.

gcampax closed this as completed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.