Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请教一下,关于转换成为tflite格式后运行得到的结果是乱码 #9

Closed
ZTMIDGO opened this issue Sep 6, 2022 · 6 comments

Comments

@ZTMIDGO
Copy link

ZTMIDGO commented Sep 6, 2022

我把模型转换成为了tflite模型,但不知道要怎么才能够和您写的代码得到正确的结果一样。

@zxkmm
Copy link
Owner

zxkmm commented Sep 7, 2022

您好,实在抱歉,解决这个可能工程量稍微有点大。不过如果是简单的问题的话或许可以简单处理一下,请问乱码是什么样子的乱码呢?以及这个模型的性能比较差,不是很确定在嵌入式/移动能不能有正常的性能。如果是生产的话我个人感觉还是用openai的api或者可以尝试一下 @BlinkDL 大佬写的RWKV 模型,性能会好很多。BlinkDL/AI-Writer#1 (comment)

@ZTMIDGO
Copy link
Author

ZTMIDGO commented Sep 7, 2022

前一段时间了解过AI-Writer。Ai-write和gpt2-ml是我目前接触到的最好的中文模型,但无法移植到移动端使用。折腾了三天,有点累。如果您会Android编程,可以一起探讨一下:https://github.com/huggingface/tflite-android-transformers
目前安卓端可以跑gpt2模型为17亿参数的模型,序列长度为128个单词。

@zxkmm
Copy link
Owner

zxkmm commented Sep 7, 2022

哇,好厉害!感谢您的推荐!我明天看一看

@BlinkDL
Copy link

BlinkDL commented Sep 8, 2022

AI-Writer有onnx版本(那个A卡版就是),在移动端应该可以直接跑。

@BlinkDL
Copy link

BlinkDL commented Sep 13, 2022

@ZTMIDGO 欢迎加RWKV开发QQ群 325154699 谢谢

@zxkmm
Copy link
Owner

zxkmm commented Sep 14, 2022

@BlinkDL 谢谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants