Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

win10的cmd输入不了中文吗?输入英文回答中文 #51

Closed
wscsjnhboy opened this issue Apr 4, 2023 · 6 comments
Closed

win10的cmd输入不了中文吗?输入英文回答中文 #51

wscsjnhboy opened this issue Apr 4, 2023 · 6 comments

Comments

@wscsjnhboy
Copy link

image

@ymcui
Copy link
Owner

ymcui commented Apr 4, 2023

看一下这个issue:#11

@wscsjnhboy
Copy link
Author

看了issue用wsl可以跑,不过配置低太卡。半天挤出一丢丢字。如下
image

@wscsjnhboy
Copy link
Author

可以使用nodejs执行效率好很多,代码如下:
child_process = require('child_process')
child = child_process.spawn('D:\proj\llama.cpp-master\bin\main', [
'-m', 'D:\proj\llama.cpp-master\models\zh-models\7B\ggml-model-q4_0.bin',
'--color', '-f', 'D:\proj\llama.cpp-master\prompts\alpaca.txt', '-ins',
'-c', '2048', '--temp', '0.2', '-n', '256', '--repeat_penalty', '1.3'])
child.stdout.pipe(process.stdout)
child.stdin.setEncoding('utf-8')
process.stdin.pipe(child.stdin)

image

@ymcui
Copy link
Owner

ymcui commented Apr 4, 2023

感谢提供方案,已添加到FAQ#6

@shiningxy
Copy link

#106 此外,这个issue中 @YukinoshitaKaren 尝试了本issue中的方法,速度仍然较慢,我认为过早地Closed本issue。

@GuoHuiChen
Copy link

经查,的确减少线程数量,有助于提高性能。增加参数: -t 4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants