流式接口实现的耗时问题 #198
Unanswered
Mryangkaitong
asked this question in
Q&A
流式接口实现的耗时问题
#198
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
如题，如果耗时定义为：用户说话结束（或者是vad结束）到拿到全部转录文字。假如用户一共说了6秒，按照2s送一次，那看现在的流式接口实现，最后一个2s chunk推理时还是会把之前的完整6秒全部送进去，重新推理，那和非流式相比没有节省耗时？
All reactions