Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

想问一下关于评测的内容。 #37

Closed
Gcstk opened this issue Mar 28, 2024 · 1 comment
Closed

想问一下关于评测的内容。 #37

Gcstk opened this issue Mar 28, 2024 · 1 comment

Comments

@Gcstk
Copy link

Gcstk commented Mar 28, 2024

请问目前评测中文数据时,使用的chunk是多少?使用gpt4构造出来的Q和reference_context是强相关关系嘛?因为在我们私有评测数据集下效果没有这么出众呢?

@shenlei1020
Copy link
Collaborator

shenlei1020 commented Mar 28, 2024

感谢对bce模型的关注~
1、数据构造方式是:https://github.com/netease-youdao/BCEmbedding/tree/master?tab=readme-ov-file#3-broad-domain-adaptability
参考llamaIndex博客的评测方式(目前rag一般都这么做,试一下就知道是否科学)
2、bce reranker社区反馈很不错的。如果您的场景效果无法满足需求,可以尝试别的模型试试,真实效果以自己场景实测为准。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants