Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to evaluate the performance? #510

Open
1 of 2 tasks
Originlightwkp opened this issue Jul 19, 2024 · 1 comment
Open
1 of 2 tasks

How to evaluate the performance? #510

Originlightwkp opened this issue Jul 19, 2024 · 1 comment

Comments

@Originlightwkp
Copy link

System Info / 系統信息

cuda 12.1
pytorch 2.3.1

Who can help? / 谁可以帮助到您?

No response

Information / 问题信息

  • The official example scripts / 官方的示例脚本
  • My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

My test results are as follows, is this considered good or bad?

[2024-07-19 09:38:21,589] [INFO] [RANK 0] validation loss at the end of training for test data | loss: 0.000000E+00 | PPL: 1.000000E+00 acc 5.319865E-02 | acc_w/o_case 5.319865E-02 |

Expected behavior / 期待表现

None

@gyjlll
Copy link

gyjlll commented Jul 27, 2024

Can you run evaluate_cogagent_demo.py correctly without reporting an error?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants