Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

“验证集的结果好与提交的测试集结果很差” #40

Open
xiaoxusanheyi opened this issue May 4, 2023 · 5 comments
Open

Comments

@xiaoxusanheyi
Copy link

针对kitti-raw的数据集,我们在修改了文中的loss后,按照github上的多GPU分阶段训练(second)执行训练验证后,结果很好,进行测试,把结果提交上去后结果很差很差,不知道为什么?过拟合了?

@Cc-Hy
Copy link
Owner

Cc-Hy commented May 10, 2023

I think if you get extremely bad results, it's generally not because of overfitting, but because there are some significant errors in your model or your code.

@xiaoxusanheyi
Copy link
Author

1.有重大错误的话,为什么我验证集的结果很好?
2.由于我是80的服务器,原文中batch_size的4,显存不够,于是就设置为了2,那么我是否需要把两个学习率lr(bev.yaml和V2.yaml)降为一半?或者说需要把epoch增加一倍再训练?

@Cc-Hy
Copy link
Owner

Cc-Hy commented May 11, 2023

Hi,

  1. 'significant errors' could come from many sources. The performance on the validation set is good indicates that your model should be correct, but you might have used the wrong data for training or the wrong data for inference.
  2. I think the change to the learning rate is reasonable, but in my experience, the learning rate does not lead to the above results.

@xiaoxusanheyi
Copy link
Author

ok,感谢作者的回复

@TimGor1997
Copy link

针对kitti-raw的数据集,我们在修改了文中的loss后,按照github上的多GPU分阶段训练(second)执行训练验证后,结果很好,进行测试,把结果提交上去后结果很差很差,不知道为什么?过拟合了?

大佬!我想请问你前面问题中提到的三个类别的mAP全是00是怎么解决的呢?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants