Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experimental results #18

Open
LPeng625 opened this issue Dec 6, 2023 · 10 comments
Open

Experimental results #18

LPeng625 opened this issue Dec 6, 2023 · 10 comments

Comments

@LPeng625
Copy link

LPeng625 commented Dec 6, 2023

image image

Hello, you have done a good job! There are some gaps between the results I ran out and the papers. Experimental configuration: 4 RTX3090 ,bs = 2. The experimental results are obtained from the above two documents. May I ask what is probably the cause of the problem?

@haoshuai714
Copy link

haoshuai714 commented Dec 7, 2023

How many video frames are you using? It feels like you used 4 or 8 frames, and the paper used 32 frames.
I'm not the author, I'm just guessing.

@LPeng625
Copy link
Author

LPeng625 commented Dec 7, 2023

How many video frames are you using? It feels like you used 4 or 8 frames, and the paper used 32 frames. I'm not the author, I'm just guessing.
Thank you. Have you reproduced the results in the paper?

@jxbbb
Copy link
Owner

jxbbb commented Dec 7, 2023

We use an early stop strategy, and you can check if the checkpoint before 40 is better.

@jxbbb
Copy link
Owner

jxbbb commented Dec 7, 2023

btw, can I take a look at the Tensorboard log?

@LPeng625
Copy link
Author

LPeng625 commented Dec 7, 2023

btw, can I take a look at the Tensorboard log?

Thanks for the reply. There are indeed better results before 40, but there is still a big gap with paper.
11381701962859_ pic
11391701962918_ pic
11401701962983_ pic
11411701962983_ pic

@LPeng625
Copy link
Author

LPeng625 commented Dec 7, 2023

ow many video frames are you using? It feels like you used 4 or 8 frames, and the paper used 32 frames.
I'm not the author, I'm just guessing.

32, this result seems to use 4 or 8 frames. We set bs to 2, I don't know if this is the reason.

@LPeng625
Copy link
Author

LPeng625 commented Dec 8, 2023

We use an early stop strategy, and you can check if the checkpoint before 40 is better.

Thanks, the best results are really close to the paper. I guess the gap is related to the training environment and the setting of the bs.

@ljy2222
Copy link

ljy2222 commented Jan 11, 2024

We use an early stop strategy, and you can check if the checkpoint before 40 is better.

Thanks, the best results are really close to the paper. I guess the gap is related to the training environment and the setting of the bs.

Hi, I met the same problem, have you successfully reproduced the results in the paper, i.e. 32 frames in Table VI.

@LPeng625
Copy link
Author

We use an early stop strategy, and you can check if the checkpoint before 40 is better.

Thanks, the best results are really close to the paper. I guess the gap is related to the training environment and the setting of the bs.

Hi, I met the same problem, have you successfully reproduced the results in the paper, i.e. 32 frames in Table VI.

Hello, there is a gap between the results of our experiment and the paper results.

@ananditajam
Copy link

Hi @jxbbb, the link(https://pan.baidu.com/s/1_eW-kLVBhf8lWGObGa4i9A?pwd=7zrz) you provided for downloading the preprocessed dataset is inaccessible. Could you please send the dataset via email?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants