Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The precision with batch inference is not as good as when trained #14

Open
mugenggeng opened this issue Apr 13, 2024 · 7 comments
Open

Comments

@mugenggeng
Copy link

Sorry to bother you, I recently had a problem with the batch test model: the accuracy obtained with the batch test was not as good as the test accuracy obtained during training. Do you know why?

@Echo0125
Copy link
Owner

Echo0125 commented Apr 14, 2024

Referring to line 53 in the dataset perframe_data_layer.py, the data is sparsely sampled during training, including train data and val data, so the performance will be different from the final test.

@mugenggeng
Copy link
Author

Thank you very much for your answer. Could you please provide us with the config file of HDD data set? @Echo0125

@Echo0125
Copy link
Owner

Echo0125 commented Apr 15, 2024

You can use the model parameters in thumos' config as hyperparameters. In addition, you can refer to the relevant hyperparameters mentioned in the supplementary material for modification.

@mugenggeng
Copy link
Author

Thanks for your help, I also find that there seems to be no way to read HDD datasets in perframe_data_layers.py @Echo0125

@Echo0125
Copy link
Owner

Echo0125 commented Apr 16, 2024

You can prepare the dataset according to this link.

@Prism-hua
Copy link

Prism-hua commented Apr 18, 2024

Hello @Echo0125 , I have downloaded the HDD dataset and found the folder of sensor features, but I do not know what kind of input type the sensor features belong to, rgb or optical flow? Because I have found only one folder, in contrast with the data structure of TVSeries mentioned in the README, which contains two separate folders for rgb inputs and optical flow inputs respectively.

Here is all the files I get after applied for the HDD dataset:
image

@mugenggeng
Copy link
Author

image
I am very sorry to bother you again, but I would like to know how the data in Table 8 was obtained. Is there a script that can be run directly?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants