Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluate on custom video #67

Open
amindehnavi opened this issue Nov 28, 2021 · 2 comments
Open

Evaluate on custom video #67

amindehnavi opened this issue Nov 28, 2021 · 2 comments

Comments

@amindehnavi
Copy link

Hi
I want to use one of the MOTChallenge videos randomly e.g. MOT17-11-SDP to test my tracker's performance. ( i use videos that are for training, so I can get the evaluation metrics like HOTA since the ground truth files are available). I test some trackers like ByteTrack on custom data and want to use TrackEval for evaluation. I'm sure that the output file of the ByteTrack is compatible with what TrackEval requires.
As I use their pretrained models and just test the model on MOTChallenge training videos, I expect to get results almost the same as what they said in their paper (MOTA = 80, IDF1 = 77.3, and HOTA=63.1). but after evaluation using this repository, I get strange results as shown in the following image.
I searched a lot for this problem but couldn't find any helpful advice. is there any step or preprocessing which I forgot to handle?? or the problem is related to the TrackEval??
thanks
WhatsApp Image 2021-11-27 at 6 44 27 PM

@Ali96528
Copy link

Hello,amindehnav
Do you know the reason why you got this result?
I have encountered the same situation.
Thank you.

@hellosuer
Copy link

Hello,amindehnav Do you know the reason why you got this result? I have encountered the same situation. Thank you.

Hello, I would like to ask, have you solved this problem? I also met this problem, looking forward to your reply, thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants