-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(perception): update perception criteria #272
Conversation
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please check review comment
driving_log_replayer/driving_log_replayer/criteria/perception.py
Outdated
Show resolved
Hide resolved
Signed-off-by: ktro2828 <kotaro.uetake@tier4.jp>
Co-authored-by: Hayato Mizushima <hayato-m126@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
I confirmed this PR woks fine with the dataset below.
https://tier4.github.io/driving_log_replayer/quick_start/perception/
Types of PR
Description
Update criteria for perception evaluation.
After this PR, users can choose criteria from the following two options.
num_tp
... Based on the number of the TP(or TN) objectsmetrics_score
... Based on classification accuracy for classification task or mAP for the othersIn a scenario file,
See the details of definition -> TIER IV INTERNAL LINK
How to review this PR
Others