Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Figure out best label smoothing parameters #32

Closed
JoshVarty opened this issue May 20, 2019 · 2 comments

Comments

@JoshVarty
Copy link
Owner

@JoshVarty JoshVarty commented May 20, 2019

I chose random parameters initially so we're not really sure what the best parameters are.

Min Max lwlrap
0.000 1.000 0.8482
0.000 0.95 0.8520
0.001 0.990 0.8513
0.001 0.975 0.8531
0.001 0.960 0.8497
0.001 0.950 0.8542
0.001 0.935 0.8497
0.010 0.990 0.8501
0.010 0.975 0.8466
0.010 0.950 0.8526
0.010 0.935 0.8499
0.010 0.900
@JoshVarty

This comment has been minimized.

Copy link
Owner Author

@JoshVarty JoshVarty commented May 23, 2019

Trying with xresnet-18 because this is taking so long.

Min Max lwlrap
0.000 1.000 0.8395
0.000 0.95 0.8432
Min Max lwlrap
0.001 0.990 0.8403
0.001 0.975 0.8393
0.001 0.950 0.8415
0.001 0.935 0.8422
0.001 0.900 0.8414
0.001 0.800 0.8421
0.001 0.700 0.8402
0.001 0.500 0.8433
0.001 0.250 0.8405
0.001 0.100 0.8374 (LB 0.669)
Min Max lwlrap
0.010 0.990 0.8398
0.010 0.975 0.8412
0.010 0.950 0.8394
0.010 0.935 0.8393
0.010 0.900 0.8368
0.001 0.800 0.8408
0.010 0.700 0.8353
0.010 0.500 0.8400
0.010 0.250 0.8353
Min Max lwlrap
0.05 0.990 0.8367
Min Max lwlrap
0.4 0.6 0.5722
Min Max lwlrap
0.2 0.99 0.7057
0.2 0.8 0.7268
0.2 0.5 0.6673
@JoshVarty

This comment has been minimized.

Copy link
Owner Author

@JoshVarty JoshVarty commented May 28, 2019

For the curated data I don't think it matters what we use so long as the minimum isn't too large. Something like 0.001 and 0.990 seems to work reasonably well.

No clue how we should treat the noisy data, though.

@JoshVarty JoshVarty closed this May 28, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.