Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check HEPAugFoldYielder and test-time augmentation #46

Open
GilesStrong opened this issue Jun 4, 2020 · 0 comments
Open

Check HEPAugFoldYielder and test-time augmentation #46

GilesStrong opened this issue Jun 4, 2020 · 0 comments
Labels
help wanted Extra attention is needed invalid This doesn't seem right investigation Something which might require a careful study medium priority Not urgent but should be dealt with sooner rather than later

Comments

@GilesStrong
Copy link
Owner

One thing I've been surprised about is that increasing the amount of test-time data augmentation can sometimes decrease model performance. I would have thought that it would saturate, rather than decrease; all transformations result in valid events, unlike say in image augmentation where augmented data is only similar and things like Polyak averaging are useful.

I've been over the code in HEPAugFoldYielder multiple times and can't spot any errors, but a second set of eyes might help. There might also be errors in my assumptions about the input data...

If the code is correct, then it would be interesting to investigate further what causes the degradation in performance, and whether it is reproducible on other datasets.

@GilesStrong GilesStrong added help wanted Extra attention is needed invalid This doesn't seem right medium priority Not urgent but should be dealt with sooner rather than later investigation Something which might require a careful study labels Jun 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed invalid This doesn't seem right investigation Something which might require a careful study medium priority Not urgent but should be dealt with sooner rather than later
Projects
None yet
Development

No branches or pull requests

1 participant