Repo for letting users reproduce the record-setting new RangerMish+Self Attention combo on FastAI Leaderboards - ImageWoof dataset 5 epochs and 20 epochs, 128px.
Contributors to this effort - FastAI board names: @LessW2020 / @muellerzr / @Seb / @grankin / @Redknight / @oguiza
We have established a total of 12 new 5 epoch and 20 epoch records using this setup.
Two variations - with and without self attention.
Both setups set new records for 5 epoch training on ImageWoof (same day).
and current leaderboard:
Below are the results without attention layer (--sa 0, which is default).
How to use:
and link to the leaderboards: https://github.com/fastai/imagenette
and FastAI forum link: https://forums.fast.ai/t/meet-mish-new-activation-function-possible-successor-to-relu/53299
More links coming.