Unofficial implementation of the EmotionROI essay and extended applications
ℹ The pretrained weights can be found here :)
Reproduction the FCNEL model in essay WHERE DO EMOTIONS COME FROM? PREDICTING THE EMOTION STIMULI MAP, and extended applications.
The results reported in the EmotionROI/FCNEL essay:
⚠ Can NOT reproduce essay results exactly, here're the implementation differences:
- The essay uses
FCN-32s + AlexNet
, we useFCN-8s + ResNet50
- The essay uses
lr=1e-8
to refine20
epochs, which is two small and doesn't have any effect in our setting, we instead uselr=1e-2
to train100
epochs withCosineAnnealingLR
- The essay might use the default
Bilinear
for output upsacling, we instead useNearest-Exact
to simulateFCN-32s
resolution
ℹ Predict ROI with any emotion label (except for sadness
) results into nearly the same output...
ℹ The ROI annotations are probably NOT related to certain emotion, but only indicates human attention focus
⚠ Mission impossible :(
Model | Train acc. | Test acc. |
---|---|---|
Resnet50 | 24.098% | 17.172% |
- essay
- EmotionROI dataset
by Armit 2023/12/27