Released by Microsoft in 2022, FocalNet or Focal Modulation Network is an attention-free architecture achieving superior performance than SoTA self-attention (SA) methods across various vision benchmarks. GitHub Paper.
pip install focalnet-tensorflow
from focalnet_tensorflow import *
model = focalnet_huge_fl3()
See usage here
- Test ported weights
- Create a PR at original repo
focalnet_tiny_srf
focalnet_small_srf
focalnet_base_srf
focalnet_tiny_lrf
focalnet_small_lrf
focalnet_base_lrf
focalnet_tiny_iso_16
focalnet_small_iso_16
focalnet_base_iso_16
focalnet_large_fl3
focalnet_large_fl4
focalnet_xlarge_fl3
focalnet_xlarge_fl4
focalnet_huge_fl3
focalnet_huge_fl4