Skip to content

Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)

License

Notifications You must be signed in to change notification settings

belkakari/implicit-kan

Repository files navigation

implicit-kan

Trying to use EfficientKAN, FastKAN and ChebyKAN as an implicit function to fit a 2D image below The basic idea comes from the Fourier Features paper (similar to SIREN). An MLP or KAN takes coordinates grid as an input and learns to output an image, basically learning to complress image inside the weights. FF and SIREN papers have shown that the basic MLP is not capable to do it properly but with a certain trick (positional encoding that is used in NeRF) it suddenly can

This repo mostly aims at expanding Appendix B from the original paper

train image

For now it looks like KANs also needs fourier features and MLP still beats KANs. More experiments are needed to verify that claim

Loss plots

train plots

EfficientKAN grid 5 vs EfficientKAN grid 7 vs MLP

kan vs mlp

About

Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published