TKAN (Temporal Kolmogorov-Arnold Networks) is a neural network architecture designed to enhance multi-horizon time series forecasting. This TensorFlow implementation integrates TKAN as a layer within sequential models, facilitating the use of advanced neural network techniques in practical applications. It is the original implementation of the paper The KAN part implementation has been inspired from efficient_kan and works similarly to it, thus not exactly like the original implementation.
Install TKAN directly from PyPI:
pip install tkan
Dependencies are managed using pyproject.toml.
TKAN can be used within TensorFlow models to handle complex sequential patterns in data. It's implementation reproduce architecture of RNN in tensorflow with Cell class and Layer that inherits from RNN in order to provide a perfect integrations with tensorflow. Here is an example that demonstrates how to use TKAN in a sequential model:
import tensorflow as tf
from tkan import TKAN
# Example model using TKAN with B-spline activations
model = tf.keras.Sequential([
tf.keras.layers.InputLayer(input_shape=X_train_seq.shape[1:]),
TKAN(100, tkan_activations=[{'spline_order': 3, 'grid_size': 10}, {'spline_order': 1, 'grid_size': 5}, {'spline_order': 4, 'grid_size': 6}, ], return_sequences=True, use_bias=True), #Define the params of the KANLinear as dict as here
TKAN(100, tkan_activations=[1, 2, 3, 3, 4], return_sequences=True, use_bias=True), #Use float or int to specify only the exponent of the spline
TKAN(100, tkan_activations=['relu', 'relu', 'relu', 'relu', 'relu'], return_sequences=True, use_bias=True), #Or use string to specify the standard tensorflow activation using Dense in sublayers instead of KANLinear
TKAN(100, tkan_activations=[None for _ in range(3)], return_sequences=False, use_bias=True), # Or put None for default activation
tf.keras.layers.Dense(y_train_seq.shape[1]),
])
You can find a more complete example with comparison with other models in the example folder.
Please cite our work if you use this repo:
@article{genet2024tkan,
title={Tkan: Temporal kolmogorov-arnold networks},
author={Genet, Remi and Inzirillo, Hugo},
journal={arXiv preprint arXiv:2405.07344},
year={2024}
}
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.