Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for convolutional\kernel\filter layers #33

Open
GiorgosXou opened this issue May 17, 2024 · 3 comments
Open

Add support for convolutional\kernel\filter layers #33

GiorgosXou opened this issue May 17, 2024 · 3 comments
Labels
enhancement New feature or request

Comments

@GiorgosXou
Copy link
Owner

GiorgosXou commented May 17, 2024

My thought proccess:

I could efficiently add support for convolutional\kernel\filter layers while preserving overall performance via just a fake-activation function and a simple condition when loading weights (i.e. "activation function" defined as FILTER...). Pottentialy by squeezing the logic of what-the-size-of-filter-is under the rest of the single byte of each activation function ... for example (considering all activation functions supported by this library are 14+5 custom ones and byte-size allows use up to 255) activation function defined by name FILTERX as 22 could be 2x2, or 98 9x8 or 101 10x1 and so on... (or even better i could also shift 22 to represent 1x2 [or even by a predifined shifting variable]) like who's going to use more than 255 on an MCU... let's be honest... although I could also add such a preference too... And finally by manipulating the output via that filter\fake-activation function. +additional destructor logic

Outro:
It always sounds exciting and funny until I start working on it and realise it isn't as easy as first thought lol

@GiorgosXou GiorgosXou added the enhancement New feature or request label May 17, 2024
@GiorgosXou
Copy link
Owner Author

GiorgosXou commented May 17, 2024

Life could be a dream until reality checks

@GiorgosXou
Copy link
Owner Author

SOUNDS SO GOOD TO BE TRUE

@GiorgosXou
Copy link
Owner Author

MONERO: 87PVyQ8Vt768hnvVyR9Qw1NyGzDea4q9Zd6AuwHb8tQBU9VdRYjRoBL7Ya8yRPVQakW2pjt2UWEtzYoxiRd7xpuB4XSJVAW
Donate Discord Server

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant