Skip to content
This repository has been archived by the owner on Apr 4, 2024. It is now read-only.

Extract Node initialization functions into a kernel file #15

Closed
Benny-Nottonson opened this issue Jan 14, 2024 · 0 comments
Closed

Extract Node initialization functions into a kernel file #15

Benny-Nottonson opened this issue Jan 14, 2024 · 0 comments

Comments

@Benny-Nottonson
Copy link
Owner

Is your feature request related to a problem? Please describe.
Tensors / Nodes are currently initialized for weights and biases using code that is held within Tensor and Node, rather than making a unary operation to do so, this should be changed.

Describe the solution you'd like
The initialization kernels should be held within a seperate kernel file or added to an existing one, and they should use vectorized SIMD operations.

Describe alternatives you've considered
The current implementation works but is significantly slower than other related functions and makes the structure of the code confusing.

@Benny-Nottonson Benny-Nottonson closed this as not planned Won't fix, can't repro, duplicate, stale Mar 15, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant