Repository navigation
embedder backward
GitHub Action edited this page Jul 9, 2026
·
1 revision
void backward(utility::matrix dZ, float lr)Updates the embedding table according to the gradient calculated throughout.
Returns void
| Parameter | Type | Use | Optional |
|---|---|---|---|
dZ |
utility::matrix |
Gradient matrix | ❌ |
lr |
float |
Learning rate | ❌ |
// Calling the backward() function
utility::matrix dZ;
embedder e(919191. 36593034);
e.backward(dZ);- AIUsage
- Block
- Embedder
- Introduction
- Layer
- Model
- NeuralNetwork
- PositionalEncoding
- SelfAttention
- Tokenizer
- Utility