model forwardResult

struct forwardResult {
    utility::matrix dist;
    utility::matrix unembed;
    utility::matrix lastHidden;
    size_t seq_len;
};

---

Basic Info

This strutcture store data about the last hidden layer which is important for back propogation.

Variables

Variable	Type	Use	Optional
dist	utility::matrix	Distribution of tokens	❌
unembed	utility::matrix	Unembed matrix used	❌
lastHidden	utility::matrix	Matrix before scaled against unembed	❌
seq_len	size_t	Number of inputted tokens	❌

---

Example

// Using forwardResult structure
model m();
forwardResult result = m.forwardPassInternal({69, 69, 91, 42, 420});