Implemented simplified self-attention mechanism, self-attention, causal mask, and multi-head attention.
Write-up: https://zacharylai.me/attention
zachlai23/attention
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Implemented simplified self-attention mechanism, self-attention, causal mask, and multi-head attention.
Write-up: https://zacharylai.me/attention