Skip to content

Commit

Permalink
spec : fix typo in gguf.md (#798)
Browse files Browse the repository at this point in the history
Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com>
  • Loading branch information
danbev committed Apr 18, 2024
1 parent 98875cd commit e1daebb
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/gguf.md
Expand Up @@ -591,7 +591,7 @@ where N signifies the block number a layer belongs to, and where `BB` could be:
- `ffn_up`: Feed-forward network "up" layer
- `ffn_gate`: Feed-forward network "gate" layer
- `ffn_down`: Feed-forward network "down" layer
- `ffn_gate_inp`: Expert-routing layer for the Fee-forward network in MoE models
- `ffn_gate_inp`: Expert-routing layer for the Feed-forward network in MoE models
- `ffn_gate_exp`: Feed-forward network "gate" layer per expert in MoE models
- `ffn_down_exp`: Feed-forward network "down" layer per expert in MoE models
- `ffn_up_exp`: Feed-forward network "up" layer per expert in MoE models
Expand Down

0 comments on commit e1daebb

Please sign in to comment.