Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GGUF file format specification #302

Merged
merged 29 commits into from Nov 1, 2023
Merged
Changes from 6 commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
d2fbcb2
docs: gguf spec first pass
philpax Jun 25, 2023
23eda2e
docs(gguf): update with review comments
philpax Jun 26, 2023
b303293
docs(gguf): update with review comments
philpax Jun 27, 2023
2bcd348
docs(gguf): quant version optional for unquant
philpax Jun 28, 2023
576e306
docs(gguf): normalize naming, add whisper
philpax Jul 9, 2023
44af6b8
Merge branch 'master' of https://github.com/ggerganov/ggml into gguf-…
philpax Jul 9, 2023
24260bf
docs(gguf): more review updates
philpax Jul 23, 2023
0133f2e
docs(gguf): add norm eps and added_tokens
philpax Jul 25, 2023
e9988f7
docs(gguf): move padding
philpax Jul 26, 2023
f4c4d6a
docs(gguf): remove migration tool
philpax Jul 27, 2023
39da254
docs(gguf): make offset base explicit
philpax Jul 27, 2023
a6d1cc1
docs(gguf): fix replace oops
philpax Jul 27, 2023
1d134ec
docs(gguf): alignment metadata+tensor name len max
philpax Aug 6, 2023
2a90bbf
docs(gguf): clarification, fixes, tensor names
philpax Aug 14, 2023
3d4507e
docs(gguf): clarify license
philpax Aug 15, 2023
39d6377
docs(gguf): minor tweaks
philpax Aug 15, 2023
e36b4ca
docs(gguf): data layout, GQA eq, no ft, LE GGUF
philpax Aug 20, 2023
d5cfb55
docs(gguf): fix magic order
philpax Aug 20, 2023
aa8d0ba
docs(gguf): match impl
philpax Aug 20, 2023
f3e7632
docs(gguf): specify fallback alignment
philpax Aug 20, 2023
2fe03e5
docs(gguf): remove TensorInfo::n_elements
philpax Aug 20, 2023
2b65fba
docs(gguf): filetype, rope base/linear scale
philpax Aug 24, 2023
b021b25
docs(gguf): v2 - uint64 all the things
philpax Aug 26, 2023
2da80c1
docs(gguf): tweak extensibility wording
philpax Aug 28, 2023
574b408
docs(gguf): fix spec discrepancies
philpax Sep 9, 2023
4ea9317
Merge branch 'master' into gguf-spec
philpax Oct 31, 2023
78faa7b
docs(gguf): v3 + other fixes
philpax Oct 31, 2023
0da010d
fix(editorconfig): use 2-space tabs for markdown
philpax Oct 31, 2023
ad95988
docs(gguf): clarify big-endian
philpax Oct 31, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view