Skip to content

llama.cpp-b4139-v0.1

Choose a tag to compare

@ymcki ymcki released this 03 Dec 14:14
· 1 commit to main since this release

Modified llama.cpp-b4139 to make it work with DeciLM-7B-Instruct.

Since support for dynamic NTK-aware RoPE scaling is not implemented in llama.cpp, so this is not a perfect implementation for now.