Repository navigation
llama.cpp-b4139-v0.1
Modified llama.cpp-b4139 to make it work with DeciLM-7B-Instruct.
Since support for dynamic NTK-aware RoPE scaling is not implemented in llama.cpp, so this is not a perfect implementation for now.
Modified llama.cpp-b4139 to make it work with DeciLM-7B-Instruct.
Since support for dynamic NTK-aware RoPE scaling is not implemented in llama.cpp, so this is not a perfect implementation for now.