Skip to content

Conversation

@dranger003
Copy link
Contributor

chat.cpp takes ~15-20s to compile due to the minja header-only library.
Contributors adding support for new models primarily modify the
common_chat_parse_* functions, which don't require minja.

By moving these functions to chat-parser.cpp (which doesn't include
minja headers), incremental compile time for parser changes drops to ~5s.

Closes #17329
Alternative to #17416

@ngxson ngxson merged commit 03914c7 into ggml-org:master Nov 28, 2025
119 of 131 checks passed
@dranger003 dranger003 deleted the move-common_chat_parse branch December 6, 2025 18:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Refactor: reduce compile time of common/chat.cpp

2 participants