Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

hotfix: important change to fix the issue of template formatting for upcoming release #223

Merged
merged 3 commits into from
Dec 1, 2023
+6 −2
Merged

hotfix: important change to fix the issue of template formatting for upcoming release #223

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
ac5dd44
Update llamaCPP.cc
tikikun Dec 1, 2023
942ee09
Update llamaCPP.cc
tikikun Dec 1, 2023
bcc524d
Correct formatting for prompt template
tikikun Dec 1, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions controllers/llamaCPP.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ void llamaCPP::chatCompletion(
role = input_role;
}
std::string content = message["content"].asString();
formatted_output += role + content + "\n";
formatted_output += role + content;
}
formatted_output += ai_prompt;

Expand All @@ -205,7 +205,11 @@ void llamaCPP::chatCompletion(
}

bool is_streamed = data["stream"];

// Enable full message debugging
#ifdef DEBUG
LOG_INFO << "Current completion text";
LOG_INFO << formatted_output ;
#endif
const int task_id = llama.request_completion(data, false, false);
LOG_INFO << "Resolved request for task_id:" << task_id;

Expand Down