This repository was archived by the owner on Jul 4, 2025. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 181
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
Grammar file not found - llamaCPP.cc:201 #397
Copy link
Copy link
Closed
Labels
type: bugSomething isn't workingSomething isn't working
Description
Say, I just download the latest Jan 0.4.5 Linux AppImage.
I can actually start the local server. After starting the server, I am getting an error about Grammar file not found and a bunch of INFO lines about waiting for "release status:1"...is this all normal? 'cause I am trying to use Continue extension from VSCode and it is not quite working
20240129 15:12:12.108051 UTC 1025930 ERROR Grammar file not found - llamaCPP.cc:201
20240129 15:12:12.108076 UTC 1025930 INFO Resolved request for task_id:0 - llamaCPP.cc:299
[1706541132] [/home/runner/actions-runner/_work/nitro/nitro/controllers/llamaCPP.h: 879][ launch_slot_with_data] slot 0 is processing [task id: 1]
[1706541132] [/home/runner/actions-runner/_work/nitro/nitro/controllers/llamaCPP.h: 1733][ update_slots] slot 0 : kv cache rm - [0, end)
http://127.0.0.1:3928/inferences/llamacpp/chat_completion
{"Content-Type":"application/json"}
2024-01-29T15:12:36.051Z [NITRO]::Debug: 20240129 15:12:36.051469 UTC 1025889 ERROR Grammar file not found - llamaCPP.cc:201
2024-01-29T15:12:36.537Z [NITRO]::Debug: 20240129 15:12:36.051494 UTC 1025889 INFO Resolved request for task_id:0 - llamaCPP.cc:299
[1706541156] [/home/runner/actions-runner/_work/nitro/nitro/controllers/llamaCPP.h: 1462][ process_tasks] slot unavailable
2024-01-29T15:12:56.540Z [NITRO]::Debug: 20240129 15:12:36.537288 UTC 1025889 INFO Waiting for task to be released status:1 - llamaCPP.cc:360
20240129 15:12:37.037350 UTC 1025889 INFO Waiting for task to be released status:1 - llamaCPP.cc:360
20240129 15:12:37.537416 UTC 1025889 INFO Waiting for task to be released status:1 - llamaCPP.cc:360
20240129 15:12:38.037478 UTC 1025889 INFO Waiting for task to be released status:1 - llamaCPP.cc:360
.
.
.
Environment details
COMPUTER HARDWARE INFORMATION
Computer Manufacturer ......... HPE
Computer Model ................ ProLiant DL380 Gen10
BIOS Version .................. U30 (07/20/2023)
Memory Installed .............. 1536 GB installed in 24 DIMMs (0 slots free)
Memory Type & Speed ........... DDR4 2933 MHz Synchronous
Number of CPU(s) .............. 48 [2 sockets * 24 core(s) each]
CPU Manufacturer .............. Intel
CPU Model/Family .............. Xeon
CPU Clock Speed ............... 3000 MHz
Graphics Card (or GPGPU)....... NVIDIA Corporation TU102GL [Quadro RTX 6000/8000]
Graphics Driver ............... 470.182.03
signalprime
Metadata
Metadata
Assignees
Labels
type: bugSomething isn't workingSomething isn't working