Failing tool call with mlx-community/gemma-4-26b-a4b-it-4bit model on

[xavierhardy]

I have downloaded the latest version of mlx_lm (0.31.2) at the time of writing after I noticed that it supported the newly released Gemma 4 LLMs. Using mlx-community/gemma-4-26b-a4b-it-4bit with the recommended sampling configuration, I'm unable to make tool calls. More specifically, the error is:

  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/tool_parsers/gemma4.py", line 49, in parse_tool_call
    raise ValueError("No function provided.")
ValueError: No function provided.

Here is confirmation of the version of the mlx_lm module:

$ mlx_lm --version                                                                                                                                                  
0.31.2

Here is the full debug log output:

$ mlx_lm.server --model mlx-community/gemma-4-26b-a4b-it-4bit --max-tokens 256000 --temp 1.0 --top-p 0.95 --top-k 64 --host 127.0.0.1 --port 12345 --log-level DEBUG
2026-04-08 08:47:25,092 - DEBUG - connect_tcp.started host='huggingface.co' port=443 local_address=None timeout=None socket_options=None
2026-04-08 08:47:27,208 - DEBUG - connect_tcp.complete return_value=<httpcore._backends.sync.SyncStream object at 0x1100b4050>
2026-04-08 08:47:27,208 - DEBUG - start_tls.started ssl_context=<ssl.SSLContext object at 0x10ffa5eb0> server_hostname='huggingface.co' timeout=None
2026-04-08 08:47:27,240 - DEBUG - start_tls.complete return_value=<httpcore._backends.sync.SyncStream object at 0x11005e490>
2026-04-08 08:47:27,240 - DEBUG - send_request_headers.started request=<Request [b'GET']>
2026-04-08 08:47:27,241 - DEBUG - send_request_headers.complete
2026-04-08 08:47:27,241 - DEBUG - send_request_body.started request=<Request [b'GET']>
2026-04-08 08:47:27,241 - DEBUG - send_request_body.complete
2026-04-08 08:47:27,241 - DEBUG - receive_response_headers.started request=<Request [b'GET']>
2026-04-08 08:47:27,357 - DEBUG - receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'Content-Type', b'application/json; charset=utf-8'), (b'Transfer-Encoding', b'chunked'), (b'Connection', b'keep-alive'), (b'Date', b'Wed, 08 Apr 2026 06:47:27 GMT'), (b'content-encoding', b'gzip'), (b'ETag', b'W/"3760-ikRpQomJqVaks2t0QBPvFmTKzO4"'), (b'X-Powered-By', b'huggingface-moon'), (b'X-Request-Id', b'Root=1-69d5f9ff-58a98f1c4e4901f5002a0570;c7deadaf-e7ae-4af7-a23e-1c22ee6aede6'), (b'RateLimit', b'"api";r=499;t=169'), (b'RateLimit-Policy', b'"fixed window";"api";q=500;w=300'), (b'cross-origin-opener-policy', b'same-origin'), (b'Referrer-Policy', b'strict-origin-when-cross-origin'), (b'Access-Control-Max-Age', b'86400'), (b'Access-Control-Allow-Origin', b'https://huggingface.co'), (b'Vary', b'Origin'), (b'vary', b'Accept-Encoding'), (b'Access-Control-Expose-Headers', b'X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,X-Total-Count,ETag,Link,Accept-Ranges,Content-Range,X-Linked-Size,X-Linked-ETag,X-Xet-Hash'), (b'X-Cache', b'Miss from cloudfront'), (b'Via', b'1.1 02ee9ebd8a83522edf11335f04975776.cloudfront.net (CloudFront)'), (b'X-Amz-Cf-Pop', b'CDG52-P4'), (b'X-Amz-Cf-Id', b'qfL-zyhd-n1i2ymzmhH5vU_MH2peDOlIVBFbBlx68FawHYqmAMqh4g==')])
2026-04-08 08:47:27,359 - INFO - HTTP Request: GET https://huggingface.co/api/models/mlx-community/gemma-4-26b-a4b-it-4bit/revision/main "HTTP/1.1 200 OK"
2026-04-08 08:47:27,359 - DEBUG - receive_response_body.started request=<Request [b'GET']>
2026-04-08 08:47:27,368 - DEBUG - receive_response_body.complete
2026-04-08 08:47:27,369 - DEBUG - response_closed.started
2026-04-08 08:47:27,369 - DEBUG - response_closed.complete
Fetching 10 files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 128659.63it/s]
Download complete: : 0.00B [00:03, ?B/s]                                                                                                                                                                                                                                                                                                                                                                     | 0/10 [00:00<?, ?it/s]
/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/server.py:1710: UserWarning: mlx_lm.server is not recommended for production as it only implements basic security checks.
  warnings.warn(
2026-04-08 08:47:32,077 - INFO - Starting httpd at 127.0.0.1 on port 12345...
2026-04-08 08:47:33,559 - DEBUG - Incoming Request Body: {
	"model": "mlx-community/gemma-4-26b-a4b-it-4bit",
	"messages": [
		{
			"role": "system",
			"content": "You are an expert coding assistant operating inside pi, a coding agent harness. You help users by reading files, executing commands, editing code, and writing new files.\n\nAvailable tools:\n- read: Read file contents\n- bash: Execute bash commands (ls, grep, find, etc.)\n- edit: Make precise file edits with exact text replacement, including multiple disjoint edits in one call\n- write: Create or overwrite files\n\nIn addition to the tools above, you may have access to other custom tools depending on the project.\n\nGuidelines:\n- Use bash for file operations like ls, rg, find\n- Use read to examine files instead of cat or sed.\n- Use edit for precise changes (edits[].oldText must match exactly)\n- When changing multiple separate locations in one file, use one edit call with multiple entries in edits[] instead of multiple edit calls\n- Each edits[].oldText is matched against the original file, not after earlier edits are applied. Do not emit overlapping or nested edits. Merge nearby changes into one edit.\n- Keep edits[].oldText as small as possible while still being unique in the file. Do not pad with large unchanged regions.\n- Use write only for new files or complete rewrites.\n- Be concise in your responses\n- Show file paths clearly when working with files\n\nPi documentation (read only when the user asks about pi itself, its SDK, extensions, themes, skills, or TUI):\n- Main documentation: /Users/xhardy/.nvm/versions/node/v24.14.1/lib/node_modules/@mariozechner/pi-coding-agent/README.md\n- Additional docs: /Users/xhardy/.nvm/versions/node/v24.14.1/lib/node_modules/@mariozechner/pi-coding-agent/docs\n- Examples: /Users/xhardy/.nvm/versions/node/v24.14.1/lib/node_modules/@mariozechner/pi-coding-agent/examples (extensions, custom tools, SDK)\n- When asked about: extensions (docs/extensions.md, examples/extensions/), themes (docs/themes.md), skills (docs/skills.md), prompt templates (docs/prompt-templates.md), TUI components (docs/tui.md), keybindings (docs/keybindings.md), SDK integrations (docs/sdk.md), custom providers (docs/custom-provider.md), adding models (docs/models.md), pi packages (docs/packages.md)\n- When working on pi topics, read the docs and examples, and follow .md cross-references before implementing\n- Always read pi .md files completely and follow links to related docs (e.g., tui.md for TUI API details)\nCurrent date: 2026-04-08\nCurrent working directory: /tmp"
		},
		{
			"role": "user",
			"content": [
				{
					"type": "text",
					"text": "Write Python tictactoe game in a file"
				}
			]
		},
		{
			"role": "user",
			"content": [
				{
					"type": "text",
					"text": "Write Python tictactoe game in a file"
				}
			]
		}
	],
	"stream": true,
	"stream_options": {
		"include_usage": true
	},
	"store": false,
	"max_completion_tokens": 512,
	"tools": [
		{
			"type": "function",
			"function": {
				"name": "read",
				"description": "Read the contents of a file. Supports text files and images (jpg, png, gif, webp). Images are sent as attachments. For text files, output is truncated to 2000 lines or 50KB (whichever is hit first). Use offset/limit for large files. When you need the full file, continue with offset until complete.",
				"parameters": {
					"type": "object",
					"required": [
						"path"
					],
					"properties": {
						"path": {
							"description": "Path to the file to read (relative or absolute)",
							"type": "string"
						},
						"offset": {
							"description": "Line number to start reading from (1-indexed)",
							"type": "number"
						},
						"limit": {
							"description": "Maximum number of lines to read",
							"type": "number"
						}
					}
				},
				"strict": false
			}
		},
		{
			"type": "function",
			"function": {
				"name": "bash",
				"description": "Execute a bash command in the current working directory. Returns stdout and stderr. Output is truncated to last 2000 lines or 50KB (whichever is hit first). If truncated, full output is saved to a temp file. Optionally provide a timeout in seconds.",
				"parameters": {
					"type": "object",
					"required": [
						"command"
					],
					"properties": {
						"command": {
							"description": "Bash command to execute",
							"type": "string"
						},
						"timeout": {
							"description": "Timeout in seconds (optional, no default timeout)",
							"type": "number"
						}
					}
				},
				"strict": false
			}
		},
		{
			"type": "function",
			"function": {
				"name": "edit",
				"description": "Edit a single file using exact text replacement. Every edits[].oldText must match a unique, non-overlapping region of the original file. If two changes affect the same block or nearby lines, merge them into one edit instead of emitting overlapping edits. Do not include large unchanged regions just to connect distant changes.",
				"parameters": {
					"additionalProperties": false,
					"type": "object",
					"required": [
						"path",
						"edits"
					],
					"properties": {
						"path": {
							"description": "Path to the file to edit (relative or absolute)",
							"type": "string"
						},
						"edits": {
							"description": "One or more targeted replacements. Each edit is matched against the original file, not incrementally. Do not include overlapping or nested edits. If two changes touch the same block or nearby lines, merge them into one edit instead.",
							"type": "array",
							"items": {
								"additionalProperties": false,
								"type": "object",
								"required": [
									"oldText",
									"newText"
								],
								"properties": {
									"oldText": {
										"description": "Exact text for one targeted replacement. It must be unique in the original file and must not overlap with any other edits[].oldText in the same call.",
										"type": "string"
									},
									"newText": {
										"description": "Replacement text for this targeted edit.",
										"type": "string"
									}
								}
							}
						}
					}
				},
				"strict": false
			}
		},
		{
			"type": "function",
			"function": {
				"name": "write",
				"description": "Write content to a file. Creates the file if it doesn't exist, overwrites if it does. Automatically creates parent directories.",
				"parameters": {
					"type": "object",
					"required": [
						"path",
						"content"
					],
					"properties": {
						"path": {
							"description": "Path to the file to write (relative or absolute)",
							"type": "string"
						},
						"content": {
							"description": "Content to write to the file",
							"type": "string"
						}
					}
				},
				"strict": false
			}
		}
	]
}
2026-04-08 08:47:33,595 - INFO - Prompt Cache: 0 sequences, 0.00 GB
2026-04-08 08:47:33,595 - INFO - - assistant: 0 sequences, 0.00 GB
2026-04-08 08:47:33,595 - INFO - - user: 0 sequences, 0.00 GB
2026-04-08 08:47:33,595 - INFO - - system: 0 sequences, 0.00 GB
127.0.0.1 - - [08/Apr/2026 08:47:33] "POST /v1/chat/completions HTTP/1.1" 200 -
2026-04-08 08:47:33,742 - DEBUG - Starting stream:
2026-04-08 08:47:40,845 - INFO - Prompt processing progress: 1314/1344
2026-04-08 08:47:41,169 - INFO - Prompt processing progress: 1343/1344
2026-04-08 08:47:41,220 - INFO - Prompt processing progress: 1344/1344
2026-04-08 08:47:41,398 - DEBUG - 

2026-04-08 08:47:41,428 - DEBUG - call
2026-04-08 08:47:41,458 - DEBUG - :
2026-04-08 08:47:41,487 - DEBUG - write
2026-04-08 08:47:41,517 - DEBUG - {
2026-04-08 08:47:41,547 - DEBUG - content
2026-04-08 08:47:41,577 - DEBUG - :
2026-04-08 08:47:41,607 - DEBUG - <|"|>
2026-04-08 08:47:41,637 - DEBUG - import
2026-04-08 08:47:41,667 - DEBUG -  os
2026-04-08 08:47:41,698 - DEBUG - 


2026-04-08 08:47:41,728 - DEBUG - def
2026-04-08 08:47:41,760 - DEBUG -  print
2026-04-08 08:47:41,790 - DEBUG - _
2026-04-08 08:47:41,820 - DEBUG - board
2026-04-08 08:47:41,849 - DEBUG - (
2026-04-08 08:47:41,879 - DEBUG - board
2026-04-08 08:47:41,909 - DEBUG - ):
2026-04-08 08:47:41,940 - DEBUG - 

2026-04-08 08:47:41,969 - DEBUG -     
2026-04-08 08:47:41,999 - DEBUG - """
2026-04-08 08:47:42,029 - DEBUG - Prints
2026-04-08 08:47:42,061 - DEBUG -  the
2026-04-08 08:47:42,091 - DEBUG -  game
2026-04-08 08:47:42,121 - DEBUG -  board
2026-04-08 08:47:42,151 - DEBUG - ."""
2026-04-08 08:47:42,181 - DEBUG - 

2026-04-08 08:47:42,211 - DEBUG -     
2026-04-08 08:47:42,242 - DEBUG - os
2026-04-08 08:47:42,272 - DEBUG - .
2026-04-08 08:47:42,303 - DEBUG - system
2026-04-08 08:47:42,333 - DEBUG - ('
2026-04-08 08:47:42,364 - DEBUG - cls
2026-04-08 08:47:42,394 - DEBUG - '
2026-04-08 08:47:42,424 - DEBUG -  if
2026-04-08 08:47:42,455 - DEBUG -  os
2026-04-08 08:47:42,485 - DEBUG - .
2026-04-08 08:47:42,515 - DEBUG - name
2026-04-08 08:47:42,545 - DEBUG -  ==
2026-04-08 08:47:42,575 - DEBUG -  '
2026-04-08 08:47:42,606 - DEBUG - nt
2026-04-08 08:47:42,637 - DEBUG - '
2026-04-08 08:47:42,667 - DEBUG -  else
2026-04-08 08:47:42,698 - DEBUG -  '
2026-04-08 08:47:42,728 - DEBUG - clear
2026-04-08 08:47:42,758 - DEBUG - ')
2026-04-08 08:47:42,788 - DEBUG - 

2026-04-08 08:47:42,819 - DEBUG -     
2026-04-08 08:47:42,849 - DEBUG - print
2026-04-08 08:47:42,879 - DEBUG - ("
2026-04-08 08:47:42,909 - DEBUG -  ")
2026-04-08 08:47:42,939 - DEBUG - 

2026-04-08 08:47:42,969 - DEBUG -     
2026-04-08 08:47:43,000 - DEBUG - for
2026-04-08 08:47:43,031 - DEBUG -  i
2026-04-08 08:47:43,061 - DEBUG -  in
2026-04-08 08:47:43,091 - DEBUG -  range
2026-04-08 08:47:43,122 - DEBUG - (
2026-04-08 08:47:43,152 - DEBUG - 3
2026-04-08 08:47:43,182 - DEBUG - ):
2026-04-08 08:47:43,212 - DEBUG - 

2026-04-08 08:47:43,242 - DEBUG -         
2026-04-08 08:47:43,272 - DEBUG - print
2026-04-08 08:47:43,302 - DEBUG - (
2026-04-08 08:47:43,333 - DEBUG - f
2026-04-08 08:47:43,362 - DEBUG - "
2026-04-08 08:47:43,393 - DEBUG -  {
2026-04-08 08:47:43,423 - DEBUG - board
2026-04-08 08:47:43,453 - DEBUG - [
2026-04-08 08:47:43,483 - DEBUG - i
2026-04-08 08:47:43,513 - DEBUG - *
2026-04-08 08:47:43,544 - DEBUG - 3
2026-04-08 08:47:43,574 - DEBUG - ]}
2026-04-08 08:47:43,604 - DEBUG -  |
2026-04-08 08:47:43,634 - DEBUG -  {
2026-04-08 08:47:43,664 - DEBUG - board
2026-04-08 08:47:43,695 - DEBUG - [
2026-04-08 08:47:43,725 - DEBUG - i
2026-04-08 08:47:43,756 - DEBUG - *
2026-04-08 08:47:43,786 - DEBUG - 3
2026-04-08 08:47:43,816 - DEBUG - +
2026-04-08 08:47:43,847 - DEBUG - 1
2026-04-08 08:47:43,876 - DEBUG - ]}
2026-04-08 08:47:43,908 - DEBUG -  |
2026-04-08 08:47:43,937 - DEBUG -  {
2026-04-08 08:47:43,967 - DEBUG - board
2026-04-08 08:47:43,998 - DEBUG - [
2026-04-08 08:47:44,028 - DEBUG - i
2026-04-08 08:47:44,058 - DEBUG - *
2026-04-08 08:47:44,089 - DEBUG - 3
2026-04-08 08:47:44,119 - DEBUG - +
2026-04-08 08:47:44,149 - DEBUG - 2
2026-04-08 08:47:44,180 - DEBUG - ]}
2026-04-08 08:47:44,209 - DEBUG -  ")
2026-04-08 08:47:44,240 - DEBUG - 

2026-04-08 08:47:44,270 - DEBUG -         
2026-04-08 08:47:44,300 - DEBUG - if
2026-04-08 08:47:44,331 - DEBUG -  i
2026-04-08 08:47:44,361 - DEBUG -  <
2026-04-08 08:47:44,391 - DEBUG -  
2026-04-08 08:47:44,422 - DEBUG - 2
2026-04-08 08:47:44,452 - DEBUG - :
2026-04-08 08:47:44,482 - DEBUG - 

2026-04-08 08:47:44,512 - DEBUG -             
2026-04-08 08:47:44,542 - DEBUG - print
2026-04-08 08:47:44,572 - DEBUG - ("
2026-04-08 08:47:44,602 - DEBUG - -----------
2026-04-08 08:47:44,633 - DEBUG - ")
2026-04-08 08:47:44,663 - DEBUG - 

2026-04-08 08:47:44,693 - DEBUG -     
2026-04-08 08:47:44,723 - DEBUG - print
2026-04-08 08:47:44,753 - DEBUG - ("
2026-04-08 08:47:44,784 - DEBUG -  ")
2026-04-08 08:47:44,814 - DEBUG - 


2026-04-08 08:47:44,844 - DEBUG - def
2026-04-08 08:47:44,874 - DEBUG -  check
2026-04-08 08:47:44,905 - DEBUG - _
2026-04-08 08:47:44,936 - DEBUG - winner
2026-04-08 08:47:44,966 - DEBUG - (
2026-04-08 08:47:44,996 - DEBUG - board
2026-04-08 08:47:45,026 - DEBUG - ):
2026-04-08 08:47:45,056 - DEBUG - 

2026-04-08 08:47:45,086 - DEBUG -     
2026-04-08 08:47:45,117 - DEBUG - """
2026-04-08 08:47:45,147 - DEBUG - Checks
2026-04-08 08:47:45,177 - DEBUG -  if
2026-04-08 08:47:45,207 - DEBUG -  there
2026-04-08 08:47:45,237 - DEBUG -  is
2026-04-08 08:47:45,267 - DEBUG -  a
2026-04-08 08:47:45,298 - DEBUG -  winner
2026-04-08 08:47:45,328 - DEBUG -  on
2026-04-08 08:47:45,358 - DEBUG -  the
2026-04-08 08:47:45,388 - DEBUG -  board
2026-04-08 08:47:45,418 - DEBUG - ."""
2026-04-08 08:47:45,450 - DEBUG - 

2026-04-08 08:47:45,480 - DEBUG -     
2026-04-08 08:47:45,510 - DEBUG - win
2026-04-08 08:47:45,540 - DEBUG - _
2026-04-08 08:47:45,571 - DEBUG - combinations
2026-04-08 08:47:45,601 - DEBUG -  =
2026-04-08 08:47:45,631 - DEBUG -  [
2026-04-08 08:47:45,661 - DEBUG - 

2026-04-08 08:47:45,691 - DEBUG -         
2026-04-08 08:47:45,721 - DEBUG - [
2026-04-08 08:47:45,752 - DEBUG - 0
2026-04-08 08:47:45,782 - DEBUG - ,
2026-04-08 08:47:45,812 - DEBUG -  
2026-04-08 08:47:45,842 - DEBUG - 1
2026-04-08 08:47:45,874 - DEBUG - ,
2026-04-08 08:47:45,904 - DEBUG -  
2026-04-08 08:47:45,934 - DEBUG - 2
2026-04-08 08:47:45,964 - DEBUG - ],
2026-04-08 08:47:45,994 - DEBUG -  [
2026-04-08 08:47:46,024 - DEBUG - 3
2026-04-08 08:47:46,054 - DEBUG - ,
2026-04-08 08:47:46,085 - DEBUG -  
2026-04-08 08:47:46,116 - DEBUG - 4
2026-04-08 08:47:46,146 - DEBUG - ,
2026-04-08 08:47:46,176 - DEBUG -  
2026-04-08 08:47:46,206 - DEBUG - 5
2026-04-08 08:47:46,236 - DEBUG - ],
2026-04-08 08:47:46,266 - DEBUG -  [
2026-04-08 08:47:46,296 - DEBUG - 6
2026-04-08 08:47:46,327 - DEBUG - ,
2026-04-08 08:47:46,357 - DEBUG -  
2026-04-08 08:47:46,387 - DEBUG - 7
2026-04-08 08:47:46,417 - DEBUG - ,
2026-04-08 08:47:46,449 - DEBUG -  
2026-04-08 08:47:46,479 - DEBUG - 8
2026-04-08 08:47:46,509 - DEBUG - ],
2026-04-08 08:47:46,539 - DEBUG -   
2026-04-08 08:47:46,569 - DEBUG - #
2026-04-08 08:47:46,600 - DEBUG -  Rows
2026-04-08 08:47:46,630 - DEBUG - 

2026-04-08 08:47:46,660 - DEBUG -         
2026-04-08 08:47:46,691 - DEBUG - [
2026-04-08 08:47:46,721 - DEBUG - 0
2026-04-08 08:47:46,752 - DEBUG - ,
2026-04-08 08:47:46,782 - DEBUG -  
2026-04-08 08:47:46,812 - DEBUG - 3
2026-04-08 08:47:46,843 - DEBUG - ,
2026-04-08 08:47:46,873 - DEBUG -  
2026-04-08 08:47:46,903 - DEBUG - 6
2026-04-08 08:47:46,933 - DEBUG - ],
2026-04-08 08:47:46,963 - DEBUG -  [
2026-04-08 08:47:46,994 - DEBUG - 1
2026-04-08 08:47:47,024 - DEBUG - ,
2026-04-08 08:47:47,054 - DEBUG -  
2026-04-08 08:47:47,085 - DEBUG - 4
2026-04-08 08:47:47,116 - DEBUG - ,
2026-04-08 08:47:47,145 - DEBUG -  
2026-04-08 08:47:47,174 - DEBUG - 7
2026-04-08 08:47:47,204 - DEBUG - ],
2026-04-08 08:47:47,235 - DEBUG -  [
2026-04-08 08:47:47,266 - DEBUG - 2
2026-04-08 08:47:47,296 - DEBUG - ,
2026-04-08 08:47:47,327 - DEBUG -  
2026-04-08 08:47:47,358 - DEBUG - 5
2026-04-08 08:47:47,388 - DEBUG - ,
2026-04-08 08:47:47,420 - DEBUG -  
2026-04-08 08:47:47,451 - DEBUG - 8
2026-04-08 08:47:47,482 - DEBUG - ],
2026-04-08 08:47:47,513 - DEBUG -   
2026-04-08 08:47:47,545 - DEBUG - #
2026-04-08 08:47:47,577 - DEBUG -  Columns
2026-04-08 08:47:47,607 - DEBUG - 

2026-04-08 08:47:47,638 - DEBUG -         
2026-04-08 08:47:47,668 - DEBUG - [
2026-04-08 08:47:47,698 - DEBUG - 0
2026-04-08 08:47:47,728 - DEBUG - ,
2026-04-08 08:47:47,758 - DEBUG -  
2026-04-08 08:47:47,788 - DEBUG - 4
2026-04-08 08:47:47,817 - DEBUG - ,
2026-04-08 08:47:47,847 - DEBUG -  
2026-04-08 08:47:47,877 - DEBUG - 8
2026-04-08 08:47:47,908 - DEBUG - ],
2026-04-08 08:47:47,938 - DEBUG -  [
2026-04-08 08:47:47,969 - DEBUG - 2
2026-04-08 08:47:47,999 - DEBUG - ,
2026-04-08 08:47:48,030 - DEBUG -  
2026-04-08 08:47:48,060 - DEBUG - 4
2026-04-08 08:47:48,090 - DEBUG - ,
2026-04-08 08:47:48,121 - DEBUG -  
2026-04-08 08:47:48,151 - DEBUG - 6
2026-04-08 08:47:48,181 - DEBUG - ]
2026-04-08 08:47:48,212 - DEBUG -                
2026-04-08 08:47:48,242 - DEBUG - #
2026-04-08 08:47:48,272 - DEBUG -  Di
2026-04-08 08:47:48,304 - DEBUG - agon
2026-04-08 08:47:48,334 - DEBUG - als
2026-04-08 08:47:48,365 - DEBUG - 

2026-04-08 08:47:48,395 - DEBUG -     
2026-04-08 08:47:48,425 - DEBUG - ]
2026-04-08 08:47:48,456 - DEBUG - 

2026-04-08 08:47:48,488 - DEBUG -     
2026-04-08 08:47:48,519 - DEBUG - for
2026-04-08 08:47:48,551 - DEBUG -  combo
2026-04-08 08:47:48,582 - DEBUG -  in
2026-04-08 08:47:48,613 - DEBUG -  win
2026-04-08 08:47:48,644 - DEBUG - _
2026-04-08 08:47:48,675 - DEBUG - combinations
2026-04-08 08:47:48,707 - DEBUG - :
2026-04-08 08:47:48,738 - DEBUG - 

2026-04-08 08:47:48,769 - DEBUG -         
2026-04-08 08:47:48,799 - DEBUG - if
2026-04-08 08:47:48,831 - DEBUG -  board
2026-04-08 08:47:48,863 - DEBUG - [
2026-04-08 08:47:48,894 - DEBUG - combo
2026-04-08 08:47:48,925 - DEBUG - [
2026-04-08 08:47:48,956 - DEBUG - 0
2026-04-08 08:47:48,987 - DEBUG - ]]
2026-04-08 08:47:49,018 - DEBUG -  ==
2026-04-08 08:47:49,049 - DEBUG -  board
2026-04-08 08:47:49,080 - DEBUG - [
2026-04-08 08:47:49,113 - DEBUG - combo
2026-04-08 08:47:49,143 - DEBUG - [
2026-04-08 08:47:49,175 - DEBUG - 1
2026-04-08 08:47:49,205 - DEBUG - ]]
2026-04-08 08:47:49,237 - DEBUG -  ==
2026-04-08 08:47:49,268 - DEBUG -  board
2026-04-08 08:47:49,299 - DEBUG - [
2026-04-08 08:47:49,330 - DEBUG - combo
2026-04-08 08:47:49,362 - DEBUG - [
2026-04-08 08:47:49,394 - DEBUG - 2
2026-04-08 08:47:49,425 - DEBUG - ]]
2026-04-08 08:47:49,456 - DEBUG -  !=
2026-04-08 08:47:49,488 - DEBUG -  "
2026-04-08 08:47:49,519 - DEBUG -  ":
2026-04-08 08:47:49,549 - DEBUG - 

2026-04-08 08:47:49,580 - DEBUG -             
2026-04-08 08:47:49,611 - DEBUG - return
2026-04-08 08:47:49,642 - DEBUG -  board
2026-04-08 08:47:49,674 - DEBUG - [
2026-04-08 08:47:49,705 - DEBUG - combo
2026-04-08 08:47:49,736 - DEBUG - [
2026-04-08 08:47:49,767 - DEBUG - 0
2026-04-08 08:47:49,798 - DEBUG - ]]
2026-04-08 08:47:49,829 - DEBUG - 

2026-04-08 08:47:49,859 - DEBUG -     
2026-04-08 08:47:49,891 - DEBUG - return
2026-04-08 08:47:49,922 - DEBUG -  None
2026-04-08 08:47:49,953 - DEBUG - 


2026-04-08 08:47:49,984 - DEBUG - def
2026-04-08 08:47:50,015 - DEBUG -  is
2026-04-08 08:47:50,045 - DEBUG - _
2026-04-08 08:47:50,076 - DEBUG - full
2026-04-08 08:47:50,107 - DEBUG - (
2026-04-08 08:47:50,138 - DEBUG - board
2026-04-08 08:47:50,169 - DEBUG - ):
2026-04-08 08:47:50,200 - DEBUG - 

2026-04-08 08:47:50,231 - DEBUG -     
2026-04-08 08:47:50,263 - DEBUG - """
2026-04-08 08:47:50,293 - DEBUG - Checks
2026-04-08 08:47:50,324 - DEBUG -  if
2026-04-08 08:47:50,355 - DEBUG -  the
2026-04-08 08:47:50,386 - DEBUG -  board
2026-04-08 08:47:50,417 - DEBUG -  is
2026-04-08 08:47:50,448 - DEBUG -  full
2026-04-08 08:47:50,479 - DEBUG - ."""
2026-04-08 08:47:50,510 - DEBUG - 

2026-04-08 08:47:50,541 - DEBUG -     
2026-04-08 08:47:50,572 - DEBUG - return
2026-04-08 08:47:50,603 - DEBUG -  "
2026-04-08 08:47:50,633 - DEBUG -  "
2026-04-08 08:47:50,664 - DEBUG -  not
2026-04-08 08:47:50,695 - DEBUG -  in
2026-04-08 08:47:50,726 - DEBUG -  board
2026-04-08 08:47:50,758 - DEBUG - 


2026-04-08 08:47:50,789 - DEBUG - def
2026-04-08 08:47:50,821 - DEBUG -  tic
2026-04-08 08:47:50,853 - DEBUG - _
2026-04-08 08:47:50,884 - DEBUG - tac
2026-04-08 08:47:50,915 - DEBUG - _
2026-04-08 08:47:50,946 - DEBUG - toe
2026-04-08 08:47:50,978 - DEBUG - ():
2026-04-08 08:47:51,009 - DEBUG - 

2026-04-08 08:47:51,040 - DEBUG -     
2026-04-08 08:47:51,071 - DEBUG - """
2026-04-08 08:47:51,102 - DEBUG - Main
2026-04-08 08:47:51,134 - DEBUG -  function
2026-04-08 08:47:51,165 - DEBUG -  to
2026-04-08 08:47:51,196 - DEBUG -  run
2026-04-08 08:47:51,227 - DEBUG -  the
2026-04-08 08:47:51,258 - DEBUG -  game
2026-04-08 08:47:51,289 - DEBUG - ."""
2026-04-08 08:47:51,321 - DEBUG - 

2026-04-08 08:47:51,351 - DEBUG -     
2026-04-08 08:47:51,382 - DEBUG - board
2026-04-08 08:47:51,413 - DEBUG -  =
2026-04-08 08:47:51,444 - DEBUG -  ["
2026-04-08 08:47:51,475 - DEBUG -  "]
2026-04-08 08:47:51,506 - DEBUG -  *
2026-04-08 08:47:51,537 - DEBUG -  
2026-04-08 08:47:51,567 - DEBUG - 9
2026-04-08 08:47:51,598 - DEBUG - 

2026-04-08 08:47:51,628 - DEBUG -     
2026-04-08 08:47:51,659 - DEBUG - current
2026-04-08 08:47:51,689 - DEBUG - _
2026-04-08 08:47:51,719 - DEBUG - player
2026-04-08 08:47:51,750 - DEBUG -  =
2026-04-08 08:47:51,780 - DEBUG -  "
2026-04-08 08:47:51,811 - DEBUG - X
2026-04-08 08:47:51,842 - DEBUG - "
2026-04-08 08:47:51,873 - DEBUG - 


2026-04-08 08:47:51,904 - DEBUG -     
2026-04-08 08:47:51,935 - DEBUG - while
2026-04-08 08:47:51,965 - DEBUG -  True
2026-04-08 08:47:51,996 - DEBUG - :
2026-04-08 08:47:52,026 - DEBUG - 

2026-04-08 08:47:52,057 - DEBUG -         
2026-04-08 08:47:52,088 - DEBUG - print
2026-04-08 08:47:52,118 - DEBUG - _
2026-04-08 08:47:52,149 - DEBUG - board
2026-04-08 08:47:52,180 - DEBUG - (
2026-04-08 08:47:52,210 - DEBUG - board
2026-04-08 08:47:52,242 - DEBUG - )
2026-04-08 08:47:52,274 - DEBUG - 

2026-04-08 08:47:52,305 - DEBUG -         
2026-04-08 08:47:52,336 - DEBUG - print
2026-04-08 08:47:52,366 - DEBUG - (
2026-04-08 08:47:52,398 - DEBUG - f
2026-04-08 08:47:52,429 - DEBUG - "
2026-04-08 08:47:52,458 - DEBUG - Player
2026-04-08 08:47:52,489 - DEBUG -  {
2026-04-08 08:47:52,520 - DEBUG - current
2026-04-08 08:47:52,550 - DEBUG - _
2026-04-08 08:47:52,580 - DEBUG - player
2026-04-08 08:47:52,609 - DEBUG - }'
2026-04-08 08:47:52,639 - DEBUG - s
2026-04-08 08:47:52,669 - DEBUG -  turn
2026-04-08 08:47:52,699 - DEBUG - .")
2026-04-08 08:47:52,730 - DEBUG - 

2026-04-08 08:47:52,761 - DEBUG -         
2026-04-08 08:47:52,791 - DEBUG - 

2026-04-08 08:47:52,822 - DEBUG -         
2026-04-08 08:47:52,852 - DEBUG - try
2026-04-08 08:47:52,883 - DEBUG - :
2026-04-08 08:47:52,913 - DEBUG - 

2026-04-08 08:47:52,943 - DEBUG -             
2026-04-08 08:47:52,974 - DEBUG - move
2026-04-08 08:47:53,005 - DEBUG -  =
2026-04-08 08:47:53,035 - DEBUG -  int
2026-04-08 08:47:53,066 - DEBUG - (
2026-04-08 08:47:53,096 - DEBUG - input
2026-04-08 08:47:53,127 - DEBUG - ("
2026-04-08 08:47:53,157 - DEBUG - Enter
2026-04-08 08:47:53,188 - DEBUG -  your
2026-04-08 08:47:53,218 - DEBUG -  move
2026-04-08 08:47:53,249 - DEBUG -  (
2026-04-08 08:47:53,279 - DEBUG - 1
2026-04-08 08:47:53,309 - DEBUG - -
2026-04-08 08:47:53,341 - DEBUG - 9
2026-04-08 08:47:53,371 - DEBUG - ):
2026-04-08 08:47:53,402 - DEBUG -  "))
2026-04-08 08:47:53,432 - DEBUG -  -
2026-04-08 08:47:53,463 - DEBUG -  
2026-04-08 08:47:53,493 - DEBUG - 1
2026-04-08 08:47:53,524 - DEBUG - 

2026-04-08 08:47:53,554 - DEBUG -             
2026-04-08 08:47:53,585 - DEBUG - if
2026-04-08 08:47:53,616 - DEBUG -  move
2026-04-08 08:47:53,646 - DEBUG -  <
2026-04-08 08:47:53,677 - DEBUG -  
2026-04-08 08:47:53,707 - DEBUG - 0
2026-04-08 08:47:53,738 - DEBUG -  or
2026-04-08 08:47:53,768 - DEBUG -  move
2026-04-08 08:47:53,799 - DEBUG -  >
2026-04-08 08:47:53,829 - DEBUG -  
2026-04-08 08:47:53,859 - DEBUG - 8
2026-04-08 08:47:53,891 - DEBUG - :
2026-04-08 08:47:53,921 - DEBUG - 

2026-04-08 08:47:53,952 - DEBUG -                 
2026-04-08 08:47:53,983 - DEBUG - print
2026-04-08 08:47:54,014 - DEBUG - ("
2026-04-08 08:47:54,045 - DEBUG - Invalid
2026-04-08 08:47:54,076 - DEBUG -  move
2026-04-08 08:47:54,107 - DEBUG - !
2026-04-08 08:47:54,138 - DEBUG -  Please
2026-04-08 08:47:54,169 - DEBUG -  enter
2026-04-08 08:47:54,200 - DEBUG -  a
2026-04-08 08:47:54,232 - DEBUG -  number
2026-04-08 08:47:54,262 - DEBUG -  between
2026-04-08 08:47:54,295 - DEBUG -  
2026-04-08 08:47:54,325 - DEBUG - 1
2026-04-08 08:47:54,356 - DEBUG -  and
2026-04-08 08:47:54,388 - DEBUG -  
2026-04-08 08:47:54,419 - DEBUG - 9
2026-04-08 08:47:54,451 - DEBUG - .")
2026-04-08 08:47:54,482 - DEBUG - 

2026-04-08 08:47:54,513 - DEBUG -                 
2026-04-08 08:47:54,544 - DEBUG - continue
2026-04-08 08:47:54,575 - DEBUG - 

2026-04-08 08:47:54,605 - DEBUG -             
2026-04-08 08:47:54,636 - DEBUG - if
2026-04-08 08:47:54,667 - DEBUG -  board
2026-04-08 08:47:54,698 - DEBUG - [
2026-04-08 08:47:54,729 - DEBUG - move
2026-04-08 08:47:54,759 - DEBUG - ]
2026-04-08 08:47:54,789 - DEBUG -  !=
2026-04-08 08:47:54,820 - DEBUG -  "
2026-04-08 08:47:54,852 - DEBUG -  ":
2026-04-08 08:47:54,882 - DEBUG - 

2026-04-08 08:47:54,912 - DEBUG -                 
2026-04-08 08:47:54,943 - DEBUG - print
2026-04-08 08:47:54,973 - DEBUG - ("
2026-04-08 08:47:55,003 - DEBUG - That
2026-04-08 08:47:55,035 - DEBUG -  position
2026-04-08 08:47:55,066 - DEBUG -  is
2026-04-08 08:47:55,096 - DEBUG -  already
2026-04-08 08:47:55,127 - DEBUG -  taken
2026-04-08 08:47:55,157 - DEBUG - !
2026-04-08 08:47:55,188 - DEBUG -  Try
2026-04-08 08:47:55,218 - DEBUG -  again
2026-04-08 08:47:55,248 - DEBUG - .")
2026-04-08 08:47:55,280 - DEBUG - 

2026-04-08 08:47:55,310 - DEBUG -                 
2026-04-08 08:47:55,341 - DEBUG - continue
2026-04-08 08:47:55,371 - DEBUG - 

2026-04-08 08:47:55,402 - DEBUG -         
2026-04-08 08:47:55,432 - DEBUG - except
2026-04-08 08:47:55,462 - DEBUG -  ValueError
2026-04-08 08:47:55,493 - DEBUG - :
2026-04-08 08:47:55,523 - DEBUG - 

2026-04-08 08:47:55,554 - DEBUG -             
2026-04-08 08:47:55,584 - DEBUG - print
2026-04-08 08:47:55,615 - DEBUG - ("
2026-04-08 08:47:55,646 - DEBUG - Invalid
2026-04-08 08:47:55,676 - DEBUG -  input
2026-04-08 08:47:55,707 - DEBUG - !
2026-04-08 08:47:55,738 - DEBUG -  Please
2026-04-08 08:47:55,768 - DEBUG -  enter
2026-04-08 08:47:55,799 - DEBUG -  a
2026-04-08 08:47:55,830 - DEBUG -  number
2026-04-08 08:47:55,860 - DEBUG - .")
2026-04-08 08:47:55,891 - DEBUG - 

2026-04-08 08:47:55,921 - DEBUG -             
2026-04-08 08:47:55,951 - DEBUG - continue
2026-04-08 08:47:55,982 - DEBUG - 


2026-04-08 08:47:56,013 - DEBUG -         
2026-04-08 08:47:56,043 - DEBUG - board
2026-04-08 08:47:56,073 - DEBUG - [
2026-04-08 08:47:56,103 - DEBUG - move
2026-04-08 08:47:56,134 - DEBUG - ]
2026-04-08 08:47:56,164 - DEBUG -  =
2026-04-08 08:47:56,194 - DEBUG -  current
2026-04-08 08:47:56,225 - DEBUG - _
2026-04-08 08:47:56,255 - DEBUG - player
2026-04-08 08:47:56,286 - DEBUG - 

2026-04-08 08:47:56,318 - DEBUG -         
2026-04-08 08:47:56,348 - DEBUG - 

2026-04-08 08:47:56,379 - DEBUG -         
2026-04-08 08:47:56,410 - DEBUG - winner
2026-04-08 08:47:56,440 - DEBUG -  =
2026-04-08 08:47:56,470 - DEBUG -  check
2026-04-08 08:47:56,500 - DEBUG - _
2026-04-08 08:47:56,531 - DEBUG - winner
2026-04-08 08:47:56,562 - DEBUG - (
2026-04-08 08:47:56,593 - DEBUG - board
2026-04-08 08:47:56,623 - DEBUG - )
2026-04-08 08:47:56,654 - DEBUG - 

2026-04-08 08:47:56,685 - DEBUG -         
2026-04-08 08:47:56,715 - DEBUG - if
2026-04-08 08:47:56,746 - DEBUG -  winner
2026-04-08 08:47:56,777 - DEBUG - :
2026-04-08 08:47:56,807 - DEBUG - 

2026-04-08 08:47:56,838 - DEBUG -             
2026-04-08 08:47:56,879 - DEBUG - print
2026-04-08 08:47:56,879 - DEBUG - _
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 53862)
Traceback (most recent call last):
  File "/opt/homebrew/Cellar/python@3.14/3.14.3_1/Frameworks/Python.framework/Versions/3.14/lib/python3.14/socketserver.py", line 697, in process_request_thread
    self.finish_request(request, client_address)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.14/3.14.3_1/Frameworks/Python.framework/Versions/3.14/lib/python3.14/socketserver.py", line 362, in finish_request
    self.RequestHandlerClass(request, client_address, self)
    ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/server.py", line 1703, in <lambda>
    lambda *args, **kwargs: handler_class(
                            ~~~~~~~~~~~~~^
        response_generator,
        ^^^^^^^^^^^^^^^^^^^
    ...<2 lines>...
        **kwargs,
        ^^^^^^^^^
    ),
    ^
  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/server.py", line 1060, in __init__
    super().__init__(*args, **kwargs)
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.14/3.14.3_1/Frameworks/Python.framework/Versions/3.14/lib/python3.14/socketserver.py", line 766, in __init__
    self.handle()
    ~~~~~~~~~~~^^
  File "/opt/homebrew/Cellar/python@3.14/3.14.3_1/Frameworks/Python.framework/Versions/3.14/lib/python3.14/http/server.py", line 496, in handle
    self.handle_one_request()
    ~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/opt/homebrew/Cellar/python@3.14/3.14.3_1/Frameworks/Python.framework/Versions/3.14/lib/python3.14/http/server.py", line 484, in handle_one_request
    method()
    ~~~~~~^^
  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/server.py", line 1189, in do_POST
    self.handle_completion(request, stop_words)
    ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/server.py", line 1498, in handle_completion
    tool_calls=tool_formatter(tool_calls),
               ~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/server.py", line 81, in __call__
    parsed = self._tool_parser(tool_text, self._tools)
  File "/tmp/llm_venv/lib/python3.14/site-packages/mlx_lm/tool_parsers/gemma4.py", line 49, in parse_tool_call
    raise ValueError("No function provided.")
ValueError: No function provided.
----------------------------------------
^C2026-04-08 08:53:14,841 - DEBUG - close.started
2026-04-08 08:53:14,841 - DEBUG - close.complete

[gofastercloud]

Hit this independently yesterday on the same model (mlx-community/gemma-4-26b-a4b-it-4bit), same traceback, while migrating an agent gateway off Ollama. Opened #1142 with a minimal fix (return [] on empty match instead of raising). Kept the existing single-match-returns-dict behaviour intact so the test_gemma4 cases don't need to change. Feel free to review if the narrow scope works for you.

[Drjacky]

I got:

2026-04-12 16:41:02 [ERROR]
 Failed to load model "gemma-4-26b-a4b-it". Error: Failed to load model.
2026-04-12 16:41:02 [DEBUG]
 stopGenerating() without a request_id is deprecated. Taking no action
2026-04-12 16:43:03 [DEBUG]
 ValueError: Gemma 4 support is not ready yet, stay tuned!

At:
  /Users/usernameeee/.lmstudio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac14-arm64@21/lib/python3.11/site-packages/mlx_engine/generate.py(170): load_model
2026-04-12 16:43:04 [DEBUG]
 [LLMProcess] Failed to load model _0x951f6c [Error]: Failed to load model.
    at _0x590496.loadModel (/Applications/LM Studio.app/Contents/Resources/app/.webpack/lib/llmworker.js:1:562095)
    at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
    at async _0x590496.handleMessage (/Applications/LM Studio.app/Contents/Resources/app/.webpack/lib/llmworker.js:1:554276) {
  cause: 'Error when loading model: ValueError: Gemma 4 support is not ready yet, stay tuned!',
  suggestion: undefined,
  errorData: undefined,
  data: undefined,
  displayData: undefined,
  title: 'Failed to load model.'
}
2026-04-12 16:43:04 [DEBUG]
 stopGenerating() without a request_id is deprecated. Taking no action

[Laukes]

Same here

[BitsIO-Ram]

Same here