From 8532dbaa4c521ee0ff8db7cb76be09737a96c8c4 Mon Sep 17 00:00:00 2001
From: Jacob Szwejbka <jakeszwe@meta.com>
Date: Thu, 16 Oct 2025 22:57:55 -0700
Subject: [PATCH] Pin bump tokenizer

Summary: pull in https://github.com/meta-pytorch/tokenizers/commit/b2a3d77d672d50f24d0ae7cd6df3b428469c2548

Differential Revision: D84889640
---
 extension/llm/tokenizers | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/extension/llm/tokenizers b/extension/llm/tokenizers
index d710a0cf10c..b2a3d77d672 160000
--- a/extension/llm/tokenizers
+++ b/extension/llm/tokenizers
@@ -1 +1 @@
-Subproject commit d710a0cf10cfa8cb7ffda33c4e61af63119bc95f
+Subproject commit b2a3d77d672d50f24d0ae7cd6df3b428469c2548