bpetite

Deterministic byte-level BPE tokenizer. Placeholder README — full documentation lands in Task 4-5.

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
.claude/skills		.claude/skills
.github		.github
.vscode		.vscode
docs		docs
scripts		scripts
src/bpetite		src/bpetite
tests		tests
.gitignore		.gitignore
.markdownlint.json		.markdownlint.json
.pre-commit-config.yaml		.pre-commit-config.yaml
CLAUDE.md		CLAUDE.md
README.md		README.md
pyproject.toml		pyproject.toml
setup-hooks.sh		setup-hooks.sh
uv.lock		uv.lock

Provide feedback