Implement escaped character support in Markdown tokenizer #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

DongyuZhao merged 1 commit into main from codex/add-backslash-escapes-and-special-character-handling

Jul 14, 2025

Owner

DongyuZhao commented Jul 14, 2025

Summary

handle backslash escape sequences in MarkdownLanguage.Tokenizer
treat escaped special characters as text tokens
expand character check to stop text capture at backslash
add coverage for escaped characters in Markdown tests

Testing

swift test

https://chatgpt.com/codex/tasks/task_e_687539b1d074832288dde87cb7e734cd


          Handle backslash escapes in Markdown tokenizer

badb802

DongyuZhao added the codex label

— with

ChatGPT Codex Connector

DongyuZhao merged commit f9b20ca into main

DongyuZhao deleted the codex/add-backslash-escapes-and-special-character-handling branch

July 16, 2025 08:15

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels