perf(plugins): optimize highlight to use codeToTokens fast path to skip hast intermediary

[arashsheyda]

🔗 Linked issue

❓ Type of change

• 📖 Documentation (updates to the documentation or readme)
• 🐞 Bug fix (a non-breaking change that fixes an issue)
• 👌 Enhancement (improving an existing functionality like performance)
• ✨ New feature (a non-breaking change that adds functionality)
• ⚠️ Breaking change (fix or feature that would cause existing functionality to change)

📚 Description

this PR optimizes the highlight plugin further by using shiki's codeToTokens API directly instead of codeToHast when no transformers are configured. this skips the entire hast tree construction and the subsequent hast => ComarkNode conversion, building ComarkNodes directly from the flat token array in a single pass

Before	After

📝 Checklist

• I have linked an issue or discussion.
• I have run pnpm verify and it passes.
• I have updated the documentation accordingly.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
comark	Ready	Preview	Apr 28, 2026 5:57pm
comark-json-render	Ready	Preview	Apr 28, 2026 5:57pm
comark-nextjs	Ready	Preview	Apr 28, 2026 5:57pm
comark-nuxt	Ready	Preview	Apr 28, 2026 5:57pm
comark-svelte	Ready	Preview	Apr 28, 2026 5:57pm
comark-twoslash	Ready	Preview	Apr 28, 2026 5:57pm
comark-vue	Ready	Preview	Apr 28, 2026 5:57pm

[pkg-pr-new]

Open in StackBlitz

comark

npm i https://pkg.pr.new/comark@170

@comark/ansi

npm i https://pkg.pr.new/@comark/ansi@170

@comark/html

npm i https://pkg.pr.new/@comark/html@170

@comark/nuxt

npm i https://pkg.pr.new/@comark/nuxt@170

@comark/react

npm i https://pkg.pr.new/@comark/react@170

@comark/svelte

npm i https://pkg.pr.new/@comark/svelte@170

@comark/vue

npm i https://pkg.pr.new/@comark/vue@170

commit: fc5aa12

[farnabaz]

Comark used to use code to tokens at first but in order to support transformers we moved to code to hast.
Switching between these two based on transformers existence is smart move 👍