fix(treesitter): always free token contents to prevent a memory leak

[amaanq]

Detected with libfuzzer

Also just inlined the stack so there's no need to allocate twice for the stack and its data ptr

[medvednikov]

hey

thanks!

VLS is in the middle of a HUGE re-write, the repo is private atm, but it will be released in July:

https://github.com/v-analyzer

this re-write works great, vlang/vls is currently archived

[amaanq]

thanks for the response! Since this is archived, should I submit the changes to v-tree-sitter then? (Projects like nvim-treesitter use this to provide V syntax highlighting support, I can switch the repo to be v-tree-sitter if that's better)

[medvednikov]

I guess, yeah :)

[i582]

thanks for the response! Since this is archived, should I submit the changes to v-tree-sitter then? (Projects like nvim-treesitter use this to provide V syntax highlighting support, I can switch the repo to be v-tree-sitter if that's better)

Hi
When we release a new version, it will be cool if your changes are pushed there, I will check if I have already fixed them in the current version, since I rewrote the scanner

[i582]

seems to be fixed in my version