Missing tiktoken_bg.wasm file in extension package

[KJ7LNW]

Which version of the app are you using?

v3.17.2

Which API Provider are you using?

Not relevant to this issue

Which Model are you using?

sonnet-3.5

What happened?

The extension is missing the required tiktoken_bg.wasm WebAssembly file, causing errors during operation. This appears to be a packaging issue with the extension.

Error:

console.ts:137 [Extension Host] Error: Missing tiktoken_bg.wasm
    at /home/ewheeler/.vscode-insiders/extensions/rooveterinaryinc.roo-cline-3.17.2/dist/workers/countTokens.js:4:18509
    at /home/ewheeler/.vscode-insiders/extensions/rooveterinaryinc.roo-cline-3.17.2/dist/workers/countTokens.js:1:222
    at Object.<anonymous> (/home/ewheeler/.vscode-insiders/extensions/rooveterinaryinc.roo-cline-3.17.2/dist/workers/countTokens.js:4:2344180)
    at Module._compile (node:internal/modules/cjs/loader:1484:14)
    at Module._extensions..js (node:internal/modules/cjs/loader:1564:10)
    at Module.load (node:internal/modules/cjs/loader:1295:32)
    at Module._load (node:internal/modules/cjs/loader:1111:12)
    at c._load (node:electron/js2c/node_init:2:16955)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:188:12)
    at MessagePort.<anonymous> (node:internal/main/worker_thread:193:26)

Steps to reproduce

1. Open Roo in VSCode
2. Type "show me a simple mermaid diagram" (this is just one way to trigger the issue)
3. Observe the error in the console

Relevant API REQUEST output

The error is shown above.

Additional context

This appears to be a missing WebAssembly file that should be included in the extension package. The tiktoken_bg.wasm file is likely used for token counting functionality, and its absence causes errors when this functionality is invoked.

[vagadiya]

Hello @KJ7LNW , could you take a look at #3697 for me please?
I am on discord 'vagadiya' as well.

Thanks

[KJ7LNW]

@vagadiya, thanks for taking care of that one!

@mrubens Did you somehow verify that tiktoken is working properly now that it is included? I'm not familiar with that code.