I found that under VSCode insider edition which supports Apple Silicon, every time I installed rust-analyzer plugin there would be a pop-up asking me to download rust-analyzer binary. Even ra was already existed in $PATH.
This is not the worst. If I let it download automatically and start coding in Rust, the editor will get soooooo laggy when typing. But if I ignore that pop-up and configure the existing binary path under config of plugin, it works well.
I guess the auto-downloading downloads an Intel version in fact?