Automatic discovery of Pixi R interpreters

[roaldarbol]

On top of python interpreters from conda/mamba and global R installations (e.g. with rig), they can both be installed with pixi to pin versions within a single project - incredibly useful when it comes to reproducibility.

So this feature request is for the automatic discovery of interpreters living inside a .pixi folder inside the opened project/folder. Note, that this has just been implemented for VS Code (for Python only), but does not work in Positron. Maybe it can be patched, or there's possibly help to find in that PR. In any case it would also need to be implemented for R interpreter.

[Robinlovelace]

That is great to see, never came across pixi but seems like a great way to manage environments. I'd also like to flag micromamba, the most efficient way to set-up and configure Python envs I've come across. No built-in support in VS Code but there's a good extension: https://marketplace.visualstudio.com/items?itemName=corker.vscode-micromamba

Would Pixi supercede the need for micromamba support @roaldarbol? You've saved me opening a feature request if so!

[Robinlovelace]

Also see prefix-dev/pixi#1543 by the author of the original post.

[roaldarbol]

@Robinlovelace It will! So the guys at prefix are the same folks behind mamba, and pixi is their "new" flagship - mamba will of course still be supported as I understand it. I use pixi now with all my projects, and we're just laying final touches on the last missing features to make it the option for R too - I currently have some nice mixed R/Python projects managed in the same environment, fully reproducible and IDE-independent. 😊

[Robinlovelace]

Very cool, keep up the great work!

[seeM]

Thank you for the info! Since we're currently using a fork of the vscode-python extension, the new pixi locator should just work once we've merged the latest release from upstream 🤞

[roaldarbol]

@seeM That sounds great! How about discovery of R installation? Since it's also possible to download R from conda-forge, that can also live in .pixi - will that also be discoverable then, or will that require extra modifications on the Positron side?

[roaldarbol]

And just to think ahead, once if Julia gets better support (#3679) - and since Julia is also on conda-forge - could that become discoverable too. :-)

[Robinlovelace]

This may not be the best place for this question but the above comms makes me wonder: is there a way to default to a system installation? That could reduce bandwidth and HD resources of installing software multiple times on different environments. Or would you just not use pixi when you want to use system installation?

[roaldarbol]

There is, you can pixi global install <package>. And good that you mentioned it, just opened #3767, requesting Positron on conda-forge to allow a global installation of it.
For more pixi-related questions, I recommend checking out their documentation and joining their Discord - super helpful and responsive - it's a great community. :-)

[seeM]

@seeM That sounds great! How about discovery of R installation? Since it's also possible to download R from conda-forge, that can also live in .pixi - will that also be discoverable then, or will that require extra modifications on the Positron side?

It would not affect R discovery, since that is a totally separate extension with its own machinery at this point.

[roaldarbol]

Which extension is that? And I guess that is then the crux of this issue. :-)

[juliasilge]

Let's use this feature to track interest in supporting Pixi interpreters for R. Thanks! 🙌

[joshualeond]

@jennybc pointed me to this issue that seems related: #2235

[roaldarbol]

The discovery of Python pixi interpreters has just been released in the vscode-python extension.

[Robinlovelace]

This is great to see! Any chance of Positron using that extension or will it be a case of developing parallel functionality 'in-house', I wonder.

[roaldarbol]

They already do - so as soon as the new release gets merged here, it should work.
#3724 (comment)

Thank you for the info! Since we're currently using a fork of the vscode-python extension, the new pixi locator should just work once we've merged the latest release from upstream 🤞

[seeM]

@roaldarbol is correct! The latest vscode-python release is a bit more complicated than usual (they've reimplemented environment discovery in Rust, which means we have to get the Rust toolchain + build setup properly too – also means much faster discovery! 🎉), so this update will take us a little longer than usual to merge.

[roaldarbol]

@roaldarbol is correct! The latest vscode-python release is a bit more complicated than usual (they've reimplemented environment discovery in Rust, which means we have to get the Rust toolchain + build setup properly too – also means much faster discovery! 🎉), so this update will take us a little longer than usual to merge.

Just FYI for Pythonistas: Since this issue no longer tracks the Python installation, I think it went under the radar - but Positron does now discover Pixi Python installations. 🚀