-
Notifications
You must be signed in to change notification settings - Fork 177
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
tests fail in pycharm on spark tests when importing an external lib #1869
Comments
It sounds like spark is running some kind of logic to figure the imports out on their own. Could you make your example project public? |
done |
I can't reproduce this, it gives me this error:
It looks to expect me to have Java. I've never run spark. Could you make a more indepth reproducer |
I've updated the repo and added jvm |
Sorry for the delay. I just tried it. It seems to work with:
[activation.env]
PYSPARK_PYTHON = "$PIXI_PROJECT_ROOT/.pixi/envs/default/bin/python"
PYSPARK_DRIVER_PYTHON= "$PIXI_PROJECT_ROOT/.pixi/envs/default/bin/python" And starting Pycharm with |
thanks @ruben-arts for checking! for me, just starting pycharm with |
Great, can this issue be closed? |
Checks
I have checked that this issue has not already been reported.
I have confirmed this bug exists on the latest version of pixi, using
pixi --version
.Reproducible example
full example here: https://github.com/lev112/pycharm-pixi-spark-test
pixi.toml:
tests/test_spark.py:
pixi.lock:
Issue description
when running the test from the command line with:
the test passes.
but when running the same test from pycharm, it fails with these logs:
Expected behavior
the test should pass
The text was updated successfully, but these errors were encountered: