Skip to content

[SYSTEMDS-3217] PythonAPI working with SYSTEMDS_ROOT set#1454

Closed
Baunsgaard wants to merge 1 commit into
apache:mainfrom
Baunsgaard:PythonBuildFixes
Closed

[SYSTEMDS-3217] PythonAPI working with SYSTEMDS_ROOT set#1454
Baunsgaard wants to merge 1 commit into
apache:mainfrom
Baunsgaard:PythonBuildFixes

Conversation

@Baunsgaard
Copy link
Copy Markdown
Contributor

This commit modify the PythonAPI at startup to work with our release
binaries. While modifying this the building of the python release
artifact have been modified to not include the test and generator code.

Copy link
Copy Markdown
Contributor

@phaniarnab phaniarnab left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

General comment: Please stick to only bug fixes/absolutely necessary changes for the patch release. Code changes in a new RC should only contain the fixes missing in the last RC.

Comment thread src/assembly/bin.xml
Comment thread src/main/python/pre_setup.py
Comment thread src/main/python/pre_setup.py Outdated
Comment thread .gitignore Outdated
@j143
Copy link
Copy Markdown
Member

j143 commented Nov 12, 2021

Thank you for the cleanup.
Also, we need to create a PR to branch-2.2.0!, with specific changes so we can test for spark, java version.

@Baunsgaard
Copy link
Copy Markdown
Contributor Author

Thank you for the cleanup. Also, we need to create a PR to branch-2.2.0!, with specific changes so we can test for spark, java version.

yes that is the next task, i will take the appropriate parts from this, and make specific targeted changes for the release branch

@Baunsgaard Baunsgaard force-pushed the PythonBuildFixes branch 2 times, most recently from e64f9b6 to c10f4e6 Compare November 15, 2021 17:22
This commit modify the PythonAPI at startup to work with our release
binaries. While modifying this the building of the python release
artifact have been modified to not include the test and generator code.

This commit also contains changes so that we can specify a config in python

[MINOR] .gitignore specific for python

[SYSTEMDS-3216] Cleanup python build to not include excessive files

This commit change the python building to not include tests, generator
python scripts. The tutorial datasets are now also ignored for the releases.
And the construction of the context, now support SYSTEMDS_ROOT set or not.
to either a release artifact or a source clone of systemds.

This commit also contain a small fix for list reading and writing
to construct the correct object types in python.

To improve test environment and startup the systemds_context now have
multiple phases and checks on startup making the experience much smoother
This also allowed to change the python tests to run fully parallel,
and therefore the changes to do so is done.
@Baunsgaard Baunsgaard deleted the PythonBuildFixes branch December 13, 2021 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants