Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LIU-251 Add Pyfunc Port Parser Options #158

Merged
merged 3 commits into from
May 23, 2022
Merged

LIU-251 Add Pyfunc Port Parser Options #158

merged 3 commits into from
May 23, 2022

Conversation

calgray
Copy link
Collaborator

@calgray calgray commented May 20, 2022

Previously pyfunc apps parsed both input and output drop contents using pickle or ast based on the pickle parameter. This however lead to the problem that a graph using only pyfunc apps either uses pickle everywhere or ast everywhere, so this change firstly split this param for all inputs and all outputs. Additionally I've changed the param to an enum type, namely one of pickle, ast, and path, however others can be added. Path is useful for functions that manually read from a file format by filename whilst at the same time using a filedrop.

rebase of #154

e.g.
image

pyfunc update
pyfunc default to pickle
update test graphs
@coveralls
Copy link

coveralls commented May 20, 2022

Coverage Status

Coverage decreased (-0.02%) to 80.979% when pulling 5893c5e on LIU-251-rebase into a055143 on master.

elif ptype in ["Python"]:
try:
import numpy
value = eval(value, {"numpy": numpy}, {})
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added numpy to scope as its currently used as default in some graphs

Copy link
Collaborator

@james-strauss-uwa james-strauss-uwa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@calgray calgray merged commit 71b95f5 into master May 23, 2022
@awicenec awicenec deleted the LIU-251-rebase branch May 9, 2023 12:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants