Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Raise an exception in case of local execution of raw containers tasks #1745

Merged
merged 3 commits into from
Jul 18, 2023

Conversation

eapolinario
Copy link
Collaborator

TL;DR

ditto

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

How did you fix the bug, make the feature etc. Link to any design docs etc

Tracking Issue

flyteorg/flyte#3833

Follow-up issue

NA
OR
https://github.com/flyteorg/flyte/issues/

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
…-locally

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
for k, v in self.environment.items():
env += f" -e {k}={v}"
print(
f"\ndocker run --rm -v /tmp/inputs:{self._input_data_dir} -v /tmp/outputs:{self._output_data_dir} {env}"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

qq: Why can't we run it with Docker?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That'd be an interesting feature, we have to assume that the docker client is configured properly (which I think it's a fair assumption). In order for this to happen we have to solve a few problems:

  1. literals and promise generation. This can be easily done in local_execute.
  2. Detect some features that we can't implement locally, for example pod templates.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I opened flyteorg/flyte#3876 to track this work.

@eapolinario eapolinario merged commit 3cb7988 into master Jul 18, 2023
126 checks passed
fg91 pushed a commit that referenced this pull request Aug 15, 2023
…#1745)

* Raise an exception in case of local raw containers

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Remove ContainerTask tests from test_type_hints

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

---------

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants