Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implemented simple echo plugin for testing #4489

Merged
merged 9 commits into from
Nov 30, 2023
Merged

Conversation

hamersaw
Copy link
Contributor

Tracking issue

NA

Docs link

NA

Describe your changes

Implements a simple echo plugin which copies the task inputs to outputs. This facilitates local testing at scale without creating a large number of k8s pods. Additionally, this can support future extensions to force retries, etc.

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Setup Process

Enable to plugin in flyte configuration. Note that this plugin is set to be the default, so ALL tasks without a specific plugin assigned will use it. Additionally, two default plugins may not be enabled, so the PodPlugin cannot be simultaneously used.

Screenshots

NA

Note to reviewers

NA

Related PRs

NA

Signed-off-by: Daniel Rammer <daniel@union.ai>
@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Nov 27, 2023
Copy link

codecov bot commented Nov 27, 2023

Codecov Report

Attention: 116 lines in your changes are missing coverage. Please review.

Comparison is base (7d712de) 59.76% compared to head (e024ef5) 59.62%.

Files Patch % Lines
flyteplugins/go/tasks/plugins/testing/echo.go 5.00% 94 Missing and 1 partial ⚠️
...teplugins/go/tasks/plugins/testing/config_flags.go 16.00% 21 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4489      +/-   ##
==========================================
- Coverage   59.76%   59.62%   -0.14%     
==========================================
  Files         636      638       +2     
  Lines       53870    53995     +125     
==========================================
+ Hits        32193    32196       +3     
- Misses      19146    19267     +121     
- Partials     2531     2532       +1     
Flag Coverage Δ
unittests 59.62% <7.20%> (-0.14%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Signed-off-by: Daniel Rammer <daniel@union.ai>
Signed-off-by: Daniel Rammer <daniel@union.ai>
Signed-off-by: Daniel Rammer <daniel@union.ai>
Signed-off-by: Daniel Rammer <daniel@union.ai>
Signed-off-by: Daniel Rammer <daniel@union.ai>
Signed-off-by: Daniel Rammer <daniel@union.ai>
Copy link
Contributor

@eapolinario eapolinario left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thoughts on naming this plugin package echo instead of testing?

@hamersaw
Copy link
Contributor Author

hamersaw commented Nov 29, 2023

thoughts on naming this plugin package echo instead of testing?

@eapolinario so it is actually named echo, just in the testing package assuming there will be other plugins we specifically use for testing someday.

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Nov 30, 2023
Signed-off-by: Daniel Rammer <daniel@union.ai>
@hamersaw hamersaw merged commit 7878b8e into master Nov 30, 2023
43 of 45 checks passed
@hamersaw hamersaw deleted the feature/testing-plugin branch November 30, 2023 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants