If-Else in SDK #66
Comments
|
Duplicate of #231. Closing this issue |
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 6, 2022
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 6, 2022
In order to make register workflows with subworkflows, they need to be passed along to the compiler. * Also updated the logging for a minor log line that was making it hard for me to debug an issue earlier today. Please see flyteorg#139 for related PRs.
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 6, 2022
…in algorithms) and HyperparameterTuningJob (flyteorg#66) * adding sagemaker protos Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 20, 2022
* Pull request template for Flyteplugins * Linter fixes
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 20, 2022
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 20, 2022
* Added reuseable workflows Signed-off-by: Yuvraj <code@evalsocket.dev> * Go generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename workflow Signed-off-by: Yuvraj <code@evalsocket.dev> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 20, 2022
* Added support for execution queue attribute Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 9, 2023
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
* Pull request template for Flyteplugins * Linter fixes
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
In order to make register workflows with subworkflows, they need to be passed along to the compiler. * Also updated the logging for a minor log line that was making it hard for me to debug an issue earlier today. Please see flyteorg#139 for related PRs.
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
* Added reuseable workflows Signed-off-by: Yuvraj <code@evalsocket.dev> * Go generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename workflow Signed-off-by: Yuvraj <code@evalsocket.dev> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>
eapolinario
pushed a commit
that referenced
this issue
Sep 7, 2023
* Added reuseable workflows Signed-off-by: Yuvraj <code@evalsocket.dev> * Go generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename workflow Signed-off-by: Yuvraj <code@evalsocket.dev> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>
eapolinario
pushed a commit
that referenced
this issue
Sep 8, 2023
…in algorithms) and HyperparameterTuningJob (#66) * adding sagemaker protos Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com>
eapolinario
added a commit
that referenced
this issue
Sep 8, 2023
* Add workflow state enums and update endpoint (#53) * Add new phases to Task execution (#52) * Add new phases to Task execution * Update flyteidl python version (#54) * Add state to NamedEntity (#55) * Add filters to named entity list requests (#56) * Add an ErrorKind field in ContainerError (#60) * Add an ErrorKind field in ContainerError * Bump versions * Arbitrary container support without Flytekit using FlyteCoPilot (#62) * Releasing v0.17.29 for RawContainerPlugin (#63) * Add Auth to execution spec (#59) * Flyte CoPilot now available for all containers (#64) * Allow different modes of data download and upload in flyte co-pilot (#65) * pytorch.proto and respective changes (#61) * Add FailureHandlingStrategy to workflow idl (#67) * Add FailureHandlingStrategy to workflow idl * Rename and allow overrides per LaunchPlan and Execution * Revert override changes * revert * Only keep options we will implement at the moment (#69) * Only keep options we will implement at the moment * regenerate * feature; tfoperator for tensorflow distributed training plugin (#71) * Add quality of service to launch plan/execution spec (#68) * IDL changes for Node-Node relationship refactor (#72) * IDL changes for Node-Node relationship refactor * Ability to provide information of the parent node. * Introduction of group_id to indicate grouping of nodes within the Parent node - (instead of dummy nodes) * Support for querying all nodes under node with group. * Support for node_id to point to original node in the workflow/graph, and node_name * feature; catalog metadata and caching status published in node events (#70) * Catalog store handling * Event proto updated * generated * merged * Dataset Identifier changed * Better model * Exposing TaskNodeMetadata with catalog information in the API * 0.17.38 * Comment * docs updated * Adding proto definitions for supporting SageMaker TrainingJob (built-in algorithms) and HyperparameterTuningJob (#66) * adding sagemaker protos Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com> * Add output prefix to LaunchPlanSpec (#74) * [ignore] Tweaking a couple comments (#75) * Return full execution inputs & outputs (#73) * [Autogenerated] Add labels to projects in flyteidl (#77) * first cut * bump version * add to project.json * regen Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com> Co-authored-by: Katrina Rogan <krogan@lyft.com> * Introduce ProjectUpdate endpoint to Flyte Admin API (#78) * add project update endpoint * PR comments * pr comments * pr comments (last one ;p) * spelling * generate Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com> Co-authored-by: Katrina Rogan <krogan@lyft.com> * Fix Stackdriver log link (#79) This PR fixes Stackdriver log link using `resource.labels.pod_name` as `advancedFilter` instead of `logName`. * Create PluginOverrides MatchableResource. (#80) * Make plugin overrides repeated (#81) * Add option to record whether a task ran on a spot instance. (#82) * Support Styx style schedule (#83) * Support cron schedule with offset. For example: https://github.com/spotify/styx#schedule-string * Add generated files * Update protos/flyteidl/admin/schedule.proto Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Update protos/flyteidl/admin/schedule.proto Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Update protos/flyteidl/admin/schedule.proto Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Regenerate files * Regenerate files * Change the message name back * Revert "Change the message name back" This reverts commit e468ea836dd30fc01699fd417ee64a182603b7f7. * Add comments for schedule and offset Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Adding necessary fields in training job message for distributed training (#84) * `distributed_protocol` added as a field in training job resource config * Added state to project (#88) Add state to a project * Create conf.py * Revert conf.py addition (#91) * Add filter and sort param when listing projects (#90) * Add filter and sort param when listing projects * Bump version * Deprecate Log Plugins (#94) * Update CI post migration (#95) * Migrate off of travis * move proto test to actions * wip * wip * wip * wip * install git * wip * wip * update script * try uploading * wip * wip * add the rest of the steps * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * Update pull_request.yml * Update pull_request.yml * Update pull_request.yml * Ignore generated code * Update pull_request.yml * Update pull_request.yml * wip * regenerate * fix workdir * wip * wip * wip * wip * wip * fixing lint * lint * Add NPM Publish Step * cleanup * Update setup.py * update maintainer emails * Publish public npm package * Publish NPM Package * Docs for FlyteIDL (#97) * Change Security/Permission fields with overrides (#98) * Change Security/Permission fields with overrides * Added changes from flyteplugins and also added functionality for FetchFromLiteral (#101) * Added changes from flyteplugins * Moved more code fromflyteplugins due to test dependencies * Moved unit test for time primitive * Added fetchFromliteral functionality * Fixing lint issues * Minor lint fixes * Moved Fetch literal functionality to separate file * Incorporated the feedback Co-authored-by: pmahindrakar <pmahindrakar@vmware.com> * Add task version to template (#102) * Update ArrayJob for Map task changes (#103) * Update Organization. Lyft -> Flyteorg, use k8s libraries (#109) * Revamp Security context to be more specific and expose it to task templates (#108) * Revamp Security Context Message Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Security Context in Admin entities Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * fix tabs Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * add deprecated message Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update protos/flyteidl/core/types.proto Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update protos/flyteidl/core/types.proto Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Move to security proto Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * comment Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> * Added new rpc service GetVersion (#110) * Added new rpc service GetVersion Signed-off-by: Yuvraj <evalsocket@gmail.com> * More changes Signed-off-by: Yuvraj <yuvraj@datapane.com> * Update get version description Signed-off-by: Yuvraj <yuvraj@datapane.com> * Version v0.18.16 (#111) * Version v0.18.16 Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Update GetVersion API to match the other API style - Have an additional envelop structure Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Move proto from datacatalog (#113) * Move proto from datacatalog Signed-off-by: niant <niant@spotify.com> * add generated files Signed-off-by: niant <niant@spotify.com> Co-authored-by: niant <niant@spotify.com> * Add free form map config for task custom (#112) * Add Secret Group (#114) * Add Secret Group Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Automatically update flyteidl versions when a github release is created (#115) * wip: Added version automatically in setup.py Signed-off-by: yuvraj <evalsocket@gmail.com> * wip: small fix Signed-off-by: yuvraj <evalsocket@gmail.com> * wip: small fix Signed-off-by: yuvraj <evalsocket@gmail.com> * wip: added npm version update Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * wip: added workflow for master merge Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * wip: added goreleaser for creating release Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * Revert Getversion method from put to get (#116) * Revert Getversion method from put to get Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * Added version in api url Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * Remove need condition in github action (#117) Signed-off-by: yuvraj <evalsocket@gmail.com> * npm auto release fix (#118) Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> Thank you! * Deprecate log plugins (#123) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Literal Transformations from a string or an interface based on literalTypes (#120) * wip: more transformations Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Changed the String formatter from %s to %v and added more unit tests (#122) Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Added default condition for unsupported type while creating literal (#124) * Changed the String formatter from %s to %v and added more unit tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added unsupported type default condition Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * #patch: Add in task execution event fields (#119) * Add group_version to secrets (#125) * Add group_version to secrets Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Fix typo in external resource message (#126) * Fix field id for ExecutionSpec#auth_role (#127) Changing field id wasn't intentional Co-Authored-By: Fernando Diaz <fernandodiaz@spotify.com> Signed-off-by: Gleb Kanterov <gleb@spotify.com> * update docs theme (#133) * update docs theme Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * add community link Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * [go] Add blob support for MakeLiteralForType (#131) The MakeLiteralForType client method currently doesn't support the blob type. This adds support for that. Signed-off-by: Sam Lai <slai@lyft.com> * dark theme updates (#134) Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Added workflow for updating flyteidl version in all component (#132) * Added workflow for updating flyte comopnent version Signed-off-by: yuvraj <evalsocket@gmail.com> * Added a single workflow for release flyteidl Signed-off-by: yuvraj <evalsocket@gmail.com> * revert workflow changes Signed-off-by: yuvraj <evalsocket@gmail.com> * bug fix in ci (#135) Signed-off-by: yuvraj <evalsocket@gmail.com> * Enable flyteidl update version for all component (#136) * enable flyteidl update version for all component Signed-off-by: yuvraj <evalsocket@gmail.com> * Added more component Signed-off-by: yuvraj <evalsocket@gmail.com> * remove flytekit from component Signed-off-by: yuvraj <evalsocket@gmail.com> * Pass dynamic workflow closure in node execution events (#141) * Documentation for Datacatalog (#143) Datacatalog service documentation Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Fix Datacatalog title.rst in docs (#145) * missing blank line in title.rst Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * generated docs Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Enable release automation for flytectl (#144) Signed-off-by: yuvraj <evalsocket@gmail.com> * Add GetOrReserveArtifact and ExtendReservation API (#142) * Move dynamic workflow metadata to GetNodeExecutionData response (#151) * Add DYNAMIC_RUNNING node execution phase (#152) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Introduce Auth Metadata and Identity Grpc Service and support Pkce auth in admin client (#155) * Introduce Auth Metadata and Identity Grpc Service Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * merge conflicts Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update deps Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * cleanup deps Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * update deps Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Delete unused catalog client Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Remove the need for UseAuth config to simplify setup further Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add deprecated comment Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Allow config of insecure creds transmission Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Moved the 3legged auth files from flytectl and also added config option for it (#156) * Moved the 3legged auth files from flytectl and also added config option for it Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed the expiry bug Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Changed logic to refresh the token Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Refactored the getAuthenticationDialOption Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added more unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added more unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * refactor pkce package Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * bump for dco Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Added ClientSetBuilder inorder to remove keyring dependency (#158) * Added ClientSetBuilder inorder to remove keyring dependency Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added token cache to deprecated method too Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Refactoring latest changes Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * do not close server right away Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * don't close http server too soon Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * event init error Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Cleanup Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com> * documentation revamp according to RFC (#160) Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Update README.rst * Update validate module to protoc-gen-validate 0.6.1 (#165) * Update validate module to protoc-gen-validate 0.6.1 Signed-off-by: Hans Werner <hwerner@lyft.com> * include generated output Signed-off-by: Hans Werner <hwerner@lyft.com> * update code Signed-off-by: Hans Werner <hwerner@lyft.com> Co-authored-by: Julio Capote <jcapote@lyft.com> * Added flyteidl documentation (#167) * Added flyteidl documentation Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Generated doc requirements and updated CI to not generate docs for now Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Moved to rst file for events Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Moved to rst file for all index files Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> (cherry picked from commit 6dc3c4785dc95b05412a9bec2377016cf16b5ea8) * Added tmp doc generation step for getting doc dependencies Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using RST for documentation generation (#169) * Fix the links in generated html files * Added handler for build finished event to fix doc links * Added contributing guide * Adding wait for the subprocess * Fixed the path issue with finding the script for fixing the links * Added darwin switch for sed -i flag * Fixed non darwin with -i flag for sed * Using find instead of xargs as it fails on readthedocs * Moving the substitution errors to /dev/null * Escaped the Link values Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using protoc-gen-doc plugin directly Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Removed the example message Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed datacatalog file generation Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using template to generate docs and also removed unused imports in proto files and fixed doc issues Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Minor doc fix Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added dependency to protoc-gen in biolerplate module Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * add main nav font awesome icons (#170) * add main nav font awesome icons Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * add "edit on github button" config Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * fix html theme config Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Support annotations/labels in sidecar (#171) * Add K8sPod as a task target option (#172) * Support passing an iam role AND a k8s service account (#173) * Support passing an iam role AND a k8s service account (again) (#175) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Added boilerplate automation (#162) * Added boilerplate automation Signed-off-by: Yuvraj <evalsocket@gmail.com> * More changes Signed-off-by: Yuvraj <evalsocket@gmail.com> * Using protoc-gen-doc from the flyteorg and regenerated docs for new modules (#174) * Fix the links in generated html files * Added handler for build finished event to fix doc links * Added contributing guide * Adding wait for the subprocess * Fixed the path issue with finding the script for fixing the links * Added darwin switch for sed -i flag * Fixed non darwin with -i flag for sed * Using find instead of xargs as it fails on readthedocs * Moving the substitution errors to /dev/null * Escaped the Link values Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using protoc-gen-doc plugin directly Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Removed the example message Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed datacatalog file generation Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using template to generate docs and also removed unused imports in proto files and fixed doc issues Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Minor doc fix Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added dependency to protoc-gen in biolerplate module Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Pulled the latest boilerplate changes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added support for Generic type for extracting a literal value (#176) * Added support for Generic type for extracting a literal value Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added grpc gateway jsonpb marshaller and unmarshaller for struct type Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using json.Marshal Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Incorporated feedback and added another test for string generic Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add workflow execution config matchable attribute (#182) * #minor Enum type (#183) * Enum type definition Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Enum Type support in flyteidl Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * lint fixes Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * re-generated Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Enum default values are the first value in the list Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Added missing docs and included boiler plate update as prereq for generate (#185) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add max concurrency to launch plan & execution spec (#186) * MakeLiteralForType shouldn't print <nil> for nil values (#188) * Add max concurrency to launch plan & execution spec (#186) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * MakeLiteralForType shouldn't print <nil> for nil values Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * bump Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Co-authored-by: Katrina Rogan <katrina@nuclyde.io> * Clean up flyteadmin proto definitions and comments. (#189) * Add Task Node overrides (#190) * Update Boilerplate (#181) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Bringin back README.md #patch (#192) * Bringin back README.md Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Moved contents of developing.rst to README (#193) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Replaced doc_requirements.in with doc-requirements.in Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added InsecureSkipVerify flag (#191) * add deployment to the top TOC (#194) Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * algolia search (#195) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * fix TOC (#196) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Add core entity links to admin request structures (#197) * Fix typos in message comments (#199) Signed-off-by: Sean Lin <sean@union.ai> * Add endpoint to recover workflow execution (#187) * update doc requirements with sphinx v4 (#201) Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Update code of conduct (#200) * update code of conduct Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * boilerplate Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Handling large integers (#202) * Handling large integers Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add ephemeral storage as a container resource (#203) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Add ephemeral storage as a matchable resource too (#204) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Add Raw Output Metadata to events (#205) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Disable bump-version and goreleaser workflow in the forked repository (#209) * Update master.yml Signed-off-by: Kevin Su <pingsutw@apache.org> * Update master.yml Signed-off-by: Kevin Su <pingsutw@apache.org> * Update master.yml Signed-off-by: Kevin Su <pingsutw@apache.org> * Add raw output data to admin execution models (#210) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Update Boilerplate (#208) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Fix up comment for raw output data (#211) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * readd docs (#212) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Change variable map to repeated map entries for ordering (#206) Signed-off-by: Sean Lin <sean@union.ai> * Add Sql in target proto (#214) Signed-off-by: Kevin Su <pingsutw@apache.org> * fix timestamp and duration literal extraction (#218) * fixed literal extraction for timestamp and duration types - was previously returning protobufs instead of native golang types Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed lint error with imports being non-alphabetical Signed-off-by: Daniel Rammer <daniel@union.ai> * Revert variable ordering change PR (#220) * Revert "Change variable map to repeated map entries for ordering (#206)" Signed-off-by: Sean Lin <sean@union.ai> * Update EventError with Is and Unwrap functions (#221) * update EventError with Is and Unwrap functions for use in errors API Signed-off-by: Daniel Rammer <daniel@union.ai> * changed EventError Is* functionality to check entire error stack Signed-off-by: Daniel Rammer <daniel@union.ai> * added nil tests to EventError.Is function Signed-off-by: Daniel Rammer <daniel@union.ai> * Schema type support for flytectl (#219) * MPI Operator plugin interface (#217) * Added mpi plugin Signed-off-by: Yuvraj <code@evalsocket.dev> * Rename variable name Signed-off-by: Yuvraj <code@evalsocket.dev> * Added docs for mpi Signed-off-by: Yuvraj <code@evalsocket.dev> * Support external token source for flyteadmin clients (#222) * refactor: add token source provider interface and implementation for clientcredentials and pkce Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * remove unused getAuthType method Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactorings Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add TokenSourceProvider interface documentation Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * move token source provider logic to admin to avoid circular deps Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * fix authentication dial option tests Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * lint files Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * allow external auth process Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * dont forget to trim Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactor: change if to switch Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactor: rename AuthType value and config Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactor: move credentials TS Provider with other types Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> Co-authored-by: Babis Kiosidis <babisk@spotify.com> * Add Slack button to README (#224) * Add Slack button to README Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * update slack link Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Add Architecture field to Container (#226) * Add Architecture field to Container Signed-off-by: Anmol Khurana <akhurana@lyft.com> * Update enum Signed-off-by: Anmol Khurana <akhurana@lyft.com> * Update enum Signed-off-by: Anmol Khurana <akhurana@lyft.com> * remove events package (#225) * moved 'go generate' snippet so that when events is removed admin service mocks are still generated Signed-off-by: Daniel Rammer <daniel@union.ai> * removed events package Signed-off-by: Daniel Rammer <daniel@union.ai> * Adding grpc health service in the clientset (#228) * Adding grpc health service in the clientset Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Update Boilerplate (#229) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * dummy edit -- updated requirements.txt (#223) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Cache Serialize API (#215) * removed datacatalog ExtendReservation API Signed-off-by: Daniel Rammer <daniel@union.ai> * filled out generated content with 'make generate' Signed-off-by: Daniel Rammer <daniel@union.ai> * updated protobuf docs for admin and core definitions Signed-off-by: Daniel Rammer <daniel@union.ai> * created ReservationID message to reuse Signed-off-by: Daniel Rammer <daniel@union.ai> * changed artifact reservation API to not include handling of artifacts - only reservations. Signed-off-by: Daniel Rammer <daniel@union.ai> * added cache reservation comments Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed indenting issues that always drive me crazy Signed-off-by: Daniel Rammer <daniel@union.ai> * updated discovery_reservable to discovery_serializable to adhere to name change Signed-off-by: Daniel Rammer <daniel@union.ai> * moved catalog reservation status enum into a message Signed-off-by: Daniel Rammer <daniel@union.ai> * changed discovery_serializable TaskMetadata field to cache_serializable Signed-off-by: Daniel Rammer <daniel@union.ai> * Execution closures in the API should defer to GetData calls for passing output data (#234) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Update Boilerplate (#236) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Added flag to pass in CAcerts (#242) * Added flag to pass in CAcerts Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Incorporated feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * caCert instead of caCerts Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * caCert to caCertFilePath Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add incompatible cluster event error (#240) * Add aborting workflow execution phase (#245) * New StructuredDataset type/literal #patch (#227) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * bump docsearch version (#246) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * update flyteidl for new navbar (#247) * update furo dep git > https (#249) Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Update Boilerplate (#243) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Add RetryAttempt and Phase to ExternalResourceInfo proto (#244) * added retry attempt and phase to ExternalResourceInfo proto Signed-off-by: Daniel Rammer <daniel@union.ai> * captialized ExternalResourceInfo retry_attempt comment Signed-off-by: Daniel Rammer <daniel@union.ai> * added index to ExternalResourceInfo proto Signed-off-by: Daniel Rammer <daniel@union.ai> * regenerated protos to fix rebase issues Signed-off-by: Daniel Rammer <daniel@union.ai> * add sphinx panels to docs (#250) Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Added UpdateExecution API and api objects (#248) * Expose flyteadmin client's auth opt (#252) * Expose flyteadmin client's auth opt Signed-off-by: Sean Lin <sean@union.ai> * Move authOpt to global Signed-off-by: Sean Lin <sean@union.ai> * minor fix Signed-off-by: Sean Lin <sean@union.ai> * Introduce TypeAnnotation#minor (#232) * feat: introduce TypeAnnotation Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net> * fix: message description Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net> * fix: regen proto after merge Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com> * Remove AdminAuth Client global state (#254) * Remove AdminAuth Client global state Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Fix unit test Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Added isDynamic flag for distinguishing subworkflows and dynamic workflows (#256) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add missing Python libs (#258) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Add hash to literal #minor (#237) * Add hash to Literal Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * make generate Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Comment hash Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Added RawOutputDataConfig in ExecutionSpec (#260) * Added RawOutputDataConfig in ExecutionSpec Signed-off-by: Kevin Su <pingsutw@apache.org> * bring back missing rsts Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * update comment, remove @latest, regenerate Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * die @latest Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Union Types #minor (#235) * Add support union type Signed-off-by: Kevin Su <pingsutw@apache.org> * Update union type + add union literal repr * Update union types to use string tags * Fix typo + generate protos * Implement changed design * generate * Remove changes to download_tooling.sh Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Kevin Su <pingsutw@apache.org> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add custom token source that allows preemptive token refresh (#262) * Add custom token source that allows preemptive token refresh Signed-off-by: Sean Lin <sean@union.ai> * Switch to apimachinery jitter Signed-off-by: Sean Lin <sean@union.ai> * Switch back to max because min doesnt make sense Signed-off-by: Sean Lin <sean@union.ai> * fix lint Signed-off-by: Sean Lin <sean@union.ai> * goimport Signed-off-by: Sean Lin <sean@union.ai> * minor fix Signed-off-by: Sean Lin <sean@union.ai> * Rename and trim config Signed-off-by: Sean Lin <sean@union.ai> * Introduce cluster assignment attribute to execution spec (#255) * checkpoint Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * one more Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * good riddance Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * one more Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * revert Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * DataProxy Service Definition (#261) * Added missing docs and mocks for DataProxy (#269) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Additional execution properties as matchable entities. (#253) * proposal Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * comments Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Fixed the import and updated tooling Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Updating the golang version to 1.7 Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Adding authType in pflags and also updated docs with valid values (#268) * Adding authType in pflags and also updated docs with valid values Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * removed the default message Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * fixed spaces in mesages Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add cache_status and logs to ExternalResrouce proto (#271) * added protobuf dependencies to doc generation Signed-off-by: Daniel Rammer <daniel@union.ai> * added cache_status and logs to ExternalResourceInfo proto Signed-off-by: Daniel Rammer <daniel@union.ai> * Generate mocks Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add is_parent & is_dynamic to node execution events (#272) * Rename DataProxy to DataProxyService for consistency (#273) * Rename DataProxy to DataProxyService for consistency Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update client go Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * bump Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Grammar edit (#267) * Minor grammar changes Grammar fix Changed Flyte IDL to Flyteidl Updated index.rst files Signed-off-by: SmritiSatyanV <smriti@union.ai> * Fix docs (#275) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Introduce taints and tolerations to cluster assignment (#276) * Add workflow execution JSON schema (#270) * Add workflow execution jsonschema Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated schema Signed-off-by: Kevin Su <pingsutw@apache.org> * Added Readme Signed-off-by: Kevin Su <pingsutw@apache.org> * updated Signed-off-by: Kevin Su <pingsutw@apache.org> * Add ContentMD5 parameter for CreateUploadLocationRequest (#278) * Add ContentMD5 parameter for CreateUploadLocationRequest Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Change contentMD5 type to bytes Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Rename suffix to filename Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * fix docs (#282) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Adding event_version to TaskExecutionEvent and TaskExecutionClosure (#279) * added event_version to TaskExecutionEvent Signed-off-by: Daniel Rammer <daniel@union.ai> * added event_version to TaskExecutionClosure Signed-off-by: Daniel Rammer <daniel@union.ai> * generated protos Signed-off-by: Daniel Rammer <daniel@union.ai> * Add ServiceHttpEndpoint to be returned to clients (#277) * Add ServiceHttpEndpoint to be returned to clients Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * add make generate check Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add missing docs (#284) Signed-off-by: Kevin Su <pingsutw@apache.org> * update docs (#285) Signed-off-by: Kevin Su <pingsutw@apache.org> * Go Linter Github action (#283) * Usess re-usable linter Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> Co-authored-by: Yuvraj <code@evalsocket.dev> * Fix pattern to hide generated code in github (#288) * Fix pattern to hide generated code in github Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Hide changes to rst files Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * #major Release 1.0.0 (#290) * #major Release 1.0.0 Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update flytestdlib to 1.0.0 Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Bump github tag action version (#292) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Changed default npm/python versions to valid semver (#293) Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Add interruptible override to execution #minor (#287) * Added interruptible flag for execution to protos Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Changed execution interruptible flag to use regular bool Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Changed interruptible overrides to use BoolValue Allows distinguishment between a value not being provided and the go zerovalue false Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Interruptible flag comment/documentation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Interruptible flag comment/documentation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Removed unescaped quotes from proto comments Included documentation for in proto generation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Re-generated documentation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Updates go version used in the pipeline (#294) * Adds linter for go code Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * Usess re-usable linter Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * changes wrt comment Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * changes wrt comments Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * updates go version in the yaml file Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> Co-authored-by: Yuvraj <code@evalsocket.dev> * Dockerized docs gen (#295) * Dockerized docs generation Now uses protoc-gen-dec Docker image instead of running protoc using the protoc-gen-doc plugin locally Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Minor cleanup of doc templates Replaced double with single quotes in proto comments (cause escaping issues with protoc-gen-doc text renderer) Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Set locale override during protos/docs generation to ensure consistent sorting Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added deck_uri to NodeExecutionEvent (#286) * Added deck metadata in TaskMetadata Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated IDL Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated IDL Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated IDL Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated gitignore Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated idl Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated comment Signed-off-by: Kevin Su <pingsutw@apache.org> * Add CreateDownloadLocation service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add CreateDownloadLocation service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add CreateDownloadLocation service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add deck_uri in NodeExecutionClosure Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * updated Signed-off-by: Kevin Su <pingsutw@apache.org> * updated Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * add deck_uri to task execution event Signed-off-by: Kevin Su <pingsutw@apache.org> * Remove deck_uri from task execution Signed-off-by: Kevin Su <pingsutw@apache.org> * Remove deprecated sidecar job (#302) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Grpc default service config (#301) * add load balancer config Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add policies doc link Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add available load balancing policies comment Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add descriptive comment about missing balancer value Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * describe load balancing policy behaviour Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * import balancers Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * skip linting for empty imports Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * lint nolint Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * rely on grpc client functionality for the configs and remove todo Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * dont repeat the comment Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * change load balancing config to serviceConfig Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * Change config name and remove package preloading Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com> * Test it Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com> Co-authored-by: Babis Kiosidis <ckiosidis@gmail.com> * feat: buf integration for proto release (#300) * fix: integrated buf Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * added protoc-gen-swagger Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * buf mod update Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * fix proto path in ci Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> Co-authored-by: Yuvraj <evalsocket@users.noreply.github.com> * Add go_package for datacatalog.proto (#304) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * fix flyteidl version upgrade automation (#305) Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * Update execution.proto (#309) * Update execution.proto [Slack conversation](https://flyte-org.slack.com/archives/C01P3B761A6/p1657755908722469) Signed-off-by: SmritiSatyanV <smriti@union.ai> * Make generate Signed-off-by: Kevin Su <pingsutw@apache.org> Co-authored-by: Kevin Su <pingsutw@apache.org> * Ray task proposal (#308) * Ray plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * Ray plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * Update cluster spec Signed-off-by: Kevin Su <pingsutw@apache.org> * Update cluster spec Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix lint error Signed-off-by: Kevin Su <pingsutw@apache.org> * Remove shutdown_after_job_finishes Signed-off-by: Kevin Su <pingsutw@apache.org> * More comments Signed-off-by: Kevin Su <pingsutw@apache.org> * Allow passing in authentication client secret as an environment variable (#311) * Read client secret from env var first since the location has a default (#312) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Adding device authorization oauth2 flow (#313) * Added config skip opening browser for pkce auth Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * added docs Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * increased the default browser session timeout to 2min Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Adding device flow idl changes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Adding device flow orchestration Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * lint fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * nit Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * refactor and feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * nit Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * test fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * more test fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * update buf (#316) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Use grpc client interceptors to properly check for auth requirement (#315) * Use grpc client interceptors to properly check for auth requirement Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Some refactor and add unit tests Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * lint Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * unit tests Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Attempt a random port Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Listen to localhost only Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * use chain unary interceptor instead Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * only log on errors Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Attempt to disable error check Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Expose newAuthInterceptor to allow other clients to create authenticating clients (#319) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add CheckpointUri to TaskNodeMetadata (#322) * Add CheckpointUri to TaskNodeMetadata Signed-off-by: Andrew Dye <andrewwdye@gmail.com> * Update swagger-codegen-cli image for arm Signed-off-by: Andrew Dye <andrewwdye@gmail.com> Signed-off-by: Andrew Dye <andrewwdye@gmail.com> * Project level attributes via matchable resource (#320) * copy pasta Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * generate Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * fix comment Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * ClusterAssignment stores cluster pool for execution placement (#321) * Cluster Pool execution placement Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Make generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * wip Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * make generate using new image Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate again Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate go1.18 Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate go1.18.5 Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * backward-compatible ClusterAssignment Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update token source provider to optionally call GetPublicClientConfig (#326) * Update token source provider Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * GH actions incident Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Make call to auth metadata optional (#327) * Make call to auth metadata optional Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * debug Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * revert Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * undeprecate Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Add unit tests Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * codecov is not very good Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Adding audience field to device flow token request (#314) * Add createworkflow failure proto #minor (#331) * Added GateNode message (#296) * added GateNode message Signed-off-by: Daniel Rammer <daniel@union.ai> * added signal service Signed-off-by: Daniel Rammer <daniel@union.ai> * fleshed out Signal service Signed-off-by: Daniel Rammer <daniel@union.ai> * updated signal service with a GetOrCreateSignal and SetSignal API Signed-off-by: Daniel Rammer <daniel@union.ai> * updated signal service api to use GetOrCreate semantics Signed-off-by: Daniel Rammer <daniel@union.ai> * added the ListSignals API Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed SignalListResponse proto name Signed-off-by: Daniel Rammer <daniel@union.ai> * set HTTP API parameters Signed-off-by: Daniel Rammer <daniel@union.ai> * generated protos Signed-off-by: Daniel Rammer <daniel@union.ai> * documented GateNode Signed-off-by: Daniel Rammer <daniel@union.ai> * updated signal list API Signed-off-by: Daniel Rammer <daniel@union.ai> * filled out signal list api Signed-off-by: Daniel Rammer <daniel@union.ai> * addressing pr comments on docs Signed-off-by: Daniel Rammer <daniel@union.ai> * added an output variable name to the signal condition Signed-off-by: Daniel Rammer <daniel@union.ai> * reworded signal condition docs Signed-off-by: Daniel Rammer <daniel@union.ai> * added ApproveCondition to GateNode Signed-off-by: Daniel Rammer <daniel@union.ai> * removed authOpt Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed types Signed-off-by: Daniel Rammer <daniel@union.ai> * updated doc_gen_deps to fix docs generation Signed-off-by: Daniel Rammer <daniel@union.ai> Signed-off-by: Daniel Rammer <daniel@union.ai> * Generate javascript proto (#336) * Cache eviction for single execution in datacatalog and flyteadmin (#318) * Added datacatalog endpoint for updating artifacts Existing artifacts can have their associated ArtifactData overwritten Signed-off-by: Nick Müller <nmueller@blackshark.ai> * datacatalog.UpdateArtifact returns ArtifactID Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added skip_cache override to ExecutionSpec, LaunchPlanSpec and WorkflowExecutionConfig Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added CatalogCacheStatus for skipped cache lookups Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added skip_cache flag to ExecutionRelaunchRequest Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Renamed skip_cache flag to overwrite_cache Signed-off-by: Nick Müller <nmueller@blackshark.ai> Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Doc Hub proposal (#303) * Add description entity Signed-off-by: Kevin Su <pingsutw@apache.org> * Add id Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * few update Signed-off-by: Kevin Su <pingsutw@apache.org> * update service Signed-off-by: Kevin Su <pingsutw@apache.org> * update service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add description entity to task and workflow Signed-off-by: Kevin Su <pingsutw@apache.org> * update des entity Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * typo Signed-off-by: Kevin Su <pingsutw@apache.org> * address comment Signed-off-by: Kevin Su <pingsutw@apache.org> * update idl Signed-off-by: Kevin Su <pingsutw@apache.org> * list description entity Signed-off-by: Kevin Su <pingsutw@apache.org> * make generate Signed-off-by: Kevin Su <pingsutw@apache.org> * make generate Signed-off-by: Kevin Su <pingsutw@apache.org> * Update service name Signed-off-by: Kevin Su <pingsutw@apache.org> * update endpoint Signed-off-by: Kevin Su <pingsutw@apache.org> * update endpoint Signed-off-by: Kevin Su <pingsutw@apache.org> * remove create_description_entity endpoint Signed-off-by: Kevin Su <pingsutw@apache.org> * Add description to task/workflow Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * address comments Signed-off-by: Kevin Su <pingsutw@apache.org> * address comments Signed-off-by: Kevin Su <pingsutw@apache.org> * fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * fix test Signed-off-by: Kevin Su <pingsutw@apache.org> * Add id.resource_type Signed-off-by: Kevin Su <pingsutw@apache.org> * undeclared name: ResourceType Signed-off-by: Kevin Su <pingsutw@apache.org> * update wrong code manually Signed-off-by: Kevin Su <pingsutw@apache.org> * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> Signed-off-by: Kevin Su <pingsutw@apache.org> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Add a more restrict CreateDownloadLink API (#332) * Add a more restrict CreateDownloadLink API Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * regenerate? Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add generates_deck to task metadata Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Remove ARTIFACT_TYPE_OUTPUT_METADATA Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Use buf to generate python stubs (#346) * Buf python migration Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Generate pyi files Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add venv to .gitgnore Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Use buf to generate python stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Use buf docker image to generate stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add stubs produced by call to `buf generate` using buf's docker image Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add pyi files Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Use buf locally Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Verify that generated protos by using buf Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Copy generated code to a separate artifact Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Move back to go_generate.yml@master Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Fix python package and publish typing information (#347) * Add __init__.py files to generated stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Publish stubs in the package Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Include __init__.py in verification workflow Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Bump versions of remote plugins Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Metadata tags (#348) * add tags to metadata Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * make generate Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Comment annotations and doc generation #minor (#350) * Comment swagger annotations in proto Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Regenerate proto stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add Databricks config to Spark config (#351) * databricks plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * update comment Signed-off-by: Kevin Su <pingsutw@apache.org> * Use struct instead of string Signed-off-by: Kevin Su <pingsutw@apache.org> * Add token Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * add instance name Signed-off-by: Kevin Su <pingsutw@apache.org> * add instance name Signed-off-by: Kevin Su <pingsutw@apache.org> Signed-off-by: Kevin Su <pingsutw@apache.org> * Add inital `dask` plugin IDL (#339) Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net> * added comments to the catalog reservation API (#355) Signed-off-by: Daniel Rammer <daniel@union.ai> Signed-off-by: Daniel Rammer <daniel@union.ai> * dockerizing buf call (#356) Signed-off-by: Daniel Rammer <daniel@union.ai> Signed-off-by: Daniel Rammer <daniel@union.ai> * Add raw claims to user info response (#357) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Adding configurable audience property for flyte clients (#329) * Adding configurable audience property for flyte clients Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * changed the const audience to audienceKey Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * fixed unit tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * fixed unit test Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * nit Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * feedback Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * refactored unit tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added UseAudienceFromAdmin property to force pull audience from admin config. Default is false and expects clients to pass it Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added test for expected number of calls to the public admin endpoint Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * fixed the tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added template configuration to task template (#358) * added template to task template Signed-off-by: Daniel Rammer <daniel@union.ai> * updated docs Signed-off-by: Daniel Rammer <daniel@union.ai> * updated pod_template_name location to TaskMetadata proto message Signed-off-by: Daniel Rammer <daniel@union.ai> --------- Signed-off-by: Daniel Rammer <daniel@union.ai> * bumping go version to 1.19 (#363) Signed-off-by: Daniel Rammer <daniel@union.ai> * gen (#359) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Co-authored-by: Katrina Rogan <katrina@Katrinas-MBP.UNION.AI> * Adding support for structured dataset (#369) Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * added dynamic_job_spec_uri to dynamic workflow metadata and node execution closure (#360) Signed-off-by: Daniel Rammer <daniel@union.ai> * Use TokenCache in ClientCredentialsTokenSourceProvider (#377) * Init customTokenSource.refreshTime (#381) Signed-off-by: Andrew Dy…
eapolinario
pushed a commit
that referenced
this issue
Sep 13, 2023
…in algorithms) and HyperparameterTuningJob (#66) * adding sagemaker protos Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
pvditt
pushed a commit
that referenced
this issue
Dec 29, 2023
…in algorithms) and HyperparameterTuningJob (#66) * adding sagemaker protos Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Apr 30, 2024
* Added support for execution queue attribute Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
austin362667
pushed a commit
to austin362667/flyte
that referenced
this issue
May 7, 2024
* Added support for execution queue attribute Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
robert-ulbrich-mercedes-benz
pushed a commit
to robert-ulbrich-mercedes-benz/flyte
that referenced
this issue
Jul 2, 2024
* Added support for execution queue attribute Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
No description provided.
The text was updated successfully, but these errors were encountered: