Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #4017 from flyteorg/monorepo--import-flyteidl
* Add workflow state enums and update endpoint (#53) * Add new phases to Task execution (#52) * Add new phases to Task execution * Update flyteidl python version (#54) * Add state to NamedEntity (#55) * Add filters to named entity list requests (#56) * Add an ErrorKind field in ContainerError (#60) * Add an ErrorKind field in ContainerError * Bump versions * Arbitrary container support without Flytekit using FlyteCoPilot (#62) * Releasing v0.17.29 for RawContainerPlugin (#63) * Add Auth to execution spec (#59) * Flyte CoPilot now available for all containers (#64) * Allow different modes of data download and upload in flyte co-pilot (#65) * pytorch.proto and respective changes (#61) * Add FailureHandlingStrategy to workflow idl (#67) * Add FailureHandlingStrategy to workflow idl * Rename and allow overrides per LaunchPlan and Execution * Revert override changes * revert * Only keep options we will implement at the moment (#69) * Only keep options we will implement at the moment * regenerate * feature; tfoperator for tensorflow distributed training plugin (#71) * Add quality of service to launch plan/execution spec (#68) * IDL changes for Node-Node relationship refactor (#72) * IDL changes for Node-Node relationship refactor * Ability to provide information of the parent node. * Introduction of group_id to indicate grouping of nodes within the Parent node - (instead of dummy nodes) * Support for querying all nodes under node with group. * Support for node_id to point to original node in the workflow/graph, and node_name * feature; catalog metadata and caching status published in node events (#70) * Catalog store handling * Event proto updated * generated * merged * Dataset Identifier changed * Better model * Exposing TaskNodeMetadata with catalog information in the API * 0.17.38 * Comment * docs updated * Adding proto definitions for supporting SageMaker TrainingJob (built-in algorithms) and HyperparameterTuningJob (#66) * adding sagemaker protos Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com> * Add output prefix to LaunchPlanSpec (#74) * [ignore] Tweaking a couple comments (#75) * Return full execution inputs & outputs (#73) * [Autogenerated] Add labels to projects in flyteidl (#77) * first cut * bump version * add to project.json * regen Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com> Co-authored-by: Katrina Rogan <krogan@lyft.com> * Introduce ProjectUpdate endpoint to Flyte Admin API (#78) * add project update endpoint * PR comments * pr comments * pr comments (last one ;p) * spelling * generate Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com> Co-authored-by: Katrina Rogan <krogan@lyft.com> * Fix Stackdriver log link (#79) This PR fixes Stackdriver log link using `resource.labels.pod_name` as `advancedFilter` instead of `logName`. * Create PluginOverrides MatchableResource. (#80) * Make plugin overrides repeated (#81) * Add option to record whether a task ran on a spot instance. (#82) * Support Styx style schedule (#83) * Support cron schedule with offset. For example: https://github.com/spotify/styx#schedule-string * Add generated files * Update protos/flyteidl/admin/schedule.proto Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Update protos/flyteidl/admin/schedule.proto Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Update protos/flyteidl/admin/schedule.proto Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Regenerate files * Regenerate files * Change the message name back * Revert "Change the message name back" This reverts commit e468ea836dd30fc01699fd417ee64a182603b7f7. * Add comments for schedule and offset Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Adding necessary fields in training job message for distributed training (#84) * `distributed_protocol` added as a field in training job resource config * Added state to project (#88) Add state to a project * Create conf.py * Revert conf.py addition (#91) * Add filter and sort param when listing projects (#90) * Add filter and sort param when listing projects * Bump version * Deprecate Log Plugins (#94) * Update CI post migration (#95) * Migrate off of travis * move proto test to actions * wip * wip * wip * wip * install git * wip * wip * update script * try uploading * wip * wip * add the rest of the steps * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * wip * Update pull_request.yml * Update pull_request.yml * Update pull_request.yml * Ignore generated code * Update pull_request.yml * Update pull_request.yml * wip * regenerate * fix workdir * wip * wip * wip * wip * wip * fixing lint * lint * Add NPM Publish Step * cleanup * Update setup.py * update maintainer emails * Publish public npm package * Publish NPM Package * Docs for FlyteIDL (#97) * Change Security/Permission fields with overrides (#98) * Change Security/Permission fields with overrides * Added changes from flyteplugins and also added functionality for FetchFromLiteral (#101) * Added changes from flyteplugins * Moved more code fromflyteplugins due to test dependencies * Moved unit test for time primitive * Added fetchFromliteral functionality * Fixing lint issues * Minor lint fixes * Moved Fetch literal functionality to separate file * Incorporated the feedback Co-authored-by: pmahindrakar <pmahindrakar@vmware.com> * Add task version to template (#102) * Update ArrayJob for Map task changes (#103) * Update Organization. Lyft -> Flyteorg, use k8s libraries (#109) * Revamp Security context to be more specific and expose it to task templates (#108) * Revamp Security Context Message Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Security Context in Admin entities Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * fix tabs Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * add deprecated message Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update protos/flyteidl/core/types.proto Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update protos/flyteidl/core/types.proto Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Move to security proto Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * comment Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> * Added new rpc service GetVersion (#110) * Added new rpc service GetVersion Signed-off-by: Yuvraj <evalsocket@gmail.com> * More changes Signed-off-by: Yuvraj <yuvraj@datapane.com> * Update get version description Signed-off-by: Yuvraj <yuvraj@datapane.com> * Version v0.18.16 (#111) * Version v0.18.16 Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Update GetVersion API to match the other API style - Have an additional envelop structure Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Move proto from datacatalog (#113) * Move proto from datacatalog Signed-off-by: niant <niant@spotify.com> * add generated files Signed-off-by: niant <niant@spotify.com> Co-authored-by: niant <niant@spotify.com> * Add free form map config for task custom (#112) * Add Secret Group (#114) * Add Secret Group Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Automatically update flyteidl versions when a github release is created (#115) * wip: Added version automatically in setup.py Signed-off-by: yuvraj <evalsocket@gmail.com> * wip: small fix Signed-off-by: yuvraj <evalsocket@gmail.com> * wip: small fix Signed-off-by: yuvraj <evalsocket@gmail.com> * wip: added npm version update Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * wip: added workflow for master merge Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * wip: added goreleaser for creating release Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * Revert Getversion method from put to get (#116) * Revert Getversion method from put to get Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * Added version in api url Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> * Remove need condition in github action (#117) Signed-off-by: yuvraj <evalsocket@gmail.com> * npm auto release fix (#118) Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com> Thank you! * Deprecate log plugins (#123) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Literal Transformations from a string or an interface based on literalTypes (#120) * wip: more transformations Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Changed the String formatter from %s to %v and added more unit tests (#122) Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Added default condition for unsupported type while creating literal (#124) * Changed the String formatter from %s to %v and added more unit tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added unsupported type default condition Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * #patch: Add in task execution event fields (#119) * Add group_version to secrets (#125) * Add group_version to secrets Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Fix typo in external resource message (#126) * Fix field id for ExecutionSpec#auth_role (#127) Changing field id wasn't intentional Co-Authored-By: Fernando Diaz <fernandodiaz@spotify.com> Signed-off-by: Gleb Kanterov <gleb@spotify.com> * update docs theme (#133) * update docs theme Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * add community link Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * [go] Add blob support for MakeLiteralForType (#131) The MakeLiteralForType client method currently doesn't support the blob type. This adds support for that. Signed-off-by: Sam Lai <slai@lyft.com> * dark theme updates (#134) Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Added workflow for updating flyteidl version in all component (#132) * Added workflow for updating flyte comopnent version Signed-off-by: yuvraj <evalsocket@gmail.com> * Added a single workflow for release flyteidl Signed-off-by: yuvraj <evalsocket@gmail.com> * revert workflow changes Signed-off-by: yuvraj <evalsocket@gmail.com> * bug fix in ci (#135) Signed-off-by: yuvraj <evalsocket@gmail.com> * Enable flyteidl update version for all component (#136) * enable flyteidl update version for all component Signed-off-by: yuvraj <evalsocket@gmail.com> * Added more component Signed-off-by: yuvraj <evalsocket@gmail.com> * remove flytekit from component Signed-off-by: yuvraj <evalsocket@gmail.com> * Pass dynamic workflow closure in node execution events (#141) * Documentation for Datacatalog (#143) Datacatalog service documentation Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Fix Datacatalog title.rst in docs (#145) * missing blank line in title.rst Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * generated docs Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Enable release automation for flytectl (#144) Signed-off-by: yuvraj <evalsocket@gmail.com> * Add GetOrReserveArtifact and ExtendReservation API (#142) * Move dynamic workflow metadata to GetNodeExecutionData response (#151) * Add DYNAMIC_RUNNING node execution phase (#152) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Introduce Auth Metadata and Identity Grpc Service and support Pkce auth in admin client (#155) * Introduce Auth Metadata and Identity Grpc Service Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * merge conflicts Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update deps Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * cleanup deps Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * update deps Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Delete unused catalog client Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Remove the need for UseAuth config to simplify setup further Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add deprecated comment Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Allow config of insecure creds transmission Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Moved the 3legged auth files from flytectl and also added config option for it (#156) * Moved the 3legged auth files from flytectl and also added config option for it Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed the expiry bug Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Changed logic to refresh the token Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Refactored the getAuthenticationDialOption Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added more unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added more unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * refactor pkce package Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * bump for dco Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Added ClientSetBuilder inorder to remove keyring dependency (#158) * Added ClientSetBuilder inorder to remove keyring dependency Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added token cache to deprecated method too Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Refactoring latest changes Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * rename Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * do not close server right away Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * don't close http server too soon Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * event init error Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Cleanup Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com> * documentation revamp according to RFC (#160) Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Update README.rst * Update validate module to protoc-gen-validate 0.6.1 (#165) * Update validate module to protoc-gen-validate 0.6.1 Signed-off-by: Hans Werner <hwerner@lyft.com> * include generated output Signed-off-by: Hans Werner <hwerner@lyft.com> * update code Signed-off-by: Hans Werner <hwerner@lyft.com> Co-authored-by: Julio Capote <jcapote@lyft.com> * Added flyteidl documentation (#167) * Added flyteidl documentation Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Generated doc requirements and updated CI to not generate docs for now Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Moved to rst file for events Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Moved to rst file for all index files Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> (cherry picked from commit 6dc3c4785dc95b05412a9bec2377016cf16b5ea8) * Added tmp doc generation step for getting doc dependencies Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using RST for documentation generation (#169) * Fix the links in generated html files * Added handler for build finished event to fix doc links * Added contributing guide * Adding wait for the subprocess * Fixed the path issue with finding the script for fixing the links * Added darwin switch for sed -i flag * Fixed non darwin with -i flag for sed * Using find instead of xargs as it fails on readthedocs * Moving the substitution errors to /dev/null * Escaped the Link values Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using protoc-gen-doc plugin directly Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Removed the example message Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed datacatalog file generation Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using template to generate docs and also removed unused imports in proto files and fixed doc issues Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Minor doc fix Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added dependency to protoc-gen in biolerplate module Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * add main nav font awesome icons (#170) * add main nav font awesome icons Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * add "edit on github button" config Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * fix html theme config Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Support annotations/labels in sidecar (#171) * Add K8sPod as a task target option (#172) * Support passing an iam role AND a k8s service account (#173) * Support passing an iam role AND a k8s service account (again) (#175) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Added boilerplate automation (#162) * Added boilerplate automation Signed-off-by: Yuvraj <evalsocket@gmail.com> * More changes Signed-off-by: Yuvraj <evalsocket@gmail.com> * Using protoc-gen-doc from the flyteorg and regenerated docs for new modules (#174) * Fix the links in generated html files * Added handler for build finished event to fix doc links * Added contributing guide * Adding wait for the subprocess * Fixed the path issue with finding the script for fixing the links * Added darwin switch for sed -i flag * Fixed non darwin with -i flag for sed * Using find instead of xargs as it fails on readthedocs * Moving the substitution errors to /dev/null * Escaped the Link values Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using protoc-gen-doc plugin directly Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Removed the example message Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Fixed datacatalog file generation Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using template to generate docs and also removed unused imports in proto files and fixed doc issues Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Minor doc fix Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added dependency to protoc-gen in biolerplate module Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Pulled the latest boilerplate changes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added support for Generic type for extracting a literal value (#176) * Added support for Generic type for extracting a literal value Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added grpc gateway jsonpb marshaller and unmarshaller for struct type Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Using json.Marshal Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Incorporated feedback and added another test for string generic Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add workflow execution config matchable attribute (#182) * #minor Enum type (#183) * Enum type definition Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Enum Type support in flyteidl Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * lint fixes Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * re-generated Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Enum default values are the first value in the list Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Added missing docs and included boiler plate update as prereq for generate (#185) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add max concurrency to launch plan & execution spec (#186) * MakeLiteralForType shouldn't print <nil> for nil values (#188) * Add max concurrency to launch plan & execution spec (#186) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * MakeLiteralForType shouldn't print <nil> for nil values Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * bump Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Co-authored-by: Katrina Rogan <katrina@nuclyde.io> * Clean up flyteadmin proto definitions and comments. (#189) * Add Task Node overrides (#190) * Update Boilerplate (#181) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Bringin back README.md #patch (#192) * Bringin back README.md Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Moved contents of developing.rst to README (#193) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Replaced doc_requirements.in with doc-requirements.in Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added InsecureSkipVerify flag (#191) * add deployment to the top TOC (#194) Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * algolia search (#195) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * fix TOC (#196) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Add core entity links to admin request structures (#197) * Fix typos in message comments (#199) Signed-off-by: Sean Lin <sean@union.ai> * Add endpoint to recover workflow execution (#187) * update doc requirements with sphinx v4 (#201) Signed-off-by: cosmicBboy <niels.bantilan@gmail.com> * Update code of conduct (#200) * update code of conduct Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * boilerplate Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Handling large integers (#202) * Handling large integers Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add ephemeral storage as a container resource (#203) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Add ephemeral storage as a matchable resource too (#204) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Add Raw Output Metadata to events (#205) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Disable bump-version and goreleaser workflow in the forked repository (#209) * Update master.yml Signed-off-by: Kevin Su <pingsutw@apache.org> * Update master.yml Signed-off-by: Kevin Su <pingsutw@apache.org> * Update master.yml Signed-off-by: Kevin Su <pingsutw@apache.org> * Add raw output data to admin execution models (#210) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Update Boilerplate (#208) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Fix up comment for raw output data (#211) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * readd docs (#212) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Change variable map to repeated map entries for ordering (#206) Signed-off-by: Sean Lin <sean@union.ai> * Add Sql in target proto (#214) Signed-off-by: Kevin Su <pingsutw@apache.org> * fix timestamp and duration literal extraction (#218) * fixed literal extraction for timestamp and duration types - was previously returning protobufs instead of native golang types Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed lint error with imports being non-alphabetical Signed-off-by: Daniel Rammer <daniel@union.ai> * Revert variable ordering change PR (#220) * Revert "Change variable map to repeated map entries for ordering (#206)" Signed-off-by: Sean Lin <sean@union.ai> * Update EventError with Is and Unwrap functions (#221) * update EventError with Is and Unwrap functions for use in errors API Signed-off-by: Daniel Rammer <daniel@union.ai> * changed EventError Is* functionality to check entire error stack Signed-off-by: Daniel Rammer <daniel@union.ai> * added nil tests to EventError.Is function Signed-off-by: Daniel Rammer <daniel@union.ai> * Schema type support for flytectl (#219) * MPI Operator plugin interface (#217) * Added mpi plugin Signed-off-by: Yuvraj <code@evalsocket.dev> * Rename variable name Signed-off-by: Yuvraj <code@evalsocket.dev> * Added docs for mpi Signed-off-by: Yuvraj <code@evalsocket.dev> * Support external token source for flyteadmin clients (#222) * refactor: add token source provider interface and implementation for clientcredentials and pkce Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * remove unused getAuthType method Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactorings Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add TokenSourceProvider interface documentation Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * move token source provider logic to admin to avoid circular deps Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * fix authentication dial option tests Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * lint files Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * allow external auth process Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * dont forget to trim Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactor: change if to switch Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactor: rename AuthType value and config Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * refactor: move credentials TS Provider with other types Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> Co-authored-by: Babis Kiosidis <babisk@spotify.com> * Add Slack button to README (#224) * Add Slack button to README Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * update slack link Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Add Architecture field to Container (#226) * Add Architecture field to Container Signed-off-by: Anmol Khurana <akhurana@lyft.com> * Update enum Signed-off-by: Anmol Khurana <akhurana@lyft.com> * Update enum Signed-off-by: Anmol Khurana <akhurana@lyft.com> * remove events package (#225) * moved 'go generate' snippet so that when events is removed admin service mocks are still generated Signed-off-by: Daniel Rammer <daniel@union.ai> * removed events package Signed-off-by: Daniel Rammer <daniel@union.ai> * Adding grpc health service in the clientset (#228) * Adding grpc health service in the clientset Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Added unit tests Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Update Boilerplate (#229) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * dummy edit -- updated requirements.txt (#223) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Cache Serialize API (#215) * removed datacatalog ExtendReservation API Signed-off-by: Daniel Rammer <daniel@union.ai> * filled out generated content with 'make generate' Signed-off-by: Daniel Rammer <daniel@union.ai> * updated protobuf docs for admin and core definitions Signed-off-by: Daniel Rammer <daniel@union.ai> * created ReservationID message to reuse Signed-off-by: Daniel Rammer <daniel@union.ai> * changed artifact reservation API to not include handling of artifacts - only reservations. Signed-off-by: Daniel Rammer <daniel@union.ai> * added cache reservation comments Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed indenting issues that always drive me crazy Signed-off-by: Daniel Rammer <daniel@union.ai> * updated discovery_reservable to discovery_serializable to adhere to name change Signed-off-by: Daniel Rammer <daniel@union.ai> * moved catalog reservation status enum into a message Signed-off-by: Daniel Rammer <daniel@union.ai> * changed discovery_serializable TaskMetadata field to cache_serializable Signed-off-by: Daniel Rammer <daniel@union.ai> * Execution closures in the API should defer to GetData calls for passing output data (#234) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Update Boilerplate (#236) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Added flag to pass in CAcerts (#242) * Added flag to pass in CAcerts Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Incorporated feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * caCert instead of caCerts Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * caCert to caCertFilePath Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add incompatible cluster event error (#240) * Add aborting workflow execution phase (#245) * New StructuredDataset type/literal #patch (#227) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * bump docsearch version (#246) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * update flyteidl for new navbar (#247) * update furo dep git > https (#249) Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Update Boilerplate (#243) Signed-off-by: Flyte-Bot <admin@flyte.org> Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com> * Add RetryAttempt and Phase to ExternalResourceInfo proto (#244) * added retry attempt and phase to ExternalResourceInfo proto Signed-off-by: Daniel Rammer <daniel@union.ai> * captialized ExternalResourceInfo retry_attempt comment Signed-off-by: Daniel Rammer <daniel@union.ai> * added index to ExternalResourceInfo proto Signed-off-by: Daniel Rammer <daniel@union.ai> * regenerated protos to fix rebase issues Signed-off-by: Daniel Rammer <daniel@union.ai> * add sphinx panels to docs (#250) Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Added UpdateExecution API and api objects (#248) * Expose flyteadmin client's auth opt (#252) * Expose flyteadmin client's auth opt Signed-off-by: Sean Lin <sean@union.ai> * Move authOpt to global Signed-off-by: Sean Lin <sean@union.ai> * minor fix Signed-off-by: Sean Lin <sean@union.ai> * Introduce TypeAnnotation#minor (#232) * feat: introduce TypeAnnotation Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net> * fix: message description Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net> * fix: regen proto after merge Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com> * Remove AdminAuth Client global state (#254) * Remove AdminAuth Client global state Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Fix unit test Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Added isDynamic flag for distinguishing subworkflows and dynamic workflows (#256) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add missing Python libs (#258) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Add hash to literal #minor (#237) * Add hash to Literal Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * make generate Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Comment hash Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Added RawOutputDataConfig in ExecutionSpec (#260) * Added RawOutputDataConfig in ExecutionSpec Signed-off-by: Kevin Su <pingsutw@apache.org> * bring back missing rsts Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * update comment, remove @latest, regenerate Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * die @latest Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Union Types #minor (#235) * Add support union type Signed-off-by: Kevin Su <pingsutw@apache.org> * Update union type + add union literal repr * Update union types to use string tags * Fix typo + generate protos * Implement changed design * generate * Remove changes to download_tooling.sh Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Kevin Su <pingsutw@apache.org> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add custom token source that allows preemptive token refresh (#262) * Add custom token source that allows preemptive token refresh Signed-off-by: Sean Lin <sean@union.ai> * Switch to apimachinery jitter Signed-off-by: Sean Lin <sean@union.ai> * Switch back to max because min doesnt make sense Signed-off-by: Sean Lin <sean@union.ai> * fix lint Signed-off-by: Sean Lin <sean@union.ai> * goimport Signed-off-by: Sean Lin <sean@union.ai> * minor fix Signed-off-by: Sean Lin <sean@union.ai> * Rename and trim config Signed-off-by: Sean Lin <sean@union.ai> * Introduce cluster assignment attribute to execution spec (#255) * checkpoint Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * one more Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * good riddance Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * one more Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * revert Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * DataProxy Service Definition (#261) * Added missing docs and mocks for DataProxy (#269) Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Additional execution properties as matchable entities. (#253) * proposal Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * comments Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Fixed the import and updated tooling Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Updating the golang version to 1.7 Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Adding authType in pflags and also updated docs with valid values (#268) * Adding authType in pflags and also updated docs with valid values Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * removed the default message Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * fixed spaces in mesages Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Add cache_status and logs to ExternalResrouce proto (#271) * added protobuf dependencies to doc generation Signed-off-by: Daniel Rammer <daniel@union.ai> * added cache_status and logs to ExternalResourceInfo proto Signed-off-by: Daniel Rammer <daniel@union.ai> * Generate mocks Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add is_parent & is_dynamic to node execution events (#272) * Rename DataProxy to DataProxyService for consistency (#273) * Rename DataProxy to DataProxyService for consistency Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update client go Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * bump Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Grammar edit (#267) * Minor grammar changes Grammar fix Changed Flyte IDL to Flyteidl Updated index.rst files Signed-off-by: SmritiSatyanV <smriti@union.ai> * Fix docs (#275) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Introduce taints and tolerations to cluster assignment (#276) * Add workflow execution JSON schema (#270) * Add workflow execution jsonschema Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated schema Signed-off-by: Kevin Su <pingsutw@apache.org> * Added Readme Signed-off-by: Kevin Su <pingsutw@apache.org> * updated Signed-off-by: Kevin Su <pingsutw@apache.org> * Add ContentMD5 parameter for CreateUploadLocationRequest (#278) * Add ContentMD5 parameter for CreateUploadLocationRequest Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Change contentMD5 type to bytes Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Rename suffix to filename Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * fix docs (#282) Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * Adding event_version to TaskExecutionEvent and TaskExecutionClosure (#279) * added event_version to TaskExecutionEvent Signed-off-by: Daniel Rammer <daniel@union.ai> * added event_version to TaskExecutionClosure Signed-off-by: Daniel Rammer <daniel@union.ai> * generated protos Signed-off-by: Daniel Rammer <daniel@union.ai> * Add ServiceHttpEndpoint to be returned to clients (#277) * Add ServiceHttpEndpoint to be returned to clients Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * add make generate check Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add missing docs (#284) Signed-off-by: Kevin Su <pingsutw@apache.org> * update docs (#285) Signed-off-by: Kevin Su <pingsutw@apache.org> * Go Linter Github action (#283) * Usess re-usable linter Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> Co-authored-by: Yuvraj <code@evalsocket.dev> * Fix pattern to hide generated code in github (#288) * Fix pattern to hide generated code in github Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Hide changes to rst files Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * #major Release 1.0.0 (#290) * #major Release 1.0.0 Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update flytestdlib to 1.0.0 Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Bump github tag action version (#292) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Changed default npm/python versions to valid semver (#293) Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Add interruptible override to execution #minor (#287) * Added interruptible flag for execution to protos Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Changed execution interruptible flag to use regular bool Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Changed interruptible overrides to use BoolValue Allows distinguishment between a value not being provided and the go zerovalue false Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Interruptible flag comment/documentation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Interruptible flag comment/documentation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Removed unescaped quotes from proto comments Included documentation for in proto generation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Re-generated documentation Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Updates go version used in the pipeline (#294) * Adds linter for go code Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * Usess re-usable linter Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * changes wrt comment Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * changes wrt comments Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> * updates go version in the yaml file Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com> Co-authored-by: Yuvraj <code@evalsocket.dev> * Dockerized docs gen (#295) * Dockerized docs generation Now uses protoc-gen-dec Docker image instead of running protoc using the protoc-gen-doc plugin locally Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Minor cleanup of doc templates Replaced double with single quotes in proto comments (cause escaping issues with protoc-gen-doc text renderer) Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Set locale override during protos/docs generation to ensure consistent sorting Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added deck_uri to NodeExecutionEvent (#286) * Added deck metadata in TaskMetadata Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated IDL Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated IDL Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated IDL Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated gitignore Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated idl Signed-off-by: Kevin Su <pingsutw@apache.org> * Updated comment Signed-off-by: Kevin Su <pingsutw@apache.org> * Add CreateDownloadLocation service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add CreateDownloadLocation service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add CreateDownloadLocation service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add deck_uri in NodeExecutionClosure Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * updated Signed-off-by: Kevin Su <pingsutw@apache.org> * updated Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * add deck_uri to task execution event Signed-off-by: Kevin Su <pingsutw@apache.org> * Remove deck_uri from task execution Signed-off-by: Kevin Su <pingsutw@apache.org> * Remove deprecated sidecar job (#302) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Grpc default service config (#301) * add load balancer config Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add policies doc link Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add available load balancing policies comment Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * add descriptive comment about missing balancer value Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * describe load balancing policy behaviour Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * import balancers Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * skip linting for empty imports Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * lint nolint Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * rely on grpc client functionality for the configs and remove todo Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * dont repeat the comment Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * change load balancing config to serviceConfig Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com> * Change config name and remove package preloading Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com> * Test it Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com> Co-authored-by: Babis Kiosidis <ckiosidis@gmail.com> * feat: buf integration for proto release (#300) * fix: integrated buf Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * added protoc-gen-swagger Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * buf mod update Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * fix proto path in ci Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> Co-authored-by: Yuvraj <evalsocket@users.noreply.github.com> * Add go_package for datacatalog.proto (#304) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * fix flyteidl version upgrade automation (#305) Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com> * Update execution.proto (#309) * Update execution.proto [Slack conversation](https://flyte-org.slack.com/archives/C01P3B761A6/p1657755908722469) Signed-off-by: SmritiSatyanV <smriti@union.ai> * Make generate Signed-off-by: Kevin Su <pingsutw@apache.org> Co-authored-by: Kevin Su <pingsutw@apache.org> * Ray task proposal (#308) * Ray plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * Ray plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * Update cluster spec Signed-off-by: Kevin Su <pingsutw@apache.org> * Update cluster spec Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Update proto Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix lint error Signed-off-by: Kevin Su <pingsutw@apache.org> * Remove shutdown_after_job_finishes Signed-off-by: Kevin Su <pingsutw@apache.org> * More comments Signed-off-by: Kevin Su <pingsutw@apache.org> * Allow passing in authentication client secret as an environment variable (#311) * Read client secret from env var first since the location has a default (#312) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Adding device authorization oauth2 flow (#313) * Added config skip opening browser for pkce auth Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * added docs Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * increased the default browser session timeout to 2min Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Adding device flow idl changes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * Adding device flow orchestration Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * lint fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * nit Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * refactor and feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * nit Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * test fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * more test fixes Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * feedback Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com> * update buf (#316) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Use grpc client interceptors to properly check for auth requirement (#315) * Use grpc client interceptors to properly check for auth requirement Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Some refactor and add unit tests Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * lint Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * unit tests Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Attempt a random port Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Listen to localhost only Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * use chain unary interceptor instead Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * only log on errors Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Attempt to disable error check Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Expose newAuthInterceptor to allow other clients to create authenticating clients (#319) Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add CheckpointUri to TaskNodeMetadata (#322) * Add CheckpointUri to TaskNodeMetadata Signed-off-by: Andrew Dye <andrewwdye@gmail.com> * Update swagger-codegen-cli image for arm Signed-off-by: Andrew Dye <andrewwdye@gmail.com> Signed-off-by: Andrew Dye <andrewwdye@gmail.com> * Project level attributes via matchable resource (#320) * copy pasta Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * generate Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * fix comment Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * ClusterAssignment stores cluster pool for execution placement (#321) * Cluster Pool execution placement Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Make generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * wip Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * make generate using new image Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate again Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate go1.18 Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate go1.18.5 Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * backward-compatible ClusterAssignment Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> * make generate Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai> Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com> * Update token source provider to optionally call GetPublicClientConfig (#326) * Update token source provider Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * GH actions incident Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Make call to auth metadata optional (#327) * Make call to auth metadata optional Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * debug Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * revert Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * undeprecate Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Add unit tests Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * codecov is not very good Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Adding audience field to device flow token request (#314) * Add createworkflow failure proto #minor (#331) * Added GateNode message (#296) * added GateNode message Signed-off-by: Daniel Rammer <daniel@union.ai> * added signal service Signed-off-by: Daniel Rammer <daniel@union.ai> * fleshed out Signal service Signed-off-by: Daniel Rammer <daniel@union.ai> * updated signal service with a GetOrCreateSignal and SetSignal API Signed-off-by: Daniel Rammer <daniel@union.ai> * updated signal service api to use GetOrCreate semantics Signed-off-by: Daniel Rammer <daniel@union.ai> * added the ListSignals API Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed SignalListResponse proto name Signed-off-by: Daniel Rammer <daniel@union.ai> * set HTTP API parameters Signed-off-by: Daniel Rammer <daniel@union.ai> * generated protos Signed-off-by: Daniel Rammer <daniel@union.ai> * documented GateNode Signed-off-by: Daniel Rammer <daniel@union.ai> * updated signal list API Signed-off-by: Daniel Rammer <daniel@union.ai> * filled out signal list api Signed-off-by: Daniel Rammer <daniel@union.ai> * addressing pr comments on docs Signed-off-by: Daniel Rammer <daniel@union.ai> * added an output variable name to the signal condition Signed-off-by: Daniel Rammer <daniel@union.ai> * reworded signal condition docs Signed-off-by: Daniel Rammer <daniel@union.ai> * added ApproveCondition to GateNode Signed-off-by: Daniel Rammer <daniel@union.ai> * removed authOpt Signed-off-by: Daniel Rammer <daniel@union.ai> * fixed types Signed-off-by: Daniel Rammer <daniel@union.ai> * updated doc_gen_deps to fix docs generation Signed-off-by: Daniel Rammer <daniel@union.ai> Signed-off-by: Daniel Rammer <daniel@union.ai> * Generate javascript proto (#336) * Cache eviction for single execution in datacatalog and flyteadmin (#318) * Added datacatalog endpoint for updating artifacts Existing artifacts can have their associated ArtifactData overwritten Signed-off-by: Nick Müller <nmueller@blackshark.ai> * datacatalog.UpdateArtifact returns ArtifactID Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added skip_cache override to ExecutionSpec, LaunchPlanSpec and WorkflowExecutionConfig Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added CatalogCacheStatus for skipped cache lookups Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Added skip_cache flag to ExecutionRelaunchRequest Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Renamed skip_cache flag to overwrite_cache Signed-off-by: Nick Müller <nmueller@blackshark.ai> Signed-off-by: Nick Müller <nmueller@blackshark.ai> * Doc Hub proposal (#303) * Add description entity Signed-off-by: Kevin Su <pingsutw@apache.org> * Add id Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * few update Signed-off-by: Kevin Su <pingsutw@apache.org> * update service Signed-off-by: Kevin Su <pingsutw@apache.org> * update service Signed-off-by: Kevin Su <pingsutw@apache.org> * Add description entity to task and workflow Signed-off-by: Kevin Su <pingsutw@apache.org> * update des entity Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * typo Signed-off-by: Kevin Su <pingsutw@apache.org> * address comment Signed-off-by: Kevin Su <pingsutw@apache.org> * update idl Signed-off-by: Kevin Su <pingsutw@apache.org> * list description entity Signed-off-by: Kevin Su <pingsutw@apache.org> * make generate Signed-off-by: Kevin Su <pingsutw@apache.org> * make generate Signed-off-by: Kevin Su <pingsutw@apache.org> * Update service name Signed-off-by: Kevin Su <pingsutw@apache.org> * update endpoint Signed-off-by: Kevin Su <pingsutw@apache.org> * update endpoint Signed-off-by: Kevin Su <pingsutw@apache.org> * remove create_description_entity endpoint Signed-off-by: Kevin Su <pingsutw@apache.org> * Add description to task/workflow Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * address comments Signed-off-by: Kevin Su <pingsutw@apache.org> * address comments Signed-off-by: Kevin Su <pingsutw@apache.org> * fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * fix test Signed-off-by: Kevin Su <pingsutw@apache.org> * Add id.resource_type Signed-off-by: Kevin Su <pingsutw@apache.org> * undeclared name: ResourceType Signed-off-by: Kevin Su <pingsutw@apache.org> * update wrong code manually Signed-off-by: Kevin Su <pingsutw@apache.org> * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> Signed-off-by: Kevin Su <pingsutw@apache.org> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Add a more restrict CreateDownloadLink API (#332) * Add a more restrict CreateDownloadLink API Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * generate Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * regenerate? Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Add generates_deck to task metadata Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Remove ARTIFACT_TYPE_OUTPUT_METADATA Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * PR Comments Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com> * Use buf to generate python stubs (#346) * Buf python migration Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Generate pyi files Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add venv to .gitgnore Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Use buf to generate python stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Use buf docker image to generate stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add stubs produced by call to `buf generate` using buf's docker image Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add pyi files Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Use buf locally Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Verify that generated protos by using buf Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Copy generated code to a separate artifact Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Move back to go_generate.yml@master Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Fix python package and publish typing information (#347) * Add __init__.py files to generated stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Publish stubs in the package Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Include __init__.py in verification workflow Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Bump versions of remote plugins Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Metadata tags (#348) * add tags to metadata Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * make generate Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Comment annotations and doc generation #minor (#350) * Comment swagger annotations in proto Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Regenerate proto stubs Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add Databricks config to Spark config (#351) * databricks plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * update comment Signed-off-by: Kevin Su <pingsutw@apache.org> * Use struct instead of string Signed-off-by: Kevin Su <pingsutw@apache.org> * Add token Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * add instance name Signed-off-by: Kevin Su <pingsutw@apache.org> * add instance name Signed-off-by: Kevin Su <pingsutw@apache.org> Signed-off-by: Kevin Su <pingsutw@apache.org> * Add inital `dask` plugin IDL (#339) Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net> * added comments to the catalog reservation API (#355) Signed-off-by: Daniel Rammer <daniel@union.ai> Signed-off-by: Daniel Rammer <daniel@union.ai> * dockerizing buf call (#356) Signed-off-by: Daniel Rammer <daniel@union.ai> Signed-off-by: Daniel Rammer <daniel@union.ai> * Add raw claims to user info response (#357) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Signed-off-by: Katrina Rogan <katroganGH@gmail.com> * Adding configurable audience property for flyte clients (#329) * Adding configurable audience property for flyte clients Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * changed the const audience to audienceKey Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * fixed unit tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * fixed unit test Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * nit Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * feedback Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * refactored unit tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added UseAudienceFromAdmin property to force pull audience from admin config. Default is false and expects clients to pass it Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added test for expected number of calls to the public admin endpoint Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * fixed the tests Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * Added template configuration to task template (#358) * added template to task template Signed-off-by: Daniel Rammer <daniel@union.ai> * updated docs Signed-off-by: Daniel Rammer <daniel@union.ai> * updated pod_template_name location to TaskMetadata proto message Signed-off-by: Daniel Rammer <daniel@union.ai> --------- Signed-off-by: Daniel Rammer <daniel@union.ai> * bumping go version to 1.19 (#363) Signed-off-by: Daniel Rammer <daniel@union.ai> * gen (#359) Signed-off-by: Katrina Rogan <katroganGH@gmail.com> Co-authored-by: Katrina Rogan <katrina@Katrinas-MBP.UNION.AI> * Adding support for structured dataset (#369) Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com> * added dynamic_job_spec_uri to dynamic workflow metadata and node execution closure (#360) Signed-off-by: Daniel Rammer <daniel@union.ai> * Use TokenCache in ClientCredentialsTokenSourceProvider (#377) * Init customTokenSource.refreshTime (#381) Signed-off-by: Andrew Dy…
- Loading branch information
