fix: add telemetry cli context #5226
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nicufk
requested review from
exu,
vsukhin,
vLia,
povilasv and
dejanzele
as code owners
✅ Deploy Preview for testkube-docs-preview ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
vsukhin
approved these changes
Mar 20, 2024
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## develop #5226 +/- ##
===========================================
- Coverage 29.74% 28.58% -1.17%
===========================================
Files 348 348
Lines 33005 33051 +46
===========================================
- Hits 9818 9448 -370
- Misses 22274 22711 +437
+ Partials 913 892 -21
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
nicufk
added a commit
that referenced
this pull request
Mar 21, 2024
nicufk
added a commit
that referenced
this pull request
Mar 21, 2024
vsukhin
added a commit
that referenced
this pull request
May 16, 2024
* feat(TKC-1642): add TestWorkflow support of cloning Git, executing tests, and artifacts (#5119) * feat(TKC-1642): add CI/CD for TestWorkflow Toolkit * feat(TKC-1642): add TestWorkflow toolkit with "execute" command * feat(TKC-1642): add "content.git" support for TestWorkflows * feat(TKC-1642): add support for 'async' option in TestWorkflow "execute" step * feat(TKC-1642): add support for TestWorkflow artifacts - API, CLI and 'artifacts' step * chore(TKC-1642): rename tarStream items * feat: Workflow tests - run script (#5074) * Workflow tests - run script * workflow tests - run script - duplicated cypress workflow removed * fix: direct client uri fix (#5125) * fix(TKC-1642): update TestWorkflow Toolkit to use libssl3 (#5124) * fix(TKC-1642): update Toolkit to use libssl3, as libssl1.1 is not available in newer alpine * fixup add missing "aborted" status for test workflow * fix: use map[string]interface{} for TestWorkflow output object * fixup warn * feat(TKC-1716): integrate TestWorkflows with Testkube Pro/Enterprise (#5120) * feat(TKC-1716): add Cloud repositories for TestWorkflows * feat(TKC-1716): add Protobuf schema for TestWorkflow notifications stream via GRPC * feat(TKC-1716): add agent workers for sharing TestWorkflow notifications with Cloud * fix: make message required in gRPC's TestWorkflow notifications * feat: add durationMs to the TestWorkflow's result (#5127) * fix: add missing durationMs for TestWorkflowResult (#5128) * feat: modify TestWorkflow preview to allow resolving without inlining the templates (#5129) * fix: added default times (#5102) * fix: added default times * fix: added default times * fix: v2 logs printing for cloud-enterprise (#5132) * fix: v2 logs printing for cloud-enterprise * fix: test name * build: bump github.com/gofiber/fiber/v2 from 2.51.0 to 2.52.1 (#5055) Bumps [github.com/gofiber/fiber/v2](https://github.com/gofiber/fiber) from 2.51.0 to 2.52.1. - [Release notes](https://github.com/gofiber/fiber/releases) - [Commits](gofiber/fiber@v2.51.0...v2.52.1) --- updated-dependencies: - dependency-name: github.com/gofiber/fiber/v2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * chore(deps): bump github.com/cloudevents/sdk-go/v2 from 2.14.0 to 2.15.2 (#5114) Bumps [github.com/cloudevents/sdk-go/v2](https://github.com/cloudevents/sdk-go) from 2.14.0 to 2.15.2. - [Release notes](https://github.com/cloudevents/sdk-go/releases) - [Commits](cloudevents/sdk-go@v2.14.0...v2.15.2) --- updated-dependencies: - dependency-name: github.com/cloudevents/sdk-go/v2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * feat: run TestWorkflows artifacts step as root, to read FS without problems (#5136) * fix typo in curl docs * fix: add field for custom CA in containerexecutor JobOptions (#5137) * fix: clean up TestWorkflow jobs after finish (#5139) * fix: mandatory -n * fix: unit test * fix: remove duplicated logic for container executor * fix: aborting execution via endpoint without test workflow name (#5143) * feat: TestWorkflow tests updated after `testworkflows.testkube.io/v1` and extended (#5138) * workflows updated after testworkflows.testkube.io/v1 * run script - postman workflow fixed * workflow tests - cases with trait updated, trait sub-step, trait with checkout on step, trait with global checkout * workflow cases - playwright anc cypress artifacts, cypress 13 video recording enabled, cypress 12 video recording (fefault), playwright shell, artifacts double asterisk, * workflows - k6 * fix: send Content-Type of TestWorkflow artifacts for signing URL (#5146) * fix: variable parsing * chore: add more logs regarding TestWorkflow controller (#5153) * fix: don't treat TestWorkflow pods as Test pods (#5154) * fix(docs:deploying-in-aws): correct api path from /results/v1 to /v1 * fix: list testsuite artifacts * fix: [TKC-1714] test suite results with step params (#5156) * fix: delete remainder of tcl licensed steps * fix: cleanups * dep: operator dependency * feat: add custom volumes and step setup phase for TestWorkflows (#5158) * feat: add volumes/volumeMounts/setup to TestWorkflow schema * feat: add proper merging of new volumes/volumeMounts/setup fields * feat: support native volumeMounts in Container * feat: support "setup" steps in TestWorkflow processor * feat: inject custom volumes to TestWorkflow * chore: update testkube-operator for support of new features * fix: ignore non test pods * fix: typo for auth selection * fix: make sync backwards compatible (#5161) * feat: handle aborting TestWorkflow executions gracefully (#5162) * feat: calibrate TestWorkflow clock for more precise step durations (#5163) * feat: testworkflow cases - k6 and jmeter with artifacts, examples for kubecon (#5166) * test workflows - k6 and jmeter tests with artifacts * example tests and workflows for kubecon * example test - name fixed * example testsuite - typo fixed * feat: fill time gaps in the TestWorkflow clock (#5167) * feat: fill time gaps in the TestWorkflow clock * feat: calibrate TestWorkflow's execution queuedAt based on scheduledAt * fix: improve Kubernetes error handling of TestWorkflow executions (#5168) * feat: avoid root privileges for TestWorkflow pods (#5169) * feat: load default user/group for Docker images * feat: use common FS Group for TestWorkflow's pod to avoid needed root permissions * feat: expose Test Workflow name for scheduled tests (#5170) * feat: expose Test Workflow name for scheduled tests * feat: use running context instead for marking scheduled tests * chore: removed duplicated cloud-pro code * update docs * update Enterprise * updated content * fix title for enterprise docs * feat: remove dashboard oss command (#5174) * fix: include TestWorkflow labels in the /labels list (#5177) * fix: gracefully handle critical pod errors (like OOM) in TestWorkflows (#5178) * fix: gracefully handle critical pod errors (like OOM) in TestWorkflows * chore: add error logs on error saving TestWorkflow result * fix: use proper application version constant (#5181) * fix: add `workingDir` support for TestWorkflow artifacts step (#5180) * fix: container executor negative test (#5175) * fix: container executor negative test * fix: minor improvement * fix: handle gracefully OOMKilled errors on GKE (#5190) - for some reason (bug?) GKE sends the SIGKILL when the container is already done successfully, and the Pod becomes stuck * fix: git fetcher tests * fix: change test content * fix: test file context * feat: display abort reason for TestWorkflow execution (#5191) * feat: [TKC-1740] remove dashboard from connect and disconnect commands (#5188) * feat: remove dashboard from connect and disconnect commands * feat: pro disconnect fixes * feat: update docs; remove helm params from installation * fix: logs grpc uris without path (#5192) * fix: logs grpc uris without path * fix: panic close of closed channel * feat: workflow tests - negative cases (#5176) * workflow tests - negative cases * workflow tests - negative cases - cypress example fixed * workflow tests - negative cases - cypress example fixed * Update test/cypress/executor-tests/crd-workflow/smoke.yaml Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * docs: Test Workflow docs (#5187) * docs: Test Workflows, Test Workflow Templates * docs: sidebar updated (Test Workflows) * docs: workflows - files example fixed * workflow docs - Artifacts condition: always * docs: added more high-level text on workflows and templates.. * docs: fixed header * workflow docs - artifacts - condition always * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * typo fixed --------- Co-authored-by: Ole Lensmar <ole@lensmar.com> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: clean pvc volume * docs: Enterprise - Include Custom certificates documentation (#5200) * hotfix: support Retry Policies in TestWorkflows (#5199) * fix: use `retry` policy for TestWorkflow stages * fix: process Retry Policy in TestWorkflows init process (cherry picked from commit 8319648) * docs: testkube upgrading * docs: added more upgrade info * feat: added logs service params for cloud (#5208) * feat: added logs service params for cloud * fix added feature flag for logs v2 * feat: implement basic workflow telemetry (#5209) * feat: add more sophisticated telemetry for workflows (#5211) * fix: increase available memory for building docs (#5212) * fix: use cluster/environment ids for cli telemetry (#5215) * ci: signing issue (#5219) * ci: upgrade cosign * ci: upgrade cosign-installer dependency * ci: upgrade scorecard (#5222) * fix: removed doubled flag (#5223) * fix: removed doubled flag * fix: imported not used * feat: slave pod logs * fix: typo in field name * fix: typo field name * fix: remove unused fields * fix: add nil cccheck * fix: logs source * fix: disable secret var cli * fix: add telemetry cli context (#5226) * Update Open Source or Pro Table (#5205) * feat: disable secret creation * fix: pass config param * fix: dep update * fix: manual abort (improve deletion detection) (#5227) (cherry picked from commit 86ad572) * fixL list secret parameters * fix: return execution namespaces * fix: spec field typo * fix: change selectorrrrr * docs: [TKC-1758] update Enterprise to Pro On-Prem (#5235) * docs: initial make docs * docs: name updates in CLI * docs: update Enterprise to Pro On-Prem in docs * docs: fix newline issue on environment variables * docs: updates * docs: updates * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: Update docs/docs/articles/running-tests.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: fix redirects --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use registry for inspection * feat: histogram metrics * fix: rename metric interface * fix: use summary metric * feat: use in cluster config * fix: build test image * fix: remove test * fix: new client type * docs: cli * docs: article * docs: [TKC-1758] doc review (#5249) * docs: fix images * docs: update screenshots * docs: update list of data collected * docs: update architecture diagrams for OSS * docs: update OSS to Core OSS * docs: update docs that only contain dashboard instructions to also have cli references * docs: update reference * feat: Workflow tests - suites, run script - `run` for workflows (suites) (#5225) * WIP - run script updated for workflows, not finished (specific workflow names need to be passed on run * test workflows - suites * test workflows - suites - edge-cases * test workflows - run script updated - workflows run (suites) * run script updated, workflow special cases * workflow suites - labels updated * ci: disable dev releases to the apt server (#5252) * fix: add minio error details * docs: shared /data volume across all pods docs (#5255) * fix: docs for sharing volume * docs: added info about possibility to override data volume * fix: docs for sharing volume * fix: docs for sharing volume * fix: docs for sharing volume * fix: typos and added info about slow NFS volumes * fix: logging improvements for logs server (#5257) * fix: logging improvements for logs server * fix: duplicated log * fix: error handling * fix: added logging of consumers instances * fix: logging of bufferInfos * fix: added message tracing param in minio adapter * fix: added message tracing param in minio adapter * fix: new MinIO adapter file based (#5258) * fix: new MinIO adapter file based * chore: less verbose gotestsum * chore: messages trace * fix: added new line for files * fix: new alpine image * fix: dont attach logs to result output (#5260) * add logs services to release flow * remove testing branch * docs: [TKC-1798] Include redirect(s) from Enterprise to Pro On-Prem (#5265) * fix subscription checker not being propagated to scheduler (#5266) * docs: Reduce the image size of add-additional-test-or-delay.png (#5270) * Reduce Image Size add-additional-test-or-delay.png was too large - replace with add-additional-test-or-delay-04.24 * Reduce Image Size Replace add-additional-test-or-delay.png with add-additional-test-or-delay-04.24.png. * feat: inject custom ca (#5269) (#5273) * feat: add runner custom ca variable * feat: add runner ca certificate to default job template * feat: add runner ca certificate to job template * feat: add runner ca certificate to job scraper template * feat: add runner ca certificate to slave pod template * feat(TKC-1808): allow to pass `run.shell` for TestWorkflow commands (#5272) * feat(TKC-1808): allow to pass `run.shell` for TestWorkflow commands * chore(TKC-1808): use latest testkube-operator * feat(TKC-1809): allow running shell in distroless environments (#5274) - copy the shell binaries to internal directory - add internal directory to PATH - use that shell as a default one * feat(expressions): add more functionalities (#5234) * feat(expressions): add `len()` standard function for expressions * feat(expressions): add floor/ceil/round functions to stdlib * feat(expressions): add chunk function to stdlib * feat(expressions): add map() function to stdlib * feat(expressions): add filter() function to stdlib * feat(expressions): add jq() function to stdlib * feat(expressions): add at() function to stdlib * feat(expressions): add eval() function to stdlib * feat(expressions): add support for wildcards and nested property accessors * feat(expressions): prepare common FS library * feat(expressions): support spread operator for Call arguments * feat(expressions): add simple option to simplify expression * fix(expressions): ternary operator * feat(expressions): add shellargs method to parse shell arguments * fix: enable secret endpoint flag * fix: ignore getting log error * fix: check for negative test * fix: doc typo * fix: remove output message * feat: Executor tests - k6 container - using ENVs in args (#5281) * executor tests - using ENV in args * executor tests - container k6 - suite extended * Refine Test Workflows Pages (#5284) * fix: nil check main (#5276) * fix: nil pointer error * style: address code review comment * style: extracted duplicated code into methods * fix: add deeper calculations * test: add tests for metrics * ci: fix linter * chore: improve TestWorkflow metrics (telemetry) * fix: image pull secrets registry always being empty when checking regi… (#5289) * fix image pull secrets registry always being empty when checking registry map and nil pointer dereference in cli * revert changes to testworkflowmetrics * fix: remove args formatting * fix: clean error message for negative tests * fix: don't return error for missed pod * feat: default storage class (#5263) * feat: default storage class model * fix: dep update * fix: add condition to template * fix: change condition operator * fix: unit test * docs: cli reference * docs: default storage class name * fix: dep update * Remove Pricing Image (#5293) * fix: logs handling with Istio (#5295) * fix: istio - logs are get concurrently in container executor * fix: istio - logs are get concurrently in container executor for job executor * fix: istio - removed count 1 for job executor * fix: error handling nil eq nil warning * fix: wait for goroutines to complete * fix: debug logs for log stream * fix: rollback count * fix: more logs * fix: unlock logs * fix: added comments * fix: debug * fix: rollback context background * fix: no minio and mongodb for agent * fix: logs for retry * fix: moved tailPodLogs as method * fix: nil in log * fix: removed count from tail * fix: golangci * fix: removed count from tail * fix: GetLogEntry simplified * fix: simplified logs * fix: allow to fully override URIs in CLI (#5288) * feat(testworkflows): expose IP and images for the Toolkit containers (#5302) * feat(testworkflows): expose real-time status from `execute` step (#5301) * fix(expressions): simplifying math and enums, expose common expressions machine for steps (#5299) * feat(testworkflows): configure global expressions machine for steps * fix(expressions): setting enum string values via expressions * fix(expressions): simplifying complex math operations * feat(testworkflows): expose tool to save internal artifacts (#5300) * feat: allow reading dynamically output of TestWorkflows (#5298) * feat(testworkflows): allow setting and accessing output from TestWorkflow steps * feat(testworkflows): improve output from initializer * fix(testworkflows): speed up TestWorkflows cleanup * fix(testworkflows): simplify the expressions in TestWorkflow beforehand * feat(testworkflows): extract logic for building files into ConfigMap, optimize it (#5297) * feat(testworkflows): add matrix/shards/executionRequest to execute (test-suite-like) step (#5304) * feat(testworkflows): expose utilities for sharding/matrix in TestWorkflows * feat(testworkflows): add matrix/shards to `execute` step / add `executionRequest` to `execute.tests` * feat(testworkflows): expose `executionName` in `execute.workflows` * feat(testworkflows): expose description for TestWorkflow's `execute` items * feat(testworkflows): add matrix/shards support for `execute` step * chore: update testkube-operator * fix(testworkflows): various adjustments (#5307) - fix processing output from steps - fix reading group from image by Skopeo - fix reading images in Toolkit - unify code for merging maps - expose ReadCount helper - rename shellargs function * fix(testworkflows): pass dynamic machine for the matrix & shards in execute step (#5308) * feat: [TKC-1841] test workflow cron job (#5296) * feat: test workflow event model * fix: dep update * feat: mapping fo workflow con job * docs: workflow schedule * fix: [TKC-1851]use init image instead of busy-box (#5306) * fix: use init image instead of usy-box * fix: use defaultImage * fix: use DefaultInitImage instead of DefaultImage * feat(testworkflows): add support for global TestWorkflowTemplate that is automatically included in all executions (#5311) * feat(testworkflows): add support for global template that is automatically included in all executions * feat(testworkflows): avoid loading global template twice when it was specifically requested * docs: disable secret creation & enable secrets endpoint (#5313) * docs: disable secret creation & enable secrets endpoint * fix: docs links * chore: bump docusaurus patch version * chore: update memory allocation for docs build * docs: fix secrets pages * feat: fetch pro context from cloud-api (#5312) * feat: fetch pro context from cloud-api * fix: fix grpc authentication * chore: address review remarks * feat: [TKC-1817] document on prem bootstrap configuration (#5305) * feat: [TKC-1817] document on prem bootstrap configuration * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: print dashboard links last and blue * fix(testworkflows): handle edge case of nullish event sent (#5323) * fix: update JMeter to version which binary is provided by Apache (#5324) * feat(testworkflows): allow unpacking tarballs, add option to pack tarballs for test-suite-like execute (#5322) * feat(testworkflows): add transfer server utility to expose data for parallel steps * feat(testworkflows): add API interface for execute.*.tarball * feat(testworkflows): add API interface for content.tarball * feat(testworkflows): add default transfer storage dir path in the constants * feat(testworkflows): expose both ID and URL while adding entry to transfer.Server * feat(testworkflows): add support for execute.*.tarball * feat(testworkflows): add support for content.tarball / fixes and improvements for execute.*.tarball * feat(expressions): add relpath and abspath functions for expressions in stdlib * feat(expressions): add range([start = 0, ]end) function * feat: workflows wizard docs (#5315) * refactor: workflow create selection * feat: add wizard steps * Update docs/docs/articles/test-workflows-creating.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: ability to test set client in executor tests (#5329) * feat(testworkflows): add support for pausing steps (#5338) * feat: add support for step's `pause` configuration in the API * feat: debug - expose pause config to init script * feat: change the Pause configuration format * feat: add initial support for pause/resume in the Init Process * feat: add control server for the Init Process to resume/pause * feat: improve pause/resume for steps * feat: expose endpoints to pause/resume steps * feat: set "paused" status correctly for workflow and workflow step * fix: avoid displaying empty line for consecutive hints/outputs * fix: compute properly "paused" status * chore: avoid sending output for pause/resume * feat: compute and persist pause periods for TestWorkflow steps * feat: add pause timestamp * feat: ignore pause period in the `timeout` * feat: add more details to TestWorkflowResultSummary * chore: compute paused expression to detect if it is static * chore: use http constant instead * fix: order of pause mutex * feat: extract common instruction names to constants * chore: fall back pause/resume to Kubernetes timestamp in case of invalid date * fix: building pause step for group stage * chore: compute paused immediately whenever it is possible * chore: add 'end' instruction to constants * feat(testworkflows): change `paused` to be boolean instead of expression * chore: avoid "-" in pause container name * chore: use latest testkube-operator * fix: new location for zap image (#5341) * feat(testworkflows): support more advanced Pod configuration (#5340) * feat: add OpenAPI support for more Pod configuration fields * feat(testworkflows): merge new pod configuration correctly * fix(testworkflows): update testkube-operator, adjust pod.resourceClaims * feat(testworkflows): append new pod configuration properties to the TestWorkflow * chore: update testkube-operator * fix: label value duplication * fix: use make * feat: refactor test workflow execute (#5333) * feat: refactor test workflow execute * fix: run workflow async * fix: add test workflow to workpool * feat: support test workflow in tirggers * fix: status and scraper unit tests * fix: trigger executor unit test * fix: nil check * fix: skip error * fix: return api error * fix: check for paused * fix: change const * fix: import * fix: nil check * doc: testworkflow trigger * fix: dep update * fix: invalid option for --output flag (#5337) The help text for the --output flag in the CLI suggest that there is type "go-template", when in fact it is just "go". * feat: cloud demo examples with cron triggers, workflow tests - triggers, junit example (#5330) * cloud demo examples with cron triggers * workflow tests - cron triggers * workflow tests - workflow suites extended, postman cron trigger test * add support for searching and sending junit reports to cloud (#5328) * fix: test trigger mapping * fix: move pkg * chore(deps): bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /docs (#5240) Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4. - [Release notes](https://github.com/webpack/webpack-dev-middleware/releases) - [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md) - [Commits](webpack/webpack-dev-middleware@v5.3.3...v5.3.4) --- updated-dependencies: - dependency-name: webpack-dev-middleware dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * feat: [TKC-1887]add on prem installer as the testkube command (#5345) * feat: add on prem installer as the testkube command * fix: add breaks and uncomment context confirmation * fix: add telemetry * feat(installer): polish init demo * Update lint.yaml * fix: fix linter * fix(installer): Testkube OSS should be the default init --------- Co-authored-by: Delnat Wito <wito.delnat@gmail.com> Co-authored-by: Wito <WitoDelnat@users.noreply.github.com> * chore: draft installing docs (#5346) * chore: draft installing docs * fix(docs): address remarks * fix(docs): inconsistencies between doc and cli * docs: Add Examples to Test Workflows (#5334) * Add Examples to Test Workflows Using Dawid Rusnak's presentation. * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-expressions Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-expressions Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-configuration.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Correct Expression page errors * Update test-workflows-examples-basics.md * Update docs/docs/articles/test-workflows-examples-expressions.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * fix(init): fix licenses with spaces and special characters (#5354) * docs: Reverse order of CLI init profiles (OSS last) (#5359) * docs: Reverse order of CLI init profiles (OSS last) * docs: Add URL to download * docs: Reverse order of CLI init profiles (OSS last) * fix: hotfix license key (#5360) * Add GitHub Actions to depedndabot * fix: salve pod template ca secret * chore(deps): bump actions/cache from 2 to 4 Bumps [actions/cache](https://github.com/actions/cache) from 2 to 4. - [Release notes](https://github.com/actions/cache/releases) - [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md) - [Commits](actions/cache@v2...v4) --- updated-dependencies: - dependency-name: actions/cache dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump golangci/golangci-lint-action from 4 to 5 Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action) from 4 to 5. - [Release notes](https://github.com/golangci/golangci-lint-action/releases) - [Commits](golangci/golangci-lint-action@v4...v5) --- updated-dependencies: - dependency-name: golangci/golangci-lint-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump codecov/codecov-action from 3 to 4 Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 3 to 4. - [Release notes](https://github.com/codecov/codecov-action/releases) - [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md) - [Commits](codecov/codecov-action@v3...v4) --- updated-dependencies: - dependency-name: codecov/codecov-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/setup-node from 3 to 4 Bumps [actions/setup-node](https://github.com/actions/setup-node) from 3 to 4. - [Release notes](https://github.com/actions/setup-node/releases) - [Commits](actions/setup-node@v3...v4) --- updated-dependencies: - dependency-name: actions/setup-node dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump docker/setup-buildx-action from 1 to 3 Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 1 to 3. - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](docker/setup-buildx-action@v1...v3) --- updated-dependencies: - dependency-name: docker/setup-buildx-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * docs: added quickstart without k8s info and some faq entries (#5370) * docs: added quickstart without k8s info and some faq entries * docs: fixed broken link * docs: typos.. * docs: Change HTTP to HTTPS on URLs (SEO requirement) (#5371) * chore(deps): bump pnpm/action-setup from 2 to 3 Bumps [pnpm/action-setup](https://github.com/pnpm/action-setup) from 2 to 3. - [Release notes](https://github.com/pnpm/action-setup/releases) - [Commits](pnpm/action-setup@v2...v3) --- updated-dependencies: - dependency-name: pnpm/action-setup dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump anchore/sbom-action from 0.14.2 to 0.15.11 Bumps [anchore/sbom-action](https://github.com/anchore/sbom-action) from 0.14.2 to 0.15.11. - [Release notes](https://github.com/anchore/sbom-action/releases) - [Commits](anchore/sbom-action@v0.14.2...v0.15.11) --- updated-dependencies: - dependency-name: anchore/sbom-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump docker/setup-qemu-action from 1 to 3 Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 1 to 3. - [Release notes](https://github.com/docker/setup-qemu-action/releases) - [Commits](docker/setup-qemu-action@v1...v3) --- updated-dependencies: - dependency-name: docker/setup-qemu-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump peaceiris/actions-gh-pages from 3 to 4 Bumps [peaceiris/actions-gh-pages](https://github.com/peaceiris/actions-gh-pages) from 3 to 4. - [Release notes](https://github.com/peaceiris/actions-gh-pages/releases) - [Changelog](https://github.com/peaceiris/actions-gh-pages/blob/main/CHANGELOG.md) - [Commits](peaceiris/actions-gh-pages@v3...v4) --- updated-dependencies: - dependency-name: peaceiris/actions-gh-pages dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump goreleaser/goreleaser-action from 2 to 5 Bumps [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action) from 2 to 5. - [Release notes](https://github.com/goreleaser/goreleaser-action/releases) - [Commits](goreleaser/goreleaser-action@v2...v5) --- updated-dependencies: - dependency-name: goreleaser/goreleaser-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * feat: test workflow events * fix: test workflow slack messages * docs: slack and webhooks * fix: slack config * fix: update slack template * fix: change slack workflow name * fix: dep update * chore(deps): bump actions/setup-go from 2 to 5 Bumps [actions/setup-go](https://github.com/actions/setup-go) from 2 to 5. - [Release notes](https://github.com/actions/setup-go/releases) - [Commits](actions/setup-go@v2...v5) --- updated-dependencies: - dependency-name: actions/setup-go dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump golangci/golangci-lint-action from 5 to 6 Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action) from 5 to 6. - [Release notes](https://github.com/golangci/golangci-lint-action/releases) - [Commits](golangci/golangci-lint-action@v5...v6) --- updated-dependencies: - dependency-name: golangci/golangci-lint-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump github/codeql-action from 2 to 3 Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2 to 3. - [Release notes](https://github.com/github/codeql-action/releases) - [Commits](github/codeql-action@v2...v3) --- updated-dependencies: - dependency-name: github/codeql-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump amannn/action-semantic-pull-request Bumps [amannn/action-semantic-pull-request](https://github.com/amannn/action-semantic-pull-request) from 3.4.6 to 5.5.2. - [Release notes](https://github.com/amannn/action-semantic-pull-request/releases) - [Changelog](https://github.com/amannn/action-semantic-pull-request/blob/main/CHANGELOG.md) - [Commits](amannn/action-semantic-pull-request@v3.4.6...v5.5.2) --- updated-dependencies: - dependency-name: amannn/action-semantic-pull-request dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump bruceadams/get-release from 1.2.3 to 1.3.2 Bumps [bruceadams/get-release](https://github.com/bruceadams/get-release) from 1.2.3 to 1.3.2. - [Release notes](https://github.com/bruceadams/get-release/releases) - [Commits](bruceadams/get-release@v1.2.3...v1.3.2) --- updated-dependencies: - dependency-name: bruceadams/get-release dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix(testworkflows): upgrade testkube-operator to support expressions in "run" step (#5385) (cherry picked from commit 022dcd0) * fix issue with image pull secrets for workflows (#5378) * feat(installer): minor improvements (#5387) * chore(deps): bump guyarb/golang-test-annotations from 0.6.0 to 0.8.0 Bumps [guyarb/golang-test-annotations](https://github.com/guyarb/golang-test-annotations) from 0.6.0 to 0.8.0. - [Release notes](https://github.com/guyarb/golang-test-annotations/releases) - [Commits](guyarb/golang-test-annotations@v0.6.0...v0.8.0) --- updated-dependencies: - dependency-name: guyarb/golang-test-annotations dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix issue with image pull secrets for workflows due to invalid registry append (#5397) * chore(deps): bump timheuer/base64-to-file from 1.1 to 1.2 Bumps [timheuer/base64-to-file](https://github.com/timheuer/base64-to-file) from 1.1 to 1.2. - [Release notes](https://github.com/timheuer/base64-to-file/releases) - [Commits](timheuer/base64-to-file@v1.1...v1.2) --- updated-dependencies: - dependency-name: timheuer/base64-to-file dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/setup-java from 3 to 4 Bumps [actions/setup-java](https://github.com/actions/setup-java) from 3 to 4. - [Release notes](https://github.com/actions/setup-java/releases) - [Commits](actions/setup-java@v3...v4) --- updated-dependencies: - dependency-name: actions/setup-java dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump peter-evans/repository-dispatch from 2 to 3 Bumps [peter-evans/repository-dispatch](https://github.com/peter-evans/repository-dispatch) from 2 to 3. - [Release notes](https://github.com/peter-evans/repository-dispatch/releases) - [Commits](peter-evans/repository-dispatch@v2...v3) --- updated-dependencies: - dependency-name: peter-evans/repository-dispatch dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump pnpm/action-setup from 3 to 4 Bumps [pnpm/action-setup](https://github.com/pnpm/action-setup) from 3 to 4. - [Release notes](https://github.com/pnpm/action-setup/releases) - [Commits](pnpm/action-setup@v3...v4) --- updated-dependencies: - dependency-name: pnpm/action-setup dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * feat: TKC-1956 log message retention time (#5399) * add support for cloud capabilities (#5398) * chore(deps): bump sigstore/cosign-installer from 3.4.0 to 3.5.0 Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.4.0 to 3.5.0. - [Release notes](https://github.com/sigstore/cosign-installer/releases) - [Commits](sigstore/cosign-installer@v3.4.0...v3.5.0) --- updated-dependencies: - dependency-name: sigstore/cosign-installer dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump docker/login-action from 1 to 3 Bumps [docker/login-action](https://github.com/docker/login-action) from 1 to 3. - [Release notes](https://github.com/docker/login-action/releases) - [Commits](docker/login-action@v1...v3) --- updated-dependencies: - dependency-name: docker/login-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/checkout from 2 to 4 Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4. - [Release notes](https://github.com/actions/checkout/releases) - [Commits](actions/checkout@v2...v4) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/upload-artifact from 3 to 4 Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3 to 4. - [Release notes](https://github.com/actions/upload-artifact/releases) - [Commits](actions/upload-artifact@v3...v4) --- updated-dependencies: - dependency-name: actions/upload-artifact dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Replace Image (#5402) An image was affecting performance of the docs. * feat: [TKC-1856] test workflow execution namespace (#5388) * feat: test workflow namespace field * feat: model for test workflow execution namespace * feat: test workflow execution namespace * fix: use execution namespace * fix: render execution namespace * fix: shoow namespace * fix: pass service account names to test workflow executor * fix: internal namespace * docs: example for test workflow namespace * fix: dep update * feat: headers for direct client * docs: cli * fix(testworkflows): improve stability of orchestration (#5408) * fix(testworkflows): expose proper error for internal cluster problem with networking * fix(testworkflows): fix problems with artifacts walker * fix(testworkflows): clean up global template * fix(testworkflows): fix streaming error messages * fix(testworkflows): delete unneeded file * fix(testworkflows): improve stability of TestWorkflow orchestration * fix(testworkflows): ensure no memory leaks while controlling TestWorkflow * fix(testworkflows): CR fixes * feat(testworkflows): add activeDeadlineSeconds for the job (#5410) * chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.3.3 Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 2.3.1 to 2.3.3. - [Release notes](https://github.com/ossf/scorecard-action/releases) - [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md) - [Commits](ossf/scorecard-action@0864cf1...dc50aa9) --- updated-dependencies: - dependency-name: ossf/scorecard-action dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * docs: link openapi definition (#5413) * fix(testworkflows): orchestration fixes (#5414) * fix(testworkflows): make the orchestration channel peeking async * fix(testworkflows): increase init controller timeout * fix(testworkflows): fallback execution namespace to the default one * fix: add more telemetry for on prem installer (#5412) * docs: add test executions durations to metrics (#5418) * fix: complete repository empty check (#4889) * fix: complete repository empty check * fix: extract method for empty check * docs: add test executions duration to metrics --------- Co-authored-by: Vladislav Sukhin <vladislav@kubeshop.io> Co-authored-by: nicufk <nicolae@kubeshop.io> * fix: relax license format to include old offline licenses (#5422) * docs: Remove references to old installer (#5427) * feat: [TKC-1854] add read only flag for test workflows (#5429) * fix: pulling from git servers using private ca (#5432) * feat: event mapper * feat: k8s event loader * fix: switch value * fix: rename testkube event * fix: dep update * fix: get causes for testkube event * fix: enable k8s events flag * fix: rename const * fix: use const * docs: k8s events * fix: rename method * fix: dep update * feat(testworkflows): TKC-1765 - parallel execution (K6/Playwright/Cypress) (#5420) * feat(testworkflows): TKC-1765 - add support for `parallel` syntax * chore(testworkflows): use single instance of TestWorkflowExecutor * feat(testworkflows): TKC-1765 - expose configured images inspector for Toolkit * fix(testworkflows): delete global template from env map * feat(testworkflows): decouple workflow resource IDs with execution IDs / support root/direct resource IDs * feat(testworkflows): TKC-1763 - initial version of `parallel` step support * feat(testworkflows): perform workflow clean up operations in parallel * feat(testworkflows): TKC-1763 - support parallelism and description for parallel steps * feat(testworkflows): TKC-1763 - expose Dashboard/API URLs to the Toolkit * feat(testworkflows): TKC-1763 - set default parallelism of 1000 in `parallel` steps * fix(testworkflows): avoid timeouts in parallel execution * feat(testworkflows): TKC-1763 - expose parallel steps signature and results * chore(testworkflows): delete debug prints * feat(testworkflows): isolate parallel steps artifacts * feat(testworkflows): expose information about current inner step in parallel step * feat(testworkflows): TKC-1763 - expose information about current inner step in parallel step * feat(testworkflows): TKC-1763 - store logs for parallel steps * feat(testworkflows): inform about the node where the parallel step is running * feat(testworkflows): TKC-1765 - add distributed K6 examples * chore(testworkflows): rename fetch tarball operation * chore(testworkflows): extract tarball unpacking logic * feat(testworkflows): TKC-1766 - add option to fetch files from parallel steps * feat(testworkflows): TKC-1766 - add example for distributed Playwright test * fix(testworkflows): avoid problems with not existing working directory permissions * fix(testworkflows): working directory expressions * feat(testworkflows): add example of automatically distributed Cypress tests * chore(testworkflows): restructure TestWorkflow operator objects * feat(testworkflows): add shorter syntax for parallel steps (do not require `steps` when it's a single one) * feat(testworkflows): inherit container defaults in the parallel step * feat(testworkflows): handle `template` alias in `parallel` step properly * feat(testworkflows): dedupe env vars in the ContainerConfig * feat(testworkflows): use inheritance in distributed Cypress/Playwright examples * chore(testworkflows): simplify distributed K6 example * chore(testworkflows): display worker description in general parallel logs * chore(testworkflows): extract building params information text * chore(testworkflows): extract processing `transfer` instruction * chore(testworkflows): extract processing `fetch` instruction * chore(testworkflows): code review fixes * chore(testworkflows): fix circular dependency * chore(testworkflows): extract code for deploying TestWorkflow bundle * chore(testworkflows): extract code for fetching the TestWorkflow logs * chore(testworkflows): extract code for fetching the TestWorkflow logs * chore(testworkflows): use job namespace in parallel execution * chore(testworkflows): unify logger for the parallel workers notifications * chore(testworkflows): extract building execution machine * chore(testworkflows): little code movement * chore(testworkflows): extract code for executing parallel operations * chore(testworkflows): unify parallel log * chore(testworkflows): build controller registry for parallel workers * chore(testworkflows): simplify watcher in the parallel workers * chore(testworkflows): clean up client set for parallel workers * feat(testworkflows): add support for conditional logs save in parallel steps * chore(testworkflows): extract logic for creating machine for spawning * chore(testworkflows): update testkube-operator * feat: added debug info in case of pod disaster (#5433) * fix(testworkflows): orchestration fixes (#5435) --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: Michal Dygas <michal.dygas@shijigroup.com> Co-authored-by: nicufk <nicolae@kubeshop.io> Co-authored-by: Ole Lensmar <ole@lensmar.com> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Javier Morante <142315352+jmorante-ks@users.noreply.github.com> Co-authored-by: Emil Davtyan <emil@kubeshop.io> Co-authored-by: Lilla Vass <lilla@kubeshop.io> Co-authored-by: Catalin <20538711+devcatalin@users.noreply.github.com> Co-authored-by: Wito <WitoDelnat@users.noreply.github.com> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Razvan Topliceanu <47887589+topliceanurazvan@users.noreply.github.com> Co-authored-by: frederikb <232148+frederikb@users.noreply.github.com> Co-authored-by: Delnat Wito <wito.delnat@gmail.com> Co-authored-by: Luca Comellini <luca.com@gmail.com> Co-authored-by: Nelson Silva <nelson.emanuel.silva@gmail.com>
vsukhin
added a commit
that referenced
this pull request
May 21, 2024
* feat: avoid root privileges for TestWorkflow pods (#5169) * feat: load default user/group for Docker images * feat: use common FS Group for TestWorkflow's pod to avoid needed root permissions * feat: expose Test Workflow name for scheduled tests (#5170) * feat: expose Test Workflow name for scheduled tests * feat: use running context instead for marking scheduled tests * chore: removed duplicated cloud-pro code * update docs * update Enterprise * updated content * fix title for enterprise docs * feat: remove dashboard oss command (#5174) * fix: include TestWorkflow labels in the /labels list (#5177) * fix: gracefully handle critical pod errors (like OOM) in TestWorkflows (#5178) * fix: gracefully handle critical pod errors (like OOM) in TestWorkflows * chore: add error logs on error saving TestWorkflow result * fix: use proper application version constant (#5181) * fix: add `workingDir` support for TestWorkflow artifacts step (#5180) * fix: container executor negative test (#5175) * fix: container executor negative test * fix: minor improvement * fix: handle gracefully OOMKilled errors on GKE (#5190) - for some reason (bug?) GKE sends the SIGKILL when the container is already done successfully, and the Pod becomes stuck * fix: git fetcher tests * fix: change test content * fix: test file context * feat: display abort reason for TestWorkflow execution (#5191) * feat: [TKC-1740] remove dashboard from connect and disconnect commands (#5188) * feat: remove dashboard from connect and disconnect commands * feat: pro disconnect fixes * feat: update docs; remove helm params from installation * fix: logs grpc uris without path (#5192) * fix: logs grpc uris without path * fix: panic close of closed channel * feat: workflow tests - negative cases (#5176) * workflow tests - negative cases * workflow tests - negative cases - cypress example fixed * workflow tests - negative cases - cypress example fixed * Update test/cypress/executor-tests/crd-workflow/smoke.yaml Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * docs: Test Workflow docs (#5187) * docs: Test Workflows, Test Workflow Templates * docs: sidebar updated (Test Workflows) * docs: workflows - files example fixed * workflow docs - Artifacts condition: always * docs: added more high-level text on workflows and templates.. * docs: fixed header * workflow docs - artifacts - condition always * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-workflow-templates.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * typo fixed --------- Co-authored-by: Ole Lensmar <ole@lensmar.com> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: clean pvc volume * docs: Enterprise - Include Custom certificates documentation (#5200) * hotfix: support Retry Policies in TestWorkflows (#5199) * fix: use `retry` policy for TestWorkflow stages * fix: process Retry Policy in TestWorkflows init process (cherry picked from commit 8319648) * docs: testkube upgrading * docs: added more upgrade info * feat: added logs service params for cloud (#5208) * feat: added logs service params for cloud * fix added feature flag for logs v2 * feat: implement basic workflow telemetry (#5209) * feat: add more sophisticated telemetry for workflows (#5211) * fix: increase available memory for building docs (#5212) * fix: use cluster/environment ids for cli telemetry (#5215) * ci: signing issue (#5219) * ci: upgrade cosign * ci: upgrade cosign-installer dependency * ci: upgrade scorecard (#5222) * fix: removed doubled flag (#5223) * fix: removed doubled flag * fix: imported not used * feat: slave pod logs * fix: typo in field name * fix: typo field name * fix: remove unused fields * fix: add nil cccheck * fix: logs source * fix: disable secret var cli * fix: add telemetry cli context (#5226) * Update Open Source or Pro Table (#5205) * feat: disable secret creation * fix: pass config param * fix: dep update * fix: manual abort (improve deletion detection) (#5227) (cherry picked from commit 86ad572) * fixL list secret parameters * fix: return execution namespaces * fix: spec field typo * fix: change selectorrrrr * docs: [TKC-1758] update Enterprise to Pro On-Prem (#5235) * docs: initial make docs * docs: name updates in CLI * docs: update Enterprise to Pro On-Prem in docs * docs: fix newline issue on environment variables * docs: updates * docs: updates * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: Update docs/docs/articles/running-tests.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: fix redirects --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use registry for inspection * feat: histogram metrics * fix: rename metric interface * fix: use summary metric * feat: use in cluster config * fix: build test image * fix: remove test * fix: new client type * docs: cli * docs: article * docs: [TKC-1758] doc review (#5249) * docs: fix images * docs: update screenshots * docs: update list of data collected * docs: update architecture diagrams for OSS * docs: update OSS to Core OSS * docs: update docs that only contain dashboard instructions to also have cli references * docs: update reference * feat: Workflow tests - suites, run script - `run` for workflows (suites) (#5225) * WIP - run script updated for workflows, not finished (specific workflow names need to be passed on run * test workflows - suites * test workflows - suites - edge-cases * test workflows - run script updated - workflows run (suites) * run script updated, workflow special cases * workflow suites - labels updated * ci: disable dev releases to the apt server (#5252) * fix: add minio error details * docs: shared /data volume across all pods docs (#5255) * fix: docs for sharing volume * docs: added info about possibility to override data volume * fix: docs for sharing volume * fix: docs for sharing volume * fix: docs for sharing volume * fix: typos and added info about slow NFS volumes * fix: logging improvements for logs server (#5257) * fix: logging improvements for logs server * fix: duplicated log * fix: error handling * fix: added logging of consumers instances * fix: logging of bufferInfos * fix: added message tracing param in minio adapter * fix: added message tracing param in minio adapter * fix: new MinIO adapter file based (#5258) * fix: new MinIO adapter file based * chore: less verbose gotestsum * chore: messages trace * fix: added new line for files * fix: new alpine image * fix: dont attach logs to result output (#5260) * add logs services to release flow * remove testing branch * docs: [TKC-1798] Include redirect(s) from Enterprise to Pro On-Prem (#5265) * fix subscription checker not being propagated to scheduler (#5266) * docs: Reduce the image size of add-additional-test-or-delay.png (#5270) * Reduce Image Size add-additional-test-or-delay.png was too large - replace with add-additional-test-or-delay-04.24 * Reduce Image Size Replace add-additional-test-or-delay.png with add-additional-test-or-delay-04.24.png. * feat: inject custom ca (#5269) (#5273) * feat: add runner custom ca variable * feat: add runner ca certificate to default job template * feat: add runner ca certificate to job template * feat: add runner ca certificate to job scraper template * feat: add runner ca certificate to slave pod template * feat(TKC-1808): allow to pass `run.shell` for TestWorkflow commands (#5272) * feat(TKC-1808): allow to pass `run.shell` for TestWorkflow commands * chore(TKC-1808): use latest testkube-operator * feat(TKC-1809): allow running shell in distroless environments (#5274) - copy the shell binaries to internal directory - add internal directory to PATH - use that shell as a default one * feat(expressions): add more functionalities (#5234) * feat(expressions): add `len()` standard function for expressions * feat(expressions): add floor/ceil/round functions to stdlib * feat(expressions): add chunk function to stdlib * feat(expressions): add map() function to stdlib * feat(expressions): add filter() function to stdlib * feat(expressions): add jq() function to stdlib * feat(expressions): add at() function to stdlib * feat(expressions): add eval() function to stdlib * feat(expressions): add support for wildcards and nested property accessors * feat(expressions): prepare common FS library * feat(expressions): support spread operator for Call arguments * feat(expressions): add simple option to simplify expression * fix(expressions): ternary operator * feat(expressions): add shellargs method to parse shell arguments * fix: enable secret endpoint flag * fix: ignore getting log error * fix: check for negative test * fix: doc typo * fix: remove output message * feat: Executor tests - k6 container - using ENVs in args (#5281) * executor tests - using ENV in args * executor tests - container k6 - suite extended * Refine Test Workflows Pages (#5284) * fix: nil check main (#5276) * fix: nil pointer error * style: address code review comment * style: extracted duplicated code into methods * fix: add deeper calculations * test: add tests for metrics * ci: fix linter * chore: improve TestWorkflow metrics (telemetry) * fix: image pull secrets registry always being empty when checking regi… (#5289) * fix image pull secrets registry always being empty when checking registry map and nil pointer dereference in cli * revert changes to testworkflowmetrics * fix: remove args formatting * fix: clean error message for negative tests * fix: don't return error for missed pod * feat: default storage class (#5263) * feat: default storage class model * fix: dep update * fix: add condition to template * fix: change condition operator * fix: unit test * docs: cli reference * docs: default storage class name * fix: dep update * Remove Pricing Image (#5293) * fix: logs handling with Istio (#5295) * fix: istio - logs are get concurrently in container executor * fix: istio - logs are get concurrently in container executor for job executor * fix: istio - removed count 1 for job executor * fix: error handling nil eq nil warning * fix: wait for goroutines to complete * fix: debug logs for log stream * fix: rollback count * fix: more logs * fix: unlock logs * fix: added comments * fix: debug * fix: rollback context background * fix: no minio and mongodb for agent * fix: logs for retry * fix: moved tailPodLogs as method * fix: nil in log * fix: removed count from tail * fix: golangci * fix: removed count from tail * fix: GetLogEntry simplified * fix: simplified logs * fix: allow to fully override URIs in CLI (#5288) * feat(testworkflows): expose IP and images for the Toolkit containers (#5302) * feat(testworkflows): expose real-time status from `execute` step (#5301) * fix(expressions): simplifying math and enums, expose common expressions machine for steps (#5299) * feat(testworkflows): configure global expressions machine for steps * fix(expressions): setting enum string values via expressions * fix(expressions): simplifying complex math operations * feat(testworkflows): expose tool to save internal artifacts (#5300) * feat: allow reading dynamically output of TestWorkflows (#5298) * feat(testworkflows): allow setting and accessing output from TestWorkflow steps * feat(testworkflows): improve output from initializer * fix(testworkflows): speed up TestWorkflows cleanup * fix(testworkflows): simplify the expressions in TestWorkflow beforehand * feat(testworkflows): extract logic for building files into ConfigMap, optimize it (#5297) * feat(testworkflows): add matrix/shards/executionRequest to execute (test-suite-like) step (#5304) * feat(testworkflows): expose utilities for sharding/matrix in TestWorkflows * feat(testworkflows): add matrix/shards to `execute` step / add `executionRequest` to `execute.tests` * feat(testworkflows): expose `executionName` in `execute.workflows` * feat(testworkflows): expose description for TestWorkflow's `execute` items * feat(testworkflows): add matrix/shards support for `execute` step * chore: update testkube-operator * fix(testworkflows): various adjustments (#5307) - fix processing output from steps - fix reading group from image by Skopeo - fix reading images in Toolkit - unify code for merging maps - expose ReadCount helper - rename shellargs function * fix(testworkflows): pass dynamic machine for the matrix & shards in execute step (#5308) * feat: [TKC-1841] test workflow cron job (#5296) * feat: test workflow event model * fix: dep update * feat: mapping fo workflow con job * docs: workflow schedule * fix: [TKC-1851]use init image instead of busy-box (#5306) * fix: use init image instead of usy-box * fix: use defaultImage * fix: use DefaultInitImage instead of DefaultImage * feat(testworkflows): add support for global TestWorkflowTemplate that is automatically included in all executions (#5311) * feat(testworkflows): add support for global template that is automatically included in all executions * feat(testworkflows): avoid loading global template twice when it was specifically requested * docs: disable secret creation & enable secrets endpoint (#5313) * docs: disable secret creation & enable secrets endpoint * fix: docs links * chore: bump docusaurus patch version * chore: update memory allocation for docs build * docs: fix secrets pages * feat: fetch pro context from cloud-api (#5312) * feat: fetch pro context from cloud-api * fix: fix grpc authentication * chore: address review remarks * feat: [TKC-1817] document on prem bootstrap configuration (#5305) * feat: [TKC-1817] document on prem bootstrap configuration * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: print dashboard links last and blue * fix(testworkflows): handle edge case of nullish event sent (#5323) * fix: update JMeter to version which binary is provided by Apache (#5324) * feat(testworkflows): allow unpacking tarballs, add option to pack tarballs for test-suite-like execute (#5322) * feat(testworkflows): add transfer server utility to expose data for parallel steps * feat(testworkflows): add API interface for execute.*.tarball * feat(testworkflows): add API interface for content.tarball * feat(testworkflows): add default transfer storage dir path in the constants * feat(testworkflows): expose both ID and URL while adding entry to transfer.Server * feat(testworkflows): add support for execute.*.tarball * feat(testworkflows): add support for content.tarball / fixes and improvements for execute.*.tarball * feat(expressions): add relpath and abspath functions for expressions in stdlib * feat(expressions): add range([start = 0, ]end) function * feat: workflows wizard docs (#5315) * refactor: workflow create selection * feat: add wizard steps * Update docs/docs/articles/test-workflows-creating.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: ability to test set client in executor tests (#5329) * feat(testworkflows): add support for pausing steps (#5338) * feat: add support for step's `pause` configuration in the API * feat: debug - expose pause config to init script * feat: change the Pause configuration format * feat: add initial support for pause/resume in the Init Process * feat: add control server for the Init Process to resume/pause * feat: improve pause/resume for steps * feat: expose endpoints to pause/resume steps * feat: set "paused" status correctly for workflow and workflow step * fix: avoid displaying empty line for consecutive hints/outputs * fix: compute properly "paused" status * chore: avoid sending output for pause/resume * feat: compute and persist pause periods for TestWorkflow steps * feat: add pause timestamp * feat: ignore pause period in the `timeout` * feat: add more details to TestWorkflowResultSummary * chore: compute paused expression to detect if it is static * chore: use http constant instead * fix: order of pause mutex * feat: extract common instruction names to constants * chore: fall back pause/resume to Kubernetes timestamp in case of invalid date * fix: building pause step for group stage * chore: compute paused immediately whenever it is possible * chore: add 'end' instruction to constants * feat(testworkflows): change `paused` to be boolean instead of expression * chore: avoid "-" in pause container name * chore: use latest testkube-operator * fix: new location for zap image (#5341) * feat(testworkflows): support more advanced Pod configuration (#5340) * feat: add OpenAPI support for more Pod configuration fields * feat(testworkflows): merge new pod configuration correctly * fix(testworkflows): update testkube-operator, adjust pod.resourceClaims * feat(testworkflows): append new pod configuration properties to the TestWorkflow * chore: update testkube-operator * fix: label value duplication * fix: use make * feat: refactor test workflow execute (#5333) * feat: refactor test workflow execute * fix: run workflow async * fix: add test workflow to workpool * feat: support test workflow in tirggers * fix: status and scraper unit tests * fix: trigger executor unit test * fix: nil check * fix: skip error * fix: return api error * fix: check for paused * fix: change const * fix: import * fix: nil check * doc: testworkflow trigger * fix: dep update * fix: invalid option for --output flag (#5337) The help text for the --output flag in the CLI suggest that there is type "go-template", when in fact it is just "go". * feat: cloud demo examples with cron triggers, workflow tests - triggers, junit example (#5330) * cloud demo examples with cron triggers * workflow tests - cron triggers * workflow tests - workflow suites extended, postman cron trigger test * add support for searching and sending junit reports to cloud (#5328) * fix: test trigger mapping * fix: move pkg * chore(deps): bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /docs (#5240) Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4. - [Release notes](https://github.com/webpack/webpack-dev-middleware/releases) - [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md) - [Commits](webpack/webpack-dev-middleware@v5.3.3...v5.3.4) --- updated-dependencies: - dependency-name: webpack-dev-middleware dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * feat: [TKC-1887]add on prem installer as the testkube command (#5345) * feat: add on prem installer as the testkube command * fix: add breaks and uncomment context confirmation * fix: add telemetry * feat(installer): polish init demo * Update lint.yaml * fix: fix linter * fix(installer): Testkube OSS should be the default init --------- Co-authored-by: Delnat Wito <wito.delnat@gmail.com> Co-authored-by: Wito <WitoDelnat@users.noreply.github.com> * chore: draft installing docs (#5346) * chore: draft installing docs * fix(docs): address remarks * fix(docs): inconsistencies between doc and cli * docs: Add Examples to Test Workflows (#5334) * Add Examples to Test Workflows Using Dawid Rusnak's presentation. * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-expressions Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-expressions Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-configuration.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Correct Expression page errors * Update test-workflows-examples-basics.md * Update docs/docs/articles/test-workflows-examples-expressions.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update docs/docs/articles/test-workflows-examples-basics.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * fix(init): fix licenses with spaces and special characters (#5354) * docs: Reverse order of CLI init profiles (OSS last) (#5359) * docs: Reverse order of CLI init profiles (OSS last) * docs: Add URL to download * docs: Reverse order of CLI init profiles (OSS last) * fix: hotfix license key (#5360) * Add GitHub Actions to depedndabot * fix: salve pod template ca secret * chore(deps): bump actions/cache from 2 to 4 Bumps [actions/cache](https://github.com/actions/cache) from 2 to 4. - [Release notes](https://github.com/actions/cache/releases) - [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md) - [Commits](actions/cache@v2...v4) --- updated-dependencies: - dependency-name: actions/cache dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump golangci/golangci-lint-action from 4 to 5 Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action) from 4 to 5. - [Release notes](https://github.com/golangci/golangci-lint-action/releases) - [Commits](golangci/golangci-lint-action@v4...v5) --- updated-dependencies: - dependency-name: golangci/golangci-lint-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump codecov/codecov-action from 3 to 4 Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 3 to 4. - [Release notes](https://github.com/codecov/codecov-action/releases) - [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md) - [Commits](codecov/codecov-action@v3...v4) --- updated-dependencies: - dependency-name: codecov/codecov-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/setup-node from 3 to 4 Bumps [actions/setup-node](https://github.com/actions/setup-node) from 3 to 4. - [Release notes](https://github.com/actions/setup-node/releases) - [Commits](actions/setup-node@v3...v4) --- updated-dependencies: - dependency-name: actions/setup-node dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump docker/setup-buildx-action from 1 to 3 Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 1 to 3. - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](docker/setup-buildx-action@v1...v3) --- updated-dependencies: - dependency-name: docker/setup-buildx-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * docs: added quickstart without k8s info and some faq entries (#5370) * docs: added quickstart without k8s info and some faq entries * docs: fixed broken link * docs: typos.. * docs: Change HTTP to HTTPS on URLs (SEO requirement) (#5371) * chore(deps): bump pnpm/action-setup from 2 to 3 Bumps [pnpm/action-setup](https://github.com/pnpm/action-setup) from 2 to 3. - [Release notes](https://github.com/pnpm/action-setup/releases) - [Commits](pnpm/action-setup@v2...v3) --- updated-dependencies: - dependency-name: pnpm/action-setup dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump anchore/sbom-action from 0.14.2 to 0.15.11 Bumps [anchore/sbom-action](https://github.com/anchore/sbom-action) from 0.14.2 to 0.15.11. - [Release notes](https://github.com/anchore/sbom-action/releases) - [Commits](anchore/sbom-action@v0.14.2...v0.15.11) --- updated-dependencies: - dependency-name: anchore/sbom-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump docker/setup-qemu-action from 1 to 3 Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 1 to 3. - [Release notes](https://github.com/docker/setup-qemu-action/releases) - [Commits](docker/setup-qemu-action@v1...v3) --- updated-dependencies: - dependency-name: docker/setup-qemu-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump peaceiris/actions-gh-pages from 3 to 4 Bumps [peaceiris/actions-gh-pages](https://github.com/peaceiris/actions-gh-pages) from 3 to 4. - [Release notes](https://github.com/peaceiris/actions-gh-pages/releases) - [Changelog](https://github.com/peaceiris/actions-gh-pages/blob/main/CHANGELOG.md) - [Commits](peaceiris/actions-gh-pages@v3...v4) --- updated-dependencies: - dependency-name: peaceiris/actions-gh-pages dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump goreleaser/goreleaser-action from 2 to 5 Bumps [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action) from 2 to 5. - [Release notes](https://github.com/goreleaser/goreleaser-action/releases) - [Commits](goreleaser/goreleaser-action@v2...v5) --- updated-dependencies: - dependency-name: goreleaser/goreleaser-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * feat: test workflow events * fix: test workflow slack messages * docs: slack and webhooks * fix: slack config * fix: update slack template * fix: change slack workflow name * fix: dep update * chore(deps): bump actions/setup-go from 2 to 5 Bumps [actions/setup-go](https://github.com/actions/setup-go) from 2 to 5. - [Release notes](https://github.com/actions/setup-go/releases) - [Commits](actions/setup-go@v2...v5) --- updated-dependencies: - dependency-name: actions/setup-go dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump golangci/golangci-lint-action from 5 to 6 Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action) from 5 to 6. - [Release notes](https://github.com/golangci/golangci-lint-action/releases) - [Commits](golangci/golangci-lint-action@v5...v6) --- updated-dependencies: - dependency-name: golangci/golangci-lint-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump github/codeql-action from 2 to 3 Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2 to 3. - [Release notes](https://github.com/github/codeql-action/releases) - [Commits](github/codeql-action@v2...v3) --- updated-dependencies: - dependency-name: github/codeql-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump amannn/action-semantic-pull-request Bumps [amannn/action-semantic-pull-request](https://github.com/amannn/action-semantic-pull-request) from 3.4.6 to 5.5.2. - [Release notes](https://github.com/amannn/action-semantic-pull-request/releases) - [Changelog](https://github.com/amannn/action-semantic-pull-request/blob/main/CHANGELOG.md) - [Commits](amannn/action-semantic-pull-request@v3.4.6...v5.5.2) --- updated-dependencies: - dependency-name: amannn/action-semantic-pull-request dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump bruceadams/get-release from 1.2.3 to 1.3.2 Bumps [bruceadams/get-release](https://github.com/bruceadams/get-release) from 1.2.3 to 1.3.2. - [Release notes](https://github.com/bruceadams/get-release/releases) - [Commits](bruceadams/get-release@v1.2.3...v1.3.2) --- updated-dependencies: - dependency-name: bruceadams/get-release dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix(testworkflows): upgrade testkube-operator to support expressions in "run" step (#5385) (cherry picked from commit 022dcd0) * fix issue with image pull secrets for workflows (#5378) * feat(installer): minor improvements (#5387) * chore(deps): bump guyarb/golang-test-annotations from 0.6.0 to 0.8.0 Bumps [guyarb/golang-test-annotations](https://github.com/guyarb/golang-test-annotations) from 0.6.0 to 0.8.0. - [Release notes](https://github.com/guyarb/golang-test-annotations/releases) - [Commits](guyarb/golang-test-annotations@v0.6.0...v0.8.0) --- updated-dependencies: - dependency-name: guyarb/golang-test-annotations dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix issue with image pull secrets for workflows due to invalid registry append (#5397) * chore(deps): bump timheuer/base64-to-file from 1.1 to 1.2 Bumps [timheuer/base64-to-file](https://github.com/timheuer/base64-to-file) from 1.1 to 1.2. - [Release notes](https://github.com/timheuer/base64-to-file/releases) - [Commits](timheuer/base64-to-file@v1.1...v1.2) --- updated-dependencies: - dependency-name: timheuer/base64-to-file dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/setup-java from 3 to 4 Bumps [actions/setup-java](https://github.com/actions/setup-java) from 3 to 4. - [Release notes](https://github.com/actions/setup-java/releases) - [Commits](actions/setup-java@v3...v4) --- updated-dependencies: - dependency-name: actions/setup-java dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump peter-evans/repository-dispatch from 2 to 3 Bumps [peter-evans/repository-dispatch](https://github.com/peter-evans/repository-dispatch) from 2 to 3. - [Release notes](https://github.com/peter-evans/repository-dispatch/releases) - [Commits](peter-evans/repository-dispatch@v2...v3) --- updated-dependencies: - dependency-name: peter-evans/repository-dispatch dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump pnpm/action-setup from 3 to 4 Bumps [pnpm/action-setup](https://github.com/pnpm/action-setup) from 3 to 4. - [Release notes](https://github.com/pnpm/action-setup/releases) - [Commits](pnpm/action-setup@v3...v4) --- updated-dependencies: - dependency-name: pnpm/action-setup dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * feat: TKC-1956 log message retention time (#5399) * add support for cloud capabilities (#5398) * chore(deps): bump sigstore/cosign-installer from 3.4.0 to 3.5.0 Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.4.0 to 3.5.0. - [Release notes](https://github.com/sigstore/cosign-installer/releases) - [Commits](sigstore/cosign-installer@v3.4.0...v3.5.0) --- updated-dependencies: - dependency-name: sigstore/cosign-installer dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump docker/login-action from 1 to 3 Bumps [docker/login-action](https://github.com/docker/login-action) from 1 to 3. - [Release notes](https://github.com/docker/login-action/releases) - [Commits](docker/login-action@v1...v3) --- updated-dependencies: - dependency-name: docker/login-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/checkout from 2 to 4 Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4. - [Release notes](https://github.com/actions/checkout/releases) - [Commits](actions/checkout@v2...v4) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump actions/upload-artifact from 3 to 4 Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3 to 4. - [Release notes](https://github.com/actions/upload-artifact/releases) - [Commits](actions/upload-artifact@v3...v4) --- updated-dependencies: - dependency-name: actions/upload-artifact dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Replace Image (#5402) An image was affecting performance of the docs. * feat: [TKC-1856] test workflow execution namespace (#5388) * feat: test workflow namespace field * feat: model for test workflow execution namespace * feat: test workflow execution namespace * fix: use execution namespace * fix: render execution namespace * fix: shoow namespace * fix: pass service account names to test workflow executor * fix: internal namespace * docs: example for test workflow namespace * fix: dep update * feat: headers for direct client * docs: cli * fix(testworkflows): improve stability of orchestration (#5408) * fix(testworkflows): expose proper error for internal cluster problem with networking * fix(testworkflows): fix problems with artifacts walker * fix(testworkflows): clean up global template * fix(testworkflows): fix streaming error messages * fix(testworkflows): delete unneeded file * fix(testworkflows): improve stability of TestWorkflow orchestration * fix(testworkflows): ensure no memory leaks while controlling TestWorkflow * fix(testworkflows): CR fixes * feat(testworkflows): add activeDeadlineSeconds for the job (#5410) * chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.3.3 Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 2.3.1 to 2.3.3. - [Release notes](https://github.com/ossf/scorecard-action/releases) - [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md) - [Commits](ossf/scorecard-action@0864cf1...dc50aa9) --- updated-dependencies: - dependency-name: ossf/scorecard-action dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * docs: link openapi definition (#5413) * fix(testworkflows): orchestration fixes (#5414) * fix(testworkflows): make the orchestration channel peeking async * fix(testworkflows): increase init controller timeout * fix(testworkflows): fallback execution namespace to the default one * fix: add more telemetry for on prem installer (#5412) * docs: add test executions durations to metrics (#5418) * fix: complete repository empty check (#4889) * fix: complete repository empty check * fix: extract method for empty check * docs: add test executions duration to metrics --------- Co-authored-by: Vladislav Sukhin <vladislav@kubeshop.io> Co-authored-by: nicufk <nicolae@kubeshop.io> * fix: relax license format to include old offline licenses (#5422) * docs: Remove references to old installer (#5427) * feat: [TKC-1854] add read only flag for test workflows (#5429) * fix: pulling from git servers using private ca (#5432) * feat: event mapper * feat: k8s event loader * fix: switch value * fix: rename testkube event * fix: dep update * fix: get causes for testkube event * fix: enable k8s events flag * fix: rename const * fix: use const * docs: k8s events * fix: rename method * fix: dep update * feat(testworkflows): TKC-1765 - parallel execution (K6/Playwright/Cypress) (#5420) * feat(testworkflows): TKC-1765 - add support for `parallel` syntax * chore(testworkflows): use single instance of TestWorkflowExecutor * feat(testworkflows): TKC-1765 - expose configured images inspector for Toolkit * fix(testworkflows): delete global template from env map * feat(testworkflows): decouple workflow resource IDs with execution IDs / support root/direct resource IDs * feat(testworkflows): TKC-1763 - initial version of `parallel` step support * feat(testworkflows): perform workflow clean up operations in parallel * feat(testworkflows): TKC-1763 - support parallelism and description for parallel steps * feat(testworkflows): TKC-1763 - expose Dashboard/API URLs to the Toolkit * feat(testworkflows): TKC-1763 - set default parallelism of 1000 in `parallel` steps * fix(testworkflows): avoid timeouts in parallel execution * feat(testworkflows): TKC-1763 - expose parallel steps signature and results * chore(testworkflows): delete debug prints * feat(testworkflows): isolate parallel steps artifacts * feat(testworkflows): expose information about current inner step in parallel step * feat(testworkflows): TKC-1763 - expose information about current inner step in parallel step * feat(testworkflows): TKC-1763 - store logs for parallel steps * feat(testworkflows): inform about the node where the parallel step is running * feat(testworkflows): TKC-1765 - add distributed K6 examples * chore(testworkflows): rename fetch tarball operation * chore(testworkflows): extract tarball unpacking logic * feat(testworkflows): TKC-1766 - add option to fetch files from parallel steps * feat(testworkflows): TKC-1766 - add example for distributed Playwright test * fix(testworkflows): avoid problems with not existing working directory permissions * fix(testworkflows): working directory expressions * feat(testworkflows): add example of automatically distributed Cypress tests * chore(testworkflows): restructure TestWorkflow operator objects * feat(testworkflows): add shorter syntax for parallel steps (do not require `steps` when it's a single one) * feat(testworkflows): inherit container defaults in the parallel step * feat(testworkflows): handle `template` alias in `parallel` step properly * feat(testworkflows): dedupe env vars in the ContainerConfig * feat(testworkflows): use inheritance in distributed Cypress/Playwright examples * chore(testworkflows): simplify distributed K6 example * chore(testworkflows): display worker description in general parallel logs * chore(testworkflows): extract building params information text * chore(testworkflows): extract processing `transfer` instruction * chore(testworkflows): extract processing `fetch` instruction * chore(testworkflows): code review fixes * chore(testworkflows): fix circular dependency * chore(testworkflows): extract code for deploying TestWorkflow bundle * chore(testworkflows): extract code for fetching the TestWorkflow logs * chore(testworkflows): extract code for fetching the TestWorkflow logs * chore(testworkflows): use job namespace in parallel execution * chore(testworkflows): unify logger for the parallel workers notifications * chore(testworkflows): extract building execution machine * chore(testworkflows): little code movement * chore(testworkflows): extract code for executing parallel operations * chore(testworkflows): unify parallel log * chore(testworkflows): build controller registry for parallel workers * chore(testworkflows): simplify watcher in the parallel workers * chore(testworkflows): clean up client set for parallel workers * feat(testworkflows): add support for conditional logs save in parallel steps * chore(testworkflows): extract logic for creating machine for spawning * chore(testworkflows): update testkube-operator * feat: added debug info in case of pod disaster (#5433) * fix(testworkflows): orchestration fixes (#5435) * fix: cloud uploader should set correct content type (#5437) * feat(testworkflows): TKC-1764 - support accompanying services (#5436) * feat(testworkflows): support `services` in the TestWorkflow objects * feat(testworkflows): support `use` in `services` * fix(testworkflows): orchestration fixes * feat(testworkflows): TKC-1764 - add support for accompanying services * chore: update integration tests to use provided URLs * chore: update integration tests to use provided Minio URLs * chore: fix NATS URIs in tests * chore: hardcode again Minio buckets for tests * fix: add missing environment variables for integration tests * fix(testworkflows): cloning the repository * fix(testworkflows): merging securityContext * fix(testworkflows): sort out proper group/fsGroup/user for the services * feat(testworkflows): add example integration tests for Testkube * fix: adjust make integration-tests to fill the access/secret keys * chore: update testkube-operator * feat: expose PWD environment variable for the processing * fix(testworkflows): CRD for integration tests (#5440) * feat: Control Plane debug command (#5438) * fix: dashboard panic when opening from init (#5425) * feat: added control plane debug * feat: tuning the command * fix: added spinner to stderr * fix: e2e test --------- Co-authored-by: nicufk <nicolae@kubeshop.io> * add action to cleanup space before building executors (#5442) * fix: include TestWorkflowTemplate events in the TestWorkflow (#5446) * fix: moved NATS tests to integration test suite * fix: moved some noisy logs to debug added TRACE level (#5448) * fix: moved some noisy logs to debug * fix: added TRACE level wrapper * feat: add support for default service account for TestWorkflows (#5453) * feat: add support for default service account for TestWorkflows * feat: combine default service account for Tests and TestWorkflows * fix: cherry-pick init/telemetry fixes (#5426) * fix: dashboard panic when opening from init (#5425) * fix: telemetry mappings (#5417) * fix: telemetry mappings * fix: send false postive * fix: cloud uploader should match content type (#5456) * feat: scraper sidecar option * fix: sidecar scraper template * fix: sidecar scraper env * fix: support sidecar in scraper * fix: check job label * fix: unit test * fix: remove env var * docs: sidecar scraper example * fix: move is container terminated to k8s client * docs: cli * fix: cloud uploader should match content type by name (#5458) * fix: presigned url needs to send contentType (#5461) * feat: log status of the parallel steps / exposes TestWorkflow pauses in result (#5460) * feat: log status of the parallel steps * fix: clone pauses while cloning result * fix: displaying log parallel status (#5464) * add building of postam image for nodejs * update manifest for image * fix typo * test flow for dev and stage * remove testing branches * fix ident * update node image * fix typo * update docs for TK Installer * fix: use /tmp host dir for integration tests Go cache (#5466) * fix: bugs from TestWorkflow examples / artifacts error (#5471) * fix: k6-workflow-smoke-preofficial-trait * fix: cypress-workflow-smoke-13-junit-report * fix: checkout example in TestWorkflowTemplates * fix: JUnit post-processor with relative paths * fixup junit integration tests --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: nicufk <nicolae@kubeshop.io> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: Ole Lensmar <ole@lensmar.com> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Javier Morante <142315352+jmorante-ks@users.noreply.github.com> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: Emil Davtyan <emil@kubeshop.io> Co-authored-by: Lilla Vass <lilla@kubeshop.io> Co-authored-by: Catalin <20538711+devcatalin@users.noreply.github.com> Co-authored-by: Wito <WitoDelnat@users.noreply.github.com> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Razvan Topliceanu <47887589+topliceanurazvan@users.noreply.github.com> Co-authored-by: frederikb <232148+frederikb@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Delnat Wito <wito.delnat@gmail.com> Co-authored-by: Luca Comellini <luca.com@gmail.com> Co-authored-by: Nelson Silva <nelson.emanuel.silva@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull request description
https://linear.app/kubeshop/issue/TKC-1572/add-context-information-to-cli-telemetry
Checklist (choose whats happened)
Breaking changes
Changes
Fixes