Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Continuous Bench Search Job tool #1733

Conversation

vankichi
Copy link
Contributor

@vankichi vankichi commented Jul 14, 2022

Description:

I have created the PR for the Continours Benchmark Job tool.
In this PR, I have implemented the search logic using the fashion-mnist-784-euc dataset.

How Has This Been Tested?:

I have checked in the local vald cluster with k3d + local-registry.

Environment:

  • Go Version: 1.18.3
  • Docker Version: 20.10.8
  • Kubernetes Version: 1.22.0
  • NGT Version: 1.14.6

Types of changes:

  • Bug fix [type/bug]
  • New feature [type/feature]
  • Add tests [type/test]
  • Security related changes [type/security]
  • Add documents [type/documentation]
  • Refactoring [type/refactoring]
  • Update dependencies [type/dependency]
  • Update benchmarks and performances [type/bench]
  • Update CI [type/ci]

Changes to Core Features:

  • Have you added an explanation of what your changes do and why you'd like us to include them?
  • Have you written new tests for your core changes, as applicable?
  • Have you successfully ran tests with your changes locally?

Checklist:

  • I have read the CONTRIBUTING document.
  • I have checked open Pull Requests for the similar feature or fixes?
  • I have added tests and benchmarks to cover my changes.
  • I have ensured all new and existing tests passed.
  • I have commented my code, particularly in hard-to-understand areas
  • I have updated the documentation accordingly.

@vdaas-ci
Copy link
Collaborator

[CHATOPS:HELP] ChatOps commands.

  • 🙆‍♀️ /approve - approve
  • 💌 /changelog - replace the PR body by changelog details
  • 🍱 /format - format codes and add licenses
  • /gen-test - generate test codes
  • 🏷️ /label - add labels
  • /rebase - rebase master
  • 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

@vdaas-ci
Copy link
Collaborator

[WARNING:INTCFG] Changes in interal/config may require you to change Helm charts. Please check.

@vankichi
Copy link
Contributor Author

/format

dockers/benchmark/job/search/Dockerfile Outdated Show resolved Hide resolved
dockers/benchmark/job/search/Dockerfile Outdated Show resolved Hide resolved
@vdaas-ci
Copy link
Collaborator

[FORMAT] Updating license headers and formatting go codes triggered by vankichi.

@github-actions github-actions bot added the team/set SET team label Jul 14, 2022
@codecov
Copy link

codecov bot commented Jul 14, 2022

Codecov Report

❗ No coverage uploaded for pull request base (feature/continous-benchmark-tool@48cdb52). Click here to learn what that means.
The diff coverage is n/a.

@@                         Coverage Diff                         @@
##             feature/continous-benchmark-tool    #1733   +/-   ##
===================================================================
  Coverage                                    ?   31.66%           
===================================================================
  Files                                       ?      377           
  Lines                                       ?    32243           
  Branches                                    ?        0           
===================================================================
  Hits                                        ?    10209           
  Misses                                      ?    21642           
  Partials                                    ?      392           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

pkg/benchmark/job/search/service/search.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/service/search.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/service/search.go Outdated Show resolved Hide resolved
cmd/benchmark/job/search/main.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/service/search.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/router/router.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/usecase/benchmarkd.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/usecase/benchmarkd.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/usecase/benchmarkd.go Outdated Show resolved Hide resolved
pkg/benchmark/job/search/usecase/benchmarkd.go Outdated Show resolved Hide resolved
Signed-off-by: vankichi <kyukawa315@gmail.com>
@vankichi vankichi force-pushed the feature/pkg-apis-internal/create-conn-bench-job-search branch from e854f5b to 6718a02 Compare July 19, 2022 04:44
vankichi added a commit that referenced this pull request Oct 30, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 4, 2023
* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 4, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 4, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 4, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 7, 2023
* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 7, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 7, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 7, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 11, 2023
* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 11, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 11, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 11, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 12, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* style: Format code with prettier and gofumpt

* Update charts and improvement conbench (#2119)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* :recycle: change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Apply new internal/sync for continous benchmark (#2175)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: fix Dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix license and format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :white_check_mark: add benchmark operator reconcile test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Refactor from deepsource feedback (#2222)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use modulo to calc idx, fix Makefile, add error handling

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: Fix feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 12, 2023
* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 12, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 12, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 12, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 12, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* style: Format code with prettier and gofumpt

* Update charts and improvement conbench (#2119)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* :recycle: change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Apply new internal/sync for continous benchmark (#2175)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: fix Dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix license and format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :white_check_mark: add benchmark operator reconcile test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Refactor from deepsource feedback (#2222)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use modulo to calc idx, fix Makefile, add error handling

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: Fix feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 26, 2023
* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 26, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 26, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 26, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Dec 26, 2023
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* style: Format code with prettier and gofumpt

* Update charts and improvement conbench (#2119)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* :recycle: change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Apply new internal/sync for continous benchmark (#2175)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: fix Dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix license and format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :white_check_mark: add benchmark operator reconcile test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Refactor from deepsource feedback (#2222)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use modulo to calc idx, fix Makefile, add error handling

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: Fix feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Jan 9, 2024
* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Jan 9, 2024
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Jan 9, 2024
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Jan 9, 2024
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* ✨ create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* ✨ create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 💚 invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert "💚 invest"

This reverts commit f0f585c.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* ✨ apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* ✨ add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* ✨ ♻️ add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* ✨ impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ✨ create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* ✨ impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* ♻️ rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* ✨ Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* 🐛 Fix job function to apply rate limiter

* ♻️ Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* 🐛 Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ♻️ Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* ♻️ change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* ♻️ fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Jan 9, 2024
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* style: Format code with prettier and gofumpt

* Update charts and improvement conbench (#2119)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* :recycle: change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Apply new internal/sync for continous benchmark (#2175)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: fix Dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix license and format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :white_check_mark: add benchmark operator reconcile test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Refactor from deepsource feedback (#2222)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use modulo to calc idx, fix Makefile, add error handling

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: Fix feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: Fix dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Update Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
vankichi added a commit that referenced this pull request Jan 11, 2024
* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* style: Format code with prettier and gofumpt

* Update charts and improvement conbench (#2119)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* create helm template for benchmark operator (#2027)

* :sparkles: create helm template for benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: refactor helm template

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with gofumpt and prettier

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Refactor helm template and operator logic (#2043)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl status handle of continuous benchmark crds (#1955)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Impl benchmark jobs (#1977)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix proto

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: add benchmark job image build ci

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :green_heart: invest

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Revert ":green_heart: invest"

This reverts commit f0f585ccf71b1c95a88559941557a27774096e69.

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply code review

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* :sparkles: apply from feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Update internal/config/benchmark.go

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: change directory path

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>

* Add crds for continuous benchmark tools (#1789)

* :sparkles: add crds for continuous benchmark operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add benchmark operator/job scheme

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: rename package names and add doc.go

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create runtime object

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825)

* :sparkles: :recycle: add Job reconciler & use scenario instead of operator

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format & rename file

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Add benchmark operator framework (#1916)

* :sparkles: impl benchmark reconciler

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: create benchmark operator framework

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: remove unness changes

Signed-off-by: vankichi <kyukawa315@gmail.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* impl reconcile logic for create benchmark job (#1923)

* :sparkles: impl reconcile logic for create benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark's crds

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor continuous benchmark job logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: update charts

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Format code with prettier and gofumpt

* :recycle: rafactor con bench config and bug fix reconcile logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Bugfix: fix typo and recall function logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor pkg benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :sparkles: impl benchmark jobs

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: apply feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Refactor helm template and operator logic

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Add download original dataset URL option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Set docker image location at the benchmark operator configmap and use it when information is set

Signed-off-by: vankichi <kyukawa315@gmail.com>

* add search algorithm benchmark and update search aggregation algo

Signed-off-by: kpango <kpango@vdaas.org>

* :sparkles: Add search result aggregation option

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* Improve job performance (#2061)

* :bug: Fix job function to apply rate limiter

* :recycle: Add pyroscope setting

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix build error

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :bug: Fix docker file and add concurrencyLimit for job goroutine

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job_template.go by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix job logic by feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Add noise to vector when update/upsert and update crd

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: add deepmerge func for override default config by user-defined config

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor deepmerge

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

* style: Format code with prettier and gofumpt

* :recycle: change add noise func

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use golang/sync/error for prevent OOM KILL

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix config adn add test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* style: Format code with prettier and gofumpt

---------

Signed-off-by: vankichi <kyukawa315@gmail.com>
Signed-off-by: kpango <kpango@vdaas.org>
Co-authored-by: Yusuke Kato <kpango@vdaas.org>
Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* :recycle: Apply new internal/sync for continous benchmark (#2175)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :whale: fix Dockerfile

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Fix license and format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :white_check_mark: add benchmark operator reconcile test

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: Refactor from deepsource feedback (#2222)

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: use modulo to calc idx, fix Makefile, add error handling

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Apply suggestions from code review

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

* :recycle: Fix feedback

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Refactor/dockers/apply build for 2 platform (#2267)

* Implement base of continuous benchmark tool (#1776)

* Create Continuous Bench Search Job tool (#1733)

* :sparkles: create bench job search tools

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :sparkles: add load hdf5 functions

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix format

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix docker and use hdf5 data

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: refactor benchmark job

Signed-off-by: vankichi <kyukawa315@gmail.com>

* :recycle: fix

Signed…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants