Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running benchmark through CLI only (No GUI) #318

Open
anrahman4 opened this issue May 7, 2024 · 10 comments
Open

Running benchmark through CLI only (No GUI) #318

anrahman4 opened this issue May 7, 2024 · 10 comments
Assignees
Milestone

Comments

@anrahman4
Copy link

Hello,

Is there anyway to run these tests through CLI only and not through the streamlit app? I want to do automation where I also am able to automate the testing via bash scripts, while also running other programs in line to track system level metrics.

Is there a way to pass the right parameters to the python main.py in such a way that it does it entirely through command line?

@alwayslove2013 alwayslove2013 added this to the 0.1.0 milestone May 8, 2024
@alwayslove2013
Copy link
Collaborator

Good idea, we will support it.

@alwayslove2013 alwayslove2013 self-assigned this May 8, 2024
@greenhal
Copy link
Contributor

greenhal commented May 8, 2024

We have a working cli for vectordbbench and plan on submitting a pull request by next week.

@alwayslove2013
Copy link
Collaborator

@greenhal welcome!

@sandszhouSZ
Copy link

So, how things going on?

@greenhal
Copy link
Contributor

Testing it internally now, should have the pr ready early next week,
FYI, The cli has been built using https://palletsprojects.com/p/click/

@greenhal
Copy link
Contributor

#330

@greenhal greenhal removed their assignment May 30, 2024
@alwayslove2013
Copy link
Collaborator

amazing!

@anrahman4
Copy link
Author

Thank you for this! This will help testing automation a ton!

@anrahman4
Copy link
Author

Can we please update the README for the GitHub page that describes how to run the benchmarking through the newly established CLI?

@greenhal
Copy link
Contributor

The CLI PR is still pending review. The README.md was updated as part of the cr, see: README.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants