Skip to content

Conversation

dineshyv
Copy link
Contributor

@dineshyv dineshyv commented Nov 13, 2024

Tests:

llama-stack-client models list
+----------------------+--------------------+---------------------------------------------+------------+
| identifier           | provider_id        | provider_resource_id                        | metadata   |
+======================+====================+=============================================+============+
| Llama3.1-8B-Instruct | remote::together-0 | meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo | {}         |
+----------------------+--------------------+---------------------------------------------+------------+
❯ llama-stack-client providers list
+-----------+--------------------------+------------------------+
| API       | Provider ID              | Provider Type          |
+===========+==========================+========================+
| inference | remote::together-0       | remote::together       |
+-----------+--------------------------+------------------------+
| memory    | inline::faiss-0          | inline::faiss          |
+-----------+--------------------------+------------------------+
| memory    | remote::weaviate-1       | remote::weaviate       |
+-----------+--------------------------+------------------------+
| safety    | inline::llama-guard-0    | inline::llama-guard    |
+-----------+--------------------------+------------------------+
| agents    | inline::meta-reference-0 | inline::meta-reference |
+-----------+--------------------------+------------------------+
| telemetry | inline::meta-reference-0 | inline::meta-reference |
+-----------+--------------------------+------------------------+
❯ llama-stack-client models get Llama3.1-8B-Instruct
+----------------------+------------+--------------------+---------------------------------------------+--------+
| identifier           | metadata   | provider_id        | provider_resource_id                        | type   |
+======================+============+====================+=============================================+========+
| Llama3.1-8B-Instruct | {}         | remote::together-0 | meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo | model  |
+----------------------+------------+--------------------+---------------------------------------------+--------+

@yanxi0830
Copy link
Contributor

https://github.com/meta-llama/llama-stack-client-python/blob/main/docs/cli_reference.md

Could you attach the test runs on all these commands?

Copy link
Contributor

@yanxi0830 yanxi0830 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Approve to unblock, I trust you :D Please run through all CLI commands for testing.

@dineshyv dineshyv merged commit ca2ff31 into main Nov 13, 2024
3 checks passed
@dineshyv dineshyv deleted the dineshyv/crud branch November 13, 2024 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants