[BUG] Made it easier to use the Snowflake integration#9443
[BUG] Made it easier to use the Snowflake integration#9443SunnyWan59 wants to merge 3 commits intoBerriAI:mainfrom
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
| ## API KEYS | ||
| ## API Keys | ||
|
|
||
| Snowflake does have API keys. Instead, you access the Snowflake API with your JWT token and account identifier. |
There was a problem hiding this comment.
is the snowflake jwt long lived, or does it need to be refreshed?
There was a problem hiding this comment.
if it's long lived, why can i not just call it SNOWFLAKE_API_KEY ?
There was a problem hiding this comment.
and pass it in as api_key: "my-special-key"
There was a problem hiding this comment.
It needs to be refreshed
|
api_base should be "https://{account-id}.snowflakecomputing.com" |
do you mean for config of the python sdk |
| api_base = "snowflakecomputing.com" | ||
| ) | ||
| ``` | ||
| and Litellm will add the `/api/v2/cortex/inference:complete/` and the `account-id` for you. |
There was a problem hiding this comment.
how would we know the account id?
The api base should be https://{account-id}.snowflakecomputing.com
| model: snowflake/mistral-7b | ||
| api_key: YOUR_API_KEY | ||
| api_base: https://YOUR-ACCOUNT-ID.snowflakecomputing.com/api/v2/cortex/inference:complete | ||
| snowflake_jwt: <JWT> |
There was a problem hiding this comment.
inconsistent param usage.
The example on sdk says api_base, that's what it should be here
|
|
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
3 participants
Made it easier to use the Snowflake integration.
snowflake_account_idandsnowflake_jwtas dynamic params via config.yamlapi_baseand append theapi/v2/cortex/inference:completeto their api base like openai does.Example config.yaml:
Relevant issues
Address: #9231
Pre-Submission checklist
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]Type
🧹 Refactoring
📖 Documentation
✅ Test