Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python: migrate GH Action dependencies for Ollama model downloads, move to Azure assets #9543

Closed
moonbox3 opened this issue Nov 5, 2024 · 3 comments
Assignees
Labels
ai connector Anything related to AI connectors github_actions Pull requests that update GitHub Actions code python Pull requests for the Python Semantic Kernel sk team issue A tag to denote issues that where created by the Semantic Kernel team (i.e., not the community) stale Issue is stale because it has been open for 90 days with no activity

Comments

@moonbox3
Copy link
Contributor

moonbox3 commented Nov 5, 2024

During SK integration tests, we perform 5 Ollama model pulls:

ollama pull ${{ vars.OLLAMA_CHAT_MODEL_ID }}
ollama pull ${{ vars.OLLAMA_CHAT_MODEL_ID_IMAGE }}
ollama pull ${{ vars.OLLAMA_CHAT_MODEL_ID_TOOL_CALL }}
ollama pull ${{ vars.OLLAMA_TEXT_MODEL_ID }}
ollama pull ${{ vars.OLLAMA_EMBEDDING_MODEL_ID }}

This puts a lot of stress on the network, is prone to failure, and adds latency. For example, here's a failure: https://github.com/microsoft/semantic-kernel/actions/runs/11685739831/job/32539906324#step:10:966.

We do need coverage for AI connectors; however, it may make more sense to deploy one Azure resource that Ollama can use to handle all the chat completion related operations, and one embedding model for those tests.

@moonbox3 moonbox3 added the python Pull requests for the Python Semantic Kernel label Nov 5, 2024
@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code triage labels Nov 5, 2024
@github-actions github-actions bot changed the title Python: migrate GH Action dependencies for Ollama model downloads, move to Azure assets .Net: Python: migrate GH Action dependencies for Ollama model downloads, move to Azure assets Nov 5, 2024
@moonbox3 moonbox3 added ai connector Anything related to AI connectors sk team issue A tag to denote issues that where created by the Semantic Kernel team (i.e., not the community) github_actions Pull requests that update GitHub Actions code and removed .NET Issue or Pull requests regarding .NET code triage labels Nov 5, 2024
@moonbox3 moonbox3 changed the title .Net: Python: migrate GH Action dependencies for Ollama model downloads, move to Azure assets Python: migrate GH Action dependencies for Ollama model downloads, move to Azure assets Nov 5, 2024
@moonbox3
Copy link
Contributor Author

moonbox3 commented Nov 5, 2024

This model may work for the tool call scenario: https://ollama.com/library/smollm2:135m or this small one: https://ollama.com/library/moondream

Copy link

github-actions bot commented Feb 4, 2025

This issue is stale because it has been open for 90 days with no activity.

@github-actions github-actions bot added the stale Issue is stale because it has been open for 90 days with no activity label Feb 4, 2025
Copy link

github-actions bot commented Mar 1, 2025

This issue was closed because it has been inactive for 14 days since being marked as stale.

@github-actions github-actions bot closed this as completed Mar 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ai connector Anything related to AI connectors github_actions Pull requests that update GitHub Actions code python Pull requests for the Python Semantic Kernel sk team issue A tag to denote issues that where created by the Semantic Kernel team (i.e., not the community) stale Issue is stale because it has been open for 90 days with no activity
Projects
Status: No status
Development

No branches or pull requests

3 participants