Skip to content

Expand Ollama docs page (local models, model management, GPU config) #77

@AmitoVrito

Description

@AmitoVrito

Expand docs/llms/ollama.md with:

  • Installing and starting Ollama
  • Pulling models (llama3, mistral, codellama, phi3)
  • Custom model URLs for remote Ollama
  • GPU memory requirements per model size
  • Streaming with local models
  • No-API-key setup for CI/testing
  • Performance tips (keep_alive, num_ctx)

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions