v0.1.21

Docker image

docker pull ghcr.io/alez007/modelship:0.1.21

Configuration

Create a models.yaml file and mount it at /modelship/config/models.yaml. Example configs for various GPU sizes are included in the image under /modelship/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

Full Changelog: v0.1.20...v0.1.21

v0.1.19

Docker image

docker pull ghcr.io/alez007/modelship:0.1.19

Configuration

Create a models.yaml file and mount it at /modelship/config/models.yaml. Example configs for various GPU sizes are included in the image under /modelship/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• rename project from yasha to modelship by @alez007 in #14

Full Changelog: v0.1.18...v0.1.19

v0.1.18

Docker image

docker pull ghcr.io/alez007/yasha:0.1.18

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• feat: add API key authentication middleware by @alez007 in #9
• feat: add BaseInfer ABC, input size limits, and payload size middleware by @alez007 in #10
• feat: add model warmup after deployment to reduce cold-start latency by @alez007 in #11
• feat: add centralized logging with structured output and request corr… by @alez007 in #12
• feat: add multi-deployment routing and num_replicas support by @alez007 in #13

Full Changelog: v0.1.17...v0.1.18

v0.1.17

Docker image

docker pull ghcr.io/alez007/yasha:0.1.17

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• refactor: unify Dockerfiles into multi-stage build and update README by @alez007 in #8

Full Changelog: v0.1.16...v0.1.17

v0.1.16

Docker image

docker pull ghcr.io/alez007/yasha:0.1.16

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• feat: add Prometheus metrics and Grafana dashboard for observability by @alez007 in #7

Full Changelog: v0.1.15...v0.1.16

v0.1.15

Docker image

docker pull ghcr.io/alez007/yasha:0.1.15

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• refactor: centralize OpenAI protocol imports into yasha.openai.protocol by @alez007 in #5
• feat: add diffusers loader for OpenAI-compatible image generation by @alez007 in #6

Full Changelog: v0.1.14...v0.1.15

v0.1.14

Docker image

docker pull ghcr.io/alez007/yasha:0.1.14

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

Full Changelog: v0.1.13...v0.1.14

v0.1.13

Docker image

docker pull ghcr.io/alez007/yasha:0.1.13

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

Full Changelog: v0.1.12...v0.1.13

v0.1.12

Docker image

docker pull ghcr.io/alez007/yasha:0.1.12

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• chore: add CI tests, project metadata, GitHub templates, and docs refresh by @alez007 in #4

Full Changelog: v0.1.11...v0.1.12

v0.1.11

Docker image

docker pull ghcr.io/alez007/yasha:0.1.11

Configuration

Create a models.yaml file and mount it at /yasha/config/models.yaml. Example configs for various GPU sizes are included in the image under /yasha/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• security md by @alez007 in #2
• env vars consolidation by @alez007 in #3

Full Changelog: v0.1.8...v0.1.11