Skip to content

Conversation

welcoMattic
Copy link
Member

@welcoMattic welcoMattic commented Sep 11, 2025

Q A
Bug fix? no
New feature? yes
Docs? no
Issues Fix #531
License MIT

This PR adds Docker Model Runner as supported platform to host and run models.

I base it on LmStudio bridge as it works similarly.

DMR docs:

Examples output:

image

@carsonbot carsonbot added Feature New feature Platform Issues & PRs about the AI Platform component Status: Needs Review labels Sep 11, 2025
@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from bc87d82 to ae371a0 Compare September 11, 2025 15:15
@welcoMattic
Copy link
Member Author

Consider this first implementation as basic bridge for basic usage. It could be improved during the hackathon by:

@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from ae371a0 to faa91f4 Compare September 12, 2025 11:59
@welcoMattic
Copy link
Member Author

Note

PHPStan failure is expected as example code use not yet merged Bridge in Platform package.

@chr-hertel
Copy link
Member

oh, that's due to #535 and not using the components from the branch but via composer install, right?
cc @VincentLanglet

@VincentLanglet
Copy link
Contributor

oh, that's due to #535 and not using the components from the branch but via composer install, right? cc @VincentLanglet

Indeed, I'll take a look.

@welcoMattic
Copy link
Member Author

@VincentLanglet if you need any help about setting up DMR, I'm on Slack and WorkAdventure (main hall)

@VincentLanglet
Copy link
Contributor

@VincentLanglet if you need any help about setting up DMR, I'm on Slack and WorkAdventure (main hall)

I feel like this can be easily fixed with 93464f6

But I get a infinite loop
https://github.com/symfony/ai/actions/runs/17674610626/job/50233715432?pr=552

I assume it's because of #527 cc @chr-hertel

Not sure if we can do something until...

@VincentLanglet
Copy link
Contributor

I'm getting something working #568

proof #552

@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from 01bf512 to bb48e7e Compare September 12, 2025 14:29
@welcoMattic welcoMattic added the Hackathon 2025 This issue or pull request was part of the Symfony AI Hackathon 2025 label Sep 12, 2025
@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from bb48e7e to f8c296e Compare September 16, 2025 09:48
@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from f8c296e to 7caa3ce Compare September 16, 2025 09:52
@chr-hertel
Copy link
Member

chr-hertel commented Sep 16, 2025

still unable to install and test locally - sorry - can someone else test and confirm?

@welcoMattic
Copy link
Member Author

still unable to install and test locally - sorry - can someone else test and confirm?

What do you need to be able to test? More doc about setting up Docker Model Runner?

@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch 2 times, most recently from 645cd4a to 0faf473 Compare September 17, 2025 06:15
@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from 0faf473 to 7ececae Compare September 17, 2025 06:39
@welcoMattic welcoMattic force-pushed the platform/docker-model-runner branch from 7ececae to d8b5e86 Compare September 17, 2025 07:01
Copy link
Contributor

@OskarStark OskarStark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CleanShot 2025-09-17 at 09 27 53@2x

Good to merge after my comment, it works seamlessly on my Mac

@OskarStark
Copy link
Contributor

I forgot to install one model and ended up with:
CleanShot 2025-09-17 at 09 20 45@2x

If possible, it would be nice to throw a MissingModelException, if we can check that beforehand. Can be a follow up PR

@OskarStark OskarStark force-pushed the platform/docker-model-runner branch from d8b5e86 to e038b0a Compare September 17, 2025 07:30
@OskarStark
Copy link
Contributor

Thanks Mathieu for working on this feature, this is much appreciated.

@OskarStark OskarStark merged commit 90ac792 into symfony:main Sep 17, 2025
11 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature New feature Hackathon 2025 This issue or pull request was part of the Symfony AI Hackathon 2025 Platform Issues & PRs about the AI Platform component Status: Reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Platform] Add Docker Model Runner
5 participants