-
-
Notifications
You must be signed in to change notification settings - Fork 102
[Platform] Add Docker Model Runner #515
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Platform] Add Docker Model Runner #515
Conversation
bc87d82
to
ae371a0
Compare
Consider this first implementation as basic bridge for basic usage. It could be improved during the hackathon by:
|
src/platform/tests/Bridge/DockerModelRunner/Completions/ModelClientTest.php
Outdated
Show resolved
Hide resolved
ae371a0
to
faa91f4
Compare
Note PHPStan failure is expected as example code use not yet merged Bridge in Platform package. |
oh, that's due to #535 and not using the components from the branch but via composer install, right? |
Indeed, I'll take a look. |
@VincentLanglet if you need any help about setting up DMR, I'm on Slack and WorkAdventure (main hall) |
I feel like this can be easily fixed with 93464f6 But I get a infinite loop I assume it's because of #527 cc @chr-hertel Not sure if we can do something until... |
faa91f4
to
01bf512
Compare
01bf512
to
bb48e7e
Compare
bb48e7e
to
f8c296e
Compare
f8c296e
to
7caa3ce
Compare
still unable to install and test locally - sorry - can someone else test and confirm? |
What do you need to be able to test? More doc about setting up Docker Model Runner? |
645cd4a
to
0faf473
Compare
0faf473
to
7ececae
Compare
7ececae
to
d8b5e86
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
d8b5e86
to
e038b0a
Compare
Thanks Mathieu for working on this feature, this is much appreciated. |
This PR adds Docker Model Runner as supported platform to host and run models.
I base it on LmStudio bridge as it works similarly.
DMR docs:
Examples output: