Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

models: migrate away from pipelines #60

Merged
merged 12 commits into from
Jun 24, 2023
Merged

models: migrate away from pipelines #60

merged 12 commits into from
Jun 24, 2023

Conversation

aarnphm
Copy link
Member

@aarnphm aarnphm commented Jun 24, 2023

This is purely to help with fine-tuning workflow.

We will fallback to use pipeline during inference only for dolly-v2

part of #61

Signed-off-by: Aaron 29749331+aarnphm@users.noreply.github.com

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Make sure that we don't download the model for runner by default

it should depends on init_local and users if they want to download the
model before serving, they should use `@svc.on_startup`

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
@aarnphm aarnphm merged commit 98328be into main Jun 24, 2023
4 checks passed
@aarnphm aarnphm deleted the migrate-from-pipeline branch June 24, 2023 09:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant