Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Flan-T5 XL truss #276

Merged
merged 1 commit into from
Apr 27, 2023
Merged

Add Flan-T5 XL truss #276

merged 1 commit into from
Apr 27, 2023

Conversation

spal1
Copy link
Collaborator

@spal1 spal1 commented Apr 26, 2023

This PR adds a Flan-T5 XL truss to the examples/ directory.

You can test this truss by running the following:

import truss

flan_t5_xl_truss = truss.load("flan-t5-xl")

example_input = flan_t5_xl_truss.example("addition example").input
response = flan_t5_xl_truss.docker_predict(example_input)

@spal1 spal1 requested a review from joostinyi April 26, 2023 23:12
@joostinyi
Copy link
Collaborator

joostinyi commented Apr 26, 2023

is it possible to add some safe accesses on the secrets object so it's truly optional? – would be great if this example worked for both cases – edit: just ran your test, the key is picked up since it's declared in the config – looks great!

@spal1 spal1 merged commit 34a4d6e into main Apr 27, 2023
2 checks passed
@spal1 spal1 deleted the samiksha/flan-t5-xl branch April 27, 2023 00:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants