Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adjust the operators so they handle batched requests #5

Open
5 tasks
karlhigley opened this issue Mar 2, 2022 · 0 comments
Open
5 tasks

Adjust the operators so they handle batched requests #5

karlhigley opened this issue Mar 2, 2022 · 0 comments
Labels
epic
Milestone
Future

Comments

@karlhigley
Copy link
Contributor

karlhigley commented Mar 2, 2022 •
edited
Loading

Operators:

  • Feast
  • Tensorflow
  • Faiss
  • ...

Open Questions:

  • How to use async in TritonPythonModel and OperatorRunner (execute becomes async, does transform?)
@karlhigley karlhigley added this to the 22.05 milestone Mar 2, 2022
@karlhigley karlhigley modified the milestones: 22.05, Future Mar 11, 2022
nv-alaiacano added a commit that referenced this issue Aug 9, 2022
@nv-alaiacano
# This is a combination of 10 commits.
272e5c3 
# This is the 1st commit message:

migrate github cpu build to use tox

# This is the commit message #2:

newline

# This is the commit message #3:

install tox in github action

# This is the commit message #4:

forgot tox oops

# This is the commit message #5:

remove macos version of tf

# This is the commit message #6:

install deps for docs in gh runner

# This is the commit message #7:

build docs with tox

# This is the commit message #8:

use a gh action to build docs

# This is the commit message #9:

move fil into tox file, remove docs for now

# This is the commit message #10:

add pytest for fil tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
epic
Projects
None yet
Milestone
Future
Development

No branches or pull requests
1 participant
@karlhigley