You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Follow up to Slack channel question with @adriangonz . As part of a project, I have a set of interconnected nodes (each node is a Triton server) in which each of them has a number of models (with the same goal) and I want each request to pass through a different set of models. For example, I want request 1 to pass through model 1 in node 1 -> model 1 in node 2 -> model 1 in node 3, and another path R2. The path for each request is determined prior to run the request and can be possibly sent through metadata to the Triton servers and Seldon core graph.
P.S A possible use case is that I have requests with different latency-accuracy requirements and I want to choose the path of the request based on that.
The text was updated successfully, but these errors were encountered:
Follow up to Slack channel question with @adriangonz . As part of a project, I have a set of interconnected nodes (each node is a Triton server) in which each of them has a number of models (with the same goal) and I want each request to pass through a different set of models. For example, I want request 1 to pass through model 1 in node 1 -> model 1 in node 2 -> model 1 in node 3, and another path R2. The path for each request is determined prior to run the request and can be possibly sent through metadata to the Triton servers and Seldon core graph.
P.S A possible use case is that I have requests with different latency-accuracy requirements and I want to choose the path of the request based on that.
The text was updated successfully, but these errors were encountered: