Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task] Add XGBoost Serving Example #136

Closed
bschifferer opened this issue Jul 11, 2022 · 1 comment
Closed

[Task] Add XGBoost Serving Example #136

bschifferer opened this issue Jul 11, 2022 · 1 comment
Assignees

Comments

@bschifferer
Copy link
Contributor

Description

Provide example how to serve XGBoost model with Merlin Systems. The example should reference training with merlin models and continue with the artficats from it (similar as https://github.com/NVIDIA-Merlin/systems/tree/main/examples )

# export the model data to a model repository directory
from merlin.systems.dag.ops.fil import PredictForest

model = ...  # XGBoost, LightGBM, or cuml/sklearn random forest.
input_schema = ...  # merlin Schema representing input features to the model
ops = feature_names >> PredictForest(model, input_schema)
ensemble = Ensemble(ops, input_schema)
ensemble.export(export_path)


# make a request to the ensemble
from merlin.systems.triton.utils import send_triton_request

outputs_list = ensemble.graph.output_schema.column_names
response = send_triton_request(request, outputs_list, endpoint="triton:8001", triton_model="ensemble_model")
response
@oliverholworthy
Copy link
Member

Closing based on completion recent completion status and PR #157 is merged

If there is a reason it's should still be open, feel free to re-open @bschifferer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants