🚀 Feature: Tracing support for Amazon SageMaker endpoints

[bobbywlindsey]

Which component is this feature for?

All Packages

🔖 Feature description

Add tracing support for Amazon SageMaker endpoints

🎤 Why is this feature needed ?

Developers may deploy a variety of LLMs as endpoints on Amazon SageMaker. They'd query these endpoints using the InvokeEndpoint API to retrieve the LLM response.

✌️ How do you aim to achieve this?

1. Create opentelemetry-instrumentation-sagemaker package
2. Create instrumentation for the sagemaker-runtime service and patch the invoke_endpoint method.
3. Create span for the request.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

• I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!

[nirga]

Yes @bobbywlindsey! We've been wanting to do this for a while! I see that you want to work on this, let me know how can I help!