Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Python] Error translating span: invalid xray traceid for XRay exporter #198

Closed
mohdnr opened this issue Dec 17, 2021 · 1 comment
Closed

[Python] Error translating span: invalid xray traceid for XRay exporter #198

mohdnr opened this issue Dec 17, 2021 · 1 comment

Comments

@mohdnr
Copy link

mohdnr commented Dec 17, 2021 •
edited
Loading

I have a python 3.8 lambda instrumented with a aws layer. This lambda is using the FastAPI ASGI framework wrapped by the Mangum Lambda+API Gateway adapter.

I'm currently running into issues where the xray exporter is consistently erroring on Error translating span: invalid xray traceid for all spans not related to the lambda startup events.

Is there something that i'm missing somewhere ? I tried multiple variations of the code and the one that always fails is when i'm using the Mangum adapter. However i can't remove that since it's handling AWS API Gateway requests and responses. Is there something in addition to the fastapi guide that i should be implementing to get around this issue ?

error demo repo

Lambda
Layer version: aws-otel-python38-ver-1-7-1:1 (Contains OpenTelemetry Python v1.7.1 with the AWS Python Extension v1.0.1)
The lambda is a invoked by an AWS Gateway configured to proxy requests

default collector config modified to add debugging.

Code to test opentelemetry auto-instrumentation

"""
Main API handler that defines all routes.
"""

import boto3
import os

from fastapi import FastAPI
from mangum import Mangum
from opentelemetry.instrumentation.fastapi import FastAPIInstrumentor

app = FastAPI(
    title="AWS + FastAPI",
    description="AWS API Gateway, Lambdas and FastAPI (oh my)",
    root_path="/dev"
)

@app.get("/hello")
def hello():
    "Hello path request"
    return {"Hello": "World"}

@app.get("/list")
def hello():
    client = boto3.client("s3")
    client.list_buckets()
    
    client = boto3.client("ec2")
    client.describe_instances()

    return {"Region ": os.environ['AWS_REGION']}  


FastAPIInstrumentor.instrument_app(app)
# Mangum allows us to use Lambdas to process requests
handler = Mangum(app=app)

Requirements file

boto3==1.17.*
fastapi==0.67.0
mangum==0.12.1
opentelemetry-sdk==1.7.1
opentelemetry-distro==0.26b1
opentelemetry-instrumentation==0.26b1
opentelemetry-instrumentation-fastapi==0.26b1

Collector config

receivers:
  otlp:
    protocols:
      grpc:
      http:

exporters:
  logging:
  awsxray:

service:
  pipelines:
    traces:
      receivers: [otlp]
      exporters: [awsxray]
    metrics:
      receivers: [otlp]
      exporters: [logging]
  telemetry:
    logs:
      level: debug
Debug logs... 

message
START RequestId: c6f8d807-e951-4cad-a932-1a397cc37866 Version: $LATEST
2021/12/18 00:00:03 [collector] Launching OpenTelemetry Lambda extension, version:  v0.1.0
2021/12/18 00:00:03 Using config file at path /var/task/collector.yaml
2021-12-18T00:00:03.083Z	info	service/collector.go:186	Applying configuration...
2021-12-18T00:00:03.085Z	info	builder/exporters_builder.go:254	Exporter was built.	{"kind": "exporter", "name": "logging"}
2021-12-18T00:00:03.085Z	debug	awsutil@v0.39.0/conn.go:59	Using proxy address: 	{"kind": "exporter", "name": "awsxray", "proxyAddr": ""}
2021-12-18T00:00:03.087Z	debug	awsutil@v0.39.0/conn.go:125	Fetch region from environment variables	{"kind": "exporter", "name": "awsxray", "region": "ca-central-1"}
2021-12-18T00:00:03.088Z	debug	awsxrayexporter@v0.39.0/xray_client.go:51	Using Endpoint: %s	{"kind": "exporter", "name": "awsxray", "endpoint": "https://xray.ca-central-1.amazonaws.com"}
2021-12-18T00:00:03.088Z	info	builder/exporters_builder.go:254	Exporter was built.	{"kind": "exporter", "name": "awsxray"}
2021-12-18T00:00:03.088Z	info	builder/pipelines_builder.go:222	Pipeline was built.	{"name": "pipeline", "name": "traces"}
2021-12-18T00:00:03.088Z	info	builder/pipelines_builder.go:222	Pipeline was built.	{"name": "pipeline", "name": "metrics"}
2021-12-18T00:00:03.089Z	info	builder/receivers_builder.go:224	Receiver was built.	{"kind": "receiver", "name": "otlp", "datatype": "traces"}
2021-12-18T00:00:03.089Z	info	builder/receivers_builder.go:224	Receiver was built.	{"kind": "receiver", "name": "otlp", "datatype": "metrics"}
2021-12-18T00:00:03.089Z	info	service/service.go:86	Starting extensions...
2021-12-18T00:00:03.089Z	info	service/service.go:91	Starting exporters...
2021-12-18T00:00:03.089Z	info	builder/exporters_builder.go:40	Exporter is starting...	{"kind": "exporter", "name": "logging"}
2021-12-18T00:00:03.089Z	info	builder/exporters_builder.go:48	Exporter started.	{"kind": "exporter", "name": "logging"}
2021-12-18T00:00:03.089Z	info	builder/exporters_builder.go:40	Exporter is starting...	{"kind": "exporter", "name": "awsxray"}
2021-12-18T00:00:03.089Z	info	builder/exporters_builder.go:48	Exporter started.	{"kind": "exporter", "name": "awsxray"}
2021-12-18T00:00:03.089Z	info	service/service.go:96	Starting processors...
2021-12-18T00:00:03.089Z	info	builder/pipelines_builder.go:54	Pipeline is starting...	{"name": "pipeline", "name": "traces"}
2021-12-18T00:00:03.089Z	info	builder/pipelines_builder.go:65	Pipeline is started.	{"name": "pipeline", "name": "traces"}
2021-12-18T00:00:03.089Z	info	builder/pipelines_builder.go:54	Pipeline is starting...	{"name": "pipeline", "name": "metrics"}
2021-12-18T00:00:03.089Z	info	builder/pipelines_builder.go:65	Pipeline is started.	{"name": "pipeline", "name": "metrics"}
2021-12-18T00:00:03.089Z	info	service/service.go:101	Starting receivers...
2021-12-18T00:00:03.089Z	info	builder/receivers_builder.go:68	Receiver is starting...	{"kind": "receiver", "name": "otlp"}
2021-12-18T00:00:03.089Z	info	otlpreceiver/otlp.go:68	Starting GRPC server on endpoint 0.0.0.0:4317	{"kind": "receiver", "name": "otlp"}
2021-12-18T00:00:03.089Z	info	otlpreceiver/otlp.go:86	Starting HTTP server on endpoint 0.0.0.0:4318	{"kind": "receiver", "name": "otlp"}
2021-12-18T00:00:03.089Z	info	otlpreceiver/otlp.go:141	Setting up a second HTTP listener on legacy endpoint 0.0.0.0:55681	{"kind": "receiver", "name": "otlp"}
2021-12-18T00:00:03.089Z	info	otlpreceiver/otlp.go:86	Starting HTTP server on endpoint 0.0.0.0:55681	{"kind": "receiver", "name": "otlp"}
2021-12-18T00:00:03.089Z	info	builder/receivers_builder.go:73	Receiver started.	{"kind": "receiver", "name": "otlp"}
2021-12-18T00:00:03.089Z	info	service/telemetry.go:92	Setting up own telemetry...
2021-12-18T00:00:03.090Z	info	service/telemetry.go:116	Serving Prometheus metrics	{"address": ":8888", "level": "basic", "service.instance.id": "29e96d95-7d06-4d11-b3aa-f98048ddfd9c", "service.version": "latest"}
2021-12-18T00:00:03.090Z	info	service/collector.go:235	Starting otelcol...	{"Version": "v0.1.0", "NumCPU": 2}
2021-12-18T00:00:03.090Z	info	service/collector.go:131	Everything is ready. Begin running and processing data.
2021/12/18 00:00:03 Registered extension ID: "51290cbf-6075-4c1a-82e1-1bb952cb661e"
2021/12/18 00:00:03 [collector] Register response: {
"	"functionName": "lambda_api",
"
"	"functionVersion": "$LATEST",
"
"	"handler": "lambda.handler"
"
"}
"
2021/12/18 00:00:03 [collector] Waiting for event...
"EXTENSION	Name: collector	State: Ready	Events: [INVOKE,SHUTDOWN]
"
2021/12/18 00:00:05 [collector] Received event: {
"	"eventType": "INVOKE",
"
"deadlineMs": 1639785615129,
"requestId": "c6f8d807-e951-4cad-a932-1a397cc37866",
"invokedFunctionArn": "arn:aws:lambda:ca-central-1:############:function:lambda_api",
"	"tracing": {
"
"		"type": "X-Amzn-Trace-Id",
"
"value": "Root=1-61bd2482-41527aa150bacd653a4b7a04;Parent=1a9bb62f555d892d;Sampled=1"
"	}
"
"}
"
2021/12/18 00:00:05 [collector] Waiting for event...
2021-12-18T00:00:09.601Z	debug	awsxrayexporter@v0.39.0/awsxray.go:54	TracesExporter	{"kind": "exporter", "name": "awsxray", "type": "awsxray", "name": "awsxray", "#spans": 9}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 7239d7900b5275e300a448031cf09077"}
2021-12-18T00:00:09.703Z	debug	awsxrayexporter@v0.39.0/awsxray.go:65	Error translating span.	{"kind": "exporter", "name": "awsxray", "error": "invalid xray traceid: 94fcdc8c426860edfc075740db6ce0f7"}
2021-12-18T00:00:09.741Z	debug	awsxrayexporter@v0.39.0/awsxray.go:78	request: {
"  TraceSegmentDocuments: [
"
""{\"name\":\"lambda_api\",\"id\":\"38f525d2575a900e\",\"start_time\":1639785605.1313155,\"trace_id\":\"1-61bd2482-41527aa150bacd653a4b7a04\",\"end_time\":1639785608.9352887,\"fault\":false,\"error\":false,\"throttle\":false,\"aws\":{\"xray\":{\"sdk\":\"opentelemetry for python\",\"sdk_version\":\"1.7.1\",\"auto_instrumentation\":true}},\"metadata\":{\"default\":{\"faas.execution\":\"c6f8d807-e951-4cad-a932-1a397cc37866\",\"faas.id\":\"arn:aws:lambda:ca-central-1:############:function:lambda_api\",\"otel.resource.cloud.provider\":\"aws\",\"otel.resource.cloud.region\":\"ca-central-1\",\"otel.resource.faas.name\":\"lambda_api\",\"otel.resource.faas.version\":\"$LATEST\",\"otel.resource.service.name\":\"lambda_api\",\"otel.resource.telemetry.auto.version\":\"0.26b1\",\"otel.resource.telemetry.sdk.language\":\"python\",\"otel.resource.telemetry.sdk.name\":\"opentelemetry\",\"otel.resource.telemetry.sdk.version\":\"1.7.1\"}},\"parent_id\":\"f3a96843ab50f00e\"}
","
"    <invalid value>,
"
"    <invalid value>,
"
"    <invalid value>,
"
"    <invalid value>,
"
"    <invalid value>,
"
"    <invalid value>,
"
"    <invalid value>,
"
"    <invalid value>
"
"  ]
"
"}	{"kind": "exporter", "name": "awsxray"}
"
"2021-12-18T00:00:10.400Z	debug	awsxrayexporter@v0.39.0/awsxray.go:81	response error	{"kind": "exporter", "name": "awsxray", "error": "SerializationException: 
\tstatus code: 400, request id: 221db53c-fb02-484a-b7a0-865bbe24169e"}"
2021-12-18T00:00:10.400Z	debug	awsxrayexporter@v0.39.0/awsxray.go:85	response: {
"
"
"}	{"kind": "exporter", "name": "awsxray"}
"
"2021-12-18T00:00:10.400Z	error	exporterhelper/queued_retry.go:149	Exporting failed. Try enabling retry_on_failure config option.	{"kind": "exporter", "name": "awsxray", "error": "Permanent error: SerializationException: 
\tstatus code: 400, request id: 221db53c-fb02-484a-b7a0-865bbe24169e"}"
"go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send
"
go.opentelemetry.io/collector@v0.39.0/exporter/exporterhelper/queued_retry.go:149
"go.opentelemetry.io/collector/exporter/exporterhelper.(*tracesExporterWithObservability).send
"
go.opentelemetry.io/collector@v0.39.0/exporter/exporterhelper/traces.go:136
"go.opentelemetry.io/collector/exporter/exporterhelper.(*queuedRetrySender).send
"
go.opentelemetry.io/collector@v0.39.0/exporter/exporterhelper/queued_retry.go:83
go.opentelemetry.io/collector/exporter/exporterhelper.NewTracesExporter.func2
go.opentelemetry.io/collector@v0.39.0/exporter/exporterhelper/traces.go:115
"go.opentelemetry.io/collector/consumer/consumerhelper.ConsumeTracesFunc.ConsumeTraces
"
go.opentelemetry.io/collector@v0.39.0/consumer/consumerhelper/traces.go:29
"go.opentelemetry.io/collector/service/internal/fanoutconsumer.(*tracesConsumer).ConsumeTraces
"
go.opentelemetry.io/collector@v0.39.0/service/internal/fanoutconsumer/traces.go:75
"go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export
"
go.opentelemetry.io/collector@v0.39.0/receiver/otlpreceiver/internal/trace/otlp.go:65
"go.opentelemetry.io/collector/model/otlpgrpc.rawTracesServer.Export
"
go.opentelemetry.io/collector/model@v0.39.0/otlpgrpc/traces.go:166
go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1
go.opentelemetry.io/collector/model@v0.39.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:217
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.26.1/interceptor.go:325
go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler
go.opentelemetry.io/collector/model@v0.39.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:219
"google.golang.org/grpc.(*Server).processUnaryRPC
"
google.golang.org/grpc@v1.42.0/server.go:1282
"google.golang.org/grpc.(*Server).handleStream
"
google.golang.org/grpc@v1.42.0/server.go:1616
google.golang.org/grpc.(*Server).serveStreams.func1.2
google.golang.org/grpc@v1.42.0/server.go:921
2021-12-18T00:00:10.422Z	error	exporterhelper/queued_retry.go:85	Exporting failed. Dropping data. Try enabling sending_queue to survive temporary failures.	{"kind": "exporter", "name": "awsxray", "dropped_items": 9}
"go.opentelemetry.io/collector/exporter/exporterhelper.(*queuedRetrySender).send
"
go.opentelemetry.io/collector@v0.39.0/exporter/exporterhelper/queued_retry.go:85
go.opentelemetry.io/collector/exporter/exporterhelper.NewTracesExporter.func2
go.opentelemetry.io/collector@v0.39.0/exporter/exporterhelper/traces.go:115
"go.opentelemetry.io/collector/consumer/consumerhelper.ConsumeTracesFunc.ConsumeTraces
"
go.opentelemetry.io/collector@v0.39.0/consumer/consumerhelper/traces.go:29
"go.opentelemetry.io/collector/service/internal/fanoutconsumer.(*tracesConsumer).ConsumeTraces
"
go.opentelemetry.io/collector@v0.39.0/service/internal/fanoutconsumer/traces.go:75
"go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export
"
go.opentelemetry.io/collector@v0.39.0/receiver/otlpreceiver/internal/trace/otlp.go:65
"go.opentelemetry.io/collector/model/otlpgrpc.rawTracesServer.Export
"
go.opentelemetry.io/collector/model@v0.39.0/otlpgrpc/traces.go:166
go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1
go.opentelemetry.io/collector/model@v0.39.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:217
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.26.1/interceptor.go:325
go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler
go.opentelemetry.io/collector/model@v0.39.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:219
"google.golang.org/grpc.(*Server).processUnaryRPC
"
google.golang.org/grpc@v1.42.0/server.go:1282
"google.golang.org/grpc.(*Server).handleStream
"
google.golang.org/grpc@v1.42.0/server.go:1616
google.golang.org/grpc.(*Server).serveStreams.func1.2
google.golang.org/grpc@v1.42.0/server.go:921
2021-12-18T00:00:10.440Z	INFO	loggingexporter/logging_exporter.go:40	TracesExporter	{"#spans": 9}
2021-12-18T00:00:10.440Z	DEBUG	loggingexporter/logging_exporter.go:49	ResourceSpans #0
"Resource labels:
"
"     -> telemetry.sdk.language: STRING(python)
"
"     -> telemetry.sdk.name: STRING(opentelemetry)
"
-> telemetry.sdk.version: STRING(1.7.1)
-> cloud.region: STRING(ca-central-1)
"     -> cloud.provider: STRING(aws)
"
"     -> faas.name: STRING(lambda_api)
"
"     -> faas.version: STRING($LATEST)
"
"     -> service.name: STRING(lambda_api)
"
-> telemetry.auto.version: STRING(0.26b1)
InstrumentationLibrarySpans #0
InstrumentationLibrary opentelemetry.instrumentation.botocore 0.26b1
Span #0
Trace ID       : 7239d7900b5275e300a448031cf09077
Parent ID      : ae44d3838ecdfae1
ID             : 9dbf833317108684
Name           : S3.ListBuckets
"    Kind           : SPAN_KIND_CLIENT
"
Start time     : 2021-12-18 00:00:06.821828085 +0000 UTC
End time       : 2021-12-18 00:00:07.069644866 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
"     -> rpc.system: STRING(aws-api)
"
-> rpc.service: STRING(S3)
"     -> rpc.method: STRING(ListBuckets)
"
-> aws.region: STRING(ca-central-1)
-> aws.request_id: STRING(NYKTKGPNCP11HZQ3)
-> retry_attempts: INT(0)
-> http.status_code: INT(200)
Span #1
Trace ID       : 7239d7900b5275e300a448031cf09077
Parent ID      : ae44d3838ecdfae1
ID             : 8c4afa98d92d4ce2
Name           : EC2.DescribeInstances
"    Kind           : SPAN_KIND_CLIENT
"
Start time     : 2021-12-18 00:00:08.620597006 +0000 UTC
End time       : 2021-12-18 00:00:08.932517372 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
"     -> rpc.system: STRING(aws-api)
"
-> rpc.service: STRING(EC2)
"     -> rpc.method: STRING(DescribeInstances)
"
-> aws.region: STRING(ca-central-1)
-> aws.request_id: STRING(56c54b54-b596-458e-a748-1c32051e2f88)
-> retry_attempts: INT(0)
-> http.status_code: INT(200)
InstrumentationLibrarySpans #1
InstrumentationLibrary opentelemetry.instrumentation.asgi 0.26b1
Span #0
Trace ID       : 7239d7900b5275e300a448031cf09077
Parent ID      : 4afc00b42f28d031
ID             : 6c4dce0276690b11
"    Name           : /list http send
"
"    Kind           : SPAN_KIND_INTERNAL
"
Start time     : 2021-12-18 00:00:08.934742806 +0000 UTC
End time       : 2021-12-18 00:00:08.934812714 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
-> http.status_code: INT(200)
"     -> type: STRING(http.response.start)
"
Span #1
Trace ID       : 7239d7900b5275e300a448031cf09077
Parent ID      : ae44d3838ecdfae1
ID             : 4afc00b42f28d031
"    Name           : /list http send
"
"    Kind           : SPAN_KIND_INTERNAL
"
Start time     : 2021-12-18 00:00:08.934620615 +0000 UTC
End time       : 2021-12-18 00:00:08.934832729 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
-> http.status_code: INT(200)
"     -> type: STRING(http.response.start)
"
Span #2
Trace ID       : 7239d7900b5275e300a448031cf09077
Parent ID      : 4a1957f63a0ff5e2
ID             : 8b3cd404c4994971
"    Name           : /list http send
"
"    Kind           : SPAN_KIND_INTERNAL
"
Start time     : 2021-12-18 00:00:08.934935617 +0000 UTC
End time       : 2021-12-18 00:00:08.93497295 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
"     -> type: STRING(http.response.body)
"
Span #3
Trace ID       : 7239d7900b5275e300a448031cf09077
Parent ID      : ae44d3838ecdfae1
ID             : 4a1957f63a0ff5e2
"    Name           : /list http send
"
"    Kind           : SPAN_KIND_INTERNAL
"
Start time     : 2021-12-18 00:00:08.934881634 +0000 UTC
End time       : 2021-12-18 00:00:08.93498422 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
"     -> type: STRING(http.response.body)
"
Span #4
Trace ID       : 7239d7900b5275e300a448031cf09077
"    Parent ID      : 
"
ID             : ae44d3838ecdfae1
"    Name           : /list
"
"    Kind           : SPAN_KIND_SERVER
"
Start time     : 2021-12-18 00:00:05.142575755 +0000 UTC
End time       : 2021-12-18 00:00:08.935000769 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
"     -> http.scheme: STRING(https)
"
-> http.host: STRING(8mbdm35542.execute-api.ca-central-1.amazonaws.com:443)
-> net.host.port: INT(443)
-> http.flavor: STRING(1.1)
"     -> http.target: STRING(/list)
"
-> http.url: STRING(https://8mbdm35542.execute-api.ca-central-1.amazonaws.com:443/dev/list)
"     -> http.method: STRING(GET)
"
-> http.server_name: STRING(8mbdm35542.execute-api.ca-central-1.amazonaws.com)
-> http.user_agent: STRING(Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36)
-> net.peer.ip: STRING(24.53.241.86)
-> net.peer.port: INT(0)
"     -> http.route: STRING(/list)
"
-> http.status_code: INT(200)
Span #5
Trace ID       : 94fcdc8c426860edfc075740db6ce0f7
"    Parent ID      : 
"
ID             : 34b39cafa2d90e30
"    Name           : /list
"
"    Kind           : SPAN_KIND_SERVER
"
Start time     : 2021-12-18 00:00:05.142299632 +0000 UTC
End time       : 2021-12-18 00:00:08.935016985 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
"     -> http.scheme: STRING(https)
"
-> http.host: STRING(8mbdm35542.execute-api.ca-central-1.amazonaws.com:443)
-> net.host.port: INT(443)
-> http.flavor: STRING(1.1)
"     -> http.target: STRING(/list)
"
-> http.url: STRING(https://8mbdm35542.execute-api.ca-central-1.amazonaws.com:443/dev/list)
"     -> http.method: STRING(GET)
"
-> http.server_name: STRING(8mbdm35542.execute-api.ca-central-1.amazonaws.com)
-> http.user_agent: STRING(Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36)
-> net.peer.ip: STRING(24.53.241.86)
-> net.peer.port: INT(0)
"     -> http.route: STRING(/list)
"
-> http.status_code: INT(200)
InstrumentationLibrarySpans #2
InstrumentationLibrary opentelemetry.instrumentation.aws_lambda 0.26b1
Span #0
Trace ID       : 61bd248241527aa150bacd653a4b7a04
Parent ID      : f3a96843ab50f00e
ID             : 38f525d2575a900e
"    Name           : lambda.handler
"
"    Kind           : SPAN_KIND_SERVER
"
Start time     : 2021-12-18 00:00:05.131315526 +0000 UTC
End time       : 2021-12-18 00:00:08.935288475 +0000 UTC
"    Status code    : STATUS_CODE_UNSET
"
"    Status message : 
"
"Attributes:
"
-> faas.id: STRING(arn:aws:lambda:ca-central-1:############:function:lambda_api)
-> faas.execution: STRING(c6f8d807-e951-4cad-a932-1a397cc37866)
"
"
END RequestId: c6f8d807-e951-4cad-a932-1a397cc37866
"REPORT RequestId: c6f8d807-e951-4cad-a932-1a397cc37866	Duration: 5370.81 ms	Billed Duration: 5371 ms	Memory Size: 128 MB	Max Memory Used: 128 MB	Init Duration: 2245.90 ms	
XRAY TraceId: 1-61bd2482-41527aa150bacd653a4b7a04	SegmentId: 1a9bb62f555d892d	Sampled: true"
\```
</p>
</details>
@mohdnr
Copy link
Author

mohdnr commented Dec 19, 2021

After some further documentation reading i noticed i was missing the below environment variables so the default provider was using the random id generator instead of the xray one. Putting them below in-case others run into a similar issue in the future when using xray as an exporter. Going to close this issue.

OTEL_PYTHON_ID_GENERATOR            = "xray"
OTEL_PROPAGATORS                    = "xray"
OTEL_EXPORTER_OTLP_ENDPOINT         = "127.0.0.1:4317"

@mohdnr mohdnr closed this as completed Dec 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mohdnr