Reopen of #962 - ISSUE WITH KAMELET azure-servicebus-source output is message length instead of message

[bjethwan]

ISSUE WITH KAMELET azure-servicebus-source output is message length instead of message

I had below KameletBinding working with Timer source but with Azure ServiceBus.
I was getting a type conversion error
Caused by: org.apache.camel.NoTypeConversionAvailableException: No type converter available to convert from type: com.azure.core.util.BinaryData to the required type: java.io.InputStream

Hence, I added a JSON Serializer in between

apiVersion: camel.apache.org/v1alpha1
kind: KameletBinding
metadata:
  name: aws-s3-streaming-upload-sink-binding
spec:
  source:
    ref:
      kind: Kamelet
      apiVersion: camel.apache.org/v1alpha1
      name: azure-servicebus-source
    properties:
      connectionString: Endpoint=<<>>/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=<<>>
      topicOrQueueName: <<>>
      serviceBusReceiveMode: RECEIVE_AND_DELETE
  steps:
  - ref:
      kind: Kamelet
      apiVersion: camel.apache.org/v1alpha1
      name: json-serialize-action
  sink:
    ref:
      kind: Kamelet
      apiVersion: camel.apache.org/v1alpha1
      name: aws-s3-streaming-upload-sink
    properties:
      bucketNameOrArn: arn:aws:s3:::<<>>
      keyName: timer-source
      region: ap-south-1
      accessKey: <<>>
      secretKey: <<>>
      batchMessageNumber: 5

Now the PROBLEM is that instead of capturing data it's capturing length of the message
{"length":54}{"length":54}{"length":54}{"length":54}{"length":54}

How to fix this?
Do I need to configure the azure-servicebus-source Kamelet to make it output String/JSON? Is it reasonable to configure the Kamelet or should I copy and configure that one?

[bjethwan]

@oscerd
Hi Andrea - I have reopened the issue.
Unless I update the existing azure-servicebus-source to emit string messages.
KameletBinding doesn't provide a way to correctly convert the Byte stream to String.
As you can see that when I try to use json-serialize-action, instead of the actual message I am getting message length.

[oscerd]

The message from servicebus is always binary.

https://docs.microsoft.com/en-us/java/api/com.azure.messaging.servicebus.servicebusreceivedmessage.getbody?view=azure-java-stable#com-azure-messaging-servicebus-servicebusreceivedmessage-getbody()

It's up to you to work with that.

[bjethwan]

oscerd
@oscerd oscerd
I agree that it's binary.
The question is how to get to String or JSON?
The json serializer kamelet is emitting json with length of the message.

For once kindly read through my message completely once.

[bjethwan]

@oscerd
Why not let our discussion finish before you close the ticket? I can't understand the rush.

[oscerd]

Because it was enough to re-open the old ticket, instead of opening a new one.

[oscerd]

One problem would be you need to call the toBytes() on the binaryData. We could do that, in the Kamelet for the moment and with a new Camel release in the component.

[oscerd]

This should be fixed with #983