Split with parallelProcessing runs sequentially

[casdtodtenhoefer]

Hello guys,

we encountered a very strange behaviour in our Camel-K integrations. Our body consits of an list with about 10.000 entries and we try to do an parallel split to send them to kafka. In our log we can see, that there are 10 threads, but they are running sequentially. The second thread starts after the first one finishes. We thing that this could be a problem regarding camel-k, because we already have a kind of similar route built with Camel Spring Boot and it's running as intended.

Here are our used routes:

camelRouteBuilder
                    .from("direct:" + getRouteId())
                    .routeId(getRouteId())
                    .split(camelRouteBuilder.body()).streaming().parallelProcessing()
                      .to(getRouteId()+"-send")
                    .end()
                    .to("direct:" + targetRouteName)
            ;

camelRouteBuilder
                .from("direct:" + getRouteId() + "-send")
                .routeId(getRouteId()+"-send")
                .removeHeaders("*")
                .setHeader("kafka.KEY", camelRouteBuilder.simple(getKafkaKey()))
                .to("kafka-producer:{{kafka.topic}}")
                //logging route
                .to("direct:" + getProducerLogging().endpoint)
        ;

Is this a known issue or am I doing something wrong?

Best regards,
Danny

[github-actions]

This issue has been automatically marked as stale due to 90 days of inactivity.
It will be closed if no further activity occurs within 15 days.
If you think that’s incorrect or the issue should never stale, please simply write any comment.
Thanks for your contributions!