Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Kafka Trigger] Ease multiple topics consumption #12527

Open
1 task done
Giovannini opened this issue May 23, 2024 · 1 comment
Open
1 task done

[Kafka Trigger] Ease multiple topics consumption #12527

Giovannini opened this issue May 23, 2024 · 1 comment
Labels

Comments

@Giovannini
Copy link

Is there an existing issue for this?

  • I have searched existing issues, it hasn't been reported yet

Use case description

The Serverless configuration for Kafka trigger only enables the consumption of a single topic per trigger. AWS already enables to reference multiple topics on a single trigger so this is not a technical limitation.

Proposed solution (optional)

The configuration parameters can be updated to load either a list of topics or a single topic and that list can be sent to AWS.

To keep compatibility with existing API (which uses topic singular), we may add a new field key and ensure that only one of the two is used. This could look like this:

events:
  - kafka:
      accessConfigurations: ...
      topics:
        - myTopic-1
        - myTopic-2
      consumerGroupId: ...
      bootstrapServers:
        - ...
@austencollins
Copy link
Member

Thanks @Giovannini. We're looking into this now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants