Subscribe to topics by pattern

[che-shr-cat]

Hi,

Do I correctly understand that subscribing to kafka topics using regex patterns doesn't work?

The docs on topics (https://faust.readthedocs.io/en/latest/reference/faust.topics.html) says:

pattern (Union[str, Pattern[AnyStr], None]) – Regular expression evaluated to decide what topics to subscribe to. You cannot specify both topics and a pattern.

But I hadn't any success in using it. Finally I found the following comment:

faust/faust/transport/drivers/aiokafka.py

Line 314 in 93199c8

# XXX pattern does not work :/

So, are there any way to subscribe to kafka topics by pattern (and dynamically get any message from a newly created topic satisfying the pattern)?

[artas728]

Same question
How to subscribe to a topic using patterns?
Thanks

[fisuk]

Are there any updates on this? I had a go with the source and tried to get the patterns working, but failed miserably because my lack of time and understanding. My understanding is that patterns are never actually passed along to aiokafka, only the topics are passed along, but I'm obviously missing something.

[m4nuC]

@che-shr-cat @artas728 @fisuk have you guys figured it out?

[pembeci]

Same question. If this is not implemented yet fully, it will be nice to notify users in the docs.