[FEATURE] create sub-module for kafka proxy #101

jiazhai · 2020-02-14T08:32:34Z

This is the sub task for #57

change name of current "impl" to kop-handler
add proxy-handler

…eamnative#101) ### Motivation Currently, a `ConnectionPool` singleton is used to maintain connections to broker. Each broker has its unique connection. Thus, for different Kafka clients that produce messages to the same topic, only 1 connection will be used. This connection might also be used to forward other requests. It harms the concurrency. What's worse, each connection should have different sessions (e.g. authentication role) for different clients. ### Modifications - Refactor `ConnectionPool` to `ConnectionFactory`, which no longer maintains a connection cache. - For each `KafkaProxyRequestHandler`, maintain the following connections: - `leaderBrokers`: the map that maps the unresolved address to the connection of leader brokers that PRODUCE and FETCH requests might be sent. - `metadataBroker`: the broker to query the metadata - `groupCoordinator`: the broker for group coordinator requests

jiazhai added the type/feature Indicates new functionality label Feb 14, 2020

jiazhai mentioned this issue Feb 14, 2020

[FEATURE] Proxy support for KoP #57

Open

sijie added workflow::triaged triage/week-15 labels Apr 9, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[FEATURE] create sub-module for kafka proxy #101

[FEATURE] create sub-module for kafka proxy #101

jiazhai commented Feb 14, 2020

[FEATURE] create sub-module for kafka proxy #101

[FEATURE] create sub-module for kafka proxy #101

Comments

jiazhai commented Feb 14, 2020