Skip to content

Merge view-generators into a single service #102

@findingrish

Description

@findingrish

There are multiple views in Pinot, these view generators have a simple task to convert a StructuredTrace into a given Pinot view. All the view generators are stateless.
Given the light weight nature of these view generator services, do we really need to run them as separate services consuming the same message.
Also, since the write to kafka is async, a single view-generator service producing view message on multiple kafka topics should scale well.
Also the fact that, the nature of all the view-generators are similar, there isn't going to be a need to individually scale them.

cc @kotharironak @buchi-busireddy @laxmanchekka @jcchavezs

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions