-
Notifications
You must be signed in to change notification settings - Fork 16
Closed
Labels
Description
There are multiple views in Pinot, these view generators have a simple task to convert a StructuredTrace into a given Pinot view. All the view generators are stateless.
Given the light weight nature of these view generator services, do we really need to run them as separate services consuming the same message.
Also, since the write to kafka is async, a single view-generator service producing view message on multiple kafka topics should scale well.
Also the fact that, the nature of all the view-generators are similar, there isn't going to be a need to individually scale them.
buchi-busireddy