Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove clustering from streaming API #23518

Closed
wants to merge 1 commit into from
Closed

Conversation

Gargron
Copy link
Member

@Gargron Gargron commented Feb 10, 2023

No description provided.

@Gargron Gargron added the deployment Related to runtime configuration, production setups label Feb 10, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Mar 5, 2023

This pull request has merge conflicts that must be resolved before it can be merged.

Copy link
Contributor

@ThisIsMissEm ThisIsMissEm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm in favour of this code change, if you want, I could continue this? (e.g., removing the throng dependency, adding nginx/systemd configuration to show how to "cluster" at nginx level, etc)

const startWorker = async (workerId) => {
log.warn(`Starting worker ${workerId}`);

const startWorker = async () => {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
const startWorker = async () => {
const startServer = async () => {

master: startMaster,
});
});
startWorker();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
startWorker();
startServer();

These two changes get rid of the verbage of workers from this code.

@ThisIsMissEm
Copy link
Contributor

@Gargron I'm currently looking into how this code could be improved further, and I'm suspecting that the current redis setup for pub/sub is inefficient (that is, the topic model doesn't actually fit with how streaming is working in the wild in production environments)

@Gargron Gargron closed this Apr 26, 2023
@Gargron Gargron deleted the remove-streaming-cluster branch April 26, 2023 09:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
deployment Related to runtime configuration, production setups rebase needed 🚧
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants