Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] NATS Message broker #1607

Open
gedw99 opened this issue May 31, 2023 · 6 comments
Open

[FEATURE] NATS Message broker #1607

gedw99 opened this issue May 31, 2023 · 6 comments
Labels
type: enhancement New feature or request

Comments

@gedw99
Copy link

gedw99 commented May 31, 2023

Nats is like Kafka but golang .

Has mqtt support

works great with benthos.

lower cou , easier to run and manage. No jvm etc.
Easy to upgrade on the fly using lane duck mode.

nsc for for security and integration

anyways if you think it’s a good idea let me know.

@gedw99 gedw99 added the type: enhancement New feature or request label May 31, 2023
@Scarjit
Copy link
Member

Scarjit commented May 31, 2023

Do you know how NATS compares to Redpanda in terms of resource usage ?
For example, if i have a broker with ~500-1000 msg/sec, what is the CPU & Memory usage of the NATS server ?

@gedw99
Copy link
Author

gedw99 commented Jun 9, 2023

hey @Scarjit

I have run Redpanda and kafka and nats jetstream. Before either existed ran tibco rendezvous :)

https://www.youtube.com/watch?v=C4BnJ5QLeTY is a good comparison between kafka and nats that goes into the type of detail you might care about....

You asked about Resource usage but that is not the way to look at it. The trade offs are far more cross cutting:

NATS is

  • lighter
  • easier to do ops at day 2. lame duck mode :)
  • more flexible.
    • much more scalable for global
  • has LEAF NODES that is designed for IOT !!!

@JeremyTheocharis
Copy link
Member

Thank you for the suggestion! At the moment, we will stick with MQTT and Kafka.

We need an MQTT in any case, as MQTT is very common in IoT and on the shopfloor. For stream processing, we leverage additionally Kafka (see also our reasoning here: https://learn.umh.app/blog/tools-techniques-for-scalable-data-processing-in-industrial-iot/)

@gedw99
Copy link
Author

gedw99 commented Jun 26, 2023

all good :) wil close...

@gedw99 gedw99 closed this as completed Jun 26, 2023
@gedw99
Copy link
Author

gedw99 commented Jun 26, 2023

@Scarjit

read that article. YOu know NATS has Leaf mode, which is for IOT factories etc where a network partition does not stop everything.

@gedw99 gedw99 reopened this Jun 26, 2023
@Scarjit
Copy link
Member

Scarjit commented Jun 26, 2023

@gedw99 We are currently in the process of restructuring our datamodel.
I would therefor not change the broker, until we have finalized the new datamodel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants