Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ideas for networking intelmq instances #901

Open
aaronkaplan opened this issue Mar 3, 2017 · 4 comments
Open

Ideas for networking intelmq instances #901

aaronkaplan opened this issue Mar 3, 2017 · 4 comments

Comments

@aaronkaplan
Copy link
Member

Some ideas from @otmarlendl

What happens when we create a bigger network of intelmq instances? We might have loops.

Proposed solutions:

  • add UUID field to eventdb. Only add events to a local instance if the UUID does not exist yet.
  • add some kind of UUCP (she-bang) path . Example: !cert.at!bsi!nic.cz. This allows loop detection.

@otmarlendl thinks, both approaches should be taken in parallel.

@aaronkaplan aaronkaplan added feature request Indicates new feature requests data-format labels Mar 3, 2017
@aaronkaplan aaronkaplan added this to the v2.0 Release: The Future milestone Mar 3, 2017
@dmth
Copy link
Contributor

dmth commented Mar 6, 2017

regarding the use of UUID's #543 (comment)

@ghost ghost mentioned this issue Apr 10, 2019
@ghost ghost modified the milestones: 2.0.0, 2.1.0 Apr 10, 2019
@ghost ghost modified the milestones: 2.1.0, 2.2.0 Oct 25, 2019
@ghost ghost removed this from the 2.2.0 milestone Jun 17, 2020
@waldbauer-certat
Copy link
Contributor

waldbauer-certat commented Oct 11, 2020

Talking about UUID's I would recommend something similar to https://discord.com/developers/docs/reference#snowflakes. Its built for concurrency and work pretty neat.

According to the discord documentation its built like

Timestamp Internal worker ID Internal process ID Increment
Binary 111111111111111111111111111111111111111111 11111 11111 111111111111
From - To Bits 63 - 22 21 - 17 16 - 12 11 - 0

If we're exchanging data over network, it might break this system due to duplicates. Possible solution is to define a "transfer" protocol, which isnt built upon this id.

@ghost
Copy link

ghost commented Feb 27, 2021

For UUIDs, maybe CyCat can be useful: https://cycat.org/ https://github.com/CyCat-project

@ghost
Copy link

ghost commented Aug 20, 2021

Will be solved as part of IEP04

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data-format feature request Indicates new feature requests
Development

No branches or pull requests

3 participants