Skip to content
This repository has been archived by the owner on May 27, 2024. It is now read-only.

duplicate events #92

Closed
aaronkaplan opened this issue Oct 5, 2016 · 6 comments
Closed

duplicate events #92

aaronkaplan opened this issue Oct 5, 2016 · 6 comments
Assignees
Labels
Milestone

Comments

@aaronkaplan
Copy link

Something looks broken.

@aaronkaplan aaronkaplan added the bug label Oct 5, 2016
@aaronkaplan aaronkaplan added this to the v1.0 milestone Oct 5, 2016
@sebix
Copy link

sebix commented Oct 11, 2016

status update: it's not the squelcher, it's something other, probably core-related.

@sebix sebix changed the title re-test the squelcher duplicate events Oct 19, 2016
@sebix
Copy link

sebix commented Oct 19, 2016

Update: two instances of the same bot have been running leading to race conditions (both are reading from the same internal queue)

@aaronkaplan
Copy link
Author

On 19 Oct 2016, at 11:28, Sebastian notifications@github.com wrote:

Update: two instances of the same bot have been running leading to race conditions (both are reading from the same internal queue)

But shouldn't the push and pop in redis be atomic?

@sebix
Copy link

sebix commented Oct 19, 2016

It is. But we don't do pushs and pops in the internal queue. This internal queue is created per bot-id, not per process!

@aaronkaplan
Copy link
Author

On 19 Oct 2016, at 13:55, Sebastian notifications@github.com wrote:

It is. But we don't do pushs and pops in the internal queue. This internal queue is created per bot-id, not per process!

got it. I see. And the internal one is not atomic due to it's different purpose. Sigh.

I think this sounds like we need a two-phase commit that a particular event in the internal queue was handled properly and can be released again.

@sebix sebix closed this as completed Nov 9, 2016
@sebix
Copy link

sebix commented Nov 9, 2016

Fix: certtools#763

Leaving this open until merged

@sebix sebix reopened this Nov 10, 2016
@sebix sebix assigned ghost and unassigned sebix Jan 28, 2017
ghost pushed a commit to certtools/intelmq that referenced this issue Jan 30, 2017
related:
#763
certat#92

Signed-off-by: Sebastian Wagner <wagner@cert.at>
ghost pushed a commit that referenced this issue Jan 31, 2017
related:
certtools#763
#92

Signed-off-by: Sebastian Wagner <wagner@cert.at>
@ghost ghost closed this as completed Feb 27, 2017
@ghost ghost mentioned this issue May 29, 2017
6 tasks
This issue was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

2 participants