Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove ack-on-drop and ack-on-dead-end. #1670

Merged
merged 2 commits into from
May 18, 2022
Merged

Conversation

mfelsche
Copy link
Member

Those behaviours were producing edge cases where error events (from source connectors) were acked, though not handled and thus acked the original failed event.

Pull request

Description

Related

Checklist

  • The RFC, if required, has been submitted and approved
  • Any user-facing impact of the changes is reflected in docs.tremor.rs
  • The code is tested
  • Use of unsafe code is reasoned about in a comment
  • Update CHANGELOG.md appropriately, recording any changes, bug fixes, or other observable changes in behavior
  • The performance impact of the change is measured (see below)

Performance

The performance should be back to where it was before, before we introduced ack-on-drop etc.

Those behaviours were producing edge cases where error events (from source connectors) were acked, though not handled and thus acked the original failed event.

Signed-off-by: Matthias Wahl <matthiaswahl@m7w3.de>
Signed-off-by: Matthias Wahl <matthiaswahl@m7w3.de>
@codecov
Copy link

codecov bot commented May 18, 2022

Codecov Report

Merging #1670 (8705881) into main (17e42a9) will decrease coverage by 0.02%.
The diff coverage is 94.11%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #1670      +/-   ##
==========================================
- Coverage   87.60%   87.58%   -0.03%     
==========================================
  Files         254      254              
  Lines       50367    50333      -34     
==========================================
- Hits        44126    44085      -41     
- Misses       6241     6248       +7     
Flag Coverage Δ
clicommand 14.35% <41.17%> (-0.02%) ⬇️
cliintegration 52.57% <82.35%> (-0.04%) ⬇️
cliunit 13.40% <0.00%> (+0.01%) ⬆️
unittests 86.37% <86.66%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
src/connectors/source.rs 86.93% <ø> (-0.32%) ⬇️
tremor-pipeline/src/lib.rs 86.58% <ø> (ø)
tremor-pipeline/src/executable_graph.rs 88.97% <87.50%> (-0.56%) ⬇️
src/pipeline.rs 85.95% <100.00%> (-0.99%) ⬇️
tremor-cli/src/run.rs 67.80% <100.00%> (ø)
tremor-pipeline/src/op/trickle/script.rs 97.36% <100.00%> (-0.51%) ⬇️
src/connectors/impls/unix_socket/client.rs 87.70% <0.00%> (-4.10%) ⬇️
tremor-cli/src/test/process.rs 71.34% <0.00%> (-1.22%) ⬇️
... and 11 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 17e42a9...8705881. Read the comment docs.

@Licenser
Copy link
Member

On a quick glance I didn't see it, does this also un-ack's drop?

Copy link
Member

@Licenser Licenser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀 yes it does I was just blind :D

events: vec![(port, event)],
..EventAndInsights::default()
}
} else if event.transactional {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

by removing this we do not ack on drop in scripts

@mfelsche mfelsche merged commit a95645c into main May 18, 2022
@mfelsche mfelsche deleted the no-ack-on-drop-or-dead-end branch May 18, 2022 09:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants