Skip to content

Commit

Permalink
readme: minor changes
Browse files Browse the repository at this point in the history
  • Loading branch information
shadowspore committed Jan 31, 2024
1 parent dd961d8 commit c2040e9
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,12 +4,6 @@ This package allows to do _[ordered input] -> [parallel processing] -> [ordered

The name was inspired by [golang.org/x/sync/singleflight](https://pkg.go.dev/golang.org/x/sync/singleflight) package.

## Motivation

Sending logs from a single file to multiple kafka brokers concurrently while preserving at-least-once delivery guarantees:
* Logs are sent to multiple kafka brokers in parallel to enhance throughput.
* File offsets are committed in the exact order they are read to ensure at-least-once delivery guarantees and prevent data loss in case of shipper or broker failures.

## Installation

```
Expand Down Expand Up @@ -78,6 +72,12 @@ processed: [3 1 9 7 6 2 5 4 8]
output: [1 2 3 4 5 6 7 8 9]
```

## Motivation

Sending logs from a single file to multiple kafka brokers concurrently while preserving at-least-once delivery guarantees:
* Logs are sent to multiple kafka brokers in parallel to enhance throughput.
* File offsets are committed in the exact order they are read to ensure at-least-once delivery guarantees and prevent data loss in case of shipper or broker failures.

## License

Source code is available under Apache License 2.0

0 comments on commit c2040e9

Please sign in to comment.