Skip to content

Conversation

@candiduslynx
Copy link
Contributor

@candiduslynx candiduslynx commented Jan 26, 2023

Implements #627

@github-actions
Copy link

github-actions bot commented Jan 26, 2023

⏱️ Benchmark results

Comparing with 08bace8

  • DefaultConcurrencyDFS-2 resources/s: 11,490 ⬆️ 1.89% increase vs. 08bace8
  • DefaultConcurrencyRoundRobin-2 resources/s: 11,425 ⬇️ 6.73% decrease vs. 08bace8
  • Glob-2 ns/op: 177.4 ⬇️ 50.73% decrease vs. 08bace8
  • TablesWithChildrenDFS-2 resources/s: 29,413 ⬆️ 13.43% increase vs. 08bace8
  • TablesWithChildrenRoundRobin-2 resources/s: 30,130 ⬆️ 19.74% increase vs. 08bace8
  • TablesWithRateLimitingDFS-2 resources/s: 28.36 ⬆️ 0.28% increase vs. 08bace8
  • TablesWithRateLimitingRoundRobin-2 resources/s: 771.8 ⬇️ 9.43% decrease vs. 08bace8
  • BufferedScanner-2 ns/op: 9.382 ⬇️ 38.67% decrease vs. 08bace8
  • LogReader-2 ns/op: 31 ⬇️ 28.71% decrease vs. 08bace8

@candiduslynx candiduslynx force-pushed the feat/destination/filter-out-duplicates branch from edbf5ba to 51d151f Compare January 26, 2023 13:34
@candiduslynx candiduslynx linked an issue Jan 26, 2023 that may be closed by this pull request
@candiduslynx candiduslynx force-pushed the feat/destination/filter-out-duplicates branch from f15b5b5 to fe2c3a6 Compare January 26, 2023 13:57
Copy link
Member

@hermanschaaf hermanschaaf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just minor comments around naming

@kodiakhq kodiakhq bot merged commit 505709e into main Jan 26, 2023
@kodiakhq kodiakhq bot deleted the feat/destination/filter-out-duplicates branch January 26, 2023 17:19
kodiakhq bot pushed a commit that referenced this pull request Jan 26, 2023
🤖 I have created a release *beep* *boop*
---


## [1.30.0](v1.29.0...v1.30.0) (2023-01-26)


### Features

* **destination:** Filter the duplicate primary keys prior to writing batch ([#629](#629)) ([505709e](505709e)), closes [#627](#627)


### Bug Fixes

* Ignore env variables in comments ([#625](#625)) ([08bace8](08bace8))
* Only call `newExecutionClient` if needed ([#630](#630)) ([ece947f](ece947f))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Primary key violation check

5 participants