Skip to content

Development Release - v0.4.0

Latest
Compare
Choose a tag to compare
@chubei chubei released this 28 Feb 07:34
· 47 commits to main since this release
16cb605

Bug Fixes

  • Improve performance of date parsing (#2306)
  • Remove ApiEndpoint::name to be consistent with other kinds of sinks (#2316)
  • Log aerospike sink error and increase batch timeout (#2336)
  • Dozer-core now propagates recoverable errors instead of panicking (#2348)
  • Don't bail out if log manager can't be started (#2365)
  • Read full message in aerospike tcp server (#2368)
  • Fix table indexes usage in aerospike connector (#2370)
  • Avoid sending repeated messages when error happens in Oracle log miner (#2373)
  • Fix oracle connector update parser (#2386)
  • i8 -> c_char (#2410)
  • Fix dummy sink performance output (#2411)
  • Oracle source skips uncommitted operations that are before another commit (#2413)
  • Oracle source replication dead loop (#2416)
  • Oracle redo log can have NULL REDO_SQL (#2418)
  • Aggregate transactions during replication to avoid losing part of long running transactions (#2423)

Features

  • Enable postgres continue ingestion (#2290)
  • Snowflake sink (#2266)
  • Support different kinds of endpoints (#2294)
  • Implement batch processing for stateless processors (#2319)
  • Continue mysql ingestion (#2322)
  • Webhook-connector (#2355)
  • Clickhouse sink (#2353)
  • Oracle connector snapshotting (#2359)
  • Oracle replication (#2361)
  • Aerospike ingestion (#2366)
  • Use http1 server for aerospike (#2374)
  • Dozer ui and dozer ui update (#2376)
  • Stop ingestion after number of events in dummy sink (#2394)
  • Print average latency in dummy sink (#2395)
  • Allow aerospike sink to handle multiple tables (#2393)
  • Support integer on oracle ingestion/sink (#2419)

Fix

  • Revert oracle resumability and fix snapshot data insert (#2425)

Miscellaneous Tasks

  • Move last_checkpoint from Source::start to SourceFactory::build (#2264)
  • Add latency measuring code in dummy sink (#2318)
  • Diable stateful output port (#2330)
  • Adapt UI for multiple tables in 1 sink (#2408)
  • Add dev container (#2412)
  • Stop using larger runners (#2417)
  • Add oracle instant client library to docker image (#2421)
  • Clean up dozer_sql::builder (#2424)
  • Remove clones and duplicated code in dozer_sql::builder (#2428)
  • Update version number to 0.4.0 (#2432)

Performance

  • Stop using record store (#2307)
  • Add Operation::BatchInsert (#2308)

Refactor

  • Change OpIdentifier to RestartableState (#2263)
  • Asyncify Source (#2329)
  • Make source state source wide instead of per table (#2344)
  • Send source state and op id to sink (#2354)
  • Make connector methods take unique reference (#2358)
  • Remove dozer-lambda (#2380)
  • Respect source transaction boundaries (#2335)
  • Handle schema and types in aerospike (#2375)
  • Remove dozer-api (#2388)
  • Guarentee operation order inside a transaction (#2389)
  • Remove dozer-cache (#2390)

Support

Contact us at https://getdozer.io