Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ARCTIC-486][FLINK]: Fix 'Watermark may loss if split read too fast' #537

Closed
wants to merge 13 commits into from

Conversation

zstraw
Copy link
Contributor

@zstraw zstraw commented Oct 28, 2022

FIX #486 to 0.3.x

Why are the changes needed?

If there is an eventTime field defined in arctic table by 'create table t (wm as cast(op_time as timestamp(3)), watermark for wm as wm) like XXX' , watermark may not emitted.

Fix this issue.

Brief change log

  • The flink 1.12 and 1.14, 1.15 versions are affected.

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before making a pull request

Documentation

  • Does this pull request introduces a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

hameizi and others added 13 commits October 20, 2022 16:54
…ties to ams (apache#496)

* remove unnecessary properties when sync and commit properties to ams

* fix immutable map can not remove and add unit test

* fix code style

* change log
…ns, the scheam sequence of change table and base table is different (apache#501)

* add HiveChangeInternalTable and BaseSchemaUpdate

* fix code style
…cutes sql with an error (apache#505)

* fix use catalog error

* change quote to static final

Co-authored-by: shendanfeng01 <shendanfeng01@corp.netease.com>
…pache#510)

* fix apache#509 optimize plan get file format from table property

* fix apache#509 optimize plan get file format from table property

Co-authored-by: luting <dylzlt93299@gmail.com>
…pache#513)

* fix apache#512 if table is running, add failed tasks to execute

Co-authored-by: luting <dylzlt93299@gmail.com>
* add subtask issue template

* add Related issues for feature template
@zstraw zstraw closed this Oct 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants