Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

refactor: refactor the fill history operation #21735

Merged
merged 99 commits into from Jul 5, 2023
Merged

refactor: refactor the fill history operation #21735

merged 99 commits into from Jul 5, 2023

Commits on May 30, 2023

  1. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed May 30, 2023
    Configuration menu
    Copy the full SHA
    2977a4d View commit details
    Browse the repository at this point in the history

  2. enh(stream): create additional task for history data processing.

    @hjxilinx
    hjxilinx committed May 30, 2023
    Configuration menu
    Copy the full SHA
    be8fd9e View commit details
    Browse the repository at this point in the history

  3. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed May 30, 2023
    Configuration menu
    Copy the full SHA
    d9c364d View commit details
    Browse the repository at this point in the history

  4. enh(stream): refactor and serialize the attributes of history tasks.

    @hjxilinx
    hjxilinx committed May 30, 2023
    Configuration menu
    Copy the full SHA
    eda0608 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed May 31, 2023
    Configuration menu
    Copy the full SHA
    e237b4a View commit details
    Browse the repository at this point in the history

  2. fix(query): add check for version range when dumping partial rows of … 

    …file block to data block
    @hjxilinx
    hjxilinx committed May 31, 2023
    Configuration menu
    Copy the full SHA
    bbb6359 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    077e1a1 View commit details
    Browse the repository at this point in the history

  2. enh(stream): refactor the fill history task.

    @hjxilinx
    hjxilinx committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    fcc706c View commit details
    Browse the repository at this point in the history

  3. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    e8549ce View commit details
    Browse the repository at this point in the history

  4. enh(stream): make history task for stream running.

    @hjxilinx
    hjxilinx committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    0dd9330 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. fix(stream): fix error in fill history scan.

    @hjxilinx
    hjxilinx committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    6a3c935 View commit details
    Browse the repository at this point in the history

  2. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    06cf358 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. refactor(stream): do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    cb26dd9 View commit details
    Browse the repository at this point in the history

  2. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    f582705 View commit details
    Browse the repository at this point in the history

  3. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    2b6ace6 View commit details
    Browse the repository at this point in the history

  4. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    6c13491 View commit details
    Browse the repository at this point in the history

  5. fix(stream): add more logs.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    6726eda View commit details
    Browse the repository at this point in the history

  6. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    c9aa59c View commit details
    Browse the repository at this point in the history

  7. other: add some logs.

    @hjxilinx
    hjxilinx committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    0fd11aa View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. other: merge other branch.

    @hjxilinx
    hjxilinx committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    53246ed View commit details
    Browse the repository at this point in the history

  2. fix: fix syntax error.

    @hjxilinx
    hjxilinx committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    63ef045 View commit details
    Browse the repository at this point in the history

  3. fix(stream): fix race condition.

    @hjxilinx
    hjxilinx committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    69c9eda View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. enh(stream): add dispatch msg.

    @hjxilinx
    hjxilinx committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    78a240b View commit details
    Browse the repository at this point in the history

  2. enh(stream): set correct task status.

    @hjxilinx
    hjxilinx committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    fb24ed1 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. stream operator fill history

    @54liuyao
    54liuyao committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    c58bde9 View commit details
    Browse the repository at this point in the history

  2. fix(stream): set the fill history status.

    @hjxilinx
    hjxilinx committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    97da2a8 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/refact/fillhistory' into refact/… 

    …fillhistory
    @hjxilinx
    hjxilinx committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    e392fb1 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. enh(stream): support restore from disk.

    @hjxilinx
    hjxilinx committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    b44447e View commit details
    Browse the repository at this point in the history

  2. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    5282492 View commit details
    Browse the repository at this point in the history

  3. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    11f0c3b View commit details
    Browse the repository at this point in the history

  4. enh(stream): do some internal refactor and support secondary scan for… 

    … history data.
    @hjxilinx
    hjxilinx committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    7c6fbd7 View commit details
    Browse the repository at this point in the history

  5. pause&resume fill history

    @54liuyao
    54liuyao committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    9a3708e View commit details
    Browse the repository at this point in the history

  6. fix(stream): wait for stream task completed.

    @hjxilinx
    hjxilinx committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    53377c2 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    1302874 View commit details
    Browse the repository at this point in the history

  2. refactor: remove one function.

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    5572415 View commit details
    Browse the repository at this point in the history

  3. fix(test): fix unit test error.

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    1742874 View commit details
    Browse the repository at this point in the history

  4. fix(test): fix link error in unit test.

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    3b2f2f0 View commit details
    Browse the repository at this point in the history

  5. trans state

    @54liuyao
    54liuyao committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    693942b View commit details
    Browse the repository at this point in the history

  6. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    74e0138 View commit details
    Browse the repository at this point in the history

  7. fix(stream): fix memory leak.

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    f3df37b View commit details
    Browse the repository at this point in the history

  8. fix: fix dead lock.

    @hjxilinx
    hjxilinx committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    a3e1882 View commit details
    Browse the repository at this point in the history

  9. use stream task state

    @54liuyao
    54liuyao committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    0aa141e View commit details
    Browse the repository at this point in the history

  10. support fill history

    yihaoDeng committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    9f91717 View commit details
    Browse the repository at this point in the history

  11. support fill history

    yihaoDeng committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    8cb8c05 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. support fill history

    yihaoDeng committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    0ef8afb View commit details
    Browse the repository at this point in the history

  2. support fill history

    yihaoDeng committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    f4b9d63 View commit details
    Browse the repository at this point in the history

  3. fix(stream): fix memory leak and failed to close vnode.

    @hjxilinx
    hjxilinx committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    9338012 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/refact/fillhistory' into refact/… 

    …fillhistory
    @hjxilinx
    hjxilinx committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    4c82558 View commit details
    Browse the repository at this point in the history

  5. support fill history

    yihaoDeng committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    1e05f5c View commit details
    Browse the repository at this point in the history

  6. fix(stream): update the info, and do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    6436566 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2023

  1. Merge branch 'refact/fillhistory1' into refact/fillhistory

    yihaoDeng committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    0eeaab9 View commit details
    Browse the repository at this point in the history

  2. fill history pause&resume

    @54liuyao
    54liuyao committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    41c1939 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. fill history pause&resume

    @54liuyao
    54liuyao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    870d75b View commit details
    Browse the repository at this point in the history

  2. fix restart crash

    yihaoDeng committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    b6d4e98 View commit details
    Browse the repository at this point in the history

  3. set task status

    @54liuyao
    54liuyao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    aafbdcb View commit details
    Browse the repository at this point in the history

  4. stream op transform

    @54liuyao
    54liuyao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    74bea44 View commit details
    Browse the repository at this point in the history

  5. scan op transform

    @54liuyao
    54liuyao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    3cfda2c View commit details
    Browse the repository at this point in the history

  6. free mem

    @54liuyao
    54liuyao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    fbed0ac View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. free mem

    @54liuyao
    54liuyao committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    1bed2b1 View commit details
    Browse the repository at this point in the history

  2. free mem

    @54liuyao
    54liuyao committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    d23c80b View commit details
    Browse the repository at this point in the history

  3. add ci

    @54liuyao
    54liuyao committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    13d9136 View commit details
    Browse the repository at this point in the history

  4. fix(stream): fix memory leak.

    @hjxilinx
    hjxilinx committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    ea7b8e9 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2023

  1. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    ceb78fd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine int… 

    …o refact/fillhistory
    @hjxilinx
    hjxilinx committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    a8de369 View commit details
    Browse the repository at this point in the history

  3. fix(stream): fix memory leak.

    @hjxilinx
    hjxilinx committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    0322fdc View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2023

  1. fix(stream): set correct stream error code.

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    7c23630 View commit details
    Browse the repository at this point in the history

  2. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    6857881 View commit details
    Browse the repository at this point in the history

  3. fix: fix syntax error.

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    6ac1795 View commit details
    Browse the repository at this point in the history

  4. mem leak

    @54liuyao
    54liuyao committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    e9d3198 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDen… 

    …gine into refact/fillhistory
    @54liuyao
    54liuyao committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    c950c73 View commit details
    Browse the repository at this point in the history

  6. fix: fix memory leak.

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    7e7feef View commit details
    Browse the repository at this point in the history

  7. set fill history info

    @54liuyao
    54liuyao committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    e236bf8 View commit details
    Browse the repository at this point in the history

  8. fix(stream): fix memory leak.

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    000325f View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/refact/fillhistory' into refact/… 

    …fillhistory
    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    9d8f6f3 View commit details
    Browse the repository at this point in the history

  10. fix(stream): fix sma error.

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    402c091 View commit details
    Browse the repository at this point in the history

  11. fix: update test case.

    @hjxilinx
    hjxilinx committed Jun 25, 2023
    Configuration menu
    Copy the full SHA
    f9be16b View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. fix(stream): fix memory leak.

    @hjxilinx
    hjxilinx committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    daafe24 View commit details
    Browse the repository at this point in the history

  2. fix(stream): fix error while fill history exists.

    @hjxilinx
    hjxilinx committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    437eb93 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. fix(stream): start stream task in case of scan history completing.

    @hjxilinx
    hjxilinx committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    b73444b View commit details
    Browse the repository at this point in the history

  2. other: merge 3.0

    @hjxilinx
    hjxilinx committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    3289ad6 View commit details
    Browse the repository at this point in the history

  3. fix(stream): fix error retrieve data from source task.And optimize th… 

    …e test cases.
    @hjxilinx
    hjxilinx committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    32fddef View commit details
    Browse the repository at this point in the history

  4. fix(stream): reduce the sleep time.

    @hjxilinx
    hjxilinx committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    4bb78df View commit details
    Browse the repository at this point in the history

  5. fix(stream): fix error in handling fill history.

    @hjxilinx
    hjxilinx committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    a19e63f View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    3710ea4 View commit details
    Browse the repository at this point in the history

  2. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    57fcd55 View commit details
    Browse the repository at this point in the history

  3. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    ed900d6 View commit details
    Browse the repository at this point in the history

  4. fix(stream): fix syntax error.

    @hjxilinx
    hjxilinx committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    f430960 View commit details
    Browse the repository at this point in the history

  5. fix(stream): fix syntax error.

    @hjxilinx
    hjxilinx committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    78739e4 View commit details
    Browse the repository at this point in the history

  6. fix(stream): fix syntax error.

    @hjxilinx
    hjxilinx committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    8867a57 View commit details
    Browse the repository at this point in the history

  7. session win range

    @54liuyao
    54liuyao committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    2fc5eeb View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. set task status of ins_stream_tasks

    @54liuyao
    54liuyao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    863da2a View commit details
    Browse the repository at this point in the history

  2. set task status of ins_stream_tasks

    @54liuyao
    54liuyao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    bc5e709 View commit details
    Browse the repository at this point in the history

  3. Merge branch '3.0' into refact/fillhistory

    @hjxilinx
    hjxilinx committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    2005756 View commit details
    Browse the repository at this point in the history

  4. refactor: do some internal refactor.

    @hjxilinx
    hjxilinx committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    2dbccc1 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine int… 

    …o refact/fillhistory
    @hjxilinx
    hjxilinx committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    393b36d View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2023

  1. test: disable stream meta storage format compatible test cases.

    @hjxilinx
    hjxilinx committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    418849e View commit details
    Browse the repository at this point in the history

  2. refactor: record the downstream input Queue blocking time.

    @hjxilinx
    hjxilinx committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    77530e1 View commit details
    Browse the repository at this point in the history

  3. test: update test cases.

    @hjxilinx
    hjxilinx committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    86b1e49 View commit details
    Browse the repository at this point in the history

  4. fix(stream): fix error in set the version range for secondary scan.

    @hjxilinx
    hjxilinx committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    ff2bf35 View commit details
    Browse the repository at this point in the history