Skip to content

[IOTDB-3562] Support Deactivate Template in cluster#7674

Merged
JackieTien97 merged 28 commits intoapache:masterfrom
MarcosZyk:deactivate_template
Oct 24, 2022
Merged

[IOTDB-3562] Support Deactivate Template in cluster#7674
JackieTien97 merged 28 commits intoapache:masterfrom
MarcosZyk:deactivate_template

Conversation

@MarcosZyk
Copy link
Contributor

@MarcosZyk MarcosZyk commented Oct 20, 2022 •
edited
Loading

Description

Feature define and design

see https://apache-iotdb.feishu.cn/docx/doxcnkwSNwyVmvgWZmZFl8HCkNh

Modification

  1. Implement DeactivateTemplate config task
  2. Implement DeactivateTemplate procedure, including the following four stages:
    1. construct black list (pre deactivated template on related device node in related schema region)
    2. invalidate related schema cache on all dataNode
    3. delete data in related data region
    4. deactivate template in black list
  3. Implement related mechanism in schema region
    1. use templateId in device node to directly represent the template usage and activation in cluster
    2. make templateId negative to represent pre deactivated state
  4. Refacter show paths using template to support path pattern

Test

https://apache-iotdb.feishu.cn/docx/OMV3dqI26osPkCxHborcOaDfnzb

@MarcosZyk
implement sql parse of deactivate template
2b6e347
@MarcosZyk
define configNode interface and implement configTask
f204fae
@MarcosZyk
implement template set info check
21555cc
@MarcosZyk
refine package structure and set up DeactivateTemplateProcedure
a2546f0
@MarcosZyk
extract RegionTask
8c363b0
@MarcosZyk
set up state transmission
0eb6406
@MarcosZyk
Revert "extract RegionTask"
975fb47 
This reverts commit 8c363b0.
@MarcosZyk
extract DataNodeRegionGroupUtil
8444f82
@MarcosZyk
extract DataNodeRegionTask
4c7ab81
@MarcosZyk
define dataNode internal Rpc interface
895a5bc
@MarcosZyk
implement procedure
f46603c
@MarcosZyk
set up dataNode execution framework
7fdeb57
@MarcosZyk
refactor template activation operation and implement deactivate template
ca51bb1
@MarcosZyk
process pre deactivated template in schema fetch
5f6b616
@MarcosZyk
Merge branch 'master' into deactivate_template
8537e7e 
# Conflicts:
#	confignode/src/main/java/org/apache/iotdb/confignode/consensus/request/ConfigPhysicalPlanType.java
@MarcosZyk
add license and java doc
88666ca
@MarcosZyk
add User Guide
75e4834
@MarcosZyk
fix error and add java doc
d95451b
@MarcosZyk
improve show paths using template efficiency
e076afe
@MarcosZyk
improve deactivate template with specified path pattern
9a37301
@MarcosZyk
add java doc and fix filter bug
961fe20
@MarcosZyk
fix black list process
341b4ff
@MarcosZyk
add IT and fix revealed bugs
0e2c098
@MarcosZyk
fix activate template recover bug
645a9a5
@MarcosZyk
fix schema region recover bug
c81f498
@MarcosZyk
improve IT
75f1fb4
@MarcosZyk
Merge branch 'master' into deactivate_template
87562fc 
# Conflicts:
#	confignode/src/main/java/org/apache/iotdb/confignode/consensus/request/ConfigPhysicalPlan.java
#	confignode/src/main/java/org/apache/iotdb/confignode/persistence/executor/ConfigPlanExecutor.java
@MarcosZyk
add ser deser test
4ec54b7
@JackieTien97 JackieTien97 merged commit f9f9721 into apache:master Oct 24, 2022
@MarcosZyk MarcosZyk deleted the deactivate_template branch November 1, 2022 01:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JackieTien97 JackieTien97 JackieTien97 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@MarcosZyk @JackieTien97