Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

other: merge 3.0 #22224

Merged
merged 977 commits into from Jul 28, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
977 commits
Select commit Hold shift + click to select a range
163adf1
chore: dm monitor refactor
kailixu Jul 14, 2023
25120ce
fix sma merge error
hzcheng Jul 14, 2023
7935d82
enhance show variables output
glzhao89 Jul 14, 2023
cdb3453
add show local variables scope
glzhao89 Jul 14, 2023
b402782
add scope for information_schema.ins_dnode_variables
glzhao89 Jul 14, 2023
145c43e
little fix
hzcheng Jul 14, 2023
021fcf2
Merge pull request #22059 from taosdata/fix/TD-25215
gccgdb1234 Jul 14, 2023
79c42cd
3.0: release 3.0.7.1 docs
xiaopingcs Jul 14, 2023
9117888
chore: more code
kailixu Jul 14, 2023
3fd349d
chore: null check
kailixu Jul 14, 2023
918d3cc
chore: more check
kailixu Jul 15, 2023
0bfc1cc
chore: windows check
kailixu Jul 16, 2023
3ab2ad2
chore: more check
kailixu Jul 16, 2023
8b6d7db
enhance: use one tsdb reader to read table sequentially
shenglian-zhou Jul 16, 2023
f93af4d
enhance: pass simple test
shenglian-zhou Jul 16, 2023
9a0e9df
enhance: block is ts sorted and each book is a source
shenglian-zhou Jul 16, 2023
2b21c5e
tsdb2: adapt cache with tsdb2 API
stephenkgu Jul 17, 2023
8263c49
tsdb/cache: fix compilation
stephenkgu Jul 17, 2023
0a74db1
Merge pull request #22080 from taosdata/3.0_docs_release
plum-lihui Jul 17, 2023
0e6b982
chore: more code
kailixu Jul 17, 2023
b21e603
enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of …
bgzhao66 Jul 14, 2023
9b0b406
tsdb/cache: relayout cache row reader
stephenkgu Jul 17, 2023
27b8671
tsdb/cache: new cacheReader field for tsdb & cache reader
stephenkgu Jul 17, 2023
655233f
fix: create initial source with blocks
shenglian-zhou Jul 17, 2023
a05383e
tsdb/cache: new load tomb callback from tsdb mergetree
stephenkgu Jul 17, 2023
832b68e
tsdb/cache: load mem del data
stephenkgu Jul 17, 2023
707be3a
unify scope for client/system/server configs
glzhao89 Jul 17, 2023
13e6a04
fix scope
glzhao89 Jul 17, 2023
929db3d
Merge branch '3.0' into enh/TS-2288
glzhao89 Jul 17, 2023
1b9754f
enhance: add log with info level. change to debug later
shenglian-zhou Jul 17, 2023
3c7924e
Merge pull request #22081 from taosdata/enh/TD-24920-3.0
dapan1121 Jul 17, 2023
62cfda1
tsdb/read2: fix UAF
stephenkgu Jul 17, 2023
463b5b6
tsdb/read2: fix null pointer runtime error
stephenkgu Jul 17, 2023
1d0c73f
fix: alter dnode keeptimeoffset err
LiShunGang Jul 17, 2023
998fbe5
tsdb/cache reader: move suid into reader's info field
stephenkgu Jul 17, 2023
ba2b404
enhance: optimize msortComparFn for table merge scan
shenglian-zhou Jul 17, 2023
cf39fcd
fix: add sma option when show create table for stb/ntb
kailixu Jul 17, 2023
52c56f4
chore: support non sma option () if supported
kailixu Jul 17, 2023
73c6666
Merge pull request #22096 from taosdata/fix/TD-25210-3.0
dapan1121 Jul 18, 2023
7e89622
Merge pull request #22092 from taosdata/fix/TD-25232
gccgdb1234 Jul 18, 2023
97a6e89
enhance: refactor create initial sources
shenglian-zhou Jul 18, 2023
6b6b7d8
enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk
bgzhao66 Jul 17, 2023
5624ecc
fix: prepare vnode dir recursively in vnodeCreate
bgzhao66 Jul 18, 2023
0a5439e
fix test case
glzhao89 Jul 18, 2023
7317769
fix mac compile error
glzhao89 Jul 18, 2023
24fed51
enh: tfsRename dir on primary disk at last
bgzhao66 Jul 18, 2023
9f9efe9
tsdb/cache reader: remove dataf & dataf last readers
stephenkgu Jul 18, 2023
2faa3d2
enh: check validity of diskPrimary during vnodeOpen
bgzhao66 Jul 18, 2023
02f4613
enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes
bgzhao66 Jul 18, 2023
f79fc81
fix: add to page buf in the same way as single source sort
shenglian-zhou Jul 18, 2023
dfaf913
fix: alter keeptimeoffset by 'k v' or 'k' 'v'
LiShunGang Jul 18, 2023
4348b9c
fix: use uinfo to show on stdout
shenglian-zhou Jul 18, 2023
224f907
fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq
bgzhao66 Jul 18, 2023
a127e91
tsdb/cache skyline: first round implementation of cache skyline
stephenkgu Jul 18, 2023
caa4503
reset state key memory
54liuyao Jul 18, 2023
5f6afc6
Merge pull request #22107 from taosdata/fix/TD-25232
gccgdb1234 Jul 18, 2023
9513f76
fix(stream): set downstream task ready state.
hjxilinx Jul 18, 2023
2bb5ac9
Merge pull request #22110 from taosdata/fix/TD-25263
hjxilinx Jul 18, 2023
40411fc
Merge branch '3.0' into fix/3_liaohj
hjxilinx Jul 18, 2023
5c75883
Merge pull request #22112 from taosdata/fix/3_liaohj
hjxilinx Jul 18, 2023
c3e5375
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
gccgdb1234 Jul 19, 2023
b9aeda2
fix: fix ubsan error of null argument
shenglian-zhou Jul 19, 2023
185081a
tsdb/fsreader: clear last fileset's resources
stephenkgu Jul 19, 2023
1d88a6a
enh: ttlMgrFlush adjust log level
LiShunGang Jul 19, 2023
4b96bc7
Merge branch '3.0' into enh/tsdb_optimize
stephenkgu Jul 19, 2023
9388653
fix scope
glzhao89 Jul 19, 2023
36be091
fix docs
glzhao89 Jul 19, 2023
7a716d4
tsdb/fs2: fix vnode get primary dir args
stephenkgu Jul 19, 2023
913cfe4
tsdb/cache: remove input[3]
stephenkgu Jul 19, 2023
d1a1976
enhance: add limit to merge sort
shenglian-zhou Jul 19, 2023
265f2a0
test: add create sma index case timeRangeWise.py
DuanKuanJun Jul 19, 2023
fc905ae
Merge pull request #22118 from taosdata/enh/ttlmgrflush
gccgdb1234 Jul 19, 2023
8481725
remove redundant results
54liuyao Jul 19, 2023
a84efab
enh(tsdb): add table filter according to stt block statistics data.
hjxilinx Jul 19, 2023
d82fb45
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb…
hjxilinx Jul 19, 2023
8e06a75
fix: auth check for sys table when user is disabled
kailixu Jul 19, 2023
c7e4aa4
set win range
54liuyao Jul 19, 2023
37ae80d
fix(tsdb): fix memory leak.
hjxilinx Jul 19, 2023
af18afb
fill history
54liuyao Jul 19, 2023
96a9d03
docs: add info for geometry
LiShunGang Jul 19, 2023
cbe03ef
Merge pull request #22069 from taosdata/enh/TS-2288
dapan1121 Jul 19, 2023
ec04a5e
Merge pull request #22121 from taosdata/fix/TD-25236-3.0a
dapan1121 Jul 19, 2023
4eaecd1
tsdb/cache: merge fs & stt row
stephenkgu Jul 19, 2023
ce71b8b
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDeng…
stephenkgu Jul 19, 2023
88b468f
Merge pull request #22123 from taosdata/docs/TD-25052
gccgdb1234 Jul 19, 2023
c30c53c
Merge pull request #22120 from taosdata/fix/TD-25268
hjxilinx Jul 19, 2023
97c44e7
refactor: do some internal refactor.
hjxilinx Jul 19, 2023
bfcc538
fix(tsdb):disable stt statistics.
hjxilinx Jul 19, 2023
46d6dcd
tsdb/cache: reset skyline when clearing fileset
stephenkgu Jul 20, 2023
7f0ea10
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDeng…
stephenkgu Jul 20, 2023
425fba2
tsdb/cache cleanup: remove unused fs methods
stephenkgu Jul 20, 2023
6dd4ec4
tsdb/cache cleanup: remove unused fs methods
stephenkgu Jul 20, 2023
94d8286
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDeng…
stephenkgu Jul 20, 2023
ccc8142
Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0
54liuyao Jul 20, 2023
48222f5
tsdb/cache: move data file reader for fs iter to cache reader
stephenkgu Jul 20, 2023
8a6ed67
fill history
54liuyao Jul 20, 2023
30129f6
enhance: merge blocks of the same table before sort
shenglian-zhou Jul 20, 2023
682a72f
Merge pull request #22119 from taosdata/test/TD-25277-3.0
plum-lihui Jul 20, 2023
6a9191f
Merge pull request #22127 from taosdata/fix/fill_history
hjxilinx Jul 20, 2023
aed99da
refactor: refactor the stream task starting order.
hjxilinx Jul 20, 2023
87fa8f0
Merge branch '3.0' into fix/3_liaohj
hjxilinx Jul 20, 2023
5d9f6fd
fix: fix limit/offset bugs
shenglian-zhou Jul 20, 2023
1a0031a
enhance: uinfo to qdebug and increase pages num to 2048
shenglian-zhou Jul 20, 2023
7d850c1
feat: optimize partition by tbname slimit
wangjiaming0909 Jul 20, 2023
45cb478
refactor: do some internal refactor.
hjxilinx Jul 20, 2023
fde8eab
Merge pull request #22111 from taosdata/szhou/tms-dev-2
dapan1121 Jul 20, 2023
c9fa170
refactor: do some internal refactor.
hjxilinx Jul 20, 2023
9353f7c
refactor: do some internal refactor.
hjxilinx Jul 20, 2023
076a425
fix: fix show create table issue for system tables
glzhao89 Jul 20, 2023
ded3ee6
add test cases
glzhao89 Jul 20, 2023
e333f47
tarray2/typeof: remove typeof for windows size
stephenkgu Jul 20, 2023
db46d31
fix(stream): refactor the halt function.
hjxilinx Jul 20, 2023
0d1c4f9
fix(stream): fix syntax error
hjxilinx Jul 21, 2023
bd8b811
refactor: do some internal refactor.
hjxilinx Jul 21, 2023
c9d75ea
refactor: do some internal refactor.
hjxilinx Jul 21, 2023
d81727a
Merge pull request #22130 from taosdata/fix/TD-25270
dapan1121 Jul 21, 2023
2ef0172
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
dapan1121 Jul 21, 2023
39ca9b5
fix(stream): fix syntax error
hjxilinx Jul 21, 2023
d0da988
Merge branch '3.0' into fix/3_liaohj
hjxilinx Jul 21, 2023
624b6b0
fix: fix(value, null) output behavior
glzhao89 Jul 21, 2023
62b73db
fix: fix(value, null) output behavior
glzhao89 Jul 21, 2023
4451b21
transform stream state
54liuyao Jul 21, 2023
3da8370
add test cases
glzhao89 Jul 21, 2023
88c13e1
add test cases
glzhao89 Jul 21, 2023
14418fa
tarray2: remove typeof for vs 2017 ci macros
stephenkgu Jul 21, 2023
b5ff918
Merge pull request #22137 from taosdata/fix/ly_test
hjxilinx Jul 21, 2023
7b1e809
Merge pull request #21794 from taosdata/enh/tsdb_optimize
gccgdb1234 Jul 21, 2023
16d7707
fix(stream): align the scan real time data for stream task.
hjxilinx Jul 21, 2023
1b26360
fix(stream): fix memory leak.
hjxilinx Jul 21, 2023
bfc4a07
fix(stream): fix memory leak.
hjxilinx Jul 21, 2023
f4864b8
fix(stream): fix memory leak.
hjxilinx Jul 21, 2023
9679cc4
fix(stream): fix race condition.
hjxilinx Jul 22, 2023
321be1f
Merge pull request #22135 from taosdata/fix/3_liaohj
hjxilinx Jul 22, 2023
4e0f7ff
fix(stream): set the correct flag of pause/resume.
hjxilinx Jul 23, 2023
e387b2f
refactor: do some internal refactor.
hjxilinx Jul 23, 2023
0b6e1a1
refactor: do some internal refactor.
hjxilinx Jul 23, 2023
13491fa
tsdb/cache: new next stt row state for fs tranverse
stephenkgu Jul 24, 2023
6a19ad3
Merge pull request #22151 from taosdata/fix/3_liaohj
hjxilinx Jul 24, 2023
1367552
fix(stream): refactor the halt status to check more status.
hjxilinx Jul 24, 2023
5f25d70
Merge pull request #22154 from taosdata/enh/tsdb_optimize
gccgdb1234 Jul 24, 2023
968cfd9
tsdb/cache: pLastIter null pointer check
stephenkgu Jul 24, 2023
13bab11
Merge pull request #22155 from taosdata/fix/3_liaohj
hjxilinx Jul 24, 2023
6fbf251
Merge pull request #22138 from taosdata/enh/TS-3625
dapan1121 Jul 24, 2023
9bae91b
fix(stream): add some logs, and remove the invalid loop.
hjxilinx Jul 24, 2023
cf59a6c
chore: set user for dm transport
kailixu Jul 24, 2023
424dd40
tsdb/cache: reuse pDataFileReader for same fileset
stephenkgu Jul 24, 2023
7946ce4
chore: code optimization
kailixu Jul 24, 2023
1d24b96
enhance: skip data blocks with the merge limit ts when create initial…
shenglian-zhou Jul 24, 2023
d78f28c
fix: monitor no longer reports logs
LiShunGang Jul 24, 2023
dce1f57
Merge pull request #22143 from taosdata/enh/TD-24987-3.0
dapan1121 Jul 24, 2023
d36903b
Merge pull request #22162 from taosdata/fix/3_liaohj
hjxilinx Jul 24, 2023
a81aaa8
docs: fix python connector docs
sunpe Jul 24, 2023
36fdf5f
Merge pull request #22169 from taosdata/docs/sunpeng/TD-25325-fix-pyt…
gccgdb1234 Jul 24, 2023
a2694b9
fix(stream): fix the invalid check of step2 .
hjxilinx Jul 24, 2023
96722a0
Merge pull request #22174 from taosdata/fix/3_liaohj
hjxilinx Jul 24, 2023
10f9c40
Merge pull request #22171 from taosdata/szhou/enhance-limit-proc
dapan1121 Jul 25, 2023
a205eba
fix: choose heap sort for table merge scan when row size is big and h…
shenglian-zhou Jul 25, 2023
c9c7f99
fix: fix error message
glzhao89 Jul 25, 2023
f963c43
Merge pull request #22132 from taosdata/fix/TS-3691
gccgdb1234 Jul 25, 2023
7ea9cf1
Merge pull request #22166 from taosdata/fix/TD-24422
gccgdb1234 Jul 25, 2023
1bce96e
fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's)
stephenkgu Jul 25, 2023
01f45b2
enh: compatibility between getFileNamePrefix and tsdbTFileName
bgzhao66 Jul 25, 2023
2383aa6
docs: delete logs in monitor doc
sunpe Jul 25, 2023
69e9df2
Merge pull request #22178 from taosdata/fix/TD-25328
gccgdb1234 Jul 25, 2023
8af8815
Merge pull request #22180 from taosdata/docs/sunpeng/TS-3730-delete-logs
gccgdb1234 Jul 25, 2023
ca2ad71
fix: return null when there are no input stream blocks for priority q…
shenglian-zhou Jul 25, 2023
768a846
Merge pull request #22177 from taosdata/enh/TS-3625
dapan1121 Jul 25, 2023
2bf84c2
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0
gccgdb1234 Jul 25, 2023
d29f835
fix(stream): set the correct step2 scan time window range.
hjxilinx Jul 25, 2023
f4c28d8
fix: table merge scan use heap sort when there is limit
shenglian-zhou Jul 25, 2023
7bfb4e0
fix(tsdb/del): continue committing fileset if more del left
stephenkgu Jul 25, 2023
0bdccd2
refactor: do some internal refactor.
hjxilinx Jul 25, 2023
02bc1b2
Merge pull request #22186 from taosdata/fix/TD-25315
gccgdb1234 Jul 25, 2023
6604266
Merge pull request #22176 from taosdata/szhou/enhance-limit-proc
dapan1121 Jul 25, 2023
2cc4e0a
fix(stream): fix syntax error
hjxilinx Jul 25, 2023
0636737
fix(stream): fix syntax error
hjxilinx Jul 25, 2023
fb86072
fix(tsdb/del): reset next key to del record's ekey
stephenkgu Jul 26, 2023
4d6b9d4
fix(stream): split delete msg for real-time scan from wal.
hjxilinx Jul 26, 2023
b6eb739
fix(tsdb): fix the
hjxilinx Jul 26, 2023
12986ff
fix(stream): fix memory leaks.
hjxilinx Jul 26, 2023
6d40cdb
adj max combine fucntion
54liuyao Jul 26, 2023
d8fd5b9
Merge pull request #22190 from taosdata/fix/TD-25315
gccgdb1234 Jul 26, 2023
78bdb04
Merge pull request #22191 from taosdata/fix/ly_stream_test
hjxilinx Jul 26, 2023
0b167c9
fix: monitor reports log summary
LiShunGang Jul 25, 2023
c3c48f2
enh: change default WAL_RETENTION_PERIOD as 3600
bgzhao66 Jul 25, 2023
d776abb
fix: adjust test cases for default WAL_RETENTION_PERIOD as 3600
bgzhao66 Jul 26, 2023
cdffabc
fix(stream): fix memory leak.
hjxilinx Jul 26, 2023
df57768
Merge branch '3.0' into fix/3_liaohj
hjxilinx Jul 26, 2023
79020ea
fix: stt and data block merge
shenglian-zhou Jul 26, 2023
1357e62
fix: fix compilation error
shenglian-zhou Jul 26, 2023
0666284
Merge pull request #22183 from taosdata/fix/TS-3691
gccgdb1234 Jul 26, 2023
610f9d1
Merge pull request #22188 from taosdata/fix/3_liaohj
hjxilinx Jul 26, 2023
432c943
fix(stream): do filter before the update check.
hjxilinx Jul 26, 2023
7d9fa2b
Merge branch '3.0' into fix/3_liaohj
hjxilinx Jul 26, 2023
3c387f6
fix(stream): fix syntax error.
hjxilinx Jul 26, 2023
6a68307
fix(tsdb): check for null ptr of pScanInfo
hjxilinx Jul 26, 2023
c57defa
Merge pull request #22195 from taosdata/szhou/fix-td25369
hjxilinx Jul 26, 2023
c368db3
stream fill operator mem leak
54liuyao Jul 26, 2023
2005568
update installation instruction
xiaopingcs Jul 21, 2023
2980062
remote web from installation package
xiaopingcs Jul 21, 2023
ceaf1d1
Merge pull request #22201 from taosdata/fix/TD-25206_3.0
gccgdb1234 Jul 26, 2023
087d54a
Merge pull request #22198 from taosdata/fix/3_liaohj
hjxilinx Jul 26, 2023
f5fced5
fix: not to walEndSnapshot in syncNodeTimerRoutine
bgzhao66 Jul 26, 2023
b1596f8
refactor: do some internal refactor.
hjxilinx Jul 26, 2023
120aa46
Merge pull request #22194 from taosdata/FIX/TD-25362-3.0
gccgdb1234 Jul 27, 2023
580b712
fix(tsdb/commit2): new maxDelKey for commit context
stephenkgu Jul 27, 2023
e1da0cc
Update 02-database.md
gccgdb1234 Jul 27, 2023
da1ba17
Update 02-database.md
gccgdb1234 Jul 27, 2023
a4e1901
fix(stream): set the value of ratio of vnode stream thread factor to …
hjxilinx Jul 27, 2023
992d623
fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN
stephenkgu Jul 27, 2023
0550402
Merge pull request #22200 from taosdata/fix/ly_stream_test
hjxilinx Jul 27, 2023
dd32f12
tsdb/commit2: reset nextKey to max to stop commit
stephenkgu Jul 27, 2023
1894608
optimize session operator reload state
54liuyao Jul 27, 2023
866f469
Merge pull request #22203 from taosdata/FIX/TD-25382-3.0
gccgdb1234 Jul 27, 2023
2ef67b3
Merge pull request #22207 from taosdata/fix/3_liaohj
hjxilinx Jul 27, 2023
8a2764c
tsdb/commit2: use max fileset's maxKey as initial maxDelKey
stephenkgu Jul 27, 2023
e89f530
fix(stream): scan wal in step2
hjxilinx Jul 27, 2023
fe495f7
tsdb/commit2: fix commit minKey for del
stephenkgu Jul 27, 2023
d9fe1a3
Merge pull request #22209 from taosdata/fix/TD-25392
hjxilinx Jul 27, 2023
167ecea
fix: check term for role time
LiShunGang Jul 25, 2023
40fe3ef
fix(stream): refactor the step2 wal scan.
hjxilinx Jul 27, 2023
0ac7ebe
op stream scan
54liuyao Jul 27, 2023
0b53bdb
op stream scan
54liuyao Jul 27, 2023
c722745
op stream scan
54liuyao Jul 27, 2023
c54bd55
op stream scan
54liuyao Jul 27, 2023
cc3cc73
Merge pull request #22199 from taosdata/fix/TS-3708
gccgdb1234 Jul 27, 2023
a72c11c
Merge pull request #22205 from taosdata/fix/TD-25315
gccgdb1234 Jul 27, 2023
7c9898c
adj stream scan
54liuyao Jul 27, 2023
6ff50d4
fix(stream): update the step2 scan wal files.
hjxilinx Jul 27, 2023
3fdbd53
Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj
hjxilinx Jul 27, 2023
3d403dc
other: merge main.
hjxilinx Jul 27, 2023
b145771
other: merge 3.0
hjxilinx Jul 27, 2023
fb226c2
enh: check cluster ttlChangeOnWrite consistency
LiShunGang Jul 20, 2023
6319cb8
fix: fix syntax error.
hjxilinx Jul 27, 2023
cc9b9bd
fix(tsdb/cache): move to stt next row if data file exausted
stephenkgu Jul 27, 2023
5d21f50
adjust history task trigger mode
54liuyao Jul 27, 2023
f667a09
fix stream fill issue
54liuyao Jul 27, 2023
22a5a18
fix(stream): 1. set correct timewindow after step2. 2. handle the cas…
hjxilinx Jul 27, 2023
fbb33be
other: add some comments.
hjxilinx Jul 27, 2023
5ca52ce
Merge pull request #22216 from taosdata/fix/TD-24937
gccgdb1234 Jul 27, 2023
9f301bd
Merge pull request #22218 from taosdata/fix/TD-24620
hjxilinx Jul 27, 2023
77d43ef
fix:tmq ci error
wangmm0220 Jul 27, 2023
7f3d1dc
fix(stream): fix memory leak.
hjxilinx Jul 27, 2023
ccc0f13
Merge pull request #22214 from taosdata/fix/3_liaohj
hjxilinx Jul 27, 2023
b3e5b5b
Merge pull request #22217 from taosdata/fix/TD-25386
gccgdb1234 Jul 28, 2023
688884d
Merge pull request #22220 from taosdata/fix/ly_stream_fill
hjxilinx Jul 28, 2023
6459587
other: fix merge error.
hjxilinx Jul 28, 2023
0a7e4c7
Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj
hjxilinx Jul 28, 2023
2a78cd2
Merge pull request #22215 from taosdata/fix/liaohj
hjxilinx Jul 28, 2023
5db8990
test: disable roll upgrade case.
hjxilinx Jul 28, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion cmake/cmake.version
Expand Up @@ -2,7 +2,7 @@
IF (DEFINED VERNUMBER)
SET(TD_VER_NUMBER ${VERNUMBER})
ELSE ()
SET(TD_VER_NUMBER "3.0.7.2.alpha")
SET(TD_VER_NUMBER "3.1.0.0.alpha")
ENDIF ()

IF (DEFINED VERCOMPATIBLE)
Expand Down
4 changes: 2 additions & 2 deletions cmake/geos_CMakeLists.txt.in
Expand Up @@ -2,11 +2,11 @@
# geos
ExternalProject_Add(geos
GIT_REPOSITORY https://github.com/libgeos/geos.git
GIT_TAG 3.11.2
GIT_TAG 3.12.0
SOURCE_DIR "${TD_CONTRIB_DIR}/geos"
BINARY_DIR ""
CONFIGURE_COMMAND ""
BUILD_COMMAND ""
INSTALL_COMMAND ""
TEST_COMMAND ""
)
)
8 changes: 4 additions & 4 deletions cmake/rocksdb_CMakeLists.txt.in
Expand Up @@ -5,8 +5,8 @@ if (${BUILD_CONTRIB})
URL https://github.com/facebook/rocksdb/archive/refs/tags/v8.1.1.tar.gz
URL_HASH MD5=3b4c97ee45df9c8a5517308d31ab008b
DOWNLOAD_NO_PROGRESS 1
DOWNLOAD_DIR "${TD_CONTRIB_DIR}/deps-download"
SOURCE_DIR "${TD_CONTRIB_DIR}/rocksdb"
DOWNLOAD_DIR "${TD_CONTRIB_DIR}/deps-download"
SOURCE_DIR "${TD_CONTRIB_DIR}/rocksdb"
CONFIGURE_COMMAND ""
BUILD_COMMAND ""
INSTALL_COMMAND ""
Expand All @@ -18,8 +18,8 @@ else()
URL https://github.com/facebook/rocksdb/archive/refs/tags/v8.1.1.tar.gz
URL_HASH MD5=3b4c97ee45df9c8a5517308d31ab008b
DOWNLOAD_NO_PROGRESS 1
DOWNLOAD_DIR "${TD_CONTRIB_DIR}/deps-download"
SOURCE_DIR "${TD_CONTRIB_DIR}/rocksdb"
DOWNLOAD_DIR "${TD_CONTRIB_DIR}/deps-download"
SOURCE_DIR "${TD_CONTRIB_DIR}/rocksdb"
CONFIGURE_COMMAND ""
BUILD_COMMAND ""
INSTALL_COMMAND ""
Expand Down
10 changes: 10 additions & 0 deletions docs/en/12-taos-sql/01-data-type.md
Expand Up @@ -42,10 +42,20 @@ In TDengine, the data types below can be used when specifying a column or tag.
| 14 | NCHAR | User Defined | Multi-byte string that can include multi byte characters like Chinese characters. Each character of NCHAR type consumes 4 bytes storage. The string value should be quoted with single quotes. Literal single quote inside the string must be preceded with backslash, like `\'`. The length must be specified when defining a column or tag of NCHAR type, for example nchar(10) means it can store at most 10 characters of nchar type and will consume fixed storage of 40 bytes. An error will be reported if the string value exceeds the length defined. |
| 15 | JSON | | JSON type can only be used on tags. A tag of json type is excluded with any other tags of any other type. |
| 16 | VARCHAR | User-defined | Alias of BINARY |
| 16 | GEOMETRY | User-defined | Geometry |
:::note

- Each row of the table cannot be longer than 48KB (64KB since version 3.0.5.0) (note that each BINARY/NCHAR/GEOMETRY column takes up an additional 2 bytes of storage space).
- Only ASCII visible characters are suggested to be used in a column or tag of BINARY type. Multi-byte characters must be stored in NCHAR type.
- The length of BINARY can be up to 16,374(data column is 65,517 and tag column is 16,382 since version 3.0.5.0) bytes. The string value must be quoted with single quotes. You must specify a length in bytes for a BINARY value, for example binary(20) for up to twenty single-byte characters. If the data exceeds the specified length, an error will occur. The literal single quote inside the string must be preceded with back slash like `\'`
- The maximum length of the GEOMETRY data column is 65,517 bytes, and the maximum length of the tag column is 16,382 bytes. Supports POINT, LINESTRING, and POLYGON subtypes of 2D. The following table describes the length calculation method:

| # | **Syntax** | **MinLen** | **MaxLen** | **Growth of each point** |
|---|--------------------------------------|------------|------------|--------------------------|
| 1 | POINT(1.0 1.0) | 21 | 21 | NA |
| 2 | LINESTRING(1.0 1.0, 2.0 2.0) | 9+2*16 | 9+4094*16 | +16 |
| 3 | POLYGON((1.0 1.0, 2.0 2.0, 1.0 1.0)) | 13+3*16 | 13+4094*16 | +16 |

- Numeric values in SQL statements will be determined as integer or float type according to whether there is decimal point or whether scientific notation is used, so attention must be paid to avoid overflow. For example, 9999999999999999999 will be considered as overflow because it exceeds the upper limit of long integer, but 9999999999999999999.0 will be considered as a legal float number.

:::
Expand Down
6 changes: 1 addition & 5 deletions docs/en/12-taos-sql/02-database.md
Expand Up @@ -36,8 +36,6 @@ database_option: {
| TSDB_PAGESIZE value
| WAL_RETENTION_PERIOD value
| WAL_RETENTION_SIZE value
| WAL_ROLL_PERIOD value
| WAL_SEGMENT_SIZE value
}
```

Expand Down Expand Up @@ -75,10 +73,8 @@ database_option: {
- TABLE_PREFIX: The prefix in the table name that is ignored when distributing a table to a vgroup when it's a positive number, or only the prefix is used when distributing a table to a vgroup, the default value is 0; For example, if the table name v30001, then "0001" is used if TSDB_PREFIX is set to 2 but "v3" is used if TSDB_PREFIX is set to -2; It can help you to control the distribution of tables.
- TABLE_SUFFIX: The suffix in the table name that is ignored when distributing a table to a vgroup when it's a positive number, or only the suffix is used when distributing a table to a vgroup, the default value is 0; For example, if the table name v30001, then "v300" is used if TSDB_SUFFIX is set to 2 but "01" is used if TSDB_SUFFIX is set to -2; It can help you to control the distribution of tables.
- TSDB_PAGESIZE: The page size of the data storage engine in a vnode. The unit is KB. The default is 4 KB. The range is 1 to 16384, that is, 1 KB to 16 MB.
- WAL_RETENTION_PERIOD: specifies the maximum time of which WAL files are to be kept for consumption. This parameter is used for data subscription. Enter a time in seconds. The default value 0. A value of 0 indicates that WAL files are not required to keep for consumption. Alter it with a proper value at first to create topics.
- WAL_RETENTION_PERIOD: specifies the maximum time of which WAL files are to be kept for consumption. This parameter is used for data subscription. Enter a time in seconds. The default value is 3600, which means the data in latest 3600 seconds will be kept in WAL for data subscription. Please adjust this parameter to a more proper value for your data subscription.
- WAL_RETENTION_SIZE: specifies the maximum total size of which WAL files are to be kept for consumption. This parameter is used for data subscription. Enter a size in KB. The default value is 0. A value of 0 indicates that the total size of WAL files to keep for consumption has no upper limit.
- WAL_ROLL_PERIOD: specifies the time after which WAL files are rotated. After this period elapses, a new WAL file is created. The default value is 0. A value of 0 indicates that a new WAL file is created only after TSDB data in memory are flushed to disk.
- WAL_SEGMENT_SIZE: specifies the maximum size of a WAL file. After the current WAL file reaches this size, a new WAL file is created. The default value is 0. A value of 0 indicates that a new WAL file is created only after TSDB data in memory are flushed to disk.
### Example Statement

```sql
Expand Down
32 changes: 16 additions & 16 deletions docs/en/12-taos-sql/03-table.md
Expand Up @@ -9,27 +9,27 @@ You create standard tables and subtables with the `CREATE TABLE` statement.

```sql
CREATE TABLE [IF NOT EXISTS] [db_name.]tb_name (create_definition [, create_definition] ...) [table_options]

CREATE TABLE create_subtable_clause

CREATE TABLE [IF NOT EXISTS] [db_name.]tb_name (create_definition [, create_definition] ...)
[TAGS (create_definition [, create_definition] ...)]
[table_options]

create_subtable_clause: {
create_subtable_clause [create_subtable_clause] ...
| [IF NOT EXISTS] [db_name.]tb_name USING [db_name.]stb_name [(tag_name [, tag_name] ...)] TAGS (tag_value [, tag_value] ...)
}

create_definition:
col_name column_definition

column_definition:
type_name [comment 'string_value']

table_options:
table_option ...

table_option: {
COMMENT 'string_value'
| WATERMARK duration[,duration]
Expand All @@ -45,9 +45,9 @@ table_option: {

1. The first column of a table MUST be of type TIMESTAMP. It is automatically set as the primary key.
2. The maximum length of the table name is 192 bytes.
3. The maximum length of each row is 48k(64k since version 3.0.5.0) bytes, please note that the extra 2 bytes used by each BINARY/NCHAR column are also counted.
3. The maximum length of each row is 48k(64k since version 3.0.5.0) bytes, please note that the extra 2 bytes used by each BINARY/NCHAR/GEOMETRY column are also counted.
4. The name of the subtable can only consist of characters from the English alphabet, digits and underscore. Table names can't start with a digit. Table names are case insensitive.
5. The maximum length in bytes must be specified when using BINARY or NCHAR types.
5. The maximum length in bytes must be specified when using BINARY/NCHAR/GEOMETRY types.
6. Escape character "\`" can be used to avoid the conflict between table names and reserved keywords, above rules will be bypassed when using escape character on table names, but the upper limit for the name length is still valid. The table names specified using escape character are case sensitive.
For example \`aBc\` and \`abc\` are different table names but `abc` and `aBc` are same table names because they are both converted to `abc` internally.
Only ASCII visible characters can be used with escape character.
Expand All @@ -58,7 +58,7 @@ table_option: {
3. MAX_DELAY: specifies the maximum latency for pushing computation results. The default value is 15 minutes or the value of the INTERVAL parameter, whichever is smaller. Enter a value between 0 and 15 minutes in milliseconds, seconds, or minutes. You can enter multiple values separated by commas (,). Note: Retain the default value if possible. Configuring a small MAX_DELAY may cause results to be frequently pushed, affecting storage and query performance. This parameter applies only to supertables and takes effect only when the RETENTIONS parameter has been specified for the database.
4. ROLLUP: specifies aggregate functions to roll up. Rolling up a function provides downsampled results based on multiple axes. This parameter applies only to supertables and takes effect only when the RETENTIONS parameter has been specified for the database. You can specify only one function to roll up. The rollup takes effect on all columns except TS. Enter one of the following values: avg, sum, min, max, last, or first.
5. SMA: specifies functions on which to enable small materialized aggregates (SMA). SMA is user-defined precomputation of aggregates based on data blocks. Enter one of the following values: max, min, or sum This parameter can be used with supertables and standard tables.
6. TTL: specifies the time to live (TTL) for the table. If TTL is specified when creatinga table, after the time period for which the table has been existing is over TTL, TDengine will automatically delete the table. Please be noted that the system may not delete the table at the exact moment that the TTL expires but guarantee there is such a system and finally the table will be deleted. The unit of TTL is in days. The default value is 0, i.e. never expire.
6. TTL: specifies the time to live (TTL) for the table. If TTL is specified when creatinga table, after the time period for which the table has been existing is over TTL, TDengine will automatically delete the table. Please be noted that the system may not delete the table at the exact moment that the TTL expires but guarantee there is such a system and finally the table will be deleted. The unit of TTL is in days. The default value is 0, i.e. never expire.

## Create Subtables

Expand Down Expand Up @@ -88,18 +88,18 @@ You can create multiple subtables in a single SQL statement provided that all su

```sql
ALTER TABLE [db_name.]tb_name alter_table_clause

alter_table_clause: {
alter_table_options
| ADD COLUMN col_name column_type
| DROP COLUMN col_name
| MODIFY COLUMN col_name column_type
| RENAME COLUMN old_col_name new_col_name
}

alter_table_options:
alter_table_option ...

alter_table_option: {
TTL value
| COMMENT 'string_value'
Expand Down Expand Up @@ -142,15 +142,15 @@ ALTER TABLE tb_name RENAME COLUMN old_col_name new_col_name

```sql
ALTER TABLE [db_name.]tb_name alter_table_clause

alter_table_clause: {
alter_table_options
| SET TAG tag_name = new_tag_value
}

alter_table_options:
alter_table_option ...

alter_table_option: {
TTL value
| COMMENT 'string_value'
Expand Down
5 changes: 5 additions & 0 deletions docs/en/12-taos-sql/04-stable.md
Expand Up @@ -51,6 +51,11 @@ DESCRIBE [db_name.]stb_name;

### View tag information for all child tables in the supertable

```
SHOW TABLE TAGS FROM table_name [FROM db_name];
SHOW TABLE TAGS FROM [db_name.]table_name;
```

```
taos> SHOW TABLE TAGS FROM st1;
tbname | id | loc |
Expand Down
2 changes: 1 addition & 1 deletion docs/en/12-taos-sql/16-operators.md
Expand Up @@ -39,7 +39,7 @@ TDengine supports the `UNION` and `UNION ALL` operations. UNION ALL collects all
| 3 | \>, < | All types except BLOB, MEDIUMBLOB, and JSON | Greater than and less than |
| 4 | \>=, <= | All types except BLOB, MEDIUMBLOB, and JSON | Greater than or equal to and less than or equal to |
| 5 | IS [NOT] NULL | All types | Indicates whether the value is null |
| 6 | [NOT] BETWEEN AND | All types except BLOB, MEDIUMBLOB, and JSON | Closed interval comparison |
| 6 | [NOT] BETWEEN AND | All types except BLOB, MEDIUMBLOB, JSON and GEOMETRY | Closed interval comparison |
| 7 | IN | All types except BLOB, MEDIUMBLOB, and JSON; the primary key (timestamp) is also not supported | Equal to any value in the list |
| 8 | LIKE | BINARY, NCHAR, and VARCHAR | Wildcard match |
| 9 | MATCH, NMATCH | BINARY, NCHAR, and VARCHAR | Regular expression match |
Expand Down
2 changes: 0 additions & 2 deletions docs/en/12-taos-sql/20-keywords.md
Expand Up @@ -334,8 +334,6 @@ The following list shows all reserved keywords:
- WAL_LEVEL
- WAL_RETENTION_PERIOD
- WAL_RETENTION_SIZE
- WAL_ROLL_PERIOD
- WAL_SEGMENT_SIZE
- WATERMARK
- WHERE
- WINDOW_CLOSE
Expand Down