Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] master from milvus-io:master #8

Open
wants to merge 1,687 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1687 commits
Select commit Hold shift + click to select a range
9ab3058
fix: Prevent restart timetick sender creating ut datanode (#33790)
congqixia Jun 12, 2024
512ea6b
enhance: Avoid merging insert data when buffering insert msgs (#33562)
congqixia Jun 13, 2024
9e99f96
test: add cases for go milvusclient delete (#33777)
ThreadDao Jun 13, 2024
7d74edd
fix: update clang-tidy and clang-format from 10 to 12 (#33141)
jiangyinzuo Jun 13, 2024
144ee26
fix: [skip e2e] Skip unstable integration test for master (#33824)
congqixia Jun 13, 2024
ca1f7ab
test: update import test case to support different dim (#33709)
zhuwenxing Jun 13, 2024
db59249
doc: [skip-e2e] add comments for meta table (#33403)
ArenaSu Jun 13, 2024
2dfa752
doc: [skip-e2e] add comments for event manager (#33444)
ArenaSu Jun 13, 2024
ab93d9c
enhance: Use BatchPkExist to reduce bloom filter func call cost (#33611)
weiliu1031 Jun 13, 2024
08fcf3f
fix: Fix meta prefix overlap bug (#33830)
wayblink Jun 13, 2024
c689ef4
fix: Remove eviction operations out of lock (#33834)
congqixia Jun 13, 2024
f3e4cb0
Update all contributors
sre-ci-robot Jun 14, 2024
b69e909
fix: Fallback field type when it isn't in request (#33832)
xiaocai2333 Jun 14, 2024
4987067
enhance: Execute bloom filter apply in parallel to speed up segment p…
weiliu1031 Jun 14, 2024
0ecd694
enhance: legacy code clean up (#33838)
shaoting-huang Jun 14, 2024
86a36b1
enhance: Tidy compaction executor (#33778)
bigsheeper Jun 14, 2024
9b69601
fix: load operation when segment is on releasing (#31340)
chyezh Jun 14, 2024
a963afa
test: refine load state check in restful test (#33861)
zhuwenxing Jun 14, 2024
b748d8a
test: add different datatype for some functions (#33869)
NicoYuan1986 Jun 14, 2024
f67b6dc
fix: DeleteData merge wrong data casuing data loss (#33820)
XuanYang-cn Jun 14, 2024
e422168
fix: readd timestamp index because segment timestamp not ordered (#33…
zhagnlu Jun 16, 2024
d43ec4d
enhance: support array bitmap index (#33527)
zhagnlu Jun 16, 2024
8537f3d
enhance: Rename Compaction to CompactionV2 (#33858)
bigsheeper Jun 16, 2024
1a9ab52
enhance: Ensure the idempotency of compaction task (#33872)
bigsheeper Jun 16, 2024
b72026c
enhance: Add rbac support on describe/alter database api (#33803)
weiliu1031 Jun 17, 2024
9514886
fix: Don't remove growing L0 segment in datanode metacache (#33829)
xiaocai2333 Jun 17, 2024
188ee43
enhance: Refine name rule check error msg (#33815)
weiliu1031 Jun 17, 2024
f993b29
enhance: Reserve space of payload writer when serialize data (#33817)
congqixia Jun 17, 2024
2da289c
enhance: add Slice func for go milvusclient column (#33836)
ThreadDao Jun 17, 2024
2a04b09
fix: Prevent use captured iteration variable partitionID (#33906)
congqixia Jun 17, 2024
88cca9d
Update all contributors
sre-ci-robot Jun 17, 2024
e83ecd5
enhance: fix not find arrow::parquet lib (#33928)
Presburger Jun 17, 2024
8cdc0e6
fix: fix data codec writer close (#33818)
shaoting-huang Jun 18, 2024
ec64499
fix: Check nodeID wildcard when removing pkOracle (#33895)
congqixia Jun 18, 2024
32f685f
enhance: growing segment support mmap (#32633)
cqy123456 Jun 18, 2024
5e906fd
enhance: Force to reset coord connection for unavailable error (#33908)
weiliu1031 Jun 18, 2024
5772123
fix: Check the correct return error in MultiRemove (#33926)
congqixia Jun 18, 2024
3fdaae8
fix: Return record with largest timestamp for entires with same PK (#…
congqixia Jun 18, 2024
5cb0760
fix: Small fixs of major compaction (#33929)
wayblink Jun 18, 2024
b460862
fix: can't find Chunk struct after growing support mmap (#33951)
cqy123456 Jun 18, 2024
7418609
Update all contributors
sre-ci-robot Jun 18, 2024
a789c60
enhance: autoindex for multi data type (#33868)
chasingegg Jun 18, 2024
0d20303
fix: fix binary vector data size (#33750)
chasingegg Jun 18, 2024
2f6f964
enhance: [skip e2e] modify gc configuration document (#33946)
chyezh Jun 19, 2024
298e50b
enhance: check index with data type (#33880)
cqy123456 Jun 19, 2024
0294595
enhance: Avoid to iterate whole segment list for each task's process …
weiliu1031 Jun 19, 2024
5fac2fa
fix: Panic if ProcessActiveStandBy returns error (#33369)
wayblink Jun 19, 2024
7b9462c
enhance: fix copying hits of inverted index twice (#33968)
longjiquan Jun 19, 2024
6d5747c
feat: adding deltalog stream reader and writer (#33844)
tedxu Jun 19, 2024
1216a4b
test: Add more sparse test cases (#33916)
elstic Jun 19, 2024
eb3197e
enhance: update amazonlinux2023 image builder (#33948)
shaoting-huang Jun 19, 2024
2a13569
enhance: support null in go payload (#32296)
smellthemoon Jun 19, 2024
6a15b6e
fix: Remove loopclosure issue in ChannelManagerImplV2 (#33989)
congqixia Jun 19, 2024
cc77363
enhance: Set maxPartitionNum default value to 1024 (#33949)
congqixia Jun 20, 2024
0264588
enhance: update pymilvus version (#33905)
NicoYuan1986 Jun 20, 2024
f3d902c
test: add test case for bulkwriter (#33879)
zhuwenxing Jun 20, 2024
31ef0a1
enhance: Add trace for bf cost in l0 compactor (#33860)
weiliu1031 Jun 20, 2024
5f02e52
enhance: Refactor data codec deserialize (#33923)
shaoting-huang Jun 20, 2024
ce3d707
test: change the number of insertion vectors (#34014)
elstic Jun 20, 2024
935bc1f
fix: Fix GetReplicas API return nil status (#33715)
weiliu1031 Jun 20, 2024
5be9929
enhance: upgrade build-env to ubuntu 22.04 and gcc12 (#33959)
yellow-shine Jun 20, 2024
dc4437f
enhance: use segment id and type to register in MmapChunkManager and …
cqy123456 Jun 20, 2024
04edb07
enhance: Add deltaRowCount in l0 compaction (#33997)
XuanYang-cn Jun 20, 2024
dac20d4
fix: fix milvus gpu compile error (#33995)
Presburger Jun 20, 2024
d9f9864
[automated] Update Knowhere Commit (#34040)
sre-ci-robot Jun 20, 2024
4e414fb
test: optimizing variable names (#34035)
elstic Jun 21, 2024
35ea775
enhance: Add rules and fix for go_client e2e code style (#34033)
congqixia Jun 21, 2024
6671000
enhance: Support queryOption WithLimit for milvusclient (#33978)
forsaken628 Jun 21, 2024
e653ad2
fix: metrics database_num is 0 after restarting rootcoord (#34011)
jaime0815 Jun 21, 2024
03a5f7e
test: update the lib of bf16 (#34043)
zhuwenxing Jun 21, 2024
958ecd5
feat: adding grouped virtual resource allocator (#33669)
tedxu Jun 21, 2024
622be36
fix: fix l0 compaction may miss some sealed segments (#33980)
sunby Jun 21, 2024
2f691f1
enhance: Unify DeleteLog parsing code (#34009)
congqixia Jun 21, 2024
380d3f4
fix: Fix memory buffer error & some renaming (#33850)
wayblink Jun 21, 2024
f3f390e
test: Update tests for range search and add test for query with dup i…
yanliang567 Jun 21, 2024
c85644e
test: modify test case about upsert partition (#33919)
NicoYuan1986 Jun 21, 2024
259a682
enhance: async search and retrieve in cgo (#33228)
chyezh Jun 22, 2024
e0e06fc
enhance: [skip e2e] Update mergify.yml to skip cov checker (#34072)
zhikunyao Jun 22, 2024
fb870d2
fix: Do compressBinlog to fix logID 0 (#34060)
bigsheeper Jun 22, 2024
e1b64e2
Update all contributors
sre-ci-robot Jun 22, 2024
b77ab76
enhance: get environment variable from .env (#34081)
yellow-shine Jun 23, 2024
6c1d815
enhance: Remove the unused compaction logic from shard (#33932)
bigsheeper Jun 23, 2024
0d7ea8e
enhance: Enhance and correct exception module (#33705)
zhagnlu Jun 23, 2024
03a3f50
enhance: add skip using array index when some situation (#33947)
zhagnlu Jun 23, 2024
78885a4
fix: turn on compression on stream writers (#34067)
tedxu Jun 24, 2024
ca7ef26
fix: sync part stats task cannot be finished(#30376) (#34027)
MrPresent-Han Jun 24, 2024
b5c9a73
fix: Prevent remove new growing L1 segment when SyncSegments (#34056)
congqixia Jun 24, 2024
b961767
enhance: support integral type for MV and skip MV if there is only on…
PwzXxm Jun 24, 2024
b923728
enhance: wal interface definition (#33745)
chyezh Jun 24, 2024
4c6f6c5
test: refine restful testcases trace (#34066)
zhuwenxing Jun 24, 2024
d08cb88
enhance: enable flush rate limiter of collection level (#33837)
jaime0815 Jun 24, 2024
aa36f9f
fix: [ut] regex query under unsupported index (#34087)
longjiquan Jun 24, 2024
a1248a1
fix: update ubuntu base image version (#33944)
weiZhenkun Jun 24, 2024
fd922d9
enhance: Add nilness linter and fix some small issues (#34049)
congqixia Jun 24, 2024
68fe6f9
enhance: [skip e2e]Update mergify.yml to skip code check workflow (#3…
zhikunyao Jun 24, 2024
07c25a1
fix: Make querycoord panick when rg metastore sync fail (#34106)
congqixia Jun 24, 2024
254b555
[automated] Update Knowhere Commit (#34119)
sre-ci-robot Jun 24, 2024
506a915
fix: Deep copy ImportTask.segmentsInfo to prevent data race (#34090)
congqixia Jun 25, 2024
d18c490
enhance: Refine compaction (#33982)
czs007 Jun 25, 2024
2cc9df5
[automated] Update cpu Builder image changes (#34078)
yellow-shine Jun 25, 2024
a21c086
enhance: [skip e2e] Check 'Build and Test' steps success for mergify …
congqixia Jun 25, 2024
ac28402
enhance: revert dead try on uploading codecov (#34130)
yellow-shine Jun 25, 2024
93291c0
fix: add build-tags at golangci-lint (#34084)
chyezh Jun 25, 2024
962a544
enhance: Add ctx in `SyncTask.Run` to be cancellable (#34042)
congqixia Jun 25, 2024
b12c34a
doc: [skip e2e] change milvus docker image version to v2.4.5 (#34135)
pingliu Jun 25, 2024
940a0ac
fix: Prevent import from generating orphaned files (#34070)
bigsheeper Jun 25, 2024
c8c423e
enhance: [skip e2e] Sync mergify Build & test job name to 22.04 (#34158)
congqixia Jun 25, 2024
f9a0f7b
Add an option to enable/disable vector field clustering key (#34097)
wayblink Jun 25, 2024
b1a3473
fix: [GoSDK] Compose result set for result zero hit case (#34129)
congqixia Jun 25, 2024
c65f41d
fix: Only sync flushed segments to datanode (#34156)
xiaocai2333 Jun 25, 2024
9630974
enhance: move rocksmq from internal to pkg module (#33881)
jaime0815 Jun 25, 2024
381d437
enhance: update new mmap config parmeters version (#34143)
cqy123456 Jun 25, 2024
cc54ab2
[automated] Update Knowhere Commit (#34172)
sre-ci-robot Jun 25, 2024
a77e295
test: add cases for go milvusclient query (#33884)
ThreadDao Jun 26, 2024
fbe3231
fix: fix error ignore in compactor (#34169)
wayblink Jun 26, 2024
a933f67
fix: centroids file not removed when data skew in major compaction (#…
chasingegg Jun 26, 2024
4520342
enhance: Avoid search querynode return nil status in response (#34100)
weiliu1031 Jun 26, 2024
f8bf690
fix: Fix datacoord's properties overwriten (#34146)
xige-16 Jun 26, 2024
a08000c
enhance:[skip e2e]update one pod mode resource (#34196)
zhuwenxing Jun 26, 2024
e04f1f9
enhance: Add unittest for `storage.DeleteLog` (#34190)
congqixia Jun 26, 2024
0565b70
enhance: [skip e2e] make mergify back-forward compatible with old che…
yellow-shine Jun 26, 2024
e43c558
enhance: [skip e2e] fix mergify (#34209)
yellow-shine Jun 26, 2024
948bfba
fix: Pass `otlpSecure` config when setup segcore tracing (#34193)
congqixia Jun 26, 2024
006f753
Update all contributors
sre-ci-robot Jun 26, 2024
51ebe95
enhance: remove CheckVecIndexWithDataTypeExist function in pkg and re…
cqy123456 Jun 26, 2024
9c2eeff
enhance: refine error message for invalid limit parameter (#34178)
jaime0815 Jun 26, 2024
be23495
test: add cases got gosdk v2 search and databases (#34204)
ThreadDao Jun 27, 2024
d2bc4a5
enhance: implement rmq and pulsar as wal (#34046)
chyezh Jun 27, 2024
f2107ad
test: update test cases about autoindex (#34224)
NicoYuan1986 Jun 27, 2024
ad90360
enhance: Update knowhere commit (#34223)
cydrain Jun 27, 2024
8123bea
enhance: Avoid assign too much segment/channels to new querynode (#34…
weiliu1031 Jun 27, 2024
dda70aa
fix: LegacyVersionWithoutRPCWatch default value to 2.4.1 (#34184)
XuanYang-cn Jun 27, 2024
b14482b
enhance: [skip e2e] use disk ann when os is ubuntu (#34236)
yellow-shine Jun 27, 2024
97db7be
fix: [GoSDK] Allocate correct bytes for bf16 vector (#34233)
congqixia Jun 27, 2024
00e5a40
test: remove dup code (#34242)
zhuwenxing Jun 28, 2024
96dcee5
fix:load major compaction partial result(#34051) (#34052)
MrPresent-Han Jun 28, 2024
cc1bc07
enhance: add log to bitmap index (#34197)
zhagnlu Jun 30, 2024
3030e46
enhance: refactor variable column to reduce memory cost (#33875)
zhagnlu Jun 30, 2024
73ffc1b
Refine clustering_compaction_task retry mechanism (#34194)
wayblink Jun 30, 2024
e5d691d
Use new stream segment reader in clustering compaction (#34232)
wayblink Jun 30, 2024
0426390
enhance: improve check health (#33800)
jaime0815 Jul 1, 2024
f7ecafe
enhance: Skip update index for L0 segment (#34099)
weiliu1031 Jul 1, 2024
14e827d
fix: Implement singleflight for segcore ChunkCache (#34250)
congqixia Jul 1, 2024
d6afb31
enhance: make subfunctions of datanode component modular (#33992)
jaime0815 Jul 1, 2024
186757e
enhance: support mark error as user error (#33498)
aoiasd Jul 1, 2024
b49862d
enhance: Optimize grow slice cost during query (#34253)
weiliu1031 Jul 1, 2024
ff51c7e
fix: Fix panic due to failed to seek (#34229)
bigsheeper Jul 1, 2024
ef3ced8
fix: descriptor event in previous version not has nullable to parse e…
smellthemoon Jul 1, 2024
b284b81
fix: Check partition in current target when observing partition load …
congqixia Jul 1, 2024
734415b
fix: Reduce duplicate PKs in segcore (#34267)
bigsheeper Jul 1, 2024
e083d99
enhance: Use channel name map finding channel watcher (#34294)
congqixia Jul 1, 2024
b32dae1
enhance: Refine max length exceeded error message (#34300)
congqixia Jul 1, 2024
4cf1a35
fix: Sync the sealed and flushed segments to datanode (#34301)
xiaocai2333 Jul 1, 2024
87bccb1
enhance: [GoSDK] Sync IndexType supported from v1 (#34310)
congqixia Jul 1, 2024
a5be322
enhance: Don't set the timeout for SyncSegments (#34226)
xiaocai2333 Jul 2, 2024
3563136
enhance: timetick interceptor implementation (#34238)
chyezh Jul 2, 2024
ec5db7a
enhance: update knowhere version (#34361)
chasingegg Jul 2, 2024
fa8d641
fix: update check for sparse hnsw index (#33713)
zhengbuqian Jul 2, 2024
34bec2e
enhance: add metrics for segment prune latnecy(#30376) (#34094)
MrPresent-Han Jul 3, 2024
fb61344
fix: Revert a optimize in clustering compaction (#34299)
wayblink Jul 3, 2024
32c943f
enhance: [skip e2e] update the version of MV (#34378)
PwzXxm Jul 3, 2024
776ffee
enhance: Tag gotestsum version when install deps (#34308)
congqixia Jul 3, 2024
8165961
enhance: Optimeize clustering compaction (#34313)
xiaocai2333 Jul 3, 2024
feb13cd
enhance: Skip pick worker when task doesn't need to execute actually …
xiaocai2333 Jul 3, 2024
94fb580
fix: Use raw parameter value to perform CAS (#34343)
congqixia Jul 3, 2024
2e434e4
fix: Only load or release Flushed segment in datanode meta (#34390)
xiaocai2333 Jul 3, 2024
a501fa1
fix: remove isFull check in compaction.enqueue (#34338)
wayblink Jul 3, 2024
8c42f13
doc: [skip e2e] add extraConfig to embed milvus (#34395)
pingliu Jul 3, 2024
da56880
fix: Avoid datarace in clustering compaction (#34288)
wayblink Jul 3, 2024
0fd0fcf
enhance: Fix lint issues & sdk testcase (#34399)
congqixia Jul 3, 2024
d1f57aa
enhance: remove deprecated code within channel manager (#34340)
jaime0815 Jul 3, 2024
23e2a0e
fix: Remove unused code to fix compiling (#34406)
xiaocai2333 Jul 4, 2024
9db8979
enhance: refine misleading param name for bloom filter parallel facto…
weiliu1031 Jul 4, 2024
8a2be8a
fix: DataNode might OOM by estimating based on MemorySize (#34201)
XuanYang-cn Jul 4, 2024
c6e2900
enhance: add the tick log for the tt msgstream seek method (#34397)
SimFG Jul 4, 2024
d51d095
enhance: Continue loop when reassign channel fails (#34331)
congqixia Jul 4, 2024
10b3ce2
enhance: use configed max topk for iterator when input topk exceeds (…
MrPresent-Han Jul 4, 2024
e4cece8
test: add cases for gosdk v2 upsert (#34400)
ThreadDao Jul 4, 2024
7611128
enhance: wal adaptor implementation (#34122)
chyezh Jul 4, 2024
0b404bf
fix: Correct the update logic of timerecorder (#34339)
bigsheeper Jul 4, 2024
fcafdb6
enhance: reconstruct scalar part's code for segment-pruner(#30376) (#…
MrPresent-Han Jul 4, 2024
439fb24
fix: Skip l0 segments when syncing segments to datanodes (#34388)
congqixia Jul 4, 2024
c16a704
fix: [restful v2] count(*) & hook (#34369)
PowderLi Jul 4, 2024
d65b689
[automated] Update Knowhere Commit (#34432)
sre-ci-robot Jul 4, 2024
6774724
test: add test cases for gosdk v2 index (#34431)
ThreadDao Jul 5, 2024
ba04981
enhance: implement wal managerment on streaming node (#34153)
chyezh Jul 5, 2024
7cac20f
doc: Update # of GitHub stars in README.md (#33577)
dandv Jul 5, 2024
0817802
enhance: use the key lock and concurrent map in the msg dispatcher cl…
SimFG Jul 5, 2024
21fc5f5
enhance: Remove datanode reporting TT based on MQ implementation (#34…
jaime0815 Jul 5, 2024
18f2458
fix: fix bitmap supported type (#34350)
zhagnlu Jul 5, 2024
233b848
fix: generate gin logs failed cause access logs panic (#34142)
aoiasd Jul 5, 2024
6b4d977
fix: Write padding into mmap file in case of SIGBUS (#34443)
congqixia Jul 5, 2024
a1c65de
fix: [GoSDK] Avoid creating schema for non-fast CreateCollection (#34…
congqixia Jul 5, 2024
60be454
enhance: add disk quota and max collections into db properties (#34368)
jaime0815 Jul 5, 2024
05df709
enhance: retry etcd server start with 3 default retries (#34208)
charleskakumanu Jul 5, 2024
43fd8d1
enhance: Check segment existence when FlushSegments and add some key …
bigsheeper Jul 6, 2024
f4dd7c7
enhance: add delta log stream new format reader and writer (#34116)
shaoting-huang Jul 6, 2024
4e5f1d5
enhance: Pre-allocate ids for import (#33958)
bigsheeper Jul 7, 2024
efdaed4
fix: fix clustering compaction can't enqueue when compaction queue is…
wayblink Jul 8, 2024
145f4f9
fix: Add `nbits` parameter check for IVF_PQ (#34451)
congqixia Jul 8, 2024
f7898a3
test: update test case (#34108)
elstic Jul 8, 2024
467113d
fix: Accidently exit the check loop (#34481)
XuanYang-cn Jul 8, 2024
686a212
fix: Upgraded Azidentity Package to v1.6.0 (#34464)
Ald392 Jul 8, 2024
ae6d6f9
enhance: change autoindex default metric type (#34261)
chasingegg Jul 8, 2024
8af187f
fix: lose partitionIDs when scalar pruning and refine segment prune r…
MrPresent-Han Jul 8, 2024
e15ac2b
fix: Fix incorrect segment num rows (#34441)
bigsheeper Jul 8, 2024
80b620e
fix: Check err is ErrKeyNotFound when CASCachedValue (#34488)
congqixia Jul 8, 2024
dfe0416
enhance: implement streaming node server service (#34166)
chyezh Jul 8, 2024
df5ba3f
enhance: update milvus proto (#34490)
PwzXxm Jul 9, 2024
3333160
enhance: Fix lint issues from recent PRs (#34482)
congqixia Jul 9, 2024
391d2aa
fix: Fix unstable ut of msgdispatcher (#34485)
bigsheeper Jul 9, 2024
0c4d82c
fix: fix compaction task startTime is 0 (#34496)
wayblink Jul 9, 2024
eeb03a0
fix: Query may return deleted records (#34501)
weiliu1031 Jul 9, 2024
eae4dfc
fix: reuse deserialize result to help improve memory management (#34507)
tedxu Jul 9, 2024
5016038
enhance: release the record in delete codec and add some log for comp…
SimFG Jul 9, 2024
4365308
enhance: support setting properties in create database request (#34510)
jaime0815 Jul 9, 2024
c1e0453
enhance:change access log write cache default config (#34354)
aoiasd Jul 9, 2024
314f4d9
enhance: Tidy dc channel manager (#34515)
XuanYang-cn Jul 9, 2024
0b3f317
[automated] Update Knowhere Commit (#34549)
sre-ci-robot Jul 9, 2024
2f70bbe
Update all contributors
sre-ci-robot Jul 10, 2024
3c70463
fix: RootCoord panic during check health (#34541)
weiliu1031 Jul 10, 2024
d60e628
enhance: Avoid use concrete segment type in segments interfaces (#34521)
congqixia Jul 10, 2024
9b37d3f
enhance: Enable setting the replica number and resource group during …
weiliu1031 Jul 10, 2024
4850336
fix: Write padding at end of mmap file not chunk (#34529)
congqixia Jul 10, 2024
ebc68d2
fix: Indexnode stuck at stopping progress cause by wrong lifetime con…
weiliu1031 Jul 10, 2024
b58a561
enhance: add the seal segment when dispatch delete msgs (#34565)
SimFG Jul 10, 2024
aef7664
fix: Prevent dispatcher merging if curTs is 0 (#34562)
bigsheeper Jul 10, 2024
c332f69
enhance: skip orphan channel cp meta when checking cp lag (#34555)
jaime0815 Jul 11, 2024
1bc3c0b
enhance: implement balancer at streaming coord (#34435)
chyezh Jul 11, 2024
3b62138
fix: unstable UT for level0 deletion (#34524)
jaime0815 Jul 11, 2024
be92147
enhance: Print reason when seal segments (#34575)
congqixia Jul 11, 2024
e0b39d8
fix: Milvus panic when compaction disabled and dropping a collection …
XuanYang-cn Jul 11, 2024
e411548
test: add cases for gosdk v2 partitions (#34593)
ThreadDao Jul 11, 2024
07b94b4
enhance: support upsert autoid==true (#30342)
smellthemoon Jul 11, 2024
fd3da90
enhance: Refine clustering compaction latency metrics (#34528)
wayblink Jul 11, 2024
d7a3697
enhance: Add back compactionTaskNum metrics (#34583)
XuanYang-cn Jul 11, 2024
104d096
feat: support partition key isolation (#34336)
PwzXxm Jul 11, 2024
d7966f4
fix: Compaction task l0 state transfer wrong (#34597)
XuanYang-cn Jul 11, 2024
a08a0c8
fix: encountering orphan channel-cp meta after DataCoord GC (#34612)
jaime0815 Jul 11, 2024
358e9a1
enhance: Alter compactTo segments before compactFrom to avoid data lo…
wayblink Jul 11, 2024
5bb0d21
fix: Restful API use deprecate error code cause access log panic. (#3…
aoiasd Jul 12, 2024
f00c529
feat: support group_size for search_group_by(#33544) (#33720)
MrPresent-Han Jul 12, 2024
531092c
enhance: Add lint rule to forbid gogo protobuf (#34594)
congqixia Jul 12, 2024
d8e68cb
enhance: use the insert rate limit for the upsert request (#34615)
SimFG Jul 12, 2024
1a248f2
enhance: Add param item for segmentFlushInterval (#34629)
congqixia Jul 12, 2024
93a5006
fix: Remove flushed segment in segment manager generated through impo…
xiaocai2333 Jul 12, 2024
2c462d3
test: Fix index creation mismatch for sparse vector columns in multiv…
elstic Jul 13, 2024
18c83c6
fix: fix auto merge error (#34661)
zhagnlu Jul 13, 2024
bd9727a
fix: fix bug that set incorrect info to columnbase (#34428)
zhagnlu Jul 14, 2024
48898ce
fix: fix meta revert bug when clustering compaction task fail (#34604)
wayblink Jul 14, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
18 changes: 13 additions & 5 deletions .env
Original file line number Diff line number Diff line change
@@ -1,11 +1,19 @@
# to define environment variables available to docker-compose.yml

IMAGE_REPO=milvusdb
IMAGE_ARCH=amd64
OS_NAME=ubuntu20.04
DATE_VERSION=20231204-fccec12
LATEST_DATE_VERSION=20231204-fccec12
GPU_DATE_VERSION=20231204-fccec12
LATEST_GPU_DATE_VERSION=20231204-fccec12
OS_NAME=ubuntu22.04

# for services.builder.image in docker-compose.yml
DATE_VERSION=20240620-5be9929
LATEST_DATE_VERSION=20240620-5be9929
# for services.gpubuilder.image in docker-compose.yml
GPU_DATE_VERSION=20240520-c35eaaa
LATEST_GPU_DATE_VERSION=20240520-c35eaaa

# for other services in docker-compose.yml
MINIO_ADDRESS=minio:9000
PULSAR_ADDRESS=pulsar://pulsar:6650
ETCD_ENDPOINTS=etcd:2379
AZURITE_CONNECTION_STRING="DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite:10000/devstoreaccount1;"

55 changes: 55 additions & 0 deletions .github/actions/bump-builder-version/action.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
name: 'Bump Builder Version'
description: 'bump builder version in the .env file'
inputs:
tag:
description: 'Tag name'
required: true
type:
description: 'the type of builder image, cpu or gpu'
required: true
default: 'cpu'
token:
description: 'github token to create pull request'
required: true
runs:
using: "composite"
steps:
- name: Bump Builder Version when cpu type
if: ${{ inputs.type == 'cpu' }}
shell: bash
run: |
sed -i "s#^DATE_VERSION=.*#DATE_VERSION=${{ inputs.tag }}#g" .env
sed -i "s#^LATEST_DATE_VERSION=.*#LATEST_DATE_VERSION=${{ inputs.tag }}#g" .env
- name: Bump Builder Version when gpu type
if: ${{ inputs.type == 'gpu' }}
shell: bash
run: |
sed -i "s#^GPU_DATE_VERSION=.*#GPU_DATE_VERSION=${{ inputs.tag }}#g" .env
sed -i "s#^LATEST_GPU_DATE_VERSION=.*#LATEST_GPU_DATE_VERSION=${{ inputs.tag }}#g" .env
- name: git config
shell: bash
run: |
git config --local user.email "41898282+github-actions[bot]@users.noreply.github.com"
git config --local user.name "github-actions[bot]"
git add .env
git commit -m "Update Builder image changes"
- name: Create Pull Request
id: cpr
uses: peter-evans/create-pull-request@v3
continue-on-error: true
with:
token: ${{ inputs.token }}
author: ${{ github.actor }} <${{ github.actor }}@users.noreply.github.com>
signoff: false
branch: update_${{ inputs.type }}_builder_${{ github.sha }}
delete-branch: true
title: '[automated] Update ${{ inputs.type }} Builder image changes'
body: |
Update ${{ inputs.type }} Builder image changes
See changes: https://github.com/milvus-io/milvus/commit/${{ github.sha }}
Signed-off-by: ${{ github.actor }} ${{ github.actor }}@users.noreply.github.com
- name: Check outputs
shell: bash
run: |
echo "Pull Request Number - ${{ steps.cpr.outputs.pull-request-number }}"
echo "Pull Request URL - ${{ steps.cpr.outputs.pull-request-url }}"
49 changes: 49 additions & 0 deletions .github/actions/cache/action.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
name: 'Milvus Cache'
description: ''
inputs:
os:
description: 'OS name'
required: true
default: 'ubuntu20.04'
kind:
description: 'Cache kind'
required: false
default: 'all'
runs:
using: "composite"
steps:
- name: Generate CCache Hash
env:
CORE_HASH: ${{ hashFiles( 'internal/core/**/*.cpp', 'internal/core/**/*.cc', 'internal/core/**/*.c', 'internal/core/**/*.h', 'internal/core/**/*.hpp', 'internal/core/**/CMakeLists.txt') }}
run: |
echo "corehash=${CORE_HASH}" >> $GITHUB_ENV
echo "Set CCache hash to ${CORE_HASH}"
shell: bash
- name: Cache CCache Volumes
if: ${{ inputs.kind == 'all' || inputs.kind == 'cpp' }}
uses: actions/cache@v3
with:
path: .docker/amd64-${{ inputs.os }}-ccache
key: ${{ inputs.os }}-ccache-${{ env.corehash }}
restore-keys: ${{ inputs.os }}-ccache-
- name: Cache Conan Packages
if: ${{ inputs.kind == 'all' || inputs.kind == 'cpp' }}
uses: actions/cache@v3
with:
path: .docker/amd64-${{ inputs.os }}-conan
key: ${{ inputs.os }}-conan-${{ hashFiles('internal/core/conanfile.*') }}
restore-keys: ${{ inputs.os }}-conan-
- name: Cache Third Party
if: ${{ inputs.kind == 'all' || inputs.kind == 'thirdparty' }}
uses: actions/cache@v3
with:
path: .docker/thirdparty
key: ${{ inputs.os }}-thirdparty-${{ hashFiles('internal/core/thirdparty/**') }}
restore-keys: ${{ inputs.os }}-thirdparty-
- name: Cache Go Mod Volumes
if: ${{ inputs.kind == 'all' || inputs.kind == 'go' }}
uses: actions/cache@v3
with:
path: .docker/amd64-${{ inputs.os }}-go-mod
key: ${{ inputs.os }}-go-mod-${{ hashFiles('go.sum, */go.sum') }}
restore-keys: ${{ inputs.os }}-go-mod-
Loading