admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,861 Commits 146 Branches 196 Tags
Commit Graph

21861 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
SimFG
1263505808
feat: [2.5] support to deny dll according to database property (#40784) 
- issue: #40762
- pr: #40764

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-23 11:18:28 +08:00
ThreadDao
31f9e3c789
[skip-e2e] test: enable jsonKeyStats in pulsar nightly test (#40826) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
v2.5.7 		2025-03-21 19:28:15 +08:00
congqixia
0f0cb4c189
enhance: [2.5] Close component in topological order when unsub channel (#40796) (#40819) 
Cherry-pick from master
pr: #40796

Related to #40795

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 19:12:15 +08:00
cqy123456
7c716d61dc
fix:[2.5]wrong p.InterimIndexRefineQuantType default value and reduce ut run time (#40830) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-21 19:10:13 +08:00
Bingyi Sun
d09483809c
fix: Fix tasks will panic if one of them throw an exception. (#40760) 
issue: #40690 
pr: https://github.com/milvus-io/milvus/pull/40691

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 17:50:18 +08:00
XuanYang-cn
70ad96ffb3
enhance: Upgrade PyMilvus version to 2.5.6rc5 (#40748) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-21 17:48:28 +08:00
jaime
e538d2c106
fix:etcd advertise-client-urls in docker-compose (#40805) 
issue: #40696
pr: #40804

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2025-03-21 15:50:13 +08:00
ThreadDao
635f6c5300
[GoSDK][2.5] test: Cherry-pick gosdk test commits from master branch (#40778) 
pr: #39694 #40352 #40775 #40787

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-03-21 14:30:14 +08:00
Bingyi Sun
0a1272fc6f
fix: Revert "enhance: update tantivy version (#39253)" (#40769) 
issue: #35528 
pr: #40313 
This reverts commit d3cec7f277b5f73a8acf5100eb8d744fbc476348.

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 11:24:17 +08:00
congqixia
50241e4cf9
enhance: [2.5][GoSDK] Support JSON Path index (#40754) (#40791) 
Cherry-pick from master
pr: #40754 
Related to #35528

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 10:28:13 +08:00
zhagnlu
14259a3f8a
fix:fix exception when do arith expr when using index (#40799) 
pr: #40783

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-20 19:34:49 +08:00
Xianhui Lin
8bdff401a3
fix: fix indexchecker schema released (#40809) 
pr:https://github.com/milvus-io/milvus/pull/38039
issue:https://github.com/milvus-io/milvus/issues/36995

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-20 18:05:22 +08:00
XuanYang-cn
5ca2af8124
fix: [2.5]L0 brings its own start pos when syncing (#40664) 
See also: #40388, #40207
pr: #40663

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-20 14:20:17 +08:00
Buqian Zheng
cff0e82f57
enhance: [2.5] improve sparse query nnz metric (#40714) 
add query type and field id label; add metric for hybrid search

issue: https://github.com/milvus-io/milvus/issues/35853
pr: https://github.com/milvus-io/milvus/pull/40713

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-20 14:14:21 +08:00
XuanYang-cn
281260e48a
fix: Massive memory cost when compacting (#40763) 
downloads batch binlogs instead of all segment's binlogs

See also: #40761

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-20 11:28:11 +08:00
XuanYang-cn
1a6761ac69
enhance: [cp25]Replace currRows with NumOfRows (#40074) (#40681) 
See also: #40068
pr: #40074

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-20 11:24:13 +08:00
Xianhui Lin
2710eb3fc9
fix: [2.5] Json Stats filter the data is double but the filter expr is int (#40771) 
Json Stats  filter the data is double but the filter is int 
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr:https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-19 20:22:13 +08:00
congqixia
cd8d7efc96
enhance: [2.5] Add an extra parameter for slow log (#40759) 
Cherry-pick from master
pr: #40758
Related to #40756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 18:10:13 +08:00
congqixia
d1359010d0
enhance: [2.5][GoSDK] Add README and examples for milvusclient (#40747) 
Cherry-pick from master
pr: #40630 #40643
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 18:02:18 +08:00
sre-ci-robot
38127e2c76
[automated] Bump milvus version to v2.5.7 (#40770) 
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-19 18:00:24 +08:00
cai.zhang
0cfe835cac
enhance: [2.5] Support slot for index task and stats task (#40288) 
issue: #39101 

master pr: #39084

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-19 16:50:11 +08:00
congqixia
e49294cd16
enhance: [2.5] Add buffer forwarder for stream delta loading (#40559) (#40699) 
Cherry-pick from master
pr: #40559
See also #40558
Related to #35303 & #38066 as well

This PR:
- Add `BufferedForward` to limit memory usage forwarding stream delete
- Add `UseLoad` flag to determine `Delete` shall use `segment.Delete` or
`segment.LoadDelta`
- Fix delegator accidentally use always true candidate while load
streaming delta

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 10:28:14 +08:00
Buqian Zheng
667fc7f91d
fix: [2.5] use NewInsertDataWithFunctionOutputField when importing binlog file (#40742) 
issue: https://github.com/milvus-io/milvus/issues/40740
pr: https://github.com/milvus-io/milvus/pull/40741

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-19 00:22:34 +08:00
Xianhui Lin
78f3d69a2f
fix: jsonstats Negative numbers cannot be filtered out (#40734) 
fix: jsonstats Negative numbers cannot be filtered out
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
pkg/v2.5.7 		2025-03-18 22:35:53 +08:00
Chun Han
aebbfc7c7b
fix: mmap properties failed to apply when creating collection(#40511) (#40515) 
related: #40511
pr: https://github.com/milvus-io/milvus/pull/40512

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-03-18 22:05:19 +08:00
cai.zhang
d4e2f581f9
fix: [2.5] Do not delete the centroids file when sampling fails instead wait GC (#40702) 
issue: #40700 

pr: #40701

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-18 22:00:20 +08:00
yihao.dai
aca9dd9105
fix: [2.5] Fix messages loss during seek (#40736) 
issue: https://github.com/milvus-io/milvus/issues/40733

pr: https://github.com/milvus-io/milvus/pull/40735

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-18 21:56:33 +08:00
congqixia
6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 (#40728) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:58:15 +08:00
congqixia
8de5174e4d
fix: [2.5] Remove lag targets after main dispatcher (#40717) 
Related to #40716

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:10:34 +08:00
cqy123456
2fbfd86146
fix:[2.5]fix growing index ut (#40724) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-18 19:04:15 +08:00
Xianhui Lin
705b3c90a5
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when enable JsonKeyStats (#40661) 
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when
enable JsonKeyStats.The reason is that the file path of the jsonkeyindex
has changed.
issue: https://github.com/milvus-io/milvus/issues/40649
，https://github.com/milvus-io/milvus/issues/40669
https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-18 17:32:16 +08:00
zhagnlu
e47682aa55
fix:add clear bitmap input for every batch loop (#40722) 
#40685
cherry-pick part from pr: #39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-18 17:27:02 +08:00
congqixia
162cfb4609
fix: [2.5] Protect getSegmentIndexes with rlock (#40720) 
Cherry-pick from master
pr: #40719
Related to #40718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 16:40:47 +08:00
Zhen Ye
167d058682
enhance: remove redundant resource key watch operation, just keep consistency of wal (#40503) 
issue: #38399
pr: #40235

related PR: #39522

- Just implement exclusive broadcaster between broadcast message with
same resource key to keep same order in different wal.
- After simplify the broadcast model, original watch-based broadcast is
too complicated and redundant, remove it.
- Add metrics for broadcast.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-18 15:46:25 +08:00
zhuwenxing
d9635c6f86
test: [cherry-pick]add empty sparse in import test (#40683) 
pr: https://github.com/milvus-io/milvus/pull/40682

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-18 15:18:13 +08:00
foxspy
0dc4b73c81
fix: [2.5] avoid segmentation faults caused by retrieving empty vector datasets (#40546) 
issue: #40544 
pr: #40545

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-03-18 14:58:13 +08:00
Bingyi Sun
b0078ceae3
fix: Fix json test (#40710) 
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/40671

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-18 12:52:13 +08:00
cqy123456
b8abd91962
enhance[2.5]: add more config for interimIndex to support more refine mode (#40429) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-17 22:04:12 +08:00
XuanYang-cn
f455923ac9
enhance: Use correct counter metrics for overall wa calculation (#40394) (#40679) 
pr: #40394

- Use CounterVec to calculate sum of increase during a time period.
- Use entries number instead of binlog size

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-17 15:06:19 +08:00
XuanYang-cn
d457ccc0e8
enhance: [25]Log start position of delete msgs (#40315) (#40678) 
pr: #40315

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-17 15:02:09 +08:00
Bingyi Sun
9145885f40
enhance: Record simdjson error (#40671) 
issue: #35528
pr: #40647

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-15 12:48:08 +08:00
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter (#40648) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-14 21:36:10 +08:00
Bingyi Sun
0a3435f53a
fix: Fix null offset loading in inverted index (#40524) 
issue: #40516 
pr: https://github.com/milvus-io/milvus/pull/40523

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-14 18:32:09 +08:00
Gao
09f7a60fe1
enhance: [2.5] make segment prune config refreshable (#40632) 
pr: #40539

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2025-03-14 16:12:09 +08:00
SimFG
a3c60a03b5
feat: [2.5] add DDLDB rate type and related quota configurations (#40653) 
- issue: #40650
- pr: #40651

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-14 15:36:17 +08:00
zhagnlu
6b9e141ada
enhance: reorder sub expr for conjunct expr (#40186) 
pr:#39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-14 15:16:08 +08:00
congqixia
d8a2c1a907
enhance: [2.5] Add channel seal policy based on blocking l0 (#40505) (#40535) 
Cherry-pick from 2.5
pr: #40505
Related to #40502

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-14 10:02:12 +08:00
cai.zhang
bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo (#40466) 
issue: #40341 

master pr: #40464

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-14 00:14:08 +08:00
Bingyi Sun
33e9db1539
fix: cherry pick json prs (#40621) 
issue: #35528 
pr: #40604 
this pr includes some prs:
1. #40604 
2. #40611 
3. #40619

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-13 20:36:10 +08:00
Xianhui Lin
f5e9dea2aa
fix: [2.5]fix the garbage cleanup logic of jsonkey stats && improve json key stats filer (#40039) 
fix: fix the garbage collection cleanup logic of jsonkey stats &&
improve json key stats filer
issue: https://github.com/milvus-io/milvus/issues/36995
https://github.com/milvus-io/milvus/issues/40034
https://github.com/milvus-io/milvus/issues/40041
https://github.com/milvus-io/milvus/issues/40106
https://github.com/milvus-io/milvus/issues/40138
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-13 20:18:10 +08:00