admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,875 Commits 137 Branches 188 Tags
Commit Graph

21875 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cai.zhang
e8970e8bf4
fix: [2.5] Update milvus key words (#40870) 
issue: #40290 
master pr: #40869

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-26 19:44:32 +08:00
aoiasd
182b3c17d0
enhance: remain raw token for audit log (#40637) (#40867) 
pr: https://github.com/milvus-io/milvus/pull/40637

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-26 14:54:18 +08:00
Gao
9c41636a95
fix: [2.5] correct WithGroupSize while reducing (#40920) 
issue: #40887 
pr: #40888

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2025-03-26 12:02:20 +08:00
zhuwenxing
8ec8a7a9c4
test: using pytest_tagging to replace pytest_tags (#40902) 
pr: https://github.com/milvus-io/milvus/pull/40878

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-26 10:46:31 +08:00
zhuwenxing
b0cc8bc9e0
test: [cherry-pick][2.5] add more restful v2 api testcases (#40915) 
pr: https://github.com/milvus-io/milvus/pull/39558

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-26 10:44:25 +08:00
zhuwenxing
99670db5e9
test: update text empty percent in go client fts test (#40010) 
pr: https://github.com/milvus-io/milvus/pull/40009

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-25 17:28:23 +08:00
Zhen Ye
53438c751d
fix: skip consuming from streaming service message (#40879) 
issue: #40532
pr: #40877

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-25 15:22:23 +08:00
cai.zhang
ec0c25aaec
fix: [2.5] As the segment size increases the number of slots should also increase (#40862) 
issue: #40858 
master pr: #39084

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-25 14:42:24 +08:00
congqixia
97fc68bf08
fix: [2.5] Set task queue time before enqueue (#40815) (#40853) 
Cherry-pick from master
pr: #40815 
Related to #40814

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-25 14:02:22 +08:00
yihao.dai
e02a3daff5
enhance: [2.5] Optimize datacoord meta mutex (#40753) 
Use a separate collection mutex.

issue: https://github.com/milvus-io/milvus/issues/40551

pr: https://github.com/milvus-io/milvus/pull/40552

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-25 13:50:21 +08:00
wt
34131d93ae
test: test mix scenes support batch insertion (#40871) 
issues: https://github.com/milvus-io/milvus/issues/40868

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2025-03-25 10:52:29 +08:00
yihao.dai
9b7d66d9da
fix: [2.5] Fix channel not balance on datanodes (#40854) 
1. Prevent channels from being assigned to only one datanode during
datacoord startup.
2. Optimize the channel assignment policy by considering newly assigned
channels.

issue: https://github.com/milvus-io/milvus/issues/40421,
https://github.com/milvus-io/milvus/issues/37630

pr: https://github.com/milvus-io/milvus/pull/40422

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-25 10:06:24 +08:00
yihao.dai
b534c9d804
enhance: [2.5] Introduce batch subscription in msgdispatcher (#40596) 
Introduce a batch subscription mechanism in msgdispatcher: the
msgdispatcher now includes a vchannel watch task queue, where all
vchannels in the queue will subscribe to the MQ only once and pull
messages from the oldest vchannel checkpoint to the latest.

issue: https://github.com/milvus-io/milvus/issues/39862

pr: https://github.com/milvus-io/milvus/pull/39863

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-24 10:18:17 +08:00
cai.zhang
d703d8dac8
fix: [2.5] Set correct default configuration for task slots (#40821) 
issue: #39101

master pr: #39084

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-23 21:28:19 +08:00
SimFG
1263505808
feat: [2.5] support to deny dll according to database property (#40784) 
- issue: #40762
- pr: #40764

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-23 11:18:28 +08:00
ThreadDao
31f9e3c789
[skip-e2e] test: enable jsonKeyStats in pulsar nightly test (#40826) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
v2.5.7 		2025-03-21 19:28:15 +08:00
congqixia
0f0cb4c189
enhance: [2.5] Close component in topological order when unsub channel (#40796) (#40819) 
Cherry-pick from master
pr: #40796

Related to #40795

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 19:12:15 +08:00
cqy123456
7c716d61dc
fix:[2.5]wrong p.InterimIndexRefineQuantType default value and reduce ut run time (#40830) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-21 19:10:13 +08:00
Bingyi Sun
d09483809c
fix: Fix tasks will panic if one of them throw an exception. (#40760) 
issue: #40690 
pr: https://github.com/milvus-io/milvus/pull/40691

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 17:50:18 +08:00
XuanYang-cn
70ad96ffb3
enhance: Upgrade PyMilvus version to 2.5.6rc5 (#40748) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-21 17:48:28 +08:00
jaime
e538d2c106
fix:etcd advertise-client-urls in docker-compose (#40805) 
issue: #40696
pr: #40804

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2025-03-21 15:50:13 +08:00
ThreadDao
635f6c5300
[GoSDK][2.5] test: Cherry-pick gosdk test commits from master branch (#40778) 
pr: #39694 #40352 #40775 #40787

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-03-21 14:30:14 +08:00
Bingyi Sun
0a1272fc6f
fix: Revert "enhance: update tantivy version (#39253)" (#40769) 
issue: #35528 
pr: #40313 
This reverts commit d3cec7f277b5f73a8acf5100eb8d744fbc476348.

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 11:24:17 +08:00
congqixia
50241e4cf9
enhance: [2.5][GoSDK] Support JSON Path index (#40754) (#40791) 
Cherry-pick from master
pr: #40754 
Related to #35528

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 10:28:13 +08:00
zhagnlu
14259a3f8a
fix:fix exception when do arith expr when using index (#40799) 
pr: #40783

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-20 19:34:49 +08:00
Xianhui Lin
8bdff401a3
fix: fix indexchecker schema released (#40809) 
pr:https://github.com/milvus-io/milvus/pull/38039
issue:https://github.com/milvus-io/milvus/issues/36995

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-20 18:05:22 +08:00
XuanYang-cn
5ca2af8124
fix: [2.5]L0 brings its own start pos when syncing (#40664) 
See also: #40388, #40207
pr: #40663

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-20 14:20:17 +08:00
Buqian Zheng
cff0e82f57
enhance: [2.5] improve sparse query nnz metric (#40714) 
add query type and field id label; add metric for hybrid search

issue: https://github.com/milvus-io/milvus/issues/35853
pr: https://github.com/milvus-io/milvus/pull/40713

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-20 14:14:21 +08:00
XuanYang-cn
281260e48a
fix: Massive memory cost when compacting (#40763) 
downloads batch binlogs instead of all segment's binlogs

See also: #40761

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-20 11:28:11 +08:00
XuanYang-cn
1a6761ac69
enhance: [cp25]Replace currRows with NumOfRows (#40074) (#40681) 
See also: #40068
pr: #40074

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-20 11:24:13 +08:00
Xianhui Lin
2710eb3fc9
fix: [2.5] Json Stats filter the data is double but the filter expr is int (#40771) 
Json Stats  filter the data is double but the filter is int 
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr:https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-19 20:22:13 +08:00
congqixia
cd8d7efc96
enhance: [2.5] Add an extra parameter for slow log (#40759) 
Cherry-pick from master
pr: #40758
Related to #40756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 18:10:13 +08:00
congqixia
d1359010d0
enhance: [2.5][GoSDK] Add README and examples for milvusclient (#40747) 
Cherry-pick from master
pr: #40630 #40643
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 18:02:18 +08:00
sre-ci-robot
38127e2c76
[automated] Bump milvus version to v2.5.7 (#40770) 
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-19 18:00:24 +08:00
cai.zhang
0cfe835cac
enhance: [2.5] Support slot for index task and stats task (#40288) 
issue: #39101 

master pr: #39084

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-19 16:50:11 +08:00
congqixia
e49294cd16
enhance: [2.5] Add buffer forwarder for stream delta loading (#40559) (#40699) 
Cherry-pick from master
pr: #40559
See also #40558
Related to #35303 & #38066 as well

This PR:
- Add `BufferedForward` to limit memory usage forwarding stream delete
- Add `UseLoad` flag to determine `Delete` shall use `segment.Delete` or
`segment.LoadDelta`
- Fix delegator accidentally use always true candidate while load
streaming delta

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 10:28:14 +08:00
Buqian Zheng
667fc7f91d
fix: [2.5] use NewInsertDataWithFunctionOutputField when importing binlog file (#40742) 
issue: https://github.com/milvus-io/milvus/issues/40740
pr: https://github.com/milvus-io/milvus/pull/40741

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-19 00:22:34 +08:00
Xianhui Lin
78f3d69a2f
fix: jsonstats Negative numbers cannot be filtered out (#40734) 
fix: jsonstats Negative numbers cannot be filtered out
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
pkg/v2.5.7 		2025-03-18 22:35:53 +08:00
Chun Han
aebbfc7c7b
fix: mmap properties failed to apply when creating collection(#40511) (#40515) 
related: #40511
pr: https://github.com/milvus-io/milvus/pull/40512

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-03-18 22:05:19 +08:00
cai.zhang
d4e2f581f9
fix: [2.5] Do not delete the centroids file when sampling fails instead wait GC (#40702) 
issue: #40700 

pr: #40701

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-18 22:00:20 +08:00
yihao.dai
aca9dd9105
fix: [2.5] Fix messages loss during seek (#40736) 
issue: https://github.com/milvus-io/milvus/issues/40733

pr: https://github.com/milvus-io/milvus/pull/40735

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-18 21:56:33 +08:00
congqixia
6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 (#40728) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:58:15 +08:00
congqixia
8de5174e4d
fix: [2.5] Remove lag targets after main dispatcher (#40717) 
Related to #40716

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:10:34 +08:00
cqy123456
2fbfd86146
fix:[2.5]fix growing index ut (#40724) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-18 19:04:15 +08:00
Xianhui Lin
705b3c90a5
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when enable JsonKeyStats (#40661) 
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when
enable JsonKeyStats.The reason is that the file path of the jsonkeyindex
has changed.
issue: https://github.com/milvus-io/milvus/issues/40649
，https://github.com/milvus-io/milvus/issues/40669
https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-18 17:32:16 +08:00
zhagnlu
e47682aa55
fix:add clear bitmap input for every batch loop (#40722) 
#40685
cherry-pick part from pr: #39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-18 17:27:02 +08:00
congqixia
162cfb4609
fix: [2.5] Protect getSegmentIndexes with rlock (#40720) 
Cherry-pick from master
pr: #40719
Related to #40718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 16:40:47 +08:00
Zhen Ye
167d058682
enhance: remove redundant resource key watch operation, just keep consistency of wal (#40503) 
issue: #38399
pr: #40235

related PR: #39522

- Just implement exclusive broadcaster between broadcast message with
same resource key to keep same order in different wal.
- After simplify the broadcast model, original watch-based broadcast is
too complicated and redundant, remove it.
- Add metrics for broadcast.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-18 15:46:25 +08:00
zhuwenxing
d9635c6f86
test: [cherry-pick]add empty sparse in import test (#40683) 
pr: https://github.com/milvus-io/milvus/pull/40682

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-18 15:18:13 +08:00
foxspy
0dc4b73c81
fix: [2.5] avoid segmentation faults caused by retrieving empty vector datasets (#40546) 
issue: #40544 
pr: #40545

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-03-18 14:58:13 +08:00