22122 Commits

Author SHA1 Message Date
congqixia
3efb0366f8
fix: [2.5] OR binary expr is prunable only when both children are prunable (#42912) (#42915)
Cherry-pick from master
pr: #42912 
Related to #42903

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-06-24 17:30:42 +08:00
Spade A
017eb9ffe2
fix: fix some bugs discovered by chaos tests --- cherry pick (#42909)
master: https://github.com/milvus-io/milvus/pull/42906
issue: https://github.com/milvus-io/milvus/issues/42870

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-24 17:10:42 +08:00
congqixia
1e55112de7
enhance: [2.5] Fill dbName for OperatePrivilegeV2Request in interceptor (#42898) (#42904)
Cherry-pick from master
pr: #42898

Related to #40340

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-06-24 10:08:41 +08:00
zhagnlu
c88f1be985
fix:fix wrong use return error for parse unsupported arith (#42729) (#42890)
pr: #42729

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-06-23 20:36:46 +08:00
zhagnlu
00549c0729
fix:reject div or mod by zero for binaryarith expr (#42691) (#42887)
pr: #42691

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-06-23 20:34:50 +08:00
nico
c39ea71638
test: update nightly script (#42868)
pr: #41782

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-06-23 18:40:41 +08:00
zhuwenxing
591d7cc51a
test: [cp2.5]add negative import case (#42883)
pr: https://github.com/milvus-io/milvus/pull/42100

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-06-23 18:38:41 +08:00
cai.zhang
513ff7d331
enhance: [2.5] Skip modify field meta when rename collection or rename dbName (#42876)
issue: #42873 

master pr: #42875

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-23 18:24:43 +08:00
Bingyi Sun
1a1d46d695
fix: Remove cached null expr result (#42783)
pr: https://github.com/milvus-io/milvus/pull/42818
issue: #42698
cached result may be changed in caller so there is no need to cache it

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-23 16:02:42 +08:00
aoiasd
f3e8f61f60
enhance: [GoSDK]support run analyzer by collection field (#42642) (#42812)
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42642

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-23 15:42:41 +08:00
cai.zhang
78b66a29b6
fix: [2.5] Reduce task slot for standalone to 1/4 of normal datanode (#42809)
issue: #42129 

master pr: #42808

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-20 16:38:46 +08:00
Spade A
79ffc17bfe
enhance: optimize tantivy cargo config cherry-pick (#42881)
master: https://github.com/milvus-io/milvus/pull/42880
issue: https://github.com/milvus-io/milvus/issues/42879

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-20 16:18:11 +08:00
Zhen Ye
30b2a66f59
fix: rocksmq cannot graceful stop (#42843)
issue: #40532
pr: #42841

Signed-off-by: chyezh <chyezh@outlook.com>
2025-06-19 22:18:40 +08:00
Spade A
b837fb2d1e
fix: update tantivy for fixing threads explosion in file watcher (#42828)
master pr: #41450

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-18 15:40:40 +08:00
cai.zhang
e30fc0fbaf
enhance: [2.5] Make Web UI toggleable via config (#42815)
issue: #42813

master pr: #42814

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-18 12:20:39 +08:00
zhuwenxing
95ac0415c4
test:[skip e2e][cp2.5]remove tls connection (#42800)
pr: https://github.com/milvus-io/milvus/pull/42799

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-06-18 10:34:43 +08:00
Chun Han
c403f01e6d
enhance: avoid using threadpool when column is ready in chunk cache(#42803) (#42804)
related: #42803

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-06-18 02:44:40 +08:00
Spade A
77bcd1dac0
fix: update tantivy for solving threads exposion for tantivy (#42713)
update tantivy: https://github.com/zilliztech/tantivy/pull/16

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-06-17 16:01:01 +08:00
nico
f19349e514
test: fix connection errror of BulkInsert nightly (#42796)
pr: #42805

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-06-17 15:28:39 +08:00
aoiasd
98fe28d0ef
fix: [2.5] flow graph should free function resource after all node close (#42731) (#42775)
pr: https://github.com/milvus-io/milvus/pull/42731

relate: https://github.com/milvus-io/milvus/issues/42730

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-17 14:40:39 +08:00
yihao.dai
f978641d6a
enhance: [2.5] Enhance import integration tests and logs (#42696)
1. Optimize the import process: skip subsequent steps and mark the task
as complete if the number of imported rows is 0.
2. Improve import integration tests:
a. Add a test to verify that autoIDs are not duplicated
b. Add a test for the corner case where all data is deleted
c. Shorten test execution time
3. Enhance import logging:
a. Print imported segment information upon completion
b. Include file name in failure logs

issue: https://github.com/milvus-io/milvus/issues/42488,
https://github.com/milvus-io/milvus/issues/42518

pr: https://github.com/milvus-io/milvus/pull/42612

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-16 20:06:38 +08:00
Xianhui Lin
0605d71826
fix: [2.5]datacoord stop get stuck After upgrading from 2.5 to 2.6 (#42669)
datacoord stop get stuck After upgrading from 2.5 to 2.6
pr:https://github.com/milvus-io/milvus/pull/42674
issue:https://github.com/milvus-io/milvus/issues/42656

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-06-16 19:56:38 +08:00
Spade A
94005f8e01
enhance: tantivy collector set bitset directly cp-39748 (#42694)
issue: https://github.com/milvus-io/milvus/issues/39755
pr: #39748
It also cherry-pick #40608

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-16 16:58:40 +08:00
congqixia
3d58b2ecee
fix: [2.5] Make controller wait checker worker quit (#42704) (#42726)
Cherry-pick from master
pr: #42704
Related to #42702

This patch add wait logic for `CheckerController` 
Nil check already exists due to code branching

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-06-16 15:14:38 +08:00
nico
3b3f25d074
test: update sdk version and cases[2.5] (#42603)
pr: #42077

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-06-16 10:32:37 +08:00
cai.zhang
4d6c57affe
fix: [2.5] Add precheck for unsupport datatype cast (#42678)
issue: #42527 
master pr: #42677

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-13 18:18:37 +08:00
cai.zhang
bcb6566c6a
fix: [2.5] Unsorted small segments should not be considered as indexed (#42615)
issue: #42143 
master pr: #42614

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-13 18:16:46 +08:00
yihao.dai
01d408e451
enhance: [2.5] Replace pointer-based map key with id in garbage collector (#42654)
issue: https://github.com/milvus-io/milvus/issues/42592

pr: https://github.com/milvus-io/milvus/pull/42647

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-13 16:58:38 +08:00
aoiasd
5110130b2e
enhance: add segment bm25 stats local cache (#41775) (#42646)
relate: https://github.com/milvus-io/milvus/issues/41424
pr: https://github.com/milvus-io/milvus/pull/41775

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-13 16:50:37 +08:00
congqixia
9db6228464
enhance: [GoSDK][2.5] Cherry-pick go client 2.5.4 commits and bump version (#42708)
Cherry-pick from master
pr: #41356 #41674

Co-authored-by: Mario Camou <mcamou@users.noreply.github.com>
Co-authored-by: ThreadDao <yufen.zong@zilliz.com>

---------

Signed-off-by: mcamou <mcamou@users.noreply.github.com>
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Mario Camou <mcamou@users.noreply.github.com>
Co-authored-by: ThreadDao <yufen.zong@zilliz.com>
client/v2.5.4
2025-06-13 14:14:36 +08:00
yihao.dai
2da19b3166
enhance: [2.5] Optimize memory usage during garbage collection (#42631)
Defer clone and decompress operations until just before removing from
meta, instead of eagerly applying them to all segments in advance.

issue: https://github.com/milvus-io/milvus/issues/42592

pr: https://github.com/milvus-io/milvus/pull/42593

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-13 03:06:37 +08:00
zhuwenxing
46920da0f3
test: [cp2.5]add default user and pwd (#42591)
pr: https://github.com/milvus-io/milvus/pull/42590

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-06-12 10:36:43 +08:00
aoiasd
35252ffbae
enhance: [2.5] use english name as language name for all type language identifier (#42601)
Set whatlang detect return language name as english name.
Make sure same with lingua. 
pr: https://github.com/milvus-io/milvus/pull/42600

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-11 14:40:37 +08:00
aoiasd
f755fbd553
enhance: [2.5] support print nq and params for search and query (#42545)
relate: https://github.com/milvus-io/milvus/issues/41801
pr: https://github.com/milvus-io/milvus/pull/41802
https://github.com/milvus-io/milvus/pull/42546

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-11 14:38:47 +08:00
aoiasd
40ecaa6061
fix:[2.5] add concurrency and close protect for bm25 function (#42599)
relate: https://github.com/milvus-io/milvus/issues/42576
pr: https://github.com/milvus-io/milvus/pull/42597

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-10 14:18:35 +08:00
groot
f2774e3c5b
enhance: [2.5] bulkinsert handles nullable/default (#42072)
issue: https://github.com/milvus-io/milvus/issues/42096,
https://github.com/milvus-io/milvus/issues/42130
pr: https://github.com/milvus-io/milvus/pull/42127

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-06-10 11:50:35 +08:00
congqixia
6fa877a0dc
enhance: [2.5] Set thread name for segcore thread pool (#42596)
Cherry-pick from master
pr: #42017 #42497

Thread name could be helpful when debugging thread explosion issues

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-06-10 11:08:35 +08:00
XuanYang-cn
0f0e45af9b
enhance: Upgrade pymilvus to 2.5.11rc7 (#42458)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-06-10 10:58:34 +08:00
Zhen Ye
edca441eae
fix: filter the streaming query node from resource group when upgrading (#42594)
issue: #42492
pr: #38677

- filter the streaming query node out from 2.6.0, avoid to load sealed
segment on streaming query node.

Signed-off-by: chyezh <chyezh@outlook.com>
2025-06-09 22:10:35 +08:00
Bingyi Sun
a32b55ed71
enhance: support auto index type for json index (#42161)
issue: #42070 
pr: #42071

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-09 21:20:34 +08:00
sre-ci-robot
1ca65c8243
[automated] Bump milvus version to v2.5.13 (#42605)
Bump milvus version to v2.5.13
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-06-09 16:28:39 +08:00
Buqian Zheng
3915ecacee
fix: pipeline/delegator leak (#42583)
the manager's logging lambda should not capture the pipeline object

this creates a circular reference between the manager and the pipeline
object, making it impossible for both to be GC-ed.

issue: https://github.com/milvus-io/milvus/issues/42581
pr: https://github.com/milvus-io/milvus/pull/42582

Signed-off-by: Buqian Zheng <buqianzheng@Buqians-MacBook-Air.local>
Co-authored-by: Buqian Zheng <buqianzheng@Buqians-MacBook-Air.local>
v2.5.13
2025-06-07 02:06:33 +08:00
wei liu
f06de7eca6
fix: Fix delegator selection logic in releaseSegment (#42572)
issue: #42568
Fix incorrect delegator selection during segment release process which
introduced by pr #42410

- Add serviceable filter to prioritize available shard leaders
- Fix fallback logic with channel-specific lookup
- Add early return when no leader found
- Add comprehensive unit tests for all scenarios

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-06-06 19:24:33 +08:00
Bingyi Sun
97fcc1586c
fix: [2.5] Fix the bug of valid data write corruption (#42555)
issue: https://github.com/milvus-io/milvus/issues/42554
pr: https://github.com/milvus-io/milvus/pull/42556

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-06 19:22:43 +08:00
Bingyi Sun
f61e13fb2d
fix: Check cast type is array for json contains expr (#42185)
issue: https://github.com/milvus-io/milvus/issues/42181
pr: #42184

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-06 11:00:33 +08:00
Buqian Zheng
44f96680fa
enhance: [2.5] update maintainers (#42558)
pr: https://github.com/milvus-io/milvus/pull/42539

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-06-05 21:22:34 +08:00
Bingyi Sun
532f10f343
enhance: Support cast function for json index (#42504)
issue: #41948
pr: #41949

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-05 20:26:33 +08:00
yihao.dai
28aa364bf7
enhance: [2.5] Adjust default import buffer size (#42542)
Increase insert buffer size from 16MB to 64MB, while keeping delete
buffer size at 16MB.

issue: https://github.com/milvus-io/milvus/issues/42518

pr: https://github.com/milvus-io/milvus/pull/42541

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-05 18:46:33 +08:00
yihao.dai
72a8777c9d
enhance: [2.5] Accelerate dispatcher building (#42544)
Reduce check interval to accelerate dispatcher building.

issue: https://github.com/milvus-io/milvus/issues/42067

pr: https://github.com/milvus-io/milvus/pull/42500

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-05 18:16:33 +08:00
Zhen Ye
a55c371261
fix: querynode upgrade from 2.5 get stucked (#42503)
issue: #42492
pr: #42502

- querynode graceful stop can be done if there's only L0 segment exists.

Signed-off-by: chyezh <chyezh@outlook.com>
2025-06-05 15:56:33 +08:00