21949 Commits

Author SHA1 Message Date
congqixia
55b37c3bb6
enhance: Bump milvus & proto version to v2.5.10 (#41328)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-15 19:50:32 +08:00
foxspy
bbc715f43e
fix: [2.5] update knowhere version to fix mac build (#41315)
issue: #41314

Signed-off-by: xianliang <xianliang.li@zilliz.com>
2025-04-15 19:36:32 +08:00
zhagnlu
2aae9caca9
enhance: use scan mode for like although inverted index exists (#41309)
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-15 18:36:32 +08:00
cai.zhang
3e06b2c9e7
fix: [2.5] Fix panic with nil pointer dereference when get indexed segment (#41299)
issue: #41288 
master pr: #41297

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-15 18:08:32 +08:00
Spade A
699f8a6ada
fix: [2.5] change log info to debug for collection ref (#41269)
master: https://github.com/milvus-io/milvus/pull/41267
issue: https://github.com/milvus-io/milvus/issues/41268

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-15 17:28:31 +08:00
cai.zhang
04eae0b0f2
fix: [2.5] Close client before remove worker client (#41254)
issue: #41252 

master pr: #41253

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-15 10:28:53 +08:00
Chun Han
afc0ca77e4
enhance: Optimize index format for improved load performance (#41041)
related: #40838
pr: https://github.com/milvus-io/milvus/pull/40839

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-04-15 07:07:38 +08:00
zhagnlu
2498eb0691
enhance: add optimize for like expr (#41222)
pr: #41066  cherry-pick from master

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-14 21:06:32 +08:00
sre-ci-robot
f2e15a43f0
[automated] Bump milvus version to v2.5.9 (#41258)
Bump milvus version to v2.5.9
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-04-11 20:48:37 +08:00
congqixia
b073112e16
enhance: [2.5][Restful] Make default timeout configurable (#41211) (#41225)
Cherry-pick from master
pr: #41211

The restful API default timeout was hard-coded. This PR make this
timeout value configurable via paramtable.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-11 13:12:27 +08:00
congqixia
89a1159ed5
enhance: [2.5][GoSDK] Cherry-pick commits and bump version to 2.5.2 (#41235)
Cherry-pick from master
pr: #41161 #41197 #41234

Related to #41108 #40928

Also this PR bump milvusclient go SDK version to v2.5.2

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
client/v2.5.2
2025-04-11 13:02:26 +08:00
congqixia
de6687e27d
fix: [2.5] Remove noexcept from CacheIndexToDiskInternal (#41221)
Related to #41219

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
v2.5.9 pkg/v2.5.9
2025-04-10 17:18:26 +08:00
wei liu
2e8445c2ef
fix: balance checker may enter infinite normal balance loop after balance suspension (#41196)
issue: #41194 
pr: #41195
- Refactor hasUnbalancedCollection flag handling to function scope
- Ensure tracking sets clearance when no balance needed
- Add deferred cleanup for both normal/stopping balance paths
- Add unit tests for collection tracking scenarios

The changes ensure tracking sets (normalBalanceCollectionsCurrentRound
and stoppingBalanceCollectionsCurrentRound) are properly cleared when:
- All collections in current round are balanced
- Balance checks return early due to unready targets
- Balance feature flags are disabled

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-04-10 15:18:28 +08:00
Bingyi Sun
daa910af6f
fix: Use int32 when creating array index for element type int8/int16 (#41186)
issue: #41172 
pr: #41185 
Elements with type int8 or int16 in Array is encoded using int32, so we
should parse it as int32 when creating index.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-10 11:08:26 +08:00
sthuang
b7858d24a0
fix: [2.5] show collections support custom privilege groups granted objects (#41204)
cherry-pick from master: https://github.com/milvus-io/milvus/pull/41203
related: https://github.com/milvus-io/milvus/issues/41200

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-04-10 10:54:26 +08:00
yanliang567
409721d9e7
test: [cherry-pick] gen collection name by testcase name (#41193)
related issue: #40698 
pr: #41170

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-04-09 22:52:27 +08:00
SimFG
4d813c48d2
fix: [2.5] get replicate channel position (#41189)
- issue: #41187
- pr: #41188

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-09 20:52:26 +08:00
cai.zhang
23c86af730
fix: [2.5] Revert add a sign (positive or negative) to constants (#41192)
issue: #41174
master pr: #41191

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-09 20:06:27 +08:00
congqixia
7001474914
fix: [2.5][RESTFUL] Return error when writer body closed (#41184)
Cherry-pick from master
pr: #41183
Related to #41181

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 19:37:09 +08:00
zhagnlu
77e6404617
fix:add clear bitmap for batch skip mode (#41165)
pr: #41166

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-09 12:02:26 +08:00
congqixia
d75596456a
enhance: [2.5] Rectify client_request_id logic (#41089) (#41149)
Cherry-pick from master
pr: #41089 
The traceID is not initialized by client_request_id in context. If the
client sent valid traceID, milvus log will print two different traceID
which is wierd.

This PR add the logic to tray parsing incoming `client_request_id` into
traceID. If it works just use it the request traceID, otherwise set it
to a different field named `client_request_id`.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 10:26:27 +08:00
zhagnlu
fe88a243d1
fix: fix remove index type failed when remote storage is local mode (#41163)
pr: #41164

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-09 10:14:27 +08:00
congqixia
8c52fbfe0d
fix: [2.5] Use element_type for Array is null operator (#41158)
Cherry-pick from master
pr: #41157

Related to #41156

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 02:08:26 +08:00
liliu-z
cb0f984155
enhance: Revert "separate for index completed (#40873)" (#41152)
This reverts commit 23e579e3240a30397f05f5b308be687f6f16b013. #40873

issue: #39519

Signed-off-by: Li Liu <li.liu@zilliz.com>
2025-04-08 17:36:30 +08:00
wei liu
ea2b40a79d
fix: remove metrics reset calls to ensure accurate reporting (#41081)
issue: #41048
pr: #41049
Fixes issue introduced in PR #33522 where metric resets caused
incomplete data collection by monitoring systems.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-04-08 11:38:36 +08:00
binbin
cc1b0a8cdb
test: Fix test cases for part of json path index (#41132)
related pr: #41016

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-04-08 11:04:25 +08:00
Bingyi Sun
9eb74d7418
fix: Fix the bug that null data can not filtered by null expr (#41135)
issue: #41063 
pr: #41124

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-08 00:26:26 +08:00
congqixia
281a4b0300
fix: [2.5] Ignore growing segment without start pos for seal policy (#41131)
Cherry-pick from master
pr: #41130
Related to #41129

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 23:42:27 +08:00
cai.zhang
64255e229a
fix: [2.5] Correctly parse the minimum value of int64 (#41010)
issue: #40729 
master pr: #41009 

Current approach to parse negative numbers is first parse the numeric
part and then multiply the result by -1(mainly to distinguish the
precedence of the negative sign and the subtraction operator). However,
for the minimum value of int64(`-9223372036854775808`), the value
`9223372036854775808` already exceeds the representable range of int64.
As a result, parsing error occurs.
Therefore, use a specific rule to match `-9223372036854775808`.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-07 23:06:27 +08:00
congqixia
c5f87c1b6d
fix: [2.5] Avoid update original search/query request (#41127)
Cherry-pick from master
pr: #41126
Related to #41034

Recent pr #40842 introduced logic to avoid requery pk column, which
updates the original request which makes the request not equavilant to
the original one.

When retry happens due to incomplete request error, this change makes
the final result set lacks the pk column even when user specifies it
explicitly.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 22:13:29 +08:00
congqixia
d679195a5a
enhance: Bump milvus & proto version to v2.5.9 (#41144)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 20:37:35 +08:00
cai.zhang
0db5e0c4f6
enhance: [2.5]Deprecate disk params about indexing (#41078)
issue: #40863 

master pr: #41045

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-07 11:36:34 +08:00
Chun Han
23e579e324
separate for index completed (#40873)
related: https://github.com/milvus-io/milvus/issues/40781

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-04-05 10:20:24 +08:00
congqixia
618054d836
enhance: [2.5] Use %v for missing id log (#41036) (#41090)
Cherry-pick from master
pr: #41036
`incomplete query result, missing id %!s(int64=348), len(searchIDs) =
10, len(queryIDs) = 9` error message format with error
when missing id is int64

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-03 18:52:23 +08:00
nico
e4782b95a0
test: update test cases (#41080)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-04-03 15:54:29 +08:00
wt
a47bb93c58
test: [cp] add more varchar expressions for query (#41083)
pr: https://github.com/milvus-io/milvus/pull/39122

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2025-04-03 14:36:22 +08:00
binbin
0f247c469e
test: [cherry-pick-2.5] Add test cases for json path index (#41074)
related pr: #41016

---------

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-04-03 13:02:27 +08:00
Zhen Ye
8065c801f2
fix: segv if the LoadArrowReaderFromRemote run at the exception path (#41071)
issue: #41067
pr: #41069

Signed-off-by: chyezh <chyezh@outlook.com>
2025-04-03 02:14:21 +08:00
wei liu
37a533fe6d
fix: [2.5] Address manual balance and balance check issues (#41038)
issue: #37651
pr: #41037
- Fix context propagation for manual balance segment task creation from
PR #38080.
- Optimize stopping balance by preventing redundant checks per round,
addressing performance regression from PR #40297.
- Decrease default `checkBalanceInterval` from 3000ms to 300ms.
- Correct minor log messages in `BalanceChecker`.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-04-03 01:26:23 +08:00
Xianhui Lin
249d5b9b41
fix: jsonstats check if cache schema is nil lazy describecollection (#41068)
fix: jsonstats check if cache schema is nil lazy describecollection
pr:https://github.com/milvus-io/milvus/pull/38039
issue:https://github.com/milvus-io/milvus/issues/36995

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-03 00:32:21 +08:00
zhagnlu
5be9cebd67
fix: fix compare two column move cursor bug (#41054)
#41033

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-02 20:08:21 +08:00
Bingyi Sun
240f766511
fix: Align brute force search with json index for exists expr (#41056)
issue: #35528 
pr: #41004

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-02 18:28:23 +08:00
cqy123456
5017e9ab8c
fix:[2.5]Inserting null and non-null array at the same time will cause milvus crash when growing mmap open (#41052)
issue: https://github.com/milvus-io/milvus/issues/40981
master pr: https://github.com/milvus-io/milvus/pull/41051

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-04-02 17:58:21 +08:00
Spade A
05c01070c6
fix: fix arm64 compile issue (#41058)
issue: #41059

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-02 17:44:22 +08:00
Buqian Zheng
c9a354d436
enhance: [2.5] weighted reranker to allow skip score normalization (#40905)
issue: https://github.com/milvus-io/milvus/issues/40836
pr: https://github.com/milvus-io/milvus/pull/40903

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-04-02 17:30:22 +08:00
foxspy
a906466d8f
fix: [2.5]Add bypass thread pool mode to avoid growing indexes blocking insert/load (#41013)
issue: #40825 
related: #41012
pr: #41012

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-04-02 16:58:25 +08:00
zhagnlu
0d3bd3131c
fix:fix format error for json (#41031)
#41026

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-02 14:32:32 +08:00
Spade A
7945ff8784
enhance: increate tantivy index worker and memory budget for json key stats for buliding index (#40912)
issue: #40897

This PR, combined with https://github.com/milvus-io/milvus/pull/40898,
makes tantivy total duration decrease roughly
from 6.3s to 1.68s for the case in the issue.

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-02 08:23:08 +08:00
Spade A
28c1ab8a16
enhance: add documents in batch for json key stats (#40898)
issue: #40897

After this, the document add operations scheduling duration is
**decreased** roughly from **6s to 0.9s** for the case in the issue.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-02 08:22:24 +08:00
sre-ci-robot
c32259ead7
[automated] Bump milvus version to v2.5.8 (#41024)
Bump milvus version to v2.5.8
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-04-01 15:08:28 +08:00