admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,928 Commits 146 Branches 196 Tags
Commit Graph

21928 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhagnlu
fe88a243d1
fix: fix remove index type failed when remote storage is local mode (#41163) 
pr: #41164

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-09 10:14:27 +08:00
congqixia
8c52fbfe0d
fix: [2.5] Use element_type for Array is null operator (#41158) 
Cherry-pick from master
pr: #41157

Related to #41156

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-09 02:08:26 +08:00
liliu-z
cb0f984155
enhance: Revert "separate for index completed (#40873)" (#41152) 
This reverts commit 23e579e3240a30397f05f5b308be687f6f16b013. #40873

issue: #39519

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2025-04-08 17:36:30 +08:00
wei liu
ea2b40a79d
fix: remove metrics reset calls to ensure accurate reporting (#41081) 
issue: #41048
pr: #41049
Fixes issue introduced in PR #33522 where metric resets caused
incomplete data collection by monitoring systems.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-04-08 11:38:36 +08:00
binbin
cc1b0a8cdb
test: Fix test cases for part of json path index (#41132) 
related pr: #41016

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2025-04-08 11:04:25 +08:00
Bingyi Sun
9eb74d7418
fix: Fix the bug that null data can not filtered by null expr (#41135) 
issue: #41063 
pr: #41124

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-04-08 00:26:26 +08:00
congqixia
281a4b0300
fix: [2.5] Ignore growing segment without start pos for seal policy (#41131) 
Cherry-pick from master
pr: #41130
Related to #41129

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-07 23:42:27 +08:00
cai.zhang
64255e229a
fix: [2.5] Correctly parse the minimum value of int64 (#41010) 
issue: #40729 
master pr: #41009 

Current approach to parse negative numbers is first parse the numeric
part and then multiply the result by -1(mainly to distinguish the
precedence of the negative sign and the subtraction operator). However,
for the minimum value of int64(`-9223372036854775808`), the value
`9223372036854775808` already exceeds the representable range of int64.
As a result, parsing error occurs.
Therefore, use a specific rule to match `-9223372036854775808`.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-04-07 23:06:27 +08:00
congqixia
c5f87c1b6d
fix: [2.5] Avoid update original search/query request (#41127) 
Cherry-pick from master
pr: #41126
Related to #41034

Recent pr #40842 introduced logic to avoid requery pk column, which
updates the original request which makes the request not equavilant to
the original one.

When retry happens due to incomplete request error, this change makes
the final result set lacks the pk column even when user specifies it
explicitly.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-07 22:13:29 +08:00
congqixia
d679195a5a
enhance: Bump milvus & proto version to v2.5.9 (#41144) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-07 20:37:35 +08:00
cai.zhang
0db5e0c4f6
enhance: [2.5]Deprecate disk params about indexing (#41078) 
issue: #40863 

master pr: #41045

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-04-07 11:36:34 +08:00
Chun Han
23e579e324
separate for index completed (#40873) 
related: https://github.com/milvus-io/milvus/issues/40781

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-04-05 10:20:24 +08:00
congqixia
618054d836
enhance: [2.5] Use %v for missing id log (#41036) (#41090) 
Cherry-pick from master
pr: #41036
`incomplete query result, missing id %!s(int64=348), len(searchIDs) =
10, len(queryIDs) = 9` error message format with error
when missing id is int64

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-03 18:52:23 +08:00
nico
e4782b95a0
test: update test cases (#41080) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-04-03 15:54:29 +08:00
wt
a47bb93c58
test: [cp] add more varchar expressions for query (#41083) 
pr: https://github.com/milvus-io/milvus/pull/39122

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2025-04-03 14:36:22 +08:00
binbin
0f247c469e
test: [cherry-pick-2.5] Add test cases for json path index (#41074) 
related pr: #41016

---------

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2025-04-03 13:02:27 +08:00
Zhen Ye
8065c801f2
fix: segv if the LoadArrowReaderFromRemote run at the exception path (#41071) 
issue: #41067
pr: #41069

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-03 02:14:21 +08:00
wei liu
37a533fe6d
fix: [2.5] Address manual balance and balance check issues (#41038) 
issue: #37651
pr: #41037
- Fix context propagation for manual balance segment task creation from
PR #38080.
- Optimize stopping balance by preventing redundant checks per round,
addressing performance regression from PR #40297.
- Decrease default `checkBalanceInterval` from 3000ms to 300ms.
- Correct minor log messages in `BalanceChecker`.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-04-03 01:26:23 +08:00
Xianhui Lin
249d5b9b41
fix: jsonstats check if cache schema is nil lazy describecollection (#41068) 
fix: jsonstats check if cache schema is nil lazy describecollection
pr:https://github.com/milvus-io/milvus/pull/38039
issue:https://github.com/milvus-io/milvus/issues/36995

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-04-03 00:32:21 +08:00
zhagnlu
5be9cebd67
fix: fix compare two column move cursor bug (#41054) 
#41033

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-02 20:08:21 +08:00
Bingyi Sun
240f766511
fix: Align brute force search with json index for exists expr (#41056) 
issue: #35528 
pr: #41004

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-04-02 18:28:23 +08:00
cqy123456
5017e9ab8c
fix:[2.5]Inserting null and non-null array at the same time will cause milvus crash when growing mmap open (#41052) 
issue: https://github.com/milvus-io/milvus/issues/40981
master pr: https://github.com/milvus-io/milvus/pull/41051

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-04-02 17:58:21 +08:00
Spade A
05c01070c6
fix: fix arm64 compile issue (#41058) 
issue: #41059

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-04-02 17:44:22 +08:00
Buqian Zheng
c9a354d436
enhance: [2.5] weighted reranker to allow skip score normalization (#40905) 
issue: https://github.com/milvus-io/milvus/issues/40836
pr: https://github.com/milvus-io/milvus/pull/40903

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-04-02 17:30:22 +08:00
foxspy
a906466d8f
fix: [2.5]Add bypass thread pool mode to avoid growing indexes blocking insert/load (#41013) 
issue: #40825 
related: #41012
pr: #41012

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-04-02 16:58:25 +08:00
zhagnlu
0d3bd3131c
fix:fix format error for json (#41031) 
#41026

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-02 14:32:32 +08:00
Spade A
7945ff8784
enhance: increate tantivy index worker and memory budget for json key stats for buliding index (#40912) 
issue: #40897

This PR, combined with https://github.com/milvus-io/milvus/pull/40898,
makes tantivy total duration decrease roughly
from 6.3s to 1.68s for the case in the issue.

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-04-02 08:23:08 +08:00
Spade A
28c1ab8a16
enhance: add documents in batch for json key stats (#40898) 
issue: #40897

After this, the document add operations scheduling duration is
**decreased** roughly from **6s to 0.9s** for the case in the issue.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-04-02 08:22:24 +08:00
sre-ci-robot
c32259ead7
[automated] Bump milvus version to v2.5.8 (#41024) 
Bump milvus version to v2.5.8
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-04-01 15:08:28 +08:00
groot
91be8b1708
fix: fix a 404 bug of WebUI when http.enablePprof is false (#41007) 
issue: https://github.com/milvus-io/milvus/issues/40952
pr: https://github.com/milvus-io/milvus/pull/40951

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2025-04-01 10:20:23 +08:00
Bingyi Sun
c7ca352de5
enhance: Initialize field id to avoid negative number (#38789) (#41017) 
pr: #38789

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-04-01 10:08:21 +08:00
congqixia
e0f274a1b8
enhance: Bump milvus & proto version to v2.5.8 (#41019) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
v2.5.8 pkg/v2.5.8 		2025-03-31 22:27:12 +08:00
Bingyi Sun
9108cee958
feat: add json null/exists expression (#41002) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/41004

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-31 21:52:23 +08:00
yihao.dai
cba8feade3
enhance: [2.5] Add UTF-8 string validation for import (#40746) 
issue: https://github.com/milvus-io/milvus/issues/40684

pr: https://github.com/milvus-io/milvus/pull/40694

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-31 21:08:21 +08:00
yihao.dai
753f8c8410
enhance: [2.5] Reduce the allocation of ID (#41005) 
This PR is a supplement to PR
https://github.com/milvus-io/milvus/pull/40960.

issue: https://github.com/milvus-io/milvus/issues/40207

pr: https://github.com/milvus-io/milvus/pull/40960

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-31 17:58:21 +08:00
wei liu
d185a8f941
enhance: Balance the collection with the largest row count first (#40958) 
issue: #37651
pr: #40297
this PR enable to balance the collection with largest row count first,
to avoid temporary migration of small table data to new nodes during
their onboarding, only to be moved out again after the large table
balance, which would cause unnecessary load.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-03-31 16:14:21 +08:00
cqy123456
48eabe3d2e
fix:[2.5]growing mmap data type crashed by nullable input (#40980) 
issue: https://github.com/milvus-io/milvus/issues/40981
master pr: https://github.com/milvus-io/milvus/pull/40994

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-31 14:42:20 +08:00
groot
712d1644d8
enhance: bulkinsert supports parsing sparse vector form parquet struct (#40874) 
issue: https://github.com/milvus-io/milvus/issues/40777
pr: https://github.com/milvus-io/milvus/pull/40927

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2025-03-31 14:20:31 +08:00
aoiasd
0ba389e434
enhance: [2.5] add utf8 check for all varchar field #40670 (#40993) 
https://github.com/milvus-io/milvus/issues/40684
pr: https://github.com/milvus-io/milvus/pull/40670

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-31 14:08:20 +08:00
yihao.dai
1caeac937b
fix: [2.5] Fix delete data loss due to duplicate binlogID (#40985) 
This PR is a supplement to PR
[#40960](https://github.com/milvus-io/milvus/pull/40960).

issue: https://github.com/milvus-io/milvus/issues/40207

pr: https://github.com/milvus-io/milvus/pull/40960

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-31 10:38:31 +08:00
cai.zhang
7e00ab6671
fix: [2.5] Add the field index lock for getSegmentsIndexStates (#40969) 
issue: #40966 

master pr: #40968

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-30 22:50:20 +08:00
Buqian Zheng
64c8e009be
fix: [2.5] update gitignore file (#40911) 
pr: https://github.com/milvus-io/milvus/pull/40910
issue: https://github.com/milvus-io/milvus/issues/40833
using this issue only to remove mergify bot label

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-28 18:40:19 +08:00
aoiasd
d49f0b65d1
fix: rocksmq consumer register not concurrent safe (#39387) (#40885) 
relate: https://github.com/milvus-io/milvus/issues/39336
pr: https://github.com/milvus-io/milvus/pull/39387

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-28 16:08:18 +08:00
cai.zhang
7db59fb1fb
fix: [2.5] Get all children deltalogs for segment to load (#40957) 
issue: #40207
master pr: #40956

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-28 16:04:19 +08:00
Buqian Zheng
8504a7b98d
enhance: [2.5] avoid re-query if hybrid search requested only pk as output field (#40906) 
pr: https://github.com/milvus-io/milvus/pull/40842
issue: https://github.com/milvus-io/milvus/issues/40833

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-28 14:50:26 +08:00
yihao.dai
27ea5d14dc
fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976) 
With concurrenct L0 compaction
(https://github.com/milvus-io/milvus/pull/36816), delta logs might be
written to the same L1 segment, causing logID duplication when using the
incremental beginLogID. This PR removes the beginLogID mechanism and
instead passes a log ID range, where the number of IDs in the range
equals the number of compaction segment binlogs multiplied by an
expansion factor.

issue: https://github.com/milvus-io/milvus/issues/40207

pr: https://github.com/milvus-io/milvus/pull/40960

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-28 14:34:21 +08:00
Chun Han
d420f100c0
enhance: refine array view to optimize memory usage(#38736) (#40206) 
related: #38736
pr: https://github.com/milvus-io/milvus/pull/38808

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-03-28 11:08:18 +08:00
congqixia
51efe9a60c
fix: [2.5][GoSDK] Set nullable according to fieldSchema for RowBased insert (#40928) (#40962) 
Cherry-pick from master
pr: #40928

Related to #40737

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-28 10:30:20 +08:00
Bingyi Sun
f0346a149a
fix: Fix using json index when iterative_filter is specified (#40946) 
issue: #40934 
pr: #40945

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-27 23:02:20 +08:00
wei liu
b64bb63e77
enhance: [2.5] Add trigger interval config for auto balance (#39154) (#39918) 
issue: #39156
pr: #39154

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-03-27 16:40:23 +08:00