21743 Commits

Author SHA1 Message Date
nico
0c6518f344
test: add iterator check and update sdk version and cases[2.5] (#40132)
pr: #39798 #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-24 19:13:56 +08:00
Bingyi Sun
29579a8ec9
fix: Fix search failure of null expression (#40128)
issue: https://github.com/milvus-io/milvus/issues/40095
pr: #40129

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-24 18:35:55 +08:00
cai.zhang
69f6849dc4
fix: [2.5] Fix bug where prefix matching fails when wildcards are in prefix (#40021)
issue: #40019 

master pr: #40020

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-24 18:03:55 +08:00
yihao.dai
b6b03ff74c
enhance: [2.5] Accelerate listing objects during binlog import (#40048)
issue: https://github.com/milvus-io/milvus/issues/40030

pr: https://github.com/milvus-io/milvus/pull/40047

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-24 15:59:56 +08:00
cai.zhang
fdad35e668
fix: [2.5] Set task version for stats task (#40130)
issue: #40034 

master pr: #40035

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-24 15:43:55 +08:00
Xianhui Lin
a4eb2ce224
fix: [2.5]Revert qc statschecker for json key stats (#40125)
Revert qc statschecker for json key stats
issue:https://github.com/milvus-io/milvus/issues/36995
pr:https://github.com/milvus-io/milvus/pull/39876

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-24 13:31:55 +08:00
Chun Han
cb82b040a7
enhance: support create collection with description(#40022) (#40028)
related: #40022
pr: https://github.com/milvus-io/milvus/pull/40023

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-24 09:55:57 +08:00
cai.zhang
6c81463263
fix: [2.5] Fix task scheduler dead lock (#40121)
issue: #39101 

master pr: #39084

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2025-02-23 18:29:55 +08:00
cai.zhang
9cbab98382
enhance: [2.5] Export request timeout interval in config (#40118) 2025-02-23 13:47:12 +08:00
congqixia
709594f158
enhance: [2.5] Use v2 package name for pkg module (#40117)
Cherry-pick from master
pr: #39990
Related to #39095

https://go.dev/doc/modules/version-numbers

Update pkg version according to golang dep version convention

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-23 00:46:01 +08:00
congqixia
ecdbc12678
enhance: [2.5] Remove hardcoded partition num in restful handler (#40113)
Cherry-pick from master
pr: #40112
The partition num shall be determined by core logic if user did not
specifiy the partition num in request.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 16:58:17 +08:00
Xianhui Lin
c1de61ff7c
fix: [2.5]Replace the position of EnabledJSONKeyStats (#40108)
Replace the position of EnabledJSONKeyStats
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-22 14:35:54 +08:00
Chun Han
2677f0b834
fix: cancel sub contexts casade when http request timeout(#40030) (#40060)
related: #40030
pr: https://github.com/milvus-io/milvus/pull/40059

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-22 11:39:53 +08:00
congqixia
cb0dc6293c
enhance: [2.5] Sync proxy.maxTaskNum default value to 1024 (#40073)
Cherry-pick from master
pr: #40072
Sync milvus.yaml value to default value for maxTaskNum

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 11:31:53 +08:00
zhagnlu
d66d3f0d47
enhance:decrease dump snapshot limit from 10w to 1w (#40102)
pr: #40101

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-22 11:29:53 +08:00
cai.zhang
be30f5301d
enhance: Refine index task scheduler policy (#40104)
master pr: #39084 

issue: #39101

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-22 11:25:54 +08:00
congqixia
898606ae4c
enhance: [2.5] Avoid stringtoslicebytes copy for BatchPKExists (#40097)
Cherry-pick from master
pr: #40096 
Using unsafe.Slice to convert string to []byte by directly using
underlying data could avoid lots of copy and cpu time

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-21 21:41:21 +08:00
cai.zhang
0caad5fe37
enhance: [2.5] Add metrics for proxy queue (#40071)
master pr: #40070

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-21 21:39:54 +08:00
yihao.dai
b8a758b6c4
enhance: [2.5] Add get vector latency metric and refine request limit error message (#40085)
issue: https://github.com/milvus-io/milvus/issues/40078

pr: https://github.com/milvus-io/milvus/pull/40083

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-21 20:19:55 +08:00
congqixia
113d17646b
fix: [2.5] Add sub task pool for multi-stage tasks (#40081)
Cherry-pick from master
pr: #40079
Related to #40078

Add a subTaskPool to execute sub task in case of logic deadlock
described in issue.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-21 19:17:55 +08:00
Chun Han
39b1f4aaea
enhance: support return configable properties when describing index(#39951) (#40043)
related: #39951
pr: https://github.com/milvus-io/milvus/pull/40042

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-21 18:51:55 +08:00
wei liu
82fb0bf9c1
fix: [2.5] task delta cache leak on reduce task (#40056)
issue: #40052
pr: #40055

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-21 16:49:54 +08:00
wei liu
e42c944e04
fix: [2.5] querycoord panic in cornor case (#40058)
issue: #40050 
pr: #40057

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-21 11:19:58 +08:00
congqixia
b7c631f0b7
enhance: [2.5] Remove frequent json stats distribution log (#40027)
Info log is too frequent only printing the json stats & index info

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-20 13:33:57 +08:00
zhenshan.cao
f142b5bff8
fix: Fix wrong trigger of json key index (#40026)
pr: https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-02-20 03:59:11 +08:00
SimFG
37874ed6d7
fix: [2.5] enhance isBalanced function to correctly count quote pairs (#40002)
- issue: #39999
- pr: #40001

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-19 20:19:00 +08:00
zhagnlu
ce6d8ba836
enhance: optimize expr performace for some points (#39695) (#39938)
1. skip get expr arguments which deserialize proto for every batch
execute.
2. replace unordered_set with sort array that has better performace for
small set.
pr: #39695

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-19 19:52:53 +08:00
congqixia
cae8f75e47
enhance: Bump milvus version to 2.5.5 (#40017)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-19 18:48:54 +08:00
XuanYang-cn
bd5c56a77b
fix: [cp25]Negative -1 executing compaction tasks (#39955)
See also: #39675
pr: #39954

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-02-19 18:42:53 +08:00
congqixia
96922c0a87
fix: [2.5] Use start pos ts instead for sealSegmentByLifetime policy (#39994)
Cherry-pick from master
pr: #39982
Related to #39981

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-19 17:48:55 +08:00
XuanYang-cn
cc6b2ff150
fix: [cp25]A segment may never transfer from sealed to flushing (#39996)
See also: #39717
pr: #39993

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-02-19 16:50:59 +08:00
Bingyi Sun
6cd00880e2
fix: Skip create primary key index when loading pk index (#39922)
issue: https://github.com/milvus-io/milvus/issues/39907
pr: https://github.com/milvus-io/milvus/pull/39921

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-19 15:54:52 +08:00
zhuwenxing
02198e14af
test: [cherry-pick]remove xfail for text match testcases (#39932)
pr: https://github.com/milvus-io/milvus/pull/39920

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-19 14:15:11 +08:00
zhuwenxing
750b70ac00
test: add fts and text match verification in second test (#39971)
/kind improvement

pr: https://github.com/milvus-io/milvus/pull/39970

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-19 14:12:58 +08:00
cai.zhang
f904b73662
fix: [2.5]Skip text index creation when segment is zero after sorting (#39969)
issue: #39961 

master pr: #39962

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-19 10:58:51 +08:00
wei liu
3c2d8c1419
enhance: [2.5] Add management api to check querycoord balance status (#37784) (#39909)
issue: #37783
pr: #37784

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-19 10:56:49 +08:00
Xianhui Lin
04175d8549
enhance: [2.5]compress jsonstatslog path only save filename (#39979)
enhance: compress jsonstatslog path only save filename
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-19 10:20:52 +08:00
Xianhui Lin
63576738b6
fix: [2.5]exists expr on nested dictionaries fail in JSONkeyIndex (#39972)
fix: exists expr on nested dictionaries fail in JSONkeyIndex
issue: https://github.com/milvus-io/milvus/issues/39963
pr: https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-19 10:18:51 +08:00
yihao.dai
7a92121c92
fix: [2.5] Fix failed to seek to earliest position (#39966)
If it is the earliest message ID, skip the seek to prevent failure.

issue: https://github.com/milvus-io/milvus/issues/39964

pr: https://github.com/milvus-io/milvus/pull/39965

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-18 20:36:53 +08:00
binbin
d60ba1828b
test: [cherry-pick] Enable more test cases for auto index (#39939) (#39959)
related pr: #39939

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-02-18 17:42:52 +08:00
nico
486e54c2c4
test: update test cases and sdk version[2.5] (#39442)
pr: #39443

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-18 17:20:52 +08:00
wei liu
d92ffb66a1
fix: [skip e2e] [2.5]data race in load test (#39846)
Related to https://github.com/milvus-io/milvus/pull/39701
pr: #39845

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-18 15:04:50 +08:00
wei liu
bf54f47c34
enhance: [2.5] use rated logger for high frequency log in dist handler (#39452) (#39928)
pr: #39452

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-18 14:32:52 +08:00
ThreadDao
7fb69960d1
test: [GoSDK][2.5] Sync gosdk test commits from master branch (#39838)
Cherry-pick from master
pr: #39484 #39570 #39537 #39824 #39579

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wxzhuyeah@gmail.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-18 11:11:08 +08:00
wei liu
7ea0af572a
enhance: [2.5] Optimize the result format of GetQueryNodeDistribution (#39664) (#39926)
pr: #39664
Use string array for SealedSegmentIDs to prevent precision loss in JSON
parsers. Large integers (int64) may be incorrectly rounded when parsed
as double.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-18 09:59:07 +08:00
congqixia
2eaa1a4869
fix: [2.5] Use text_log prefix for TextMatchIndex null offset file (#39936)
Cherry-pick from master
pr: #39935
Related to #39933

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-18 00:43:07 +08:00
zhagnlu
de8abe7970
fix:reset default auto index for varchar (#39908)
pr: #39819

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-17 20:55:26 +08:00
cai.zhang
52434ccc78
enhance: [2.5] Limit the speed of the generating stats task (#39645)
master pr: #39644

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-17 16:06:17 +08:00
XuanYang-cn
8067113133
enhance: [cp25]Enable to observe write amplification (#39661) (#39743)
pr: #39661

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-02-17 16:00:17 +08:00
Zhen Ye
56c1a8d462
fix: ignore growing option is lost at hibridsearch (#39900)
issue: #39892
pr: #39799

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-17 15:30:15 +08:00