1733 Commits

Author SHA1 Message Date
aoiasd
d9706150d2
enhance: [2.5] run analyzer should get database name from grpc context (#42399)
pr:https://github.com/milvus-io/milvus/pull/42398

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-30 15:48:30 +08:00
aoiasd
198ff1f150
enhance: [2.5] support run analyzer by loaded collection field (#42119)
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42113

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-29 10:26:30 +08:00
congqixia
6c17cdffd8
enhance: [2.5] Take nq into slow query consideration (#42109) (#42125)
Cherry-pick from master
pr: #42109
Related to #40756

Large nq will naturally increase query time, which causing lots of slow
log when user NQ numbers are very large.

This PR make slow search counts span per nq (using avg val) to decide
whether one request is slow or not.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-28 19:02:30 +08:00
congqixia
49684a2439
enhance: [2.5][Nullable] Fill absent nullable field server-side (#42095) (#42120)
Cherry-pick from master
pr: #42095

The absent nullable field shall be filled at server-side in nullable
design. While the implementation here was buggy causing the feature was
not able to serve.

This PR make proxy fill the field data in correct format so that field
data with absent column(s) will be accepted.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-28 10:02:28 +08:00
Xianhui Lin
0490344442
fix: support TTL expiration with queries returning no results (#42103)
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-27 15:18:28 +08:00
groot
a48001f999
feat: support to drop properties of field (#41954)
issue: https://github.com/milvus-io/milvus/issues/41990
pr: https://github.com/milvus-io/milvus/pull/41996

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-05-27 14:32:34 +08:00
Xianhui Lin
0574fc7b7b
enhance: support TTL expiration with queries returning no results (#41960)
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-26 15:52:28 +08:00
yihao.dai
9b085520cf
fix: [2.5] Fix proxy panic at shard client manager (#42026)
issue: https://github.com/milvus-io/milvus/issues/42024

pr: https://github.com/milvus-io/milvus/pull/42025

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-23 19:44:26 +08:00
SimFG
00336a8c4c
enhance: [2.5] add privilege group message types and corresponding tests (#41940)
- issue: #41938
- pr: #41939

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-21 11:12:29 +08:00
aoiasd
0e75e664f2
enhance: accesslog support fetch hybrid search expr and field (#40167) (#41921)
relate: https://github.com/milvus-io/milvus/issues/40166
pr: https://github.com/milvus-io/milvus/pull/40167

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-20 15:14:24 +08:00
yihao.dai
7c8370ccd2
fix: [2.5] Fix ants.Pool goroutine leak (#41893)
1. Release the pool after it is no longer in use.
2. Upgrade ants.Pool to fix the goroutine leak issue (see
https://github.com/panjf2000/ants/pull/287).

issue: https://github.com/milvus-io/milvus/issues/41838

pr: https://github.com/milvus-io/milvus/pull/41892

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-16 19:12:22 +08:00
aoiasd
daf745ffa3
fix: [2.5] hybird search sub requset not set analyzer name (#41897)
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41896

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-16 17:58:22 +08:00
SimFG
94e2871348
enhance: [2.5] implement authorization checks for DescribeCollection and DescribeDatabase tasks (#41799)
- issue: #41694
- pr: #41798

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-15 17:48:23 +08:00
foxspy
e36df6991b
enhance: [2.5] Output index version information in the DescribeIndex interface (#41841)
issue: #41431 
pr: #41847

Signed-off-by: foxspy <xianliang.li@zilliz.com>
2025-05-15 14:34:23 +08:00
SimFG
4c656e8a7a
enhance: support more ddl apis to replicate according to cdc (#41679)
- issue: #41677
- pr: #41678

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-08 20:02:58 +08:00
SimFG
b69bf42a04
enhance: [2.5] Implement OperatePrivilegeV2 message handling and unmarshal support (#41594)
- issue: #41353
- pr: #41355

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-30 11:52:53 +08:00
Xianhui Lin
17465ffe9e
feat: [2.5]add str update ts in describecollection (#41600)
issue:https://github.com/milvus-io/milvus/issues/39093
pr:https://github.com/milvus-io/milvus/pull/39096

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-29 17:50:53 +08:00
SimFG
6e18ededab
fix: [2.5] mockery too unavailable after upgrade golang version (#41522)
- issue: ##41291
- pr: #41481

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-25 14:40:40 +08:00
SimFG
18eb627533
fix: [2.5] Update logging context and upgrade dependencies (#41319)
- issue: #41291
- pr: #41318

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-04-24 23:50:40 +08:00
aoiasd
8b3353cdab
feat: [2.5] Support run analyzer and more tokenizer. (#41444)
relate: https://github.com/milvus-io/milvus/issues/39659
https://github.com/milvus-io/milvus/issues/39705
pr: https://github.com/milvus-io/milvus/pull/40416
https://github.com/milvus-io/milvus/pull/40458
https://github.com/milvus-io/milvus/pull/39723
https://github.com/milvus-io/milvus/pull/40813
https://github.com/milvus-io/milvus/pull/39854
https://github.com/milvus-io/milvus/pull/39660

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-04-24 10:48:39 +08:00
aoiasd
544493e3e2
feat:[2.5] support multi analyzer for bm25 function (#41456)
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41351

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-04-23 20:52:39 +08:00
Xianhui Lin
28c9dedb04
feat: [2.5]Add support for modifying max capacity of array fields (#41406)
feat: Add support for modifying max capacity of array fields

This commit adds support for modifying the max capacity of array fields
in the alterCollectionFieldTask function. It checks if the field is an
array type and then validates and updates the max capacity value. This
change improves the flexibility of array fields in the collection.

Issue: https://github.com/milvus-io/milvus/issues/41363
pr:https://github.com/milvus-io/milvus/pull/41404

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-21 18:00:37 +08:00
SimFG
4d813c48d2
fix: [2.5] get replicate channel position (#41189)
- issue: #41187
- pr: #41188

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-09 20:52:26 +08:00
congqixia
c5f87c1b6d
fix: [2.5] Avoid update original search/query request (#41127)
Cherry-pick from master
pr: #41126
Related to #41034

Recent pr #40842 introduced logic to avoid requery pk column, which
updates the original request which makes the request not equavilant to
the original one.

When retry happens due to incomplete request error, this change makes
the final result set lacks the pk column even when user specifies it
explicitly.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 22:13:29 +08:00
congqixia
618054d836
enhance: [2.5] Use %v for missing id log (#41036) (#41090)
Cherry-pick from master
pr: #41036
`incomplete query result, missing id %!s(int64=348), len(searchIDs) =
10, len(queryIDs) = 9` error message format with error
when missing id is int64

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-03 18:52:23 +08:00
Buqian Zheng
c9a354d436
enhance: [2.5] weighted reranker to allow skip score normalization (#40905)
issue: https://github.com/milvus-io/milvus/issues/40836
pr: https://github.com/milvus-io/milvus/pull/40903

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-04-02 17:30:22 +08:00
aoiasd
0ba389e434
enhance: [2.5] add utf8 check for all varchar field #40670 (#40993)
https://github.com/milvus-io/milvus/issues/40684
pr: https://github.com/milvus-io/milvus/pull/40670

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-31 14:08:20 +08:00
Buqian Zheng
8504a7b98d
enhance: [2.5] avoid re-query if hybrid search requested only pk as output field (#40906)
pr: https://github.com/milvus-io/milvus/pull/40842
issue: https://github.com/milvus-io/milvus/issues/40833

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-28 14:50:26 +08:00
aoiasd
182b3c17d0
enhance: remain raw token for audit log (#40637) (#40867)
pr: https://github.com/milvus-io/milvus/pull/40637

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-26 14:54:18 +08:00
SimFG
1263505808
feat: [2.5] support to deny dll according to database property (#40784)
- issue: #40762
- pr: #40764

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-23 11:18:28 +08:00
XuanYang-cn
70ad96ffb3
enhance: Upgrade PyMilvus version to 2.5.6rc5 (#40748)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-03-21 17:48:28 +08:00
Buqian Zheng
cff0e82f57
enhance: [2.5] improve sparse query nnz metric (#40714)
add query type and field id label; add metric for hybrid search

issue: https://github.com/milvus-io/milvus/issues/35853
pr: https://github.com/milvus-io/milvus/pull/40713

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-20 14:14:21 +08:00
congqixia
cd8d7efc96
enhance: [2.5] Add an extra parameter for slow log (#40759)
Cherry-pick from master
pr: #40758
Related to #40756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-19 18:10:13 +08:00
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter (#40648)
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 21:36:10 +08:00
SimFG
a3c60a03b5
feat: [2.5] add DDLDB rate type and related quota configurations (#40653)
- issue: #40650
- pr: #40651

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-14 15:36:17 +08:00
cai.zhang
bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo (#40466)
issue: #40341 

master pr: #40464

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-14 00:14:08 +08:00
Bingyi Sun
bd4170106d
fix: cherry pick json index related prs (#40568)
issue: #35528 
pr: #40407 
this pr includes some json index related pr:
1. #40407
2. #40538 
3. #40419

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-11 21:00:09 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313)
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00
SimFG
6ab8e84f1e
fix: [2.5] improve error handling and unit tests for InitMetaCache function (#40324)
- issue: #40320
- pr: #40322

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-05 11:08:13 +08:00
congqixia
cc7d4ce399
fix: [2.5] Add duplication param check for create index (#40254) (#40330)
Cherry-pick from master
pr: #40254 
Related to #40156

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 10:10:01 +08:00
SimFG
a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api (#40193)
- issue: #40178
- pr: #40192

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-03 10:20:01 +08:00
congqixia
709594f158
enhance: [2.5] Use v2 package name for pkg module (#40117)
Cherry-pick from master
pr: #39990
Related to #39095

https://go.dev/doc/modules/version-numbers

Update pkg version according to golang dep version convention

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-23 00:46:01 +08:00
Chun Han
2677f0b834
fix: cancel sub contexts casade when http request timeout(#40030) (#40060)
related: #40030
pr: https://github.com/milvus-io/milvus/pull/40059

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-22 11:39:53 +08:00
cai.zhang
0caad5fe37
enhance: [2.5] Add metrics for proxy queue (#40071)
master pr: #40070

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-21 21:39:54 +08:00
yihao.dai
b8a758b6c4
enhance: [2.5] Add get vector latency metric and refine request limit error message (#40085)
issue: https://github.com/milvus-io/milvus/issues/40078

pr: https://github.com/milvus-io/milvus/pull/40083

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-21 20:19:55 +08:00
congqixia
113d17646b
fix: [2.5] Add sub task pool for multi-stage tasks (#40081)
Cherry-pick from master
pr: #40079
Related to #40078

Add a subTaskPool to execute sub task in case of logic deadlock
described in issue.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-21 19:17:55 +08:00
wei liu
3c2d8c1419
enhance: [2.5] Add management api to check querycoord balance status (#37784) (#39909)
issue: #37783
pr: #37784

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-19 10:56:49 +08:00
wei liu
7ea0af572a
enhance: [2.5] Optimize the result format of GetQueryNodeDistribution (#39664) (#39926)
pr: #39664
Use string array for SealedSegmentIDs to prevent precision loss in JSON
parsers. Large integers (int64) may be incorrectly rounded when parsed
as double.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-18 09:59:07 +08:00
zhagnlu
de8abe7970
fix:reset default auto index for varchar (#39908)
pr: #39819

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-17 20:55:26 +08:00
Zhen Ye
56c1a8d462
fix: ignore growing option is lost at hibridsearch (#39900)
issue: #39892
pr: #39799

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-17 15:30:15 +08:00