21820 Commits

Author SHA1 Message Date
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter (#40648)
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 21:36:10 +08:00
Bingyi Sun
0a3435f53a
fix: Fix null offset loading in inverted index (#40524)
issue: #40516 
pr: https://github.com/milvus-io/milvus/pull/40523

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 18:32:09 +08:00
Gao
09f7a60fe1
enhance: [2.5] make segment prune config refreshable (#40632)
pr: #40539

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-03-14 16:12:09 +08:00
SimFG
a3c60a03b5
feat: [2.5] add DDLDB rate type and related quota configurations (#40653)
- issue: #40650
- pr: #40651

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-14 15:36:17 +08:00
zhagnlu
6b9e141ada
enhance: reorder sub expr for conjunct expr (#40186)
pr:#39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-14 15:16:08 +08:00
congqixia
d8a2c1a907
enhance: [2.5] Add channel seal policy based on blocking l0 (#40505) (#40535)
Cherry-pick from 2.5
pr: #40505
Related to #40502

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-14 10:02:12 +08:00
cai.zhang
bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo (#40466)
issue: #40341 

master pr: #40464

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-14 00:14:08 +08:00
Bingyi Sun
33e9db1539
fix: cherry pick json prs (#40621)
issue: #35528 
pr: #40604 
this pr includes some prs:
1. #40604 
2. #40611 
3. #40619

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-13 20:36:10 +08:00
Xianhui Lin
f5e9dea2aa
fix: [2.5]fix the garbage cleanup logic of jsonkey stats && improve json key stats filer (#40039)
fix: fix the garbage collection cleanup logic of jsonkey stats &&
improve json key stats filer
issue: https://github.com/milvus-io/milvus/issues/36995
https://github.com/milvus-io/milvus/issues/40034
https://github.com/milvus-io/milvus/issues/40041
https://github.com/milvus-io/milvus/issues/40106
https://github.com/milvus-io/milvus/issues/40138
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-03-13 20:18:10 +08:00
cai.zhang
f6c4ad52f0
enhance: [2.5] Refine task meta with key lock (#40353)
issue: #39101 

master pr: #39084

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-13 19:18:08 +08:00
Bingyi Sun
d8f51ca852
fix: Catch invalid json pointer error (#40626)
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40625

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-13 16:10:09 +08:00
wei liu
4a3a1b7cc7
enhance: Remove CPU profile to prevent blocking stop progress (#40459)
pr: #40460
- Removed CPU profile dump from util.go's pprof collection
- Avoid potential blocking in StopCPUProfile() during shutdown
- Maintain goroutine/heap/block/mutex profiles for diagnostics
- Ensure safe shutdown timeout handling without profile stalls

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-03-13 14:40:11 +08:00
yihao.dai
cd8f1fe0e4
enhance: [2.5] Remove unnecessary collection and partition label from the metrics (#40593)
/kind improvement

pr: https://github.com/milvus-io/milvus/pull/39536

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-13 12:24:08 +08:00
sthuang
9542271554
fix: [2.5] rbac star privilege return empty when listing policy (#40557)
cherry-pick from master: https://github.com/milvus-io/milvus/pull/40553
related: https://github.com/milvus-io/milvus/issues/40547

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-13 00:42:09 +08:00
Spade A
ec6f8bac6d
fix: [2.5] avoid panic when field not exists in schema in query node (#40542)
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40541

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-12 22:14:09 +08:00
Spade A
bcec7c5087
fix: [2.5] ref collection for search/query (#40550)
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40549

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-12 20:12:09 +08:00
Xiaofan
a7dd0eda9e
fix: [2.5] empty row for sparse vector (#40586)
fix: #40584 
pr: #40585

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-03-12 16:42:06 +08:00
yihao.dai
b0ad3d9444
enhance: [2.5] Improve import error msgs (#40597)
issue: https://github.com/milvus-io/milvus/issues/40208

pr: https://github.com/milvus-io/milvus/pull/40567

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-12 14:36:08 +08:00
Bingyi Sun
bd4170106d
fix: cherry pick json index related prs (#40568)
issue: #35528 
pr: #40407 
this pr includes some json index related pr:
1. #40407
2. #40538 
3. #40419

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-11 21:00:09 +08:00
congqixia
d0763cb84d
enhance: [2.5] Fix Array.h clang format issue (#40536)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-11 15:58:09 +08:00
congqixia
004668b14c
fix: [2.5] Add duplicated type/index params check creating collection (#40465)
Cherry-pick from master
pr: #40462
Related to #40461

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-11 10:14:11 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313)
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00
sparknack
3b847712bd
fix: add collection flush before sparse searching in pytest (#40510)
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-03-10 19:14:04 +08:00
congqixia
14ca0dfc7c
enhance: [2.5] Avoid convert body byte slice to string in httpserver (#40405) (#40414)
Cherry-pick from master
pr: #40405
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-10 14:44:05 +08:00
congqixia
9cf2cb66e1
fix: [2.5][GoSDK] move metaheader to client in case of race (#40444)
Cherry-pick from master
pr: #40443
See failure run in #40352

This PR:
- move metaheader map to client struct from config
- set default value for field schema

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
client/v2.5.1
2025-03-10 11:18:04 +08:00
sre-ci-robot
7e27452a9b
[automated] Bump milvus version to v2.5.6 (#40493)
Bump milvus version to v2.5.6
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-10 11:00:05 +08:00
Chun Han
ed71932c0a
fix:array corrupt for ignoring validity(#40384) (#40433)
related: #40384

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
v2.5.6 pkg/v2.5.6
2025-03-07 18:15:48 +08:00
Bingyi Sun
32b6f721eb
fix: Null expr does not work for json field (#40457)
issue: #40455 
pr: #40456

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-07 18:00:03 +08:00
smellthemoon
08a8e01f72
fix: [2.5]store wrong offset when build tantivy in nullable field (#40453)
pr: #40452 
issue: #40454

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-03-07 17:54:06 +08:00
cai.zhang
2846cc5810
fix: [2.5] Skip executing stats for zero segment (#40449)
issue : #40241 

master pr: #40448

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-07 16:16:03 +08:00
cai.zhang
8d76d58d20
enhance: [2.5]Only check element type with not null array (#40447)
master pr: #40446

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-07 12:49:08 +08:00
congqixia
54a2509220
enhance: [2.5][GoSDK] Support index properties API & bump version (#40434)
Cherry-pick from master
pr: #40417 
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-07 01:46:06 +08:00
shaoyue
730b8604f2
enhance: [2.5]upgrade go toolchain to 1.22.7, remove unnecessary binary (#40399)
master pr: #40398

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
2025-03-06 19:28:05 +08:00
congqixia
629da61617
enhance: [2.5][GoSDK] sync milvusclient patches for 2.5.1 (#40410)
Cherry pick from master
pr: #40268 #40284 #40328 #40373 #40381

------------------------------------------
#### fix: [GoSDK] Pass base64 passwd content instead of raw data
(#40268)

Related to #40261

Also add some options for create collection options and refine some
behavior

------------------------------------------
#### fix: [GoSDK] Return role without grants (#40284)

Related to #40274

Previousy DescribeRole returns only roles with grants, this PR add
select role action to check role existence.

Also added database properties related option

-----------------------------------------
#### fix: [GoSDK] Pass only valid data for nullable column (#40328)

Related to #40327

-----------------------------------------
#### enhance: [GoSDK] Add DescribeReplica API & sync rbac v2 (#40373)

Related to #31293 #37031

This PR:
- Add DescribeReplica API
- Add unified RBAC v2 API names(AddPrivilegesToGroup,
RemovePrivilegesFromGroup, GrantPrivilegeV2, RevokePrivilegeV2)
- Mark old ones deprecated

-----------------------------------------
#### enhance: [GoSDK] support update ts caching policy(#40381)

Related to #39093

This PR add update timestamp check and retry policy according to the
design of the related issue

-----------------------------------------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 17:48:03 +08:00
Ted Xu
f83567c0d0
fix: correct memory size estimation on arrays (#40377)
See: #40342
pr: #40312

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-06 17:42:04 +08:00
congqixia
89bc94595d
fix: [2.5] Pass Knapsnak ptr to avoid compact multiple times (#40401)
Cherry-pick from master
pr: #40400 
Related to #40388

The small segments may be put into bucket twice due to value parameter
of Knapsnap.packWith

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:16:03 +08:00
congqixia
1df4631a3f
enhance: [2.5] Remove debug log in rg handler v2 (#40376) (#40393)
Cherry-pick from master
pr: #40376
Remove debug log in resource group handler

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:14:12 +08:00
groot
a1b9e3ccb6
fix: Fix a crash issue of bulkinsert (#40304)
issue: https://github.com/milvus-io/milvus/issues/40291
pr: https://github.com/milvus-io/milvus/pull/40331

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-03-05 21:36:08 +08:00
nico
493b7a5bc3
test: update teardown collection after rename[2.5] (#40380)
pr: #40379

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 20:30:03 +08:00
aoiasd
ebf3416245
fix: main dispatcher not terminate cause messsage stream leak. (#40061) (#40351)
Main dispatcher will leak when we remove solo dispatcher in the end.
relate: https://github.com/milvus-io/milvus/issues/40046
pr: https://github.com/milvus-io/milvus/pull/40061

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-05 20:14:02 +08:00
Spade A
345ca01634
fix: [2.5]fix concurrent issues in null offset #40363 (#40365)
issue: https://github.com/milvus-io/milvus/issues/40308
cherry-pick: https://github.com/milvus-io/milvus/pull/40363

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-05 16:54:09 +08:00
Zhen Ye
a0f18e8c88
enhance: better logging for grpc resolver (#40338)
issue: #40311
pr: #40337

- better logging for grpc resolver
- remove the redundant streaming node manage client when streaming
service is disable

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 15:14:01 +08:00
nico
dddd2075bc
test: update sdk version and test cases[2.5] (#40359)
pr: #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 12:56:01 +08:00
yihao.dai
7cbd40c7a1
fix: [2.5] Fix parsing import endTs (#40333)
Parsing import beginTs, endTs as a hybrid timestamp.

issue: https://github.com/milvus-io/milvus/issues/40326

pr: https://github.com/milvus-io/milvus/pull/40332

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-05 11:40:13 +08:00
sre-ci-robot
9a42d3dc37
[automated] Update cpu Builder image changes (#40345)
Update cpu Builder image changes
See changes:
825316670d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-05 11:24:02 +08:00
sre-ci-robot
1832fcdd4e
[automated] Update gpu Builder image changes (#40344)
Update gpu Builder image changes
See changes:
825316670d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-05 11:22:15 +08:00
SimFG
6ab8e84f1e
fix: [2.5] improve error handling and unit tests for InitMetaCache function (#40324)
- issue: #40320
- pr: #40322

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-05 11:08:13 +08:00
congqixia
cc7d4ce399
fix: [2.5] Add duplication param check for create index (#40254) (#40330)
Cherry-pick from master
pr: #40254 
Related to #40156

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 10:10:01 +08:00
Zhen Ye
34f2bc0a68
enhance: add more metrics for async cgo component (#40232)
issue: #40014
pr: #40136

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 09:16:00 +08:00
Ted Xu
f02e549840
fix: compaction task cannot be genereted if size greater than max size (#40350)
See: #40343
pr: #40348

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 00:40:01 +08:00