21804 Commits

Author SHA1 Message Date
Xiaofan
a7dd0eda9e
fix: [2.5] empty row for sparse vector (#40586)
fix: #40584 
pr: #40585

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-03-12 16:42:06 +08:00
yihao.dai
b0ad3d9444
enhance: [2.5] Improve import error msgs (#40597)
issue: https://github.com/milvus-io/milvus/issues/40208

pr: https://github.com/milvus-io/milvus/pull/40567

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-12 14:36:08 +08:00
Bingyi Sun
bd4170106d
fix: cherry pick json index related prs (#40568)
issue: #35528 
pr: #40407 
this pr includes some json index related pr:
1. #40407
2. #40538 
3. #40419

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-11 21:00:09 +08:00
congqixia
d0763cb84d
enhance: [2.5] Fix Array.h clang format issue (#40536)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-11 15:58:09 +08:00
congqixia
004668b14c
fix: [2.5] Add duplicated type/index params check creating collection (#40465)
Cherry-pick from master
pr: #40462
Related to #40461

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-11 10:14:11 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313)
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00
sparknack
3b847712bd
fix: add collection flush before sparse searching in pytest (#40510)
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-03-10 19:14:04 +08:00
congqixia
14ca0dfc7c
enhance: [2.5] Avoid convert body byte slice to string in httpserver (#40405) (#40414)
Cherry-pick from master
pr: #40405
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-10 14:44:05 +08:00
congqixia
9cf2cb66e1
fix: [2.5][GoSDK] move metaheader to client in case of race (#40444)
Cherry-pick from master
pr: #40443
See failure run in #40352

This PR:
- move metaheader map to client struct from config
- set default value for field schema

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
client/v2.5.1
2025-03-10 11:18:04 +08:00
sre-ci-robot
7e27452a9b
[automated] Bump milvus version to v2.5.6 (#40493)
Bump milvus version to v2.5.6
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-10 11:00:05 +08:00
Chun Han
ed71932c0a
fix:array corrupt for ignoring validity(#40384) (#40433)
related: #40384

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
v2.5.6 pkg/v2.5.6
2025-03-07 18:15:48 +08:00
Bingyi Sun
32b6f721eb
fix: Null expr does not work for json field (#40457)
issue: #40455 
pr: #40456

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-07 18:00:03 +08:00
smellthemoon
08a8e01f72
fix: [2.5]store wrong offset when build tantivy in nullable field (#40453)
pr: #40452 
issue: #40454

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-03-07 17:54:06 +08:00
cai.zhang
2846cc5810
fix: [2.5] Skip executing stats for zero segment (#40449)
issue : #40241 

master pr: #40448

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-07 16:16:03 +08:00
cai.zhang
8d76d58d20
enhance: [2.5]Only check element type with not null array (#40447)
master pr: #40446

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-07 12:49:08 +08:00
congqixia
54a2509220
enhance: [2.5][GoSDK] Support index properties API & bump version (#40434)
Cherry-pick from master
pr: #40417 
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-07 01:46:06 +08:00
shaoyue
730b8604f2
enhance: [2.5]upgrade go toolchain to 1.22.7, remove unnecessary binary (#40399)
master pr: #40398

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
2025-03-06 19:28:05 +08:00
congqixia
629da61617
enhance: [2.5][GoSDK] sync milvusclient patches for 2.5.1 (#40410)
Cherry pick from master
pr: #40268 #40284 #40328 #40373 #40381

------------------------------------------
#### fix: [GoSDK] Pass base64 passwd content instead of raw data
(#40268)

Related to #40261

Also add some options for create collection options and refine some
behavior

------------------------------------------
#### fix: [GoSDK] Return role without grants (#40284)

Related to #40274

Previousy DescribeRole returns only roles with grants, this PR add
select role action to check role existence.

Also added database properties related option

-----------------------------------------
#### fix: [GoSDK] Pass only valid data for nullable column (#40328)

Related to #40327

-----------------------------------------
#### enhance: [GoSDK] Add DescribeReplica API & sync rbac v2 (#40373)

Related to #31293 #37031

This PR:
- Add DescribeReplica API
- Add unified RBAC v2 API names(AddPrivilegesToGroup,
RemovePrivilegesFromGroup, GrantPrivilegeV2, RevokePrivilegeV2)
- Mark old ones deprecated

-----------------------------------------
#### enhance: [GoSDK] support update ts caching policy(#40381)

Related to #39093

This PR add update timestamp check and retry policy according to the
design of the related issue

-----------------------------------------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 17:48:03 +08:00
Ted Xu
f83567c0d0
fix: correct memory size estimation on arrays (#40377)
See: #40342
pr: #40312

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-06 17:42:04 +08:00
congqixia
89bc94595d
fix: [2.5] Pass Knapsnak ptr to avoid compact multiple times (#40401)
Cherry-pick from master
pr: #40400 
Related to #40388

The small segments may be put into bucket twice due to value parameter
of Knapsnap.packWith

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:16:03 +08:00
congqixia
1df4631a3f
enhance: [2.5] Remove debug log in rg handler v2 (#40376) (#40393)
Cherry-pick from master
pr: #40376
Remove debug log in resource group handler

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:14:12 +08:00
groot
a1b9e3ccb6
fix: Fix a crash issue of bulkinsert (#40304)
issue: https://github.com/milvus-io/milvus/issues/40291
pr: https://github.com/milvus-io/milvus/pull/40331

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-03-05 21:36:08 +08:00
nico
493b7a5bc3
test: update teardown collection after rename[2.5] (#40380)
pr: #40379

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 20:30:03 +08:00
aoiasd
ebf3416245
fix: main dispatcher not terminate cause messsage stream leak. (#40061) (#40351)
Main dispatcher will leak when we remove solo dispatcher in the end.
relate: https://github.com/milvus-io/milvus/issues/40046
pr: https://github.com/milvus-io/milvus/pull/40061

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-05 20:14:02 +08:00
Spade A
345ca01634
fix: [2.5]fix concurrent issues in null offset #40363 (#40365)
issue: https://github.com/milvus-io/milvus/issues/40308
cherry-pick: https://github.com/milvus-io/milvus/pull/40363

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-05 16:54:09 +08:00
Zhen Ye
a0f18e8c88
enhance: better logging for grpc resolver (#40338)
issue: #40311
pr: #40337

- better logging for grpc resolver
- remove the redundant streaming node manage client when streaming
service is disable

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 15:14:01 +08:00
nico
dddd2075bc
test: update sdk version and test cases[2.5] (#40359)
pr: #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 12:56:01 +08:00
yihao.dai
7cbd40c7a1
fix: [2.5] Fix parsing import endTs (#40333)
Parsing import beginTs, endTs as a hybrid timestamp.

issue: https://github.com/milvus-io/milvus/issues/40326

pr: https://github.com/milvus-io/milvus/pull/40332

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-05 11:40:13 +08:00
sre-ci-robot
9a42d3dc37
[automated] Update cpu Builder image changes (#40345)
Update cpu Builder image changes
See changes:
825316670d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-05 11:24:02 +08:00
sre-ci-robot
1832fcdd4e
[automated] Update gpu Builder image changes (#40344)
Update gpu Builder image changes
See changes:
825316670d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-05 11:22:15 +08:00
SimFG
6ab8e84f1e
fix: [2.5] improve error handling and unit tests for InitMetaCache function (#40324)
- issue: #40320
- pr: #40322

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-05 11:08:13 +08:00
congqixia
cc7d4ce399
fix: [2.5] Add duplication param check for create index (#40254) (#40330)
Cherry-pick from master
pr: #40254 
Related to #40156

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 10:10:01 +08:00
Zhen Ye
34f2bc0a68
enhance: add more metrics for async cgo component (#40232)
issue: #40014
pr: #40136

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 09:16:00 +08:00
Ted Xu
f02e549840
fix: compaction task cannot be genereted if size greater than max size (#40350)
See: #40343
pr: #40348

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 00:40:01 +08:00
Bingyi Sun
825316670d
enhance: upgrade rust version to 1.83 (#39295) (#40317)
issue: #39254
pr: https://github.com/milvus-io/milvus/pull/39295

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-04 17:42:04 +08:00
Zhen Ye
b55327046f
fix: duplicate consuming from stream for invisible segment (#40318)
issue: #40207
pr: #40316

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-04 16:10:05 +08:00
zhuwenxing
29c2354593
test: [cherry-pick]fix text match (#40296)
pr: https://github.com/milvus-io/milvus/pull/40295

/kind improvement
2025-03-03 21:24:01 +08:00
congqixia
4272703de4
enhance: Bump milvus & proto version to v2.5.6 (#40293)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-03 16:52:00 +08:00
liliu-z
6fd5af3605
fix: [2.5] Change CMake variable for switch to knowhere-cuvs (#40289)
issue: #39883
pr: #40105

Signed-off-by: Mickael Ide <mide@nvidia.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: Micka <ide.mickael@gmail.com>
2025-03-03 14:48:00 +08:00
yanliang567
2f7cce11a3
test: Update get index params method (#40244)
related issue: #40156
remove the old get index params method and update the new one

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-03-03 14:40:05 +08:00
nico
b046d44065
test: update drop collection in teardown method[2.5] (#40286)
pr: #40271

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-03 14:23:59 +08:00
Chun Han
d754e0bb7e
fix: restful drop db properties failed(#39953) (#40260)
related: #39953
pr: https://github.com/milvus-io/milvus/pull/40257

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-03 10:22:02 +08:00
SimFG
a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api (#40193)
- issue: #40178
- pr: #40192

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-03 10:20:01 +08:00
yihao.dai
893caee467
fix: [2.5] Fix task delta cache data race (#40262)
issue: https://github.com/milvus-io/milvus/issues/40258

pr: https://github.com/milvus-io/milvus/pull/40259

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-02 16:52:10 +08:00
congqixia
3f76e1c6d1
enhance: [GoSDK][2.5] Use pkg v2 module path (#40134) (#40269)
Cherry-pick from master
pr: #40134
Related to #39095
Previous PR #39990 update pkg module path using "/v2" package name, this
PR update milvusclient go sdk dependency for this update

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-01 11:00:01 +08:00
wei liu
82c000a4b2
fix: task delta cache leak due to duplicate task id (#40184)
issue: #40052
pr: #40183

task delta cache rely on the taskID is unique, so it incDeltaCache at
AddTask, and decDeltaCache at RemoveTask, but the taskID allocator is
not atomic, which cause two task with same taskID, in such case, it will
call incDeltaCache twice, but call decDeltaCacheOnce, which cause delta
cache leak.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-28 10:22:08 +08:00
zhuwenxing
00eda6fe31
test: [cherry-pick]add concurrent index creation verification (#40175)
pr: https://github.com/milvus-io/milvus/pull/40174

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-27 20:11:59 +08:00
zhuwenxing
bc318732ad
test: fix checker function name, release mistake and add nullable (#40092)
pr: https://github.com/milvus-io/milvus/pull/40135

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-27 20:10:09 +08:00
wei liu
14f05650e3
enhance: clean shard location cache after collection released (#40228)
issue: #40077
pr: #40088

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-27 19:42:05 +08:00
congqixia
2f4f5945cb
enhance: [2.5] Unify milvus version def (#40229)
Cherry-pick from master
pr: #40227 
Related to #40216

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-27 14:17:58 +08:00