3209 Commits

Author SHA1 Message Date
Bingyi Sun
f0346a149a
fix: Fix using json index when iterative_filter is specified (#40946)
issue: #40934 
pr: #40945

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-27 23:02:20 +08:00
congqixia
2411c184a8
enhance: [2.5] Support detailed manual compaction criterion (#40892) (#40924)
Cherry-pick from master
pr: #40892
Related to #40866

This PR:
- update go-api/v2 and support partition id/channel/segment level manual
compaction
- refines the compaction trigger implementation
- unify the compaction signal usage

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-27 10:36:22 +08:00
zhuwenxing
8ec8a7a9c4
test: using pytest_tagging to replace pytest_tags (#40902)
pr: https://github.com/milvus-io/milvus/pull/40878

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 10:46:31 +08:00
zhuwenxing
b0cc8bc9e0
test: [cherry-pick][2.5] add more restful v2 api testcases (#40915)
pr: https://github.com/milvus-io/milvus/pull/39558

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 10:44:25 +08:00
zhuwenxing
99670db5e9
test: update text empty percent in go client fts test (#40010)
pr: https://github.com/milvus-io/milvus/pull/40009

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-25 17:28:23 +08:00
wt
34131d93ae
test: test mix scenes support batch insertion (#40871)
issues: https://github.com/milvus-io/milvus/issues/40868

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2025-03-25 10:52:29 +08:00
yihao.dai
b534c9d804
enhance: [2.5] Introduce batch subscription in msgdispatcher (#40596)
Introduce a batch subscription mechanism in msgdispatcher: the
msgdispatcher now includes a vchannel watch task queue, where all
vchannels in the queue will subscribe to the MQ only once and pull
messages from the oldest vchannel checkpoint to the latest.

issue: https://github.com/milvus-io/milvus/issues/39862

pr: https://github.com/milvus-io/milvus/pull/39863

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-24 10:18:17 +08:00
ThreadDao
31f9e3c789
[skip-e2e] test: enable jsonKeyStats in pulsar nightly test (#40826)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-03-21 19:28:15 +08:00
XuanYang-cn
70ad96ffb3
enhance: Upgrade PyMilvus version to 2.5.6rc5 (#40748)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-03-21 17:48:28 +08:00
jaime
e538d2c106
fix:etcd advertise-client-urls in docker-compose (#40805)
issue: #40696
pr: #40804

Signed-off-by: jaime <yun.zhang@zilliz.com>
2025-03-21 15:50:13 +08:00
ThreadDao
635f6c5300
[GoSDK][2.5] test: Cherry-pick gosdk test commits from master branch (#40778)
pr: #39694 #40352 #40775 #40787

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-03-21 14:30:14 +08:00
congqixia
50241e4cf9
enhance: [2.5][GoSDK] Support JSON Path index (#40754) (#40791)
Cherry-pick from master
pr: #40754 
Related to #35528

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-21 10:28:13 +08:00
zhagnlu
14259a3f8a
fix:fix exception when do arith expr when using index (#40799)
pr: #40783

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-20 19:34:49 +08:00
cai.zhang
0cfe835cac
enhance: [2.5] Support slot for index task and stats task (#40288)
issue: #39101 

master pr: #39084

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-19 16:50:11 +08:00
congqixia
6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 (#40728)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-18 19:58:15 +08:00
zhuwenxing
d9635c6f86
test: [cherry-pick]add empty sparse in import test (#40683)
pr: https://github.com/milvus-io/milvus/pull/40682

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-18 15:18:13 +08:00
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter (#40648)
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 21:36:10 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313)
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00
sparknack
3b847712bd
fix: add collection flush before sparse searching in pytest (#40510)
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-03-10 19:14:04 +08:00
Chun Han
ed71932c0a
fix:array corrupt for ignoring validity(#40384) (#40433)
related: #40384

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-07 18:15:48 +08:00
nico
493b7a5bc3
test: update teardown collection after rename[2.5] (#40380)
pr: #40379

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 20:30:03 +08:00
nico
dddd2075bc
test: update sdk version and test cases[2.5] (#40359)
pr: #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 12:56:01 +08:00
zhuwenxing
29c2354593
test: [cherry-pick]fix text match (#40296)
pr: https://github.com/milvus-io/milvus/pull/40295

/kind improvement
2025-03-03 21:24:01 +08:00
congqixia
4272703de4
enhance: Bump milvus & proto version to v2.5.6 (#40293)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-03 16:52:00 +08:00
yanliang567
2f7cce11a3
test: Update get index params method (#40244)
related issue: #40156
remove the old get index params method and update the new one

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-03-03 14:40:05 +08:00
nico
b046d44065
test: update drop collection in teardown method[2.5] (#40286)
pr: #40271

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-03 14:23:59 +08:00
SimFG
a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api (#40193)
- issue: #40178
- pr: #40192

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-03 10:20:01 +08:00
congqixia
3f76e1c6d1
enhance: [GoSDK][2.5] Use pkg v2 module path (#40134) (#40269)
Cherry-pick from master
pr: #40134
Related to #39095
Previous PR #39990 update pkg module path using "/v2" package name, this
PR update milvusclient go sdk dependency for this update

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-01 11:00:01 +08:00
zhuwenxing
00eda6fe31
test: [cherry-pick]add concurrent index creation verification (#40175)
pr: https://github.com/milvus-io/milvus/pull/40174

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-27 20:11:59 +08:00
zhuwenxing
bc318732ad
test: fix checker function name, release mistake and add nullable (#40092)
pr: https://github.com/milvus-io/milvus/pull/40135

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-27 20:10:09 +08:00
yanliang567
84f7e2d895
test: Update search iterator result check for dup ids (#40190)
Related issue: #40161 
1. fix the search iterator result assertion for dup ids
2. use normalized vectors for iterator tests

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-02-26 16:49:59 +08:00
zhuwenxing
32c00dbc1b
test: fix duplicate import file names in tests (#40182)
pr: https://github.com/milvus-io/milvus/pull/40181

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-26 14:02:05 +08:00
yihao.dai
eee98fd044
fix: [2.5] Fix collections with duplicate names can be created (#40147)
This PR introduces two restrictions:

1. Before dropping a collection, all aliases associated with that
collection must be dropped.
2. When creating a collection, if the collection name duplicates any
alias, the collection creation will fail.

issue: https://github.com/milvus-io/milvus/issues/40142

pr: https://github.com/milvus-io/milvus/pull/40143

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-25 22:07:56 +08:00
nico
0c6518f344
test: add iterator check and update sdk version and cases[2.5] (#40132)
pr: #39798 #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-24 19:13:56 +08:00
congqixia
709594f158
enhance: [2.5] Use v2 package name for pkg module (#40117)
Cherry-pick from master
pr: #39990
Related to #39095

https://go.dev/doc/modules/version-numbers

Update pkg version according to golang dep version convention

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-23 00:46:01 +08:00
zhuwenxing
02198e14af
test: [cherry-pick]remove xfail for text match testcases (#39932)
pr: https://github.com/milvus-io/milvus/pull/39920

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-19 14:15:11 +08:00
zhuwenxing
750b70ac00
test: add fts and text match verification in second test (#39971)
/kind improvement

pr: https://github.com/milvus-io/milvus/pull/39970

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-19 14:12:58 +08:00
binbin
d60ba1828b
test: [cherry-pick] Enable more test cases for auto index (#39939) (#39959)
related pr: #39939

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-02-18 17:42:52 +08:00
nico
486e54c2c4
test: update test cases and sdk version[2.5] (#39442)
pr: #39443

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-18 17:20:52 +08:00
wei liu
d92ffb66a1
fix: [skip e2e] [2.5]data race in load test (#39846)
Related to https://github.com/milvus-io/milvus/pull/39701
pr: #39845

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-18 15:04:50 +08:00
ThreadDao
7fb69960d1
test: [GoSDK][2.5] Sync gosdk test commits from master branch (#39838)
Cherry-pick from master
pr: #39484 #39570 #39537 #39824 #39579

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wxzhuyeah@gmail.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-18 11:11:08 +08:00
yanliang567
3a951f2160
test: Cherry pick sparse invert index algo tests (#39816)
related issue: https://github.com/milvus-io/milvus/issues/39332
related pr: #39691

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-02-17 15:06:15 +08:00
Xianhui Lin
f0964f769d
enhance: [2.5]Add json key inverted index in stats for optimization (#39876)
Add json key inverted index in stats for optimization
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-16 20:12:15 +08:00
smellthemoon
ba0edb8383
enhance: [2.5]return topks when search in restful v2 (#39839)
pr: #39812

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-02-14 11:30:14 +08:00
Zhen Ye
f85bf59921
fix: rootcoord graceful stop failed and limit resource of ci (#39793)
issue: #38399
pr: #39781

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-13 19:34:13 +08:00
congqixia
7ca5e8309b
enhance: [GoSDK][2.5] Sync gosdk commits from master branch (#39823)
Cherry-pick from master
pr: #38791 #38812 #38940 #39515 #39580 #39662 #39665 #39751

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-12 18:46:47 +08:00
wei liu
11cba57dc7
fix: [2.5] load collection stucks if compaction/gc happens (#39761)
issue: #39680
pr: #39701
if compaction/gc happens, load collection may stuck due to
SegmentNotFound, we should trigger UpdateNextTarget to get a new data
view to execute loading operation.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-11 15:48:50 +08:00
Zhen Ye
858dc10ef9
enhance: broadcast with event-based notification (#39550)
issue: #38399
pr: #39522

- broadcast message can carry multi resource key now.
- implement event-based notification for broadcast messages
- broadcast message use broadcast id as a unique identifier in message
- broadcasted message on vchannels keep the broadcasted vchannel now.
- broadcasted message and broadcast message have a common broadcast
header now.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-07 11:50:50 +08:00
congqixia
6f7b2b4e75
enhance: [2.5] Refine error msg for schema & index checking (#39533) (#39565)
Cherry-pick from master
pr: #39533

The error message was malformated or missing some meta info, say field
name. This PR recitfies some message format and add field name in error
message when type param check fails.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 13:43:06 +08:00
ThreadDao
c1c1f2df4e
test: [2.5] add test cases for template param (#39475)
issue: #33419
pr: #38867

- add case for Get
- add case for TemplateParam

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-01-22 09:55:24 +08:00