admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,090 Commits 137 Branches 188 Tags
Commit Graph

22090 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhenshan.cao
2db9eb34b6 enhance: Refine segment allocation in Datacoord 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2025-12-12 22:39:40 +08:00
cai.zhang
1b0495f10a fix: [2.5]Fix target segment marked dropped for save stats result twice (#45480) 
issue: #45477 

master pr: #45478

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-12-12 19:00:06 +08:00
zhagnlu
2aa074828f fix: fix delete consumer bug for cocurrency R-W (#43831) (#43855) 
pr: #43831

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-12-12 18:59:38 +08:00
Chun Han
5561ff232c fix: refine judgement for batch views(#38736) (#43479) 
related: #38736
pr: https://github.com/milvus-io/milvus/pull/43481

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-12-12 18:59:04 +08:00
Chun Han
29d9ee7bd2 enhance: refine variable-length-type memory usage(#38736) (#43093) 
related: #38736
pr: https://github.com/milvus-io/milvus/pull/39578

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-12-12 18:59:04 +08:00
sre-ci-robot
c00beaeca8 [automated] Bump milvus version to v2.5.13 (#42605) 
Bump milvus version to v2.5.13
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-12-12 18:42:40 +08:00
congqixia
cfc8577f76
fix: [hotfix]Use task timestamp to calculating ttl timestamp (#42925) 
Cherry-pick from master
pr: #42920
Related to #42918

Previously the `CollectionTtlTimestamp` could be overflowed when the
guarantee_ts==1, which means using `Eventually` consistency level.

This patch use task timestamp, allocated by scheduler, to generate ttl
timestamp ignore the potential very small timestamp being used.

Also add overflow check for ttl timestamp calculated.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-06-25 10:12:42 +08:00
Spade A
a239e76355
fix: update tantivy for fixing threads explosion in file watcher hotfix (#42829) 
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-06-18 21:22:40 +08:00
Spade A
42a98a287d
fix: update tantivy for solving threads exposion for tantivy (#42715) 
update tantivy: https://github.com/zilliztech/tantivy/pull/16

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
 2025-06-13 16:19:03 +08:00
Buqian Zheng
3915ecacee
fix: pipeline/delegator leak (#42583) 
the manager's logging lambda should not capture the pipeline object

this creates a circular reference between the manager and the pipeline
object, making it impossible for both to be GC-ed.

issue: https://github.com/milvus-io/milvus/issues/42581
pr: https://github.com/milvus-io/milvus/pull/42582

Signed-off-by: Buqian Zheng <buqianzheng@Buqians-MacBook-Air.local>
Co-authored-by: Buqian Zheng <buqianzheng@Buqians-MacBook-Air.local>
v2.5.13 		2025-06-07 02:06:33 +08:00
wei liu
f06de7eca6
fix: Fix delegator selection logic in releaseSegment (#42572) 
issue: #42568
Fix incorrect delegator selection during segment release process which
introduced by pr #42410

- Add serviceable filter to prioritize available shard leaders
- Fix fallback logic with channel-specific lookup
- Add early return when no leader found
- Add comprehensive unit tests for all scenarios

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-06-06 19:24:33 +08:00
Bingyi Sun
97fcc1586c
fix: [2.5] Fix the bug of valid data write corruption (#42555) 
issue: https://github.com/milvus-io/milvus/issues/42554
pr: https://github.com/milvus-io/milvus/pull/42556

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-06 19:22:43 +08:00
Bingyi Sun
f61e13fb2d
fix: Check cast type is array for json contains expr (#42185) 
issue: https://github.com/milvus-io/milvus/issues/42181
pr: #42184

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-06 11:00:33 +08:00
Buqian Zheng
44f96680fa
enhance: [2.5] update maintainers (#42558) 
pr: https://github.com/milvus-io/milvus/pull/42539

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-06-05 21:22:34 +08:00
Bingyi Sun
532f10f343
enhance: Support cast function for json index (#42504) 
issue: #41948
pr: #41949

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-05 20:26:33 +08:00
yihao.dai
28aa364bf7
enhance: [2.5] Adjust default import buffer size (#42542) 
Increase insert buffer size from 16MB to 64MB, while keeping delete
buffer size at 16MB.

issue: https://github.com/milvus-io/milvus/issues/42518

pr: https://github.com/milvus-io/milvus/pull/42541

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-06-05 18:46:33 +08:00
yihao.dai
72a8777c9d
enhance: [2.5] Accelerate dispatcher building (#42544) 
Reduce check interval to accelerate dispatcher building.

issue: https://github.com/milvus-io/milvus/issues/42067

pr: https://github.com/milvus-io/milvus/pull/42500

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-06-05 18:16:33 +08:00
Zhen Ye
a55c371261
fix: querynode upgrade from 2.5 get stucked (#42503) 
issue: #42492
pr: #42502

- querynode graceful stop can be done if there's only L0 segment exists.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-06-05 15:56:33 +08:00
Xianhui Lin
a1927e22a5
fix: add ShowLoadCollections and ShowLoadPartitions for compatibale mixcoord (#42514) 
fix: add ShowLoadCollections and ShowLoadPartitions for compatibale
mixcoord
issue:https://github.com/milvus-io/milvus/issues/42492

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-06-05 15:46:33 +08:00
yihao.dai
fdfb78b9e5
fix: [2.5] Fix duplicate autoID between import and insert (#42520) 
Remove the unlimited logID mechanism and switch to redundantly
allocating a large number of IDs.

issue: https://github.com/milvus-io/milvus/issues/42518

pr: https://github.com/milvus-io/milvus/pull/42519

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-06-05 00:54:33 +08:00
cai.zhang
a0a6510db9
fix: [2.5] Only mark segment compacting for sort stats task (#42517) 
issue: #42506 

master pr: #42516

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-06-04 21:40:32 +08:00
cai.zhang
ad29371019
fix: Importing segments stats task must be triggered by import_checker (#42487) 
issue: #42486

master pr: #42424

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
pkg/v2.5.13 		2025-06-03 18:44:31 +08:00
zhagnlu
66e28f605f
fix: fix is null bug for marisa index (#42421) 
pr: #42420

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 14:52:32 +08:00
wei liu
b298218a29
enhance: [2.5] Remove balance constraints between channel and segment tasks (#42410) 
issue: #42176
pr: #42177

Remove the mutual exclusion constraints between channel and segment
balance tasks to allow them to run concurrently.

Changes include:
- Remove permitBalanceChannel() and permitBalanceSegment() methods from
RoundRobinBalancer
- Update ChannelLevelScoreBalancer, MultiTargetBalancer,
RowCountBasedBalancer, and ScoreBasedBalancer to remove constraint
checks
- Allow segment balance tasks to proceed even when channel balance tasks
are running
- Update test cases to reflect new behavior where balance tasks no
longer block each other
- Improve error handling in task executor by preferring serviceable
shard leaders for segment release operations
- Add fallback logic to find latest shard leader when serviceable leader
is not available

This change improves the efficiency of load balancing by removing
unnecessary coordination overhead between different types of balance
operations.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-06-03 10:16:32 +08:00
zhagnlu
bc5be6380d
fix: Add explicit move semantics to get_batch_view interface (#42402) 
pr: #42403

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 10:08:31 +08:00
cai.zhang
ad8067f76e
fix: [2.5] Just trigger stats task for Flushed segment (#42425) 
issue: #42419 

master pr: #42424

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-06-03 09:58:36 +08:00
congqixia
0393fecb7a
fix: [2.5] Reset compacting when finishing segment stats (#42005) 
Cherry-pick from master
pr: #41963 
Related to #41962

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-30 16:02:30 +08:00
aoiasd
d9706150d2
enhance: [2.5] run analyzer should get database name from grpc context (#42399) 
pr:https://github.com/milvus-io/milvus/pull/42398

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-30 15:48:30 +08:00
congqixia
99c6209ffc
enhance: Bump milvus & proto version to v2.5.13 (#42175) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-30 15:28:30 +08:00
aoiasd
6b0e602574
fix: [2.5] update tantivy version to fix stemmper panic (#42172) 
relate: https://github.com/milvus-io/milvus/issues/42168
pr: https://github.com/milvus-io/milvus/pull/42171

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-30 14:06:29 +08:00
cqy123456
b7fc38286f
fix:[2.5]when use new interim index, fail to get vector as output field. (#42183) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-05-30 10:58:29 +08:00
Min Tian
8d9c70b89b
fix: [2.5] Not need knowhere for thread control when calling knowhere-iterator (#42136) (#42133) 
issue: #42132 
pr: #42136 

When calling knowhere-iterator, the thread pool control of knowhere is
no longer needed.

Signed-off-by: min.tian <min.tian.cn@gmail.com>
 2025-05-30 10:14:30 +08:00
liliu-z
1cab5dc2b2
enhance: Make cagra gpu image default (#42193) 
pr: #41906
issue: #41907

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: presburger <yusheng.ma@zilliz.com>
 2025-05-30 03:12:30 +08:00
yanliang567
73ed1a6105
test: [2.5] Add TTL tests to verify expiration in read (#42190) 
related issue: #42182
pr: #42189

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-05-29 20:54:29 +08:00
wei liu
d2ff390a52
fix: Segment may be released prematurely during balance channel (#42043) 
issue: #41143
pr: #42090

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-05-29 18:36:35 +08:00
foxspy
e567b38a74
enhance: [2.5] update knowhere version (#42159) 
issue: #42060 
/kind branch-feature

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-29 12:22:30 +08:00
Bingyi Sun
37a640f5ed
enhance: return index params for restful api (#42016) (#42080) 
issue: #42015
pr: #42016

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-29 11:50:30 +08:00
aoiasd
198ff1f150
enhance: [2.5] support run analyzer by loaded collection field (#42119) 
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42113

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-29 10:26:30 +08:00
wei liu
4a05180f88
enhance: [2.5] support balancing multiple collections in single trigger (#41875) (#42134) 
issue: #41874
pr: #41875
- Optimize balance_checker to support balancing multiple collections
simultaneously
- Add new parameters for segment and channel balancing batch sizes
- Add enableBalanceOnMultipleCollections parameter
- Update tests for balance checker

This change improves resource utilization by allowing the system to
balance multiple collections in a single trigger with configurable batch
sizes.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-05-28 23:18:30 +08:00
congqixia
6c17cdffd8
enhance: [2.5] Take nq into slow query consideration (#42109) (#42125) 
Cherry-pick from master
pr: #42109
Related to #40756

Large nq will naturally increase query time, which causing lots of slow
log when user NQ numbers are very large.

This PR make slow search counts span per nq (using avg val) to decide
whether one request is slow or not.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-28 19:02:30 +08:00
foxspy
6ac85e5cfe
fix: [2.5] add describeIndex timestamp for restful interface (#42105) 
issue: https://github.com/milvus-io/milvus/issues/41431
pr: #42104

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-28 12:00:29 +08:00
congqixia
49684a2439
enhance: [2.5][Nullable] Fill absent nullable field server-side (#42095) (#42120) 
Cherry-pick from master
pr: #42095

The absent nullable field shall be filled at server-side in nullable
design. While the implementation here was buggy causing the feature was
not able to serve.

This PR make proxy fill the field data in correct format so that field
data with absent column(s) will be accepted.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-28 10:02:28 +08:00
Xianhui Lin
843c4228df
fix: pass the ttl duration in the search request for ttl filter (#42121) 
fix:  pass the TTL duration in the search request for TTL filter
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42122

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-28 09:42:28 +08:00
Xianhui Lin
0490344442
fix: support TTL expiration with queries returning no results (#42103) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-27 15:18:28 +08:00
groot
a48001f999
feat: support to drop properties of field (#41954) 
issue: https://github.com/milvus-io/milvus/issues/41990
pr: https://github.com/milvus-io/milvus/pull/41996

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2025-05-27 14:32:34 +08:00
Linkwei
f4e4bb20fa
enhance: [skip e2e] Enhance monitoring by adding metrics related to Milvus 2.5. (#41933) 
Enhance monitoring by adding metrics related to Milvus 2.5.
https://github.com/milvus-io/milvus/issues/41652

Signed-off-by: Linkwei <link.xie@zilliz.com>
 2025-05-26 19:50:30 +08:00
zhuwenxing
f4fe920fde
test: [cherry-pick]add multi analyzer test (#41632) 
pr: https://github.com/milvus-io/milvus/pull/41578

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-05-26 19:06:31 +08:00
XuanYang-cn
f6d2f01640
enhance: Upgrade PyMilvus to 2.5.10rc2 (#42034) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-05-26 19:02:28 +08:00
zhuwenxing
60b651c36c
test: add csv import testcase and adjust import testcase tag (#41638) (#42069) 
/kind improvement
pr: #41638

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-05-26 16:20:31 +08:00
Xianhui Lin
0574fc7b7b
enhance: support TTL expiration with queries returning no results (#41960) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-26 15:52:28 +08:00