cai.zhang
ad29371019
fix: Importing segments stats task must be triggered by import_checker ( #42487 )
...
issue: #42486
master pr: #42424
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-03 18:44:31 +08:00
zhagnlu
66e28f605f
fix: fix is null bug for marisa index ( #42421 )
...
pr: #42420
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-06-03 14:52:32 +08:00
wei liu
b298218a29
enhance: [2.5] Remove balance constraints between channel and segment tasks ( #42410 )
...
issue: #42176
pr: #42177
Remove the mutual exclusion constraints between channel and segment
balance tasks to allow them to run concurrently.
Changes include:
- Remove permitBalanceChannel() and permitBalanceSegment() methods from
RoundRobinBalancer
- Update ChannelLevelScoreBalancer, MultiTargetBalancer,
RowCountBasedBalancer, and ScoreBasedBalancer to remove constraint
checks
- Allow segment balance tasks to proceed even when channel balance tasks
are running
- Update test cases to reflect new behavior where balance tasks no
longer block each other
- Improve error handling in task executor by preferring serviceable
shard leaders for segment release operations
- Add fallback logic to find latest shard leader when serviceable leader
is not available
This change improves the efficiency of load balancing by removing
unnecessary coordination overhead between different types of balance
operations.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-06-03 10:16:32 +08:00
zhagnlu
bc5be6380d
fix: Add explicit move semantics to get_batch_view interface ( #42402 )
...
pr: #42403
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-06-03 10:08:31 +08:00
cai.zhang
ad8067f76e
fix: [2.5] Just trigger stats task for Flushed segment ( #42425 )
...
issue: #42419
master pr: #42424
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-06-03 09:58:36 +08:00
congqixia
0393fecb7a
fix: [2.5] Reset compacting when finishing segment stats ( #42005 )
...
Cherry-pick from master
pr: #41963
Related to #41962
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-30 16:02:30 +08:00
aoiasd
d9706150d2
enhance: [2.5] run analyzer should get database name from grpc context ( #42399 )
...
pr:https://github.com/milvus-io/milvus/pull/42398
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-30 15:48:30 +08:00
congqixia
99c6209ffc
enhance: Bump milvus & proto version to v2.5.13 ( #42175 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-30 15:28:30 +08:00
aoiasd
6b0e602574
fix: [2.5] update tantivy version to fix stemmper panic ( #42172 )
...
relate: https://github.com/milvus-io/milvus/issues/42168
pr: https://github.com/milvus-io/milvus/pull/42171
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-30 14:06:29 +08:00
cqy123456
b7fc38286f
fix:[2.5]when use new interim index, fail to get vector as output field. ( #42183 )
...
issue: https://github.com/milvus-io/milvus/issues/27678
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-05-30 10:58:29 +08:00
Min Tian
8d9c70b89b
fix: [2.5] Not need knowhere for thread control when calling knowhere-iterator ( #42136 ) ( #42133 )
...
issue: #42132
pr: #42136
When calling knowhere-iterator, the thread pool control of knowhere is
no longer needed.
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2025-05-30 10:14:30 +08:00
liliu-z
1cab5dc2b2
enhance: Make cagra gpu image default ( #42193 )
...
pr: #41906
issue: #41907
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: presburger <yusheng.ma@zilliz.com>
2025-05-30 03:12:30 +08:00
yanliang567
73ed1a6105
test: [2.5] Add TTL tests to verify expiration in read ( #42190 )
...
related issue: #42182
pr: #42189
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-05-29 20:54:29 +08:00
wei liu
d2ff390a52
fix: Segment may be released prematurely during balance channel ( #42043 )
...
issue: #41143
pr: #42090
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-05-29 18:36:35 +08:00
foxspy
e567b38a74
enhance: [2.5] update knowhere version ( #42159 )
...
issue: #42060
/kind branch-feature
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-05-29 12:22:30 +08:00
Bingyi Sun
37a640f5ed
enhance: return index params for restful api ( #42016 ) ( #42080 )
...
issue: #42015
pr: #42016
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-05-29 11:50:30 +08:00
aoiasd
198ff1f150
enhance: [2.5] support run analyzer by loaded collection field ( #42119 )
...
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42113
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-29 10:26:30 +08:00
wei liu
4a05180f88
enhance: [2.5] support balancing multiple collections in single trigger ( #41875 ) ( #42134 )
...
issue: #41874
pr: #41875
- Optimize balance_checker to support balancing multiple collections
simultaneously
- Add new parameters for segment and channel balancing batch sizes
- Add enableBalanceOnMultipleCollections parameter
- Update tests for balance checker
This change improves resource utilization by allowing the system to
balance multiple collections in a single trigger with configurable batch
sizes.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-05-28 23:18:30 +08:00
congqixia
6c17cdffd8
enhance: [2.5] Take nq into slow query consideration ( #42109 ) ( #42125 )
...
Cherry-pick from master
pr: #42109
Related to #40756
Large nq will naturally increase query time, which causing lots of slow
log when user NQ numbers are very large.
This PR make slow search counts span per nq (using avg val) to decide
whether one request is slow or not.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-28 19:02:30 +08:00
foxspy
6ac85e5cfe
fix: [2.5] add describeIndex timestamp for restful interface ( #42105 )
...
issue: https://github.com/milvus-io/milvus/issues/41431
pr: #42104
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-05-28 12:00:29 +08:00
congqixia
49684a2439
enhance: [2.5][Nullable] Fill absent nullable field server-side ( #42095 ) ( #42120 )
...
Cherry-pick from master
pr: #42095
The absent nullable field shall be filled at server-side in nullable
design. While the implementation here was buggy causing the feature was
not able to serve.
This PR make proxy fill the field data in correct format so that field
data with absent column(s) will be accepted.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-28 10:02:28 +08:00
Xianhui Lin
843c4228df
fix: pass the ttl duration in the search request for ttl filter ( #42121 )
...
fix: pass the TTL duration in the search request for TTL filter
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42122
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-28 09:42:28 +08:00
Xianhui Lin
0490344442
fix: support TTL expiration with queries returning no results ( #42103 )
...
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-27 15:18:28 +08:00
groot
a48001f999
feat: support to drop properties of field ( #41954 )
...
issue: https://github.com/milvus-io/milvus/issues/41990
pr: https://github.com/milvus-io/milvus/pull/41996
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-05-27 14:32:34 +08:00
Linkwei
f4e4bb20fa
enhance: [skip e2e] Enhance monitoring by adding metrics related to Milvus 2.5. ( #41933 )
...
Enhance monitoring by adding metrics related to Milvus 2.5.
https://github.com/milvus-io/milvus/issues/41652
Signed-off-by: Linkwei <link.xie@zilliz.com>
2025-05-26 19:50:30 +08:00
zhuwenxing
f4fe920fde
test: [cherry-pick]add multi analyzer test ( #41632 )
...
pr: https://github.com/milvus-io/milvus/pull/41578
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-05-26 19:06:31 +08:00
XuanYang-cn
f6d2f01640
enhance: Upgrade PyMilvus to 2.5.10rc2 ( #42034 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-05-26 19:02:28 +08:00
zhuwenxing
60b651c36c
test: add csv import testcase and adjust import testcase tag ( #41638 ) ( #42069 )
...
/kind improvement
pr: #41638
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-05-26 16:20:31 +08:00
Xianhui Lin
0574fc7b7b
enhance: support TTL expiration with queries returning no results ( #41960 )
...
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-26 15:52:28 +08:00
cai.zhang
0daebdc3c9
fix: [2.5] Use locking to ensure the atomicity of dropping segment indexes ( #42076 )
...
issue: #41288
master pr: #42075
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-05-26 15:40:28 +08:00
Chun Han
81ed143132
enhance: refine expiring compaction( #41336 ) ( #42052 )
...
related: #41336
pr: https://github.com/milvus-io/milvus/pull/42056
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-05-25 16:44:27 +08:00
yihao.dai
6de19f8598
enhance: [2.5] Enhance import context ( #42051 )
...
Rename `imeta` to `importMeta` to improve readability, and enhance
import related context usage.
issue: https://github.com/milvus-io/milvus/issues/41123
pr: https://github.com/milvus-io/milvus/pull/42021
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-24 18:40:26 +08:00
yihao.dai
9b085520cf
fix: [2.5] Fix proxy panic at shard client manager ( #42026 )
...
issue: https://github.com/milvus-io/milvus/issues/42024
pr: https://github.com/milvus-io/milvus/pull/42025
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-23 19:44:26 +08:00
yihao.dai
83ca664150
fix: [2.5] Fix import slot assignment ( #41982 )
...
Assign the import task to the worker with the most available slots, even
if availableSlots < requiredSlots. This ensures tasks won’t be blocked
indefinitely.
issue: https://github.com/milvus-io/milvus/issues/41981
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-23 01:36:30 +08:00
Chun Han
a6d4b47879
fix: failed to reset time point for force expiry compaction( #41855 ) ( #42000 )
...
related: #41855
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-05-22 12:14:25 +08:00
Chun Han
19ab9513ff
enhance: threadpool name is not output as expected( #40838 ) ( #41705 )
...
related: #40838
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-05-22 12:12:32 +08:00
SimFG
00336a8c4c
enhance: [2.5] add privilege group message types and corresponding tests ( #41940 )
...
- issue: #41938
- pr: #41939
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-21 11:12:29 +08:00
aoiasd
0e75e664f2
enhance: accesslog support fetch hybrid search expr and field ( #40167 ) ( #41921 )
...
relate: https://github.com/milvus-io/milvus/issues/40166
pr: https://github.com/milvus-io/milvus/pull/40167
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-20 15:14:24 +08:00
yanliang567
7fc7e519be
test: Remove distributed line for go sdk test ( #41895 )
...
related issue: https://github.com/milvus-io/milvus/issues/41819
pr: https://github.com/milvus-io/milvus/pull/41820
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-05-20 14:14:24 +08:00
sre-ci-robot
022d149e90
[automated] Bump milvus version to v2.5.12 ( #41924 )
...
Bump milvus version to v2.5.12
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-05-19 16:58:27 +08:00
Chun Han
043e333290
enhance: support strict expiry compaction for milvus( #41855 ) ( #41856 )
...
related: #41855
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-05-19 09:50:24 +08:00
yihao.dai
7c8370ccd2
fix: [2.5] Fix ants.Pool goroutine leak ( #41893 )
...
1. Release the pool after it is no longer in use.
2. Upgrade ants.Pool to fix the goroutine leak issue (see
https://github.com/panjf2000/ants/pull/287 ).
issue: https://github.com/milvus-io/milvus/issues/41838
pr: https://github.com/milvus-io/milvus/pull/41892
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-16 19:12:22 +08:00
aoiasd
daf745ffa3
fix: [2.5] hybird search sub requset not set analyzer name ( #41897 )
...
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41896
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-16 17:58:22 +08:00
XuanYang-cn
aa01b6add4
fix: ChannelManager double assignment ( #41877 )
...
This pr fixs double assign in channels, recurr of dropped channel, amend
extra channel meta, and refresh incorrect state with DN by the following
edits:
1. Loose the lock in advanceStandbys to avoid concurrent assignment.
2. Trasfer ToWatch to ToRelease if DN returns ErrChannelRedupulicate.
3. Remove dup channel when recovering
See also: #41876
pr: #41837
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-05-16 14:58:23 +08:00
yanliang567
bfdd6adb7b
test: Upgrade helm chart version and resource limit ( #41881 )
...
related issue: https://github.com/milvus-io/milvus/issues/41819
pr: #41820
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-05-16 13:24:23 +08:00
congqixia
e0c79ffee8
enhance: Bump milvus & proto version to v2.5.12 ( #41888 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-16 13:06:23 +08:00
yihao.dai
9f28a006cd
fix: [2.5] Fix ineffective log level setting in ThreadWatcher ( #41887 )
...
issue: https://github.com/milvus-io/milvus/issues/41781
pr: https://github.com/milvus-io/milvus/pull/41886
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-16 12:02:27 +08:00
XuanYang-cn
4f3fd71ba7
enhance: Upgrade pymilvus to 2.5.9rc3 ( #41753 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-05-16 11:38:25 +08:00
congqixia
30dda24982
enhance: [2.5] Bump x/net fixing CVE-2025-22872 ( #41878 )
...
Cherry-pick from master
pr: #41861
Related to #41291
Related to CVE-2025-22872
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-16 10:20:24 +08:00
cai.zhang
dc1e9e2f81
fix: [2.5] Don't create index for unsorted importing segment when enable stats ( #41865 )
...
issue: #41863
master pr: #41864
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-05-16 10:18:35 +08:00
