admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,069 Commits 137 Branches 188 Tags
Commit Graph

10367 Commits

Author SHA1 Message Date
cai.zhang
ad29371019
fix: Importing segments stats task must be triggered by import_checker (#42487) 
issue: #42486

master pr: #42424

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-06-03 18:44:31 +08:00
zhagnlu
66e28f605f
fix: fix is null bug for marisa index (#42421) 
pr: #42420

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 14:52:32 +08:00
wei liu
b298218a29
enhance: [2.5] Remove balance constraints between channel and segment tasks (#42410) 
issue: #42176
pr: #42177

Remove the mutual exclusion constraints between channel and segment
balance tasks to allow them to run concurrently.

Changes include:
- Remove permitBalanceChannel() and permitBalanceSegment() methods from
RoundRobinBalancer
- Update ChannelLevelScoreBalancer, MultiTargetBalancer,
RowCountBasedBalancer, and ScoreBasedBalancer to remove constraint
checks
- Allow segment balance tasks to proceed even when channel balance tasks
are running
- Update test cases to reflect new behavior where balance tasks no
longer block each other
- Improve error handling in task executor by preferring serviceable
shard leaders for segment release operations
- Add fallback logic to find latest shard leader when serviceable leader
is not available

This change improves the efficiency of load balancing by removing
unnecessary coordination overhead between different types of balance
operations.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-06-03 10:16:32 +08:00
zhagnlu
bc5be6380d
fix: Add explicit move semantics to get_batch_view interface (#42402) 
pr: #42403

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 10:08:31 +08:00
cai.zhang
ad8067f76e
fix: [2.5] Just trigger stats task for Flushed segment (#42425) 
issue: #42419 

master pr: #42424

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-06-03 09:58:36 +08:00
congqixia
0393fecb7a
fix: [2.5] Reset compacting when finishing segment stats (#42005) 
Cherry-pick from master
pr: #41963 
Related to #41962

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-30 16:02:30 +08:00
aoiasd
d9706150d2
enhance: [2.5] run analyzer should get database name from grpc context (#42399) 
pr:https://github.com/milvus-io/milvus/pull/42398

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-30 15:48:30 +08:00
aoiasd
6b0e602574
fix: [2.5] update tantivy version to fix stemmper panic (#42172) 
relate: https://github.com/milvus-io/milvus/issues/42168
pr: https://github.com/milvus-io/milvus/pull/42171

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-30 14:06:29 +08:00
cqy123456
b7fc38286f
fix:[2.5]when use new interim index, fail to get vector as output field. (#42183) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-05-30 10:58:29 +08:00
Min Tian
8d9c70b89b
fix: [2.5] Not need knowhere for thread control when calling knowhere-iterator (#42136) (#42133) 
issue: #42132 
pr: #42136 

When calling knowhere-iterator, the thread pool control of knowhere is
no longer needed.

Signed-off-by: min.tian <min.tian.cn@gmail.com>
 2025-05-30 10:14:30 +08:00
liliu-z
1cab5dc2b2
enhance: Make cagra gpu image default (#42193) 
pr: #41906
issue: #41907

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: presburger <yusheng.ma@zilliz.com>
 2025-05-30 03:12:30 +08:00
wei liu
d2ff390a52
fix: Segment may be released prematurely during balance channel (#42043) 
issue: #41143
pr: #42090

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-05-29 18:36:35 +08:00
foxspy
e567b38a74
enhance: [2.5] update knowhere version (#42159) 
issue: #42060 
/kind branch-feature

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-29 12:22:30 +08:00
Bingyi Sun
37a640f5ed
enhance: return index params for restful api (#42016) (#42080) 
issue: #42015
pr: #42016

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-29 11:50:30 +08:00
aoiasd
198ff1f150
enhance: [2.5] support run analyzer by loaded collection field (#42119) 
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42113

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-29 10:26:30 +08:00
wei liu
4a05180f88
enhance: [2.5] support balancing multiple collections in single trigger (#41875) (#42134) 
issue: #41874
pr: #41875
- Optimize balance_checker to support balancing multiple collections
simultaneously
- Add new parameters for segment and channel balancing batch sizes
- Add enableBalanceOnMultipleCollections parameter
- Update tests for balance checker

This change improves resource utilization by allowing the system to
balance multiple collections in a single trigger with configurable batch
sizes.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-05-28 23:18:30 +08:00
congqixia
6c17cdffd8
enhance: [2.5] Take nq into slow query consideration (#42109) (#42125) 
Cherry-pick from master
pr: #42109
Related to #40756

Large nq will naturally increase query time, which causing lots of slow
log when user NQ numbers are very large.

This PR make slow search counts span per nq (using avg val) to decide
whether one request is slow or not.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-28 19:02:30 +08:00
foxspy
6ac85e5cfe
fix: [2.5] add describeIndex timestamp for restful interface (#42105) 
issue: https://github.com/milvus-io/milvus/issues/41431
pr: #42104

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-28 12:00:29 +08:00
congqixia
49684a2439
enhance: [2.5][Nullable] Fill absent nullable field server-side (#42095) (#42120) 
Cherry-pick from master
pr: #42095

The absent nullable field shall be filled at server-side in nullable
design. While the implementation here was buggy causing the feature was
not able to serve.

This PR make proxy fill the field data in correct format so that field
data with absent column(s) will be accepted.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-28 10:02:28 +08:00
Xianhui Lin
843c4228df
fix: pass the ttl duration in the search request for ttl filter (#42121) 
fix:  pass the TTL duration in the search request for TTL filter
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42122

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-28 09:42:28 +08:00
Xianhui Lin
0490344442
fix: support TTL expiration with queries returning no results (#42103) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-27 15:18:28 +08:00
groot
a48001f999
feat: support to drop properties of field (#41954) 
issue: https://github.com/milvus-io/milvus/issues/41990
pr: https://github.com/milvus-io/milvus/pull/41996

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2025-05-27 14:32:34 +08:00
Xianhui Lin
0574fc7b7b
enhance: support TTL expiration with queries returning no results (#41960) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-26 15:52:28 +08:00
cai.zhang
0daebdc3c9
fix: [2.5] Use locking to ensure the atomicity of dropping segment indexes (#42076) 
issue:  #41288 

master pr: #42075

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-05-26 15:40:28 +08:00
Chun Han
81ed143132
enhance: refine expiring compaction(#41336) (#42052) 
related: #41336
pr: https://github.com/milvus-io/milvus/pull/42056

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-05-25 16:44:27 +08:00
yihao.dai
6de19f8598
enhance: [2.5] Enhance import context (#42051) 
Rename `imeta` to `importMeta` to improve readability, and enhance
import related context usage.

issue: https://github.com/milvus-io/milvus/issues/41123

pr: https://github.com/milvus-io/milvus/pull/42021

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-24 18:40:26 +08:00
yihao.dai
9b085520cf
fix: [2.5] Fix proxy panic at shard client manager (#42026) 
issue: https://github.com/milvus-io/milvus/issues/42024

pr: https://github.com/milvus-io/milvus/pull/42025

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-23 19:44:26 +08:00
yihao.dai
83ca664150
fix: [2.5] Fix import slot assignment (#41982) 
Assign the import task to the worker with the most available slots, even
if availableSlots < requiredSlots. This ensures tasks won’t be blocked
indefinitely.

issue: https://github.com/milvus-io/milvus/issues/41981

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-23 01:36:30 +08:00
Chun Han
a6d4b47879
fix: failed to reset time point for force expiry compaction(#41855) (#42000) 
related: #41855

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-05-22 12:14:25 +08:00
Chun Han
19ab9513ff
enhance: threadpool name is not output as expected(#40838) (#41705) 
related: #40838

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-05-22 12:12:32 +08:00
SimFG
00336a8c4c
enhance: [2.5] add privilege group message types and corresponding tests (#41940) 
- issue: #41938
- pr: #41939

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-05-21 11:12:29 +08:00
aoiasd
0e75e664f2
enhance: accesslog support fetch hybrid search expr and field (#40167) (#41921) 
relate: https://github.com/milvus-io/milvus/issues/40166
pr: https://github.com/milvus-io/milvus/pull/40167

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-20 15:14:24 +08:00
Chun Han
043e333290
enhance: support strict expiry compaction for milvus(#41855) (#41856) 
related: #41855

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-05-19 09:50:24 +08:00
yihao.dai
7c8370ccd2
fix: [2.5] Fix ants.Pool goroutine leak (#41893) 
1. Release the pool after it is no longer in use.
2. Upgrade ants.Pool to fix the goroutine leak issue (see
https://github.com/panjf2000/ants/pull/287).

issue: https://github.com/milvus-io/milvus/issues/41838

pr: https://github.com/milvus-io/milvus/pull/41892

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-16 19:12:22 +08:00
aoiasd
daf745ffa3
fix: [2.5] hybird search sub requset not set analyzer name (#41897) 
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41896

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-16 17:58:22 +08:00
XuanYang-cn
aa01b6add4
fix: ChannelManager double assignment (#41877) 
This pr fixs double assign in channels, recurr of dropped channel, amend
extra channel meta, and refresh incorrect state with DN by the following
edits:
1. Loose the lock in advanceStandbys to avoid concurrent assignment.
2. Trasfer ToWatch to ToRelease if DN returns ErrChannelRedupulicate.
3. Remove dup channel when recovering
See also: #41876 
pr: #41837

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-05-16 14:58:23 +08:00
yihao.dai
9f28a006cd
fix: [2.5] Fix ineffective log level setting in ThreadWatcher (#41887) 
issue: https://github.com/milvus-io/milvus/issues/41781

pr: https://github.com/milvus-io/milvus/pull/41886

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-16 12:02:27 +08:00
cai.zhang
dc1e9e2f81
fix: [2.5] Don't create index for unsorted importing segment when enable stats (#41865) 
issue: #41863 

master pr: #41864

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-05-16 10:18:35 +08:00
yihao.dai
9b17108b50
fix: [2.5] Fix import reader goroutine leak (#41870) 
Close the chunk manager's reader after the import completes to prevent
goroutine leaks.

issues: https://github.com/milvus-io/milvus/issues/41868

pr: https://github.com/milvus-io/milvus/pull/41869

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-15 22:20:23 +08:00
SimFG
94e2871348
enhance: [2.5] implement authorization checks for DescribeCollection and DescribeDatabase tasks (#41799) 
- issue: #41694
- pr: #41798

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-05-15 17:48:23 +08:00
aoiasd
bb562c6a7e
fix:[2.5] analyzer memory leak because function runner not close (#41840) 
relate: https://github.com/milvus-io/milvus/issues/41213
pr:https://github.com/milvus-io/milvus/pull/41839

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-15 15:48:23 +08:00
foxspy
e36df6991b
enhance: [2.5] Output index version information in the DescribeIndex interface (#41841) 
issue: #41431 
pr: #41847

Signed-off-by: foxspy <xianliang.li@zilliz.com>
 2025-05-15 14:34:23 +08:00
cai.zhang
6278fb3b56
fix: [2.5] Collect entites num group by collection instead of partition (#41789) 
issue: #41787

master pr: #41788

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-05-15 11:40:23 +08:00
cai.zhang
813bcb14a7
fix: [2.5]prevent crash when contains_all/any is used with empty array (#41756) 
issue: https://github.com/milvus-io/milvus/issues/41348

related and optimized by https://github.com/milvus-io/milvus/pull/41347

master pr: #41739

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: Sangho Park <hoyaspark@gmail.com>
 2025-05-14 14:30:22 +08:00
congqixia
e6bfa12064
enhance: [2.5][Restful] Add consistency level for query/get API (#41825) (#41830) 
Cherry-pick from master
pr: #41825 
Related to #41805

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-14 14:16:22 +08:00
yihao.dai
841f02cf0e
fix: [2.5] Disable block and mutex profiling on arm to prevent SIGSEGV (#41823) 
issue: https://github.com/milvus-io/milvus/issues/41821

pr: https://github.com/milvus-io/milvus/pull/41822

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-14 10:56:50 +08:00
foxspy
96f7ab592b
enhance: [2.5] update knowhere version (#41828) 
issue: #37644 
/kind branch-feature

Signed-off-by: foxspy <xianliang.li@zilliz.com>
 2025-05-14 10:50:23 +08:00
yihao.dai
a7c818cadb
fix: [2.5] Fix no candidate segments error for small import (#41772) 
When autoID is enabled, the preimport task estimates row distribution by
evenly dividing the total row count (numRows) across all vchannels:
`estimatedCount = numRows / vchannelNum`.
However, the actual import task hashes real auto-generated IDs to
determine
the target vchannel. This mismatch can lead to inaccurate row
distribution estimation
in such corner cases:
- Importing 1 row into 2 vchannels:
				• Preimport: 1 / 2 = 0 → both v0 and v1 are estimated to have 0 rows
				• Import: real autoID (e.g., 457975852966809057) hashes to v1
				  → actual result: v0 = 0, v1 = 1

To resolve such corner case, we now allocate at least one segment for
each vchannel
when autoID is enabled, ensuring all vchannels are prepared to receive
data even
if no rows are estimated for them.

issue: https://github.com/milvus-io/milvus/issues/41759

pr: https://github.com/milvus-io/milvus/pull/41771

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-14 10:36:22 +08:00
Xianhui Lin
548754a5e3
fix: fallback to mixcoord session when upgrade to mixCoord (#41773) 
fix: fallback to mixcoord  session when upgrade to mixCoord
issue:https://github.com/milvus-io/milvus/issues/41737

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-13 23:12:58 +08:00
zhagnlu
5b8ea84d38
fix: add params to ignore config type exception (#41777) 
pr: #41776

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-13 11:28:57 +08:00