admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-04 11:18:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,172 Commits 149 Branches 196 Tags
Commit Graph

1902 Commits

Author SHA1 Message Date
aoiasd
9d01606fe8
enhance: update go and lindera version. (#43493) 
relate: https://github.com/milvus-io/milvus/issues/43120
pr: https://github.com/milvus-io/milvus/pull/43121
https://github.com/milvus-io/milvus/pull/43019

---------

Signed-off-by: liliu-z <liliu-z@users.noreply.github.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Co-authored-by: liliu-z <liliu-z@users.noreply.github.com>
 2025-07-22 16:30:58 +08:00
Chun Han
da149f4dfe
fix: refine judgement for batch views(#38736) (#43480) 
related: #38736
pr: https://github.com/milvus-io/milvus/pull/43481

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-07-22 16:16:53 +08:00
Chun Han
6df6913d8c
fix: fail to get string views due to chunk bound empty loop(#41300) (#43483) 
related: #41300
pr: https://github.com/milvus-io/milvus/pull/41452

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-07-22 15:50:53 +08:00
congqixia
b657c076a4
fix: "fix: [2.5] Align null bitmap offset when loading multi-chunk (#43342)" (#43411) 
Related to #43389
alternative of #43395

This reverts commit e54d92447ccd6d616fe58cadb112cf0c6a44a6e9.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-07-18 17:14:52 +08:00
Spade A
ecf011aeb1
fix: update tantivy for fixing dir removing race condition #43399 (#43401) 
pr: https://github.com/milvus-io/milvus/pull/43399
issue: https://github.com/milvus-io/milvus/issues/43258

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-07-18 16:56:52 +08:00
foxspy
a6b2284de6
enhance: [2.5]update knowhere version (#43398) 
issue: #42937 
/kind branch-feature

Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2025-07-18 16:20:52 +08:00
congqixia
e54d92447c
fix: [2.5] Align null bitmap offset when loading multi-chunk (#43321) (#43342) 
Cherry-pick from master
pr: #43321
Related to #43262

This patch fixes following logic bug:
- When multiple chunks are loaded and size cannot be divided by 8, just
appending uint8_t as bitmap will cause null bitmap dislocation
- `null_bitmap_data()` points to start of whole row group, which may not
stand for current `arrow::Array`

The current solutions is:
- Reorganize the null_bitmap with currect size & offset
- Pass `array->offset()` in tuple to info the current offset

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-07-17 12:16:52 +08:00
zhagnlu
385112e7e3
fix:fix text_match bug because of not adapting to multi-chunk model (#43297) 
pr: #43303

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-07-17 11:22:53 +08:00
Alexander Guzhva
71c0f64a16
fix: [2.5] fix incorrect bitset for the division comparison when the right is < 0 (#43180) 
issue: #42900 
pr: #43179 

Upd: also handles Inf and NaN values, and the division by zero case for
fp32 and fp64

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
 2025-07-16 15:36:52 +08:00
Spade A
6ccf1aa9b8
fix: void copy when getting json chunk #43183 (#43202) 
master https://github.com/milvus-io/milvus/pull/43183
fix: https://github.com/milvus-io/milvus/issues/43182

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-07-16 15:34:51 +08:00
Spade A
21d6866a56
fix: fix text match index / json key stats index leak when segment released (#43308) 
pr: https://github.com/milvus-io/milvus/pull/42655
issue: https://github.com/milvus-io/milvus/issues/42626

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-07-15 15:22:18 +08:00
Chun Han
4fe8011a70
enhance: refine variable-length-type memory usage(#38736) (#43093) 
related: #38736
pr: https://github.com/milvus-io/milvus/pull/39578

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-07-04 18:26:45 +08:00
Chun Han
bfa9688da3
enhance: supporting separate chunk cache pool(#42803) (#42901) 
related: #42803

1. add a new thread pools using folly::CPUThreadPoolExecutor, named by
FThreadPools
2. reading vectors from chunkcache will use the separated
CHUNKCACHE_POOL to avoid being influenced by load collection
3. Note. For safety on cloud side on 2.5.x, only read-chunk-cache
operations is using this newly created thread pools other caller points
for threadpool will be mutated in the near future
4. master-branch doesn't need this pr as caching layer unified the chunk
cache behaviour

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-06-26 15:52:43 +08:00
foxspy
47f265864b
enhance: [2.5] update knowhere version for milvus 2.5.14 (#42939) 
issue: #42937 
pr: #42938

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-06-25 21:06:43 +08:00
zhagnlu
fe05970eba
fix is_not_in for trie index (#42886) 
pr: #42716

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-25 17:30:43 +08:00
Spade A
017eb9ffe2
fix: fix some bugs discovered by chaos tests --- cherry pick (#42909) 
master: https://github.com/milvus-io/milvus/pull/42906
issue: https://github.com/milvus-io/milvus/issues/42870

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-06-24 17:10:42 +08:00
Bingyi Sun
1a1d46d695
fix: Remove cached null expr result (#42783) 
pr: https://github.com/milvus-io/milvus/pull/42818
issue: #42698
cached result may be changed in caller so there is no need to cache it

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-23 16:02:42 +08:00
Spade A
79ffc17bfe
enhance: optimize tantivy cargo config cherry-pick (#42881) 
master: https://github.com/milvus-io/milvus/pull/42880
issue: https://github.com/milvus-io/milvus/issues/42879

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-06-20 16:18:11 +08:00
Spade A
b837fb2d1e
fix: update tantivy for fixing threads explosion in file watcher (#42828) 
master pr: #41450

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-06-18 15:40:40 +08:00
Chun Han
c403f01e6d
enhance: avoid using threadpool when column is ready in chunk cache(#42803) (#42804) 
related: #42803

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-06-18 02:44:40 +08:00
Spade A
77bcd1dac0
fix: update tantivy for solving threads exposion for tantivy (#42713) 
update tantivy: https://github.com/zilliztech/tantivy/pull/16

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
 2025-06-17 16:01:01 +08:00
Spade A
94005f8e01
enhance: tantivy collector set bitset directly cp-39748 (#42694) 
issue: https://github.com/milvus-io/milvus/issues/39755
pr: #39748
It also cherry-pick #40608

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-06-16 16:58:40 +08:00
aoiasd
35252ffbae
enhance: [2.5] use english name as language name for all type language identifier (#42601) 
Set whatlang detect return language name as english name.
Make sure same with lingua. 
pr: https://github.com/milvus-io/milvus/pull/42600

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-06-11 14:40:37 +08:00
congqixia
6fa877a0dc
enhance: [2.5] Set thread name for segcore thread pool (#42596) 
Cherry-pick from master
pr: #42017 #42497

Thread name could be helpful when debugging thread explosion issues

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-06-10 11:08:35 +08:00
Bingyi Sun
97fcc1586c
fix: [2.5] Fix the bug of valid data write corruption (#42555) 
issue: https://github.com/milvus-io/milvus/issues/42554
pr: https://github.com/milvus-io/milvus/pull/42556

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-06 19:22:43 +08:00
Bingyi Sun
f61e13fb2d
fix: Check cast type is array for json contains expr (#42185) 
issue: https://github.com/milvus-io/milvus/issues/42181
pr: #42184

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-06 11:00:33 +08:00
Bingyi Sun
532f10f343
enhance: Support cast function for json index (#42504) 
issue: #41948
pr: #41949

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-05 20:26:33 +08:00
zhagnlu
66e28f605f
fix: fix is null bug for marisa index (#42421) 
pr: #42420

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 14:52:32 +08:00
zhagnlu
bc5be6380d
fix: Add explicit move semantics to get_batch_view interface (#42402) 
pr: #42403

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 10:08:31 +08:00
aoiasd
6b0e602574
fix: [2.5] update tantivy version to fix stemmper panic (#42172) 
relate: https://github.com/milvus-io/milvus/issues/42168
pr: https://github.com/milvus-io/milvus/pull/42171

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-30 14:06:29 +08:00
cqy123456
b7fc38286f
fix:[2.5]when use new interim index, fail to get vector as output field. (#42183) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-05-30 10:58:29 +08:00
Min Tian
8d9c70b89b
fix: [2.5] Not need knowhere for thread control when calling knowhere-iterator (#42136) (#42133) 
issue: #42132 
pr: #42136 

When calling knowhere-iterator, the thread pool control of knowhere is
no longer needed.

Signed-off-by: min.tian <min.tian.cn@gmail.com>
 2025-05-30 10:14:30 +08:00
foxspy
e567b38a74
enhance: [2.5] update knowhere version (#42159) 
issue: #42060 
/kind branch-feature

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-29 12:22:30 +08:00
Xianhui Lin
0490344442
fix: support TTL expiration with queries returning no results (#42103) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-27 15:18:28 +08:00
Xianhui Lin
0574fc7b7b
enhance: support TTL expiration with queries returning no results (#41960) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-26 15:52:28 +08:00
Chun Han
19ab9513ff
enhance: threadpool name is not output as expected(#40838) (#41705) 
related: #40838

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-05-22 12:12:32 +08:00
cai.zhang
813bcb14a7
fix: [2.5]prevent crash when contains_all/any is used with empty array (#41756) 
issue: https://github.com/milvus-io/milvus/issues/41348

related and optimized by https://github.com/milvus-io/milvus/pull/41347

master pr: #41739

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: Sangho Park <hoyaspark@gmail.com>
 2025-05-14 14:30:22 +08:00
foxspy
96f7ab592b
enhance: [2.5] update knowhere version (#41828) 
issue: #37644 
/kind branch-feature

Signed-off-by: foxspy <xianliang.li@zilliz.com>
 2025-05-14 10:50:23 +08:00
zhagnlu
5b8ea84d38
fix: add params to ignore config type exception (#41777) 
pr: #41776

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-13 11:28:57 +08:00
zhagnlu
418c35630b
fix: GetValueFromConfig return nullopt instead of exception (#41711) 
pr: #41709

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-09 11:20:54 +08:00
Bingyi Sun
22582a45b0
feat: Add json index support for json contains expr (#41478) (#41658) 
pr: #41478 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-07 10:40:53 +08:00
Chun Han
69a80b9ce3
enhance: resize high priority wqthreadpool dynamically(#40838) (#41549) 
related: #40838

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-04-28 00:44:39 +08:00
zhagnlu
66f40fba85
enhance: add expr filter ratio monitor params (#41403) 
pr: #41402

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-24 21:58:39 +08:00
Xianhui Lin
db602da685
fix: [2.5]json stats add map null check before insert into tantivity (#41506) 
json stats add map null check before insert into tantivity
issue:https://github.com/milvus-io/milvus/issues/41494
pr:https://github.com/milvus-io/milvus/pull/41505

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-04-24 21:10:39 +08:00
Bingyi Sun
4ac57f1217
enhance: support binary range expression for json path index (#41317) 
pr: #41025 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-04-24 20:04:39 +08:00
aoiasd
8b3353cdab
feat: [2.5] Support run analyzer and more tokenizer. (#41444) 
relate: https://github.com/milvus-io/milvus/issues/39659
https://github.com/milvus-io/milvus/issues/39705
pr: https://github.com/milvus-io/milvus/pull/40416
https://github.com/milvus-io/milvus/pull/40458
https://github.com/milvus-io/milvus/pull/39723
https://github.com/milvus-io/milvus/pull/40813
https://github.com/milvus-io/milvus/pull/39854
https://github.com/milvus-io/milvus/pull/39660

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-04-24 10:48:39 +08:00
sparknack
45ad8ecb29
enhance: add simde package (#41446) 
issue: #40942

pr: #40943 

Add simde package, which can make porting SIMD code to other
architectures much easier.

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
 2025-04-24 10:46:43 +08:00
foxspy
d5977ec521
enhance: [2.5] add force rebuild index configuration (#41432) 
issue: #41431 
pr: #41473

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-04-23 21:44:38 +08:00
aoiasd
544493e3e2
feat:[2.5] support multi analyzer for bm25 function (#41456) 
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41351

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-04-23 20:52:39 +08:00
Xianhui Lin
83b993afb6
fix: [2.5]JsonStats filter by conjunctExpr and improve the task slot calculation logic (#41458) 
Optimized JSON filter execution by introducing
ProcessJsonStatsChunkPos() for unified position calculation and
GetNextBatchSize() for better batch processing.
Improved JSON key generation by replacing manual path joining with
milvus::Json::pointer() and adjusted slot size calculation for JSON key
index jobs.
Updated the task slot calculation logic in calculateStatsTaskSlot() to
handle the increased resource needs of JSON key index jobs.
issue: https://github.com/milvus-io/milvus/issues/41378
https://github.com/milvus-io/milvus/issues/41218
pr: https://github.com/milvus-io/milvus/pull/41459

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-04-23 14:36:38 +08:00