admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,086 Commits 137 Branches 188 Tags
Commit Graph

98 Commits

Author SHA1 Message Date
Chun Han
29d9ee7bd2 enhance: refine variable-length-type memory usage(#38736) (#43093) 
related: #38736
pr: https://github.com/milvus-io/milvus/pull/39578

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-12-12 18:59:04 +08:00
Bingyi Sun
f61e13fb2d
fix: Check cast type is array for json contains expr (#42185) 
issue: https://github.com/milvus-io/milvus/issues/42181
pr: #42184

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-06-06 11:00:33 +08:00
zhagnlu
bc5be6380d
fix: Add explicit move semantics to get_batch_view interface (#42402) 
pr: #42403

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-06-03 10:08:31 +08:00
Xianhui Lin
0490344442
fix: support TTL expiration with queries returning no results (#42103) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-27 15:18:28 +08:00
Xianhui Lin
0574fc7b7b
enhance: support TTL expiration with queries returning no results (#41960) 
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-26 15:52:28 +08:00
cai.zhang
813bcb14a7
fix: [2.5]prevent crash when contains_all/any is used with empty array (#41756) 
issue: https://github.com/milvus-io/milvus/issues/41348

related and optimized by https://github.com/milvus-io/milvus/pull/41347

master pr: #41739

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: Sangho Park <hoyaspark@gmail.com>
 2025-05-14 14:30:22 +08:00
Bingyi Sun
22582a45b0
feat: Add json index support for json contains expr (#41478) (#41658) 
pr: #41478 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-07 10:40:53 +08:00
zhagnlu
66f40fba85
enhance: add expr filter ratio monitor params (#41403) 
pr: #41402

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-24 21:58:39 +08:00
Bingyi Sun
4ac57f1217
enhance: support binary range expression for json path index (#41317) 
pr: #41025 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-04-24 20:04:39 +08:00
Xianhui Lin
83b993afb6
fix: [2.5]JsonStats filter by conjunctExpr and improve the task slot calculation logic (#41458) 
Optimized JSON filter execution by introducing
ProcessJsonStatsChunkPos() for unified position calculation and
GetNextBatchSize() for better batch processing.
Improved JSON key generation by replacing manual path joining with
milvus::Json::pointer() and adjusted slot size calculation for JSON key
index jobs.
Updated the task slot calculation logic in calculateStatsTaskSlot() to
handle the increased resource needs of JSON key index jobs.
issue: https://github.com/milvus-io/milvus/issues/41378
https://github.com/milvus-io/milvus/issues/41218
pr: https://github.com/milvus-io/milvus/pull/41459

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-04-23 14:36:38 +08:00
Xianhui Lin
3b7b16ba2f
fix: [2.5]support infix and suffix match types in JsonStats (#41388) 
fix: [2.5]support infix and suffix match types in JsonStats
issue:https://github.com/milvus-io/milvus/issues/41386
pr:https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-04-18 12:32:36 +08:00
zhagnlu
2aae9caca9
enhance: use scan mode for like although inverted index exists (#41309) 
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-15 18:36:32 +08:00
zhagnlu
2498eb0691
enhance: add optimize for like expr (#41222) 
pr: #41066  cherry-pick from master

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-14 21:06:32 +08:00
zhagnlu
77e6404617
fix:add clear bitmap for batch skip mode (#41165) 
pr: #41166

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-09 12:02:26 +08:00
congqixia
8c52fbfe0d
fix: [2.5] Use element_type for Array is null operator (#41158) 
Cherry-pick from master
pr: #41157

Related to #41156

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-09 02:08:26 +08:00
Bingyi Sun
9eb74d7418
fix: Fix the bug that null data can not filtered by null expr (#41135) 
issue: #41063 
pr: #41124

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-04-08 00:26:26 +08:00
zhagnlu
0d3bd3131c
fix:fix format error for json (#41031) 
#41026

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-02 14:32:32 +08:00
Bingyi Sun
9108cee958
feat: add json null/exists expression (#41002) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/41004

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-31 21:52:23 +08:00
Bingyi Sun
f0346a149a
fix: Fix using json index when iterative_filter is specified (#40946) 
issue: #40934 
pr: #40945

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-27 23:02:20 +08:00
zhagnlu
deed5b5df4
enhance:change multi or expr to in expr (#40751) 
pr: #40757

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-27 11:08:20 +08:00
zhagnlu
14259a3f8a
fix:fix exception when do arith expr when using index (#40799) 
pr: #40783

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-20 19:34:49 +08:00
Xianhui Lin
2710eb3fc9
fix: [2.5] Json Stats filter the data is double but the filter expr is int (#40771) 
Json Stats  filter the data is double but the filter is int 
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr:https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-19 20:22:13 +08:00
Xianhui Lin
705b3c90a5
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when enable JsonKeyStats (#40661) 
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when
enable JsonKeyStats.The reason is that the file path of the jsonkeyindex
has changed.
issue: https://github.com/milvus-io/milvus/issues/40649
，https://github.com/milvus-io/milvus/issues/40669
https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-18 17:32:16 +08:00
zhagnlu
e47682aa55
fix:add clear bitmap input for every batch loop (#40722) 
#40685
cherry-pick part from pr: #39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-18 17:27:02 +08:00
zhagnlu
6b9e141ada
enhance: reorder sub expr for conjunct expr (#40186) 
pr:#39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-14 15:16:08 +08:00
Bingyi Sun
33e9db1539
fix: cherry pick json prs (#40621) 
issue: #35528 
pr: #40604 
this pr includes some prs:
1. #40604 
2. #40611 
3. #40619

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-13 20:36:10 +08:00
Xianhui Lin
f5e9dea2aa
fix: [2.5]fix the garbage cleanup logic of jsonkey stats && improve json key stats filer (#40039) 
fix: fix the garbage collection cleanup logic of jsonkey stats &&
improve json key stats filer
issue: https://github.com/milvus-io/milvus/issues/36995
https://github.com/milvus-io/milvus/issues/40034
https://github.com/milvus-io/milvus/issues/40041
https://github.com/milvus-io/milvus/issues/40106
https://github.com/milvus-io/milvus/issues/40138
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-13 20:18:10 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313) 
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-10 22:14:05 +08:00
Bingyi Sun
29579a8ec9
fix: Fix search failure of null expression (#40128) 
issue: https://github.com/milvus-io/milvus/issues/40095
pr: #40129

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-02-24 18:35:55 +08:00
zhagnlu
ce6d8ba836
enhance: optimize expr performace for some points (#39695) (#39938) 
1. skip get expr arguments which deserialize proto for every batch
execute.
2. replace unordered_set with sort array that has better performace for
small set.
pr: #39695

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-19 19:52:53 +08:00
Xianhui Lin
04175d8549
enhance: [2.5]compress jsonstatslog path only save filename (#39979) 
enhance: compress jsonstatslog path only save filename
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-02-19 10:20:52 +08:00
Xianhui Lin
f0964f769d
enhance: [2.5]Add json key inverted index in stats for optimization (#39876) 
Add json key inverted index in stats for optimization
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-16 20:12:15 +08:00
cai.zhang
401794f405
fix: [2.5] Fix module for long type (#39802) 
issue: #39640 

master pr: #39722

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-14 15:18:21 +08:00
Bingyi Sun
56cb1683eb
fix: Fix performance issue and use after free bug (#39343) 
cherry pick some fixes in https://github.com/milvus-io/milvus/pull/39249

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-01-17 11:51:03 +08:00
Spade A
47e410feb1
fix: [2.5] fix assignment operator in AssertInfo to comparison operator (#39351) 
cp https://github.com/milvus-io/milvus/pull/39347
issue: #39346

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
 2025-01-17 11:27:02 +08:00
smellthemoon
1602390734
enhance: support null expr(#38772) (#38931) 
pr: #38772 
issue: #31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2025-01-16 10:55:07 +08:00
congqixia
0b62c1e692
enhance: [2.5] Optimize retrieve performance utilizing bitset SIMD methods (#39041) 
Cherry pick from master
pr: #39004 #39037
Related to #39003

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-07 17:45:03 +08:00
Chun Han
decdfdae10
fix: growing-groupby-crush(#38533) (#38538) 
related: #38533

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-12-17 21:05:12 +08:00
Ted Xu
4919ccf543
enhance: eliminate compile warnings (#38420) 
See: #38435

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-12-16 09:58:43 +08:00
Chun Han
c1f9158996
fix: search-group-by failed to get data from multi-chunked-segment(##… (#38383) 
related: #38343

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-12-13 16:54:43 +08:00
cqy123456
b14a0c4bf5
fix:GrowingDataGetter get the wrong string data (#38015) 
issue: https://github.com/milvus-io/milvus/issues/37994
2.4 pr: https://github.com/milvus-io/milvus/pull/37995

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-12-12 14:50:42 +08:00
Gao
994fc544e7
enhance: support iterative filter execution (#37363) 
issue: #37360

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-12-11 11:32:44 +08:00
Xianhui Lin
6d0a4fdb31
fix: Fix bug for Search fails with filter expression contains underscore (#38085) 
Enhance the matching for elements within the UnaryRangeArray
https://github.com/milvus-io/milvus/issues/38068

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2024-12-05 10:18:40 +08:00
Bingyi Sun
90064cd47b
fix: Fix variable redeclaration in term filter (#38045) 
https://github.com/milvus-io/milvus/issues/38046

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-12-02 15:10:38 +08:00
zhagnlu
62af24c1a1
fix: change search latency metric from us unit to ms unit (#37806) 
#37805

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-11-24 17:26:33 +08:00
Bingyi Sun
d1596297d9
fix: Fix query failure with inverted index (#37686) 
https://github.com/milvus-io/milvus/issues/37649

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-11-15 10:28:31 +08:00
smellthemoon
3389a6b500
enhance: support null in text match index (#37517) 
#37508

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-11-13 11:08:29 +08:00
Chun Han
2d29dcd30c
enhance:refine group_strict_size parameter(#37482) (#37483) 
related: #37482

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-11-12 09:56:28 +08:00
Bingyi Sun
40ba5a3414
fix: fix chunked segment term filter expression and add ut (#37392) 
issue: https://github.com/milvus-io/milvus/issues/37143

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-11-07 11:04:19 -08:00
Bingyi Sun
bd04cac4b3
fix: fix group by on chunked segment (#37292) 
https://github.com/milvus-io/milvus/issues/37244

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-11-05 17:12:23 +08:00