admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,875 Commits 146 Branches 196 Tags
Commit Graph

1821 Commits

Author SHA1 Message Date
cqy123456
7c716d61dc
fix:[2.5]wrong p.InterimIndexRefineQuantType default value and reduce ut run time (#40830) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-21 19:10:13 +08:00
Bingyi Sun
d09483809c
fix: Fix tasks will panic if one of them throw an exception. (#40760) 
issue: #40690 
pr: https://github.com/milvus-io/milvus/pull/40691

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 17:50:18 +08:00
Bingyi Sun
0a1272fc6f
fix: Revert "enhance: update tantivy version (#39253)" (#40769) 
issue: #35528 
pr: #40313 
This reverts commit d3cec7f277b5f73a8acf5100eb8d744fbc476348.

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 11:24:17 +08:00
zhagnlu
14259a3f8a
fix:fix exception when do arith expr when using index (#40799) 
pr: #40783

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-20 19:34:49 +08:00
Xianhui Lin
2710eb3fc9
fix: [2.5] Json Stats filter the data is double but the filter expr is int (#40771) 
Json Stats  filter the data is double but the filter is int 
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr:https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-19 20:22:13 +08:00
Xianhui Lin
78f3d69a2f
fix: jsonstats Negative numbers cannot be filtered out (#40734) 
fix: jsonstats Negative numbers cannot be filtered out
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-18 22:35:53 +08:00
cai.zhang
d4e2f581f9
fix: [2.5] Do not delete the centroids file when sampling fails instead wait GC (#40702) 
issue: #40700 

pr: #40701

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-18 22:00:20 +08:00
cqy123456
2fbfd86146
fix:[2.5]fix growing index ut (#40724) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-18 19:04:15 +08:00
Xianhui Lin
705b3c90a5
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when enable JsonKeyStats (#40661) 
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when
enable JsonKeyStats.The reason is that the file path of the jsonkeyindex
has changed.
issue: https://github.com/milvus-io/milvus/issues/40649
，https://github.com/milvus-io/milvus/issues/40669
https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-18 17:32:16 +08:00
zhagnlu
e47682aa55
fix:add clear bitmap input for every batch loop (#40722) 
#40685
cherry-pick part from pr: #39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-18 17:27:02 +08:00
foxspy
0dc4b73c81
fix: [2.5] avoid segmentation faults caused by retrieving empty vector datasets (#40546) 
issue: #40544 
pr: #40545

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-03-18 14:58:13 +08:00
Bingyi Sun
b0078ceae3
fix: Fix json test (#40710) 
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/40671

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-18 12:52:13 +08:00
cqy123456
b8abd91962
enhance[2.5]: add more config for interimIndex to support more refine mode (#40429) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-17 22:04:12 +08:00
Bingyi Sun
9145885f40
enhance: Record simdjson error (#40671) 
issue: #35528
pr: #40647

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-15 12:48:08 +08:00
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter (#40648) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-14 21:36:10 +08:00
Bingyi Sun
0a3435f53a
fix: Fix null offset loading in inverted index (#40524) 
issue: #40516 
pr: https://github.com/milvus-io/milvus/pull/40523

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-14 18:32:09 +08:00
zhagnlu
6b9e141ada
enhance: reorder sub expr for conjunct expr (#40186) 
pr:#39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-14 15:16:08 +08:00
Bingyi Sun
33e9db1539
fix: cherry pick json prs (#40621) 
issue: #35528 
pr: #40604 
this pr includes some prs:
1. #40604 
2. #40611 
3. #40619

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-13 20:36:10 +08:00
Xianhui Lin
f5e9dea2aa
fix: [2.5]fix the garbage cleanup logic of jsonkey stats && improve json key stats filer (#40039) 
fix: fix the garbage collection cleanup logic of jsonkey stats &&
improve json key stats filer
issue: https://github.com/milvus-io/milvus/issues/36995
https://github.com/milvus-io/milvus/issues/40034
https://github.com/milvus-io/milvus/issues/40041
https://github.com/milvus-io/milvus/issues/40106
https://github.com/milvus-io/milvus/issues/40138
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-13 20:18:10 +08:00
Bingyi Sun
d8f51ca852
fix: Catch invalid json pointer error (#40626) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40625

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-13 16:10:09 +08:00
Spade A
ec6f8bac6d
fix: [2.5] avoid panic when field not exists in schema in query node (#40542) 
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40541

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-12 22:14:09 +08:00
Bingyi Sun
bd4170106d
fix: cherry pick json index related prs (#40568) 
issue: #35528 
pr: #40407 
this pr includes some json index related pr:
1. #40407
2. #40538 
3. #40419

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-11 21:00:09 +08:00
congqixia
d0763cb84d
enhance: [2.5] Fix Array.h clang format issue (#40536) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-11 15:58:09 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313) 
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-10 22:14:05 +08:00
Chun Han
ed71932c0a
fix:array corrupt for ignoring validity(#40384) (#40433) 
related: #40384

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-03-07 18:15:48 +08:00
Bingyi Sun
32b6f721eb
fix: Null expr does not work for json field (#40457) 
issue: #40455 
pr: #40456

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-07 18:00:03 +08:00
smellthemoon
08a8e01f72
fix: [2.5]store wrong offset when build tantivy in nullable field (#40453) 
pr: #40452 
issue: #40454

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2025-03-07 17:54:06 +08:00
cai.zhang
8d76d58d20
enhance: [2.5]Only check element type with not null array (#40447) 
master pr: #40446

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-07 12:49:08 +08:00
Spade A
345ca01634
fix: [2.5]fix concurrent issues in null offset #40363 (#40365) 
issue: https://github.com/milvus-io/milvus/issues/40308
cherry-pick: https://github.com/milvus-io/milvus/pull/40363

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-05 16:54:09 +08:00
Zhen Ye
34f2bc0a68
enhance: add more metrics for async cgo component (#40232) 
issue: #40014
pr: #40136

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-05 09:16:00 +08:00
Bingyi Sun
825316670d
enhance: upgrade rust version to 1.83 (#39295) (#40317) 
issue: #39254
pr: https://github.com/milvus-io/milvus/pull/39295

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-04 17:42:04 +08:00
zhagnlu
c45771af6a
enhance: add monitor metric for retrieve raw data (#40155) 
pr: #40141

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-25 14:41:56 +08:00
Bingyi Sun
29579a8ec9
fix: Fix search failure of null expression (#40128) 
issue: https://github.com/milvus-io/milvus/issues/40095
pr: #40129

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-02-24 18:35:55 +08:00
zhagnlu
d66d3f0d47
enhance:decrease dump snapshot limit from 10w to 1w (#40102) 
pr: #40101

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-22 11:29:53 +08:00
yihao.dai
b8a758b6c4
enhance: [2.5] Add get vector latency metric and refine request limit error message (#40085) 
issue: https://github.com/milvus-io/milvus/issues/40078

pr: https://github.com/milvus-io/milvus/pull/40083

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-02-21 20:19:55 +08:00
zhagnlu
ce6d8ba836
enhance: optimize expr performace for some points (#39695) (#39938) 
1. skip get expr arguments which deserialize proto for every batch
execute.
2. replace unordered_set with sort array that has better performace for
small set.
pr: #39695

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-19 19:52:53 +08:00
Bingyi Sun
6cd00880e2
fix: Skip create primary key index when loading pk index (#39922) 
issue: https://github.com/milvus-io/milvus/issues/39907
pr: https://github.com/milvus-io/milvus/pull/39921

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-02-19 15:54:52 +08:00
Xianhui Lin
04175d8549
enhance: [2.5]compress jsonstatslog path only save filename (#39979) 
enhance: compress jsonstatslog path only save filename
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-02-19 10:20:52 +08:00
Xianhui Lin
63576738b6
fix: [2.5]exists expr on nested dictionaries fail in JSONkeyIndex (#39972) 
fix: exists expr on nested dictionaries fail in JSONkeyIndex
issue: https://github.com/milvus-io/milvus/issues/39963
pr: https://github.com/milvus-io/milvus/pull/38039

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-02-19 10:18:51 +08:00
congqixia
2eaa1a4869
fix: [2.5] Use text_log prefix for TextMatchIndex null offset file (#39936) 
Cherry-pick from master
pr: #39935
Related to #39933

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-18 00:43:07 +08:00
Xianhui Lin
f0964f769d
enhance: [2.5]Add json key inverted index in stats for optimization (#39876) 
Add json key inverted index in stats for optimization
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-16 20:12:15 +08:00
presburger
e372b1733c
enhance: [2.5]update raft to cuvs (#39221) 
pr: #39873
issue: #39883

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2025-02-14 16:52:14 +08:00
cai.zhang
401794f405
fix: [2.5] Fix module for long type (#39802) 
issue: #39640 

master pr: #39722

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-14 15:18:21 +08:00
congqixia
df28d2200d
fix: [2.5] Remove load field & schema column size check #39834 (#39835) 
Cherry-pick from master
pr: #39833
Related to #39788

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-13 12:42:53 +08:00
cqy123456
d121ac3a7a
enhance: [2.5]intermin index support different index type and more data type(fp16/bf16) (#39180) 
issue: https://github.com/milvus-io/milvus/issues/27678
related: https://github.com/milvus-io/milvus/pull/39753
some raw data status will change:
Intermin index has raw data: 
<html xmlns:v="urn:schemas-microsoft-com:vml"
xmlns:o="urn:schemas-microsoft-com:office:office"
xmlns:x="urn:schemas-microsoft-com:office:excel"
xmlns="http://www.w3.org/TR/REC-html40">

<head>

<meta name=ProgId content=Excel.Sheet>
<meta name=Generator content="Microsoft Excel 15">
<link id=Main-File rel=Main-File

href="file:////Users/cqy/Library/Group%20Containers/UBF8T346G9.Office/TemporaryItems/msohtmlclip/clip.htm">
<link rel=File-List

href="file:////Users/cqy/Library/Group%20Containers/UBF8T346G9.Office/TemporaryItems/msohtmlclip/clip_filelist.xml">
<!--table
	{mso-displayed-decimal-separator:"\.";
	mso-displayed-thousand-separator:"\,";}
@page
	{margin:.75in .7in .75in .7in;
	mso-header-margin:.3in;
	mso-footer-margin:.3in;}
.font5
	{color:windowtext;
	font-size:9.0pt;
	font-weight:400;
	font-style:normal;
	text-decoration:none;
	font-family:等线;
	mso-generic-font-family:auto;
	mso-font-charset:134;}
tr
	{mso-height-source:auto;
	mso-ruby-visibility:none;}
col
	{mso-width-source:auto;
	mso-ruby-visibility:none;}
br
	{mso-data-placement:same-cell;}
td
	{padding-top:1px;
	padding-right:1px;
	padding-left:1px;
	mso-ignore:padding;
	color:black;
	font-size:12.0pt;
	font-weight:400;
	font-style:normal;
	text-decoration:none;
	font-family:等线;
	mso-generic-font-family:auto;
	mso-font-charset:134;
	mso-number-format:General;
	text-align:general;
	vertical-align:middle;
	border:none;
	mso-background-source:auto;
	mso-pattern:auto;
	mso-protection:locked visible;
	white-space:nowrap;
	mso-rotate:0;}
ruby
	{ruby-align:left;}
rt
	{color:windowtext;
	font-size:9.0pt;
	font-weight:400;
	font-style:normal;
	text-decoration:none;
	font-family:等线;
	mso-generic-font-family:auto;
	mso-font-charset:134;
	mso-char-type:none;
	display:none;}
-->
</head>

<body link="#0563C1" vlink="#954F72">


sparse vector | growing segment | sealed segment
-- | -- | --
BM25 | no | no
IP | yes | no
  |   |  
dense vector | growing segment | sealed segment
ivf flat cc | yes | yes
scann_dvr | no | no



</body>

</html>

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-02-13 09:56:47 +08:00
Buqian Zheng
0f4d3ef8b6
enhance[2.5]: move GetVector_EmptySparseVector ut to growing test (#39286) 
issue: https://github.com/milvus-io/milvus/issues/35853
pr: https://github.com/milvus-io/milvus/pull/39234

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-02-12 16:00:49 +08:00
foxspy
b02d6423a3
enhance: [2.5]update knowhere version (#39673) 
/kind branch-feature

release note :
https://github.com/zilliztech/knowhere/releases/tag/v2.5.3

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-02-07 12:46:45 +08:00
Gao
aee9368c6e
enhance: [2.5] update knowhere version and IsAdditionalScalarSupported interface (#39574) 
pr: #39573

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2025-02-05 19:53:11 +08:00
zhagnlu
6cdabd9002
fix:fix GetValueFromConfig for bool type (#39527) 
pr: #39526

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-01-23 00:03:07 +08:00
Bingyi Sun
6342237ca8
enhance: add workaround for concurrent tantivy reload and directory removal (#39441) 
related pr: https://github.com/milvus-io/milvus/pull/39440
issue: https://github.com/milvus-io/milvus/issues/39428

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-01-20 17:33:05 +08:00