admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-29 15:05:31 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,185 Commits 136 Branches 185 Tags
Commit Graph

46 Commits

Author SHA1 Message Date
Buqian Zheng
fa8d641ce6
fix: update check for sparse hnsw index (#33713) 
issue: #29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-07-02 21:56:09 +08:00
cqy123456
51ebe95be5
enhance: remove CheckVecIndexWithDataTypeExist function in pkg and remove some cgo call (#34102) 
issue: https://github.com/milvus-io/milvus/issues/22837
related pr: https://github.com/milvus-io/milvus/pull/34104

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-26 21:13:44 +08:00
cqy123456
298e50b834
enhance: check index with data type (#33880) 
issue: https://github.com/milvus-io/milvus/issues/22837
related: https://github.com/milvus-io/milvus/pull/33878

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-19 10:15:59 +08:00
Gao
a789c60380
enhance: autoindex for multi data type (#33868) 
issue: #22837 

contain https://github.com/milvus-io/milvus/pull/33625
https://github.com/milvus-io/milvus/pull/33867
https://github.com/milvus-io/milvus/pull/33911 which already merged to
2.4 branch

Signed-off-by: chasingegg <chao.gao@zilliz.com>
Co-authored-by: foxspy <xianliang.li@zilliz.com>
 2024-06-18 21:34:01 +08:00
zhagnlu
d43ec4db0b
enhance: support array bitmap index (#33527) 
#32900

---------

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-16 21:51:58 +08:00
cqy123456
be3559e022
enhance: proxy check hnsw with sparse is legal (#33697) 
issue:https://github.com/milvus-io/milvus/issues/22837
related:https://github.com/milvus-io/milvus/pull/33653

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-12 20:13:55 +08:00
Jiquan Long
0c5d8660aa
feat: support inverted index for array (#33452) 
issue: https://github.com/milvus-io/milvus/issues/27704

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-05-31 09:47:47 +08:00
zhagnlu
589d4dfd82
enhance: optimize bitmap index (#33358) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-05-30 13:09:43 +08:00
Buqian Zheng
c5918ffbdb
enhance: mark sparse inverted index as mmap-able (#33281) 
issue: #29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-05-23 14:11:42 +08:00
zhagnlu
d669fbcf46
enhance: support bitmap index for scalar type (#32902) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-05-19 21:49:38 +08:00
Cai Yudong
00438f408f
enhance: Unify data type check APIs for go (#31887) 
Issue: #22837

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-07 14:27:22 +08:00
Cai Yudong
0d1abb081b
enhance: Disable HNSW Binary (#31825) 
Issue: #31494

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-03 14:53:14 +08:00
cai.zhang
1f43be4a3c
enhance: Support auto index for scalar index (#31255) 
issue: #29309 
reopen pr : #29310

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-03-21 10:37:08 +08:00
Buqian Zheng
3c80083f51
feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 
add sparse float vector support to different milvus components,
including proxy, data node to receive and write sparse float vectors to
binlog, query node to handle search requests, index node to build index
for sparse float column, etc.

https://github.com/milvus-io/milvus/issues/29419

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-03-13 14:32:54 -07:00
Xiaofan
4bda6c33ad
fix: binary vector should not limit dimension to 32768 (#30676) 
all the vector dimension check should happen on collection creation but
not index build
fix #30285

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2024-03-05 14:21:00 +08:00
Bingyi Sun
8addd75481
fix: Mmap could be enabled on ScaNN index (#30914) 
issue: https://github.com/milvus-io/milvus/issues/30899

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-03-01 10:56:59 +08:00
cqy123456
b31d1a1eb5
enhance: add addition index params for raft index (#30179) 
issue: https://github.com/milvus-io/milvus/issues/29230

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
Co-authored-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-02-26 14:50:54 +08:00
xige-16
033eae9e73
enhance: Set segment.maxSize param to 1024M (#30139) 
issue: #25639 
/kind improvement

When the number of vector columns increases, the number of rows per
segment will decrease. In order to reduce the impact on vector indexing
performance, it is necessary to increase the segment max limit.

If a collection has multiple vector fields with memory and disk indices
on different vector fields, the size limit after segment compaction is
the minimum of segment.maxSize and segment.diskSegmentMaxSize.

Signed-off-by: xige-16 <xi.ge@zilliz.com>

---------

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2024-01-29 10:17:02 +08:00
yah01
51fe4743f1
enhance: hint the invalid metric type in error message (#30263) 
this hints the user passed invalid metric type in error message, so
users could know what's wrong

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2024-01-25 14:15:00 +08:00
yah01
1c8ce33eea
fix: report error if the altering index doesn't support mmap (#29832) 
this also checks the param value
fix #29909

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2024-01-17 16:40:54 +08:00
Xu Tong
e429965f32
Add float16 approve for multi-type part (#28427) 
issue：https://github.com/milvus-io/milvus/issues/22837

Add bfloat16 vector, add the index part of float16 vector.

Signed-off-by: Writer-X <1256866856@qq.com>
 2024-01-11 15:48:51 +08:00
cqy123456
22bb84fa9d
feat:add new gpu index:GPU_BRUTE_FORCE and limit gpu index metric type (#29590) 
issue: https://github.com/milvus-io/milvus/issues/29230
this pr do these things:
1. add gpu brute force;
2. limit gpu index only support l2 / ip;

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-01-05 15:24:48 +08:00
yah01
9e0163e12f
enhance: use GPU pool for gpu tasks (#29678) 
- this much improve the performance for GPU index

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2024-01-04 17:50:46 +08:00
cqy123456
4c979538a4
enhance: update cagra index params in config and add params check (#29045) 
issue:https://github.com/milvus-io/milvus/issues/29230
this pr do two things about cagra index:
 a.milvus yaml config support gpu memory settings

 b.add cagra-params check

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
Co-authored-by: yusheng.ma <yusheng.ma@zilliz.com>
 2023-12-26 11:04:47 +08:00
Jiquan Long
520c07ec9d
fix: autoindex panic with flat index type (#29071) 
issue: https://github.com/milvus-io/milvus/issues/29048

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-12-12 22:08:46 +08:00
groot
ad1daebc8e
fix: Change ranges of HNSW parameters according to Knowhere (#28875) 
fix: https://github.com/milvus-io/milvus/issues/28860

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-12-05 16:20:42 +08:00
congqixia
5d558623fe
Add revive sub-lints and fix existing problems (#27495) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-10-07 20:53:38 +08:00
congqixia
67a471e09c
Fix gofumpt issue in scann_checker_test.go (#27305) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-22 00:39:26 +08:00
Gao
ab2d8dd0a7
Add ScaNN index param checker (#27268) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-09-21 14:51:25 +08:00
SimFG
26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
Xu Tong
9166011c4a
Add float16 vector (#25852) 
Signed-off-by: Writer-X <1256866856@qq.com>
 2023-09-08 10:03:16 +08:00
Cai Yudong
8dc16b599b
Add binary metric types SUBSTRUCTURE/SUPERSTRUCTURE back (#26766) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-08-31 20:07:00 +08:00
cqy123456
7e3323a518
update dimension range of diskann. (#26405) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-08-17 20:26:20 +08:00
cqy123456
376642b933
reset diskann min dim limit (#26344) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-08-15 16:45:34 +08:00
Gao
b6fcbb0998
Support ScaNN index (#26099) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-08-11 14:21:29 +08:00
Cai Yudong
9a4761dcc7
Remove binary metrics TANIMOTO/SUPERSTRUCTURE/SUBSTRUCTURE (#25708) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-19 16:16:58 +08:00
Cai Yudong
73512c72fd
Remove calc_distance (#25663) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-18 14:23:20 +08:00
Cai Yudong
5aad0ceec3
HNSW support binary vector (#25417) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-10 18:18:28 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
Jiquan Long
29ae1229b6
Support AutoIndex (#24387) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-29 20:35:28 +08:00
Jiquan Long
a98c79b6a6
Fix flat index can be created with invalid metric type (#24180) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-18 11:07:26 +08:00
congqixia
73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
Jiquan Long
7be7e6f360
Refactor check logic of index parameters (#23856) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-06 10:40:39 +08:00
Cai Yudong
2725d38b9e
Add COSINE metric type (#23350) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-20 10:20:31 +08:00
Cai Yudong
49eb4b8af4
Clean ANNOY params (#23353) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-11 17:54:35 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00