admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-05 10:22:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,957 Commits 136 Branches 188 Tags
Commit Graph

62 Commits

Author SHA1 Message Date
Cai Yudong
2bd2cca04a
enhance: Truly support multi vector data types in SearchBruteForce (#40499) 
Issue: #38666

Signed-off-by: CaiYudong <yudong.cai@zilliz.com>
 2025-03-10 18:36:03 +08:00
congqixia
844df76cc0
enhance: Rectify run_clang_format grep command (#39534) 
Previously the grep with regex does not work and failed to match lots of
.cpp files

This PR:
- use "-E" flag to use regex match
- commit the fixed result of current cpp code

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-23 17:07:05 +08:00
Cai Yudong
341d6c1eb7
feat: Update segcore for VECTOR_INT8 (#39415) 
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2025-01-21 11:03:03 +08:00
Patrick Weizhi Xu
85f462be1a
enhance: speed up search iterator stage 1 (#37947) 
issue: #37548

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-12-26 10:32:49 +08:00
Gao
994fc544e7
enhance: support iterative filter execution (#37363) 
issue: #37360

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-12-11 11:32:44 +08:00
cqy123456
8216345b07
enhance: reduce copy of bitset and id conversion of brurtforce search (#37675) 
issue: https://github.com/milvus-io/milvus/issues/37798

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-11-19 15:48:40 +08:00
aoiasd
e9391acf80
fix: bm25 brute force search need index params k1 and b (#37721) 
relate: https://github.com/milvus-io/milvus/issues/35853

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-11-18 15:44:31 +08:00
aoiasd
993051bb49
fix: brute force bm25 search lack avgdl param (#37650) 
relate: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-11-14 14:58:31 +08:00
Cai Yudong
3c9a47c8db
feat: Encode traceID and spanID as hex string (#34807) 
Issue: https://github.com/zilliztech/knowhere/pull/714

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-08-06 15:20:16 +08:00
Min Tian
a4aed9b0b5
enhance: new knowhere param for range_search (#34686) 
issue: #34685 
knowhere needs a new json param `range_search_k` for RangeSearch to
early terminate the iterator.

Signed-off-by: min.tian <min.tian.cn@gmail.com>
 2024-07-23 11:45:43 +08:00
Cai Yudong
ad90360162
enhance: Update knowhere commit (#34223) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-06-27 18:20:06 +08:00
zhagnlu
0d7ea8ec42
enhance: Enhance and correct exception module (#33705) 
#33704

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-23 21:22:01 +08:00
Buqian Zheng
858599d831
enhance: sparse float vector to support brute force iterator and range search (#32635) 
issue: #29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-04-29 14:35:26 +08:00
Gao
0fab265eed
enhance: update knowhere and some header changes (#32468) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-04-22 15:47:26 +08:00
Cai Yudong
246586be27
enhance: Unify data type check APIs under internal/core (#31800) 
Issue: #22837 

Move and rename following C++ APIs:
datatype_sizeof() ==> GetDataTypeSize()
datatype_name() ==> GetDataTypeName()
datatype_is_vector() / IsVectorType() ==> IsVectorDataType()
datatype_is_variable() ==> IsVariableDataType()
datatype_is_sparse_vector() ==> IsSparseFloatVectorDataType()
datatype_is_string() / IsString() ==> IsDataTypeString()
datatype_is_floating() / IsFloat() ==> IsDataTypeFloat()
datatype_is_binary() ==> IsDataTypeBinary()
datatype_is_json() ==> IsDataTypeJson()
datatype_is_array() ==> IsDataTypeArray()
datatype_is_variable() == IsDataTypeVariable()
datatype_is_integer() / IsIntegral() ==> IsDataTypeInteger()

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-02 19:15:14 +08:00
Cai Yudong
675a5dc822
fix: Save traceID and spanID as std::vector into search config (#31278) 
Issue: #30961

Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2024-03-29 14:29:11 +08:00
Buqian Zheng
96cfae55a5
feat: [Sparse Float Vector] segcore to support sparse vector search and get raw vector by id (#30629) 
This PR adds the ability to search/get sparse float vectors in segcore,
and added unit tests by modifying lots of existing tests into
parameterized ones.

https://github.com/milvus-io/milvus/issues/29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-03-12 09:16:30 -07:00
Cai Yudong
a99143dd52
fix: Save traceID and spanID as hex string into search config (#31071) 
Issue: #30961

Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2024-03-11 14:21:01 +08:00
Cai Yudong
122981aeb9
fix: Disable knowhere trace as a quick fix (#31055) 
Issue: #30961

Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2024-03-08 15:27:01 +08:00
Cai Yudong
8a219e0102
feat: Support knowhere trace using OpenTelemetry (#30750) 
Issue: #21508

Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2024-02-28 12:29:00 +08:00
MrPresent-Han
77eb6defb1
feat: support groupby on growing and non-indexed sealed egment(#30307) (#30644) 
related: #30308

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-02-21 14:02:53 +08:00
Xu Tong
e429965f32
Add float16 approve for multi-type part (#28427) 
issue：https://github.com/milvus-io/milvus/issues/22837

Add bfloat16 vector, add the index part of float16 vector.

Signed-off-by: Writer-X <1256866856@qq.com>
 2024-01-11 15:48:51 +08:00
yah01
8f89e9cf75
enhance: remove all unnecessary string formatting (#29323) 
done by two regex expressions:
- `PanicInfo\((.+),[. \n]+fmt::format\(([.\s\S]+?)\)\)`
- `AssertInfo\((.+),[. \n]+fmt::format\(([.\s\S]+?)\)\)`

related: #28811

---------

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-12-20 10:04:43 +08:00
Enwei Jiao
b80a3e19d3
Add code for PanicInfo (#27364) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-27 12:01:28 +08:00
Enwei Jiao
0afdfdb9af
Remove other Exceptions, keeps SegcoreError only (#27017) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-14 14:05:20 +08:00
Xu Tong
9166011c4a
Add float16 vector (#25852) 
Signed-off-by: Writer-X <1256866856@qq.com>
 2023-09-08 10:03:16 +08:00
MrPresent-Han
7d5a4b2994
add more event for segcore search(#26277) (#26688) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-08-30 14:15:01 +08:00
yah01
cb721781f3
Improve error message throwed from knowhere (#25473) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-11 17:26:29 +08:00
Cai Yudong
1b3c4b26f1
Optimize range search result sort in segcore (#24837) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-13 19:22:38 +08:00
Cai Yudong
2725d38b9e
Add COSINE metric type (#23350) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-20 10:20:31 +08:00
yah01
bdd6bc7695
Re-format cpp code (#22513) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 15:55:49 +08:00
smellthemoon
cf999b68dd
Fix range search can not get status from knowhere (#22384) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-24 17:59:45 +08:00
smellthemoon
7a4dfcc72b
Add status error output (#22325) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-22 15:51:44 +08:00
smellthemoon
9e0ec15436
Support range search (#21652) 
Signed-off-by: smellthemoon <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
 2023-02-21 09:48:32 +08:00
presburger
9950cacd10
support knowhere 2.0 (#21857) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-02-10 14:24:32 +08:00
Cai Yudong
4c5ffc832c
Add param check for BruteForceSearch in segcore (#20838) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-11-30 14:53:15 +08:00
Cai Yudong
94ffa8a275
Upgrade to knowhere-v1.2.0 (#18746) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-08-23 10:20:58 +08:00
Cai Yudong
015a2f0866
Let growing segment call knowhere brute search API (#18227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-07-12 11:58:25 +08:00
Jiquan Long
6954a5ba3e
Fix search successfully with invalid metric type (#17977) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-07-01 22:28:23 +08:00
Cai Yudong
a001412e12
Replace faiss::MetricType with knowhere::MetricType (#17891) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-06-29 14:20:19 +08:00
Cai Yudong
e78269f450
Optimize search related interface in segcore (#17568) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-06-23 18:16:13 +08:00
xige-16
515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
zhenshan.cao
58ea38142f
Use boost dynamic_bitset in segcore (#16476) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-04-14 22:37:34 +08:00
Cai Yudong
a37479d728
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2022-04-08 15:29:31 +08:00
Cai Yudong
f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-25 13:49:25 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
Cai Yudong
c141b2a242
[skip e2e] Reorder header files for query/SearchBruteForce.cpp (#14054) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 19:19:24 +08:00
Cai Yudong
b053317545
Rename FaissMetricTypeToString to MetricTypeToString (#12767) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-07 10:13:53 +08:00
Cai Yudong
365b5a5d01
Rename SubSearchResult fields for better readability (#12341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 17:07:40 +08:00