admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,676 Commits 137 Branches 188 Tags
Commit Graph

60 Commits

Author SHA1 Message Date
congqixia
a103dd5eb3
enhance: Fix SearchOnSealed clang-format lint (#36056) 
Related to #36008

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-06 16:47:04 +08:00
SimFG
5247631289
fix: fill the metric type field in the LoadMetaInfo object (#35962) 
- issue: #35960

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-09-05 20:50:23 -07:00
Chun Han
f00c529aea
feat: support group_size for search_group_by(#33544) (#33720) 
related: #33544

mainly changes in three aspects:

1. enable setting group_size for group by function
2. separate normal reduce and group by reduce
3. eleminate uncessary padding in search result for reducing

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-07-12 10:17:36 +08:00
Buqian Zheng
96cfae55a5
feat: [Sparse Float Vector] segcore to support sparse vector search and get raw vector by id (#30629) 
This PR adds the ability to search/get sparse float vectors in segcore,
and added unit tests by modifying lots of existing tests into
parameterized ones.

https://github.com/milvus-io/milvus/issues/29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-03-12 09:16:30 -07:00
Cai Yudong
8a219e0102
feat: Support knowhere trace using OpenTelemetry (#30750) 
Issue: #21508

Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2024-02-28 12:29:00 +08:00
MrPresent-Han
77eb6defb1
feat: support groupby on growing and non-indexed sealed egment(#30307) (#30644) 
related: #30308

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-02-21 14:02:53 +08:00
chyezh
def717af55
fix: SealedIndexingEntry in SealedIndexingRecord may leak without smart pointer protect. (#29932) 
may related issue: #29828

Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2024-01-14 10:28:51 +08:00
MrPresent-Han
9e2e7157e9
feat: support search_group_by for milvus(#25324) (#28983) 
related: #25324

Search GroupBy function, used to aggregate result entities based on a
specific scalar column.
several points to mention:

1. Temporarliy, the whole groupby is implemented separated from
iterative expr framework **for the first period**
2. In the long term, the groupBy operation will be incorporated into the
iterative expr framework:https://github.com/milvus-io/milvus/pull/28166
3. This pr includes some unrelated mocked interface regarding alterIndex
due to some unworth-to-mention reasons. All these un-associated content
will be removed before the final pr is merged. This version of pr is
only for review
4. All other related details were commented in the files comparison

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-01-05 15:50:47 +08:00
Xu Tong
9166011c4a
Add float16 vector (#25852) 
Signed-off-by: Writer-X <1256866856@qq.com>
 2023-09-08 10:03:16 +08:00
Gao
41d37409e9
Remove unused search conf (#26689) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-08-31 10:23:07 +08:00
yah01
300fef446b
Enable mmap for vector index (#25877) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-10 13:59:15 +08:00
Jiquan Long
96141fa998
Fix coping segment offsets twice (#25729) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-07-19 14:24:57 +08:00
yah01
546080dcdd
Support to retrieve json (#23563) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-21 11:46:32 +08:00
yah01
3202eb0d9f
Optimize rounding distances, avoid promoting to double (#22846) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 14:09:56 +08:00
yah01
bdd6bc7695
Re-format cpp code (#22513) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 15:55:49 +08:00
yah01
7478e44911
Support using mmap to load data (#22052) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-01 18:07:49 +08:00
smellthemoon
9e0ec15436
Support range search (#21652) 
Signed-off-by: smellthemoon <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
 2023-02-21 09:48:32 +08:00
presburger
9950cacd10
support knowhere 2.0 (#21857) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-02-10 14:24:32 +08:00
Cai Yudong
4c5ffc832c
Add param check for BruteForceSearch in segcore (#20838) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-11-30 14:53:15 +08:00
aoiasd
2b58bd5c0a
Optimize large memory usage of InsertRecord by using vector instead of unordered_map if InsertRecord used in sealed segment (#19245) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-09-23 17:08:51 +08:00
xige-16
428840178c
Support diskann index for vector field (#19093) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-21 20:16:51 +08:00
Letian Jiang
ef7742507d
Remove redundant code (#18832) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-08-25 19:48:54 +08:00
Cai Yudong
305601ad25
Add API SearchOnSealedChunk() to search on sealed segment without index (#18830) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-08-25 18:16:55 +08:00
Cai Yudong
dcf45df029
Optimize API vector_search parameter in segcore (#18827) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-08-25 16:16:54 +08:00
Cai Yudong
a001412e12
Replace faiss::MetricType with knowhere::MetricType (#17891) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-06-29 14:20:19 +08:00
Cai Yudong
7385770014
Upgrade to knowhere-v1.1.12 (#17692) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-06-24 10:34:18 +08:00
zhenshan.cao
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-23 16:41:58 +08:00
xige-16
515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
zhenshan.cao
58ea38142f
Use boost dynamic_bitset in segcore (#16476) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-04-14 22:37:34 +08:00
Cai Yudong
f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-25 13:49:25 +08:00
bigsheeper
390cdd2515
Remove tmporary debug log in core (#15330) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-24 10:03:41 +08:00
bigsheeper
ebed1a68ff
Add log for segcore search (#15159) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-11 18:07:34 +08:00
Cai Yudong
0dae260a9c
[skip e2e] Re-organize header files included under query (#14272) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-27 14:12:11 +08:00
Cai Yudong
cb952d6036
Rename SearchResult fields for better readability (#12327) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 14:57:18 +08:00
elfisworking
d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574) 
Signed-off-by: elfisworking <zymustb@126.com>
 2021-10-08 17:39:55 +08:00
yukun
3c77eda7ac
Add error msgs in segcore (#8410) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-23 18:59:54 +08:00
xige-16
468bef4478
Fix dataset's memory leak in knowWhere when search (#7527) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-07 14:25:59 +08:00
yukun
61bda45e35
Add ConfAdapter to check search (#6971) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:54:10 +08:00
Cai Yudong
724f10b9a0
Unify the usage of query and search (#6467) 
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-13 22:20:33 +08:00
FluorineDog
43b39cc9c9 Fix memory leak, temp solution 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-04-19 16:39:23 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-22 16:36:10 +08:00
FluorineDog
af1900b42a Remove ConcurrentBitsetPtr in segcore 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-03-09 16:16:43 +08:00
BossZou
01267776d2 Fix rocksmq consume invalid currendID 
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
 2021-01-23 10:15:57 +08:00
XuanYang-cn
50e2369000 Change name and tag to ID 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 19:36:09 +08:00
FluorineDog
bff208d78c Add sealedSegment (go&c) unittest, fix growingSegment field id check 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-22 17:40:58 +08:00
FluorineDog
7f044fff82 Enable search for sealed 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-21 15:29:52 +08:00
FluorineDog
9ff1bc0f99 Adapt Expr Executor to SegmentInternalInterface, fix row_count consistency 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-16 18:12:58 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
FluorineDog
8fccf7e630 Use bitset_view at search 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-15 13:40:51 +08:00