131 Commits

Author SHA1 Message Date
xige-16
54d17bc5da
Fix query too slow when insert multi repeated pk data (#18231)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-13 10:22:26 +08:00
bigsheeper
641fb96958
Return malloc_trim result and log if malloc_trim successfully (#17959)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-01 10:44:18 +08:00
Cai Yudong
a001412e12
Replace faiss::MetricType with knowhere::MetricType (#17891)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-06-29 14:20:19 +08:00
Enwei Jiao
16c3aedc15
refine complie configuration (#17502)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-06-24 21:12:15 +08:00
Cai Yudong
7385770014
Upgrade to knowhere-v1.1.12 (#17692)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-06-24 10:34:18 +08:00
bigsheeper
1722431699
Checking for existence in map in segcore (#17700)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 18:16:14 +08:00
bigsheeper
92d06b2e30
Purge memory by the memory state and try to purge after each search (#17565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-17 17:46:10 +08:00
xige-16
b5c11a216d
Alter varChar type params's name to max_length (#17409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-07 15:58:06 +08:00
xige-16
a8829554eb
Merge multiple sets of expr's optypes in diff dirs (#17192)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-24 21:56:00 +08:00
zhenshan.cao
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
Enwei Jiao
d28a2db46c
move arrow from storage to core (#17061)
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
2022-05-22 20:03:58 +08:00
Jiquan Long
c5149c7e85
Replace text codec of pb with binary codec (#16955)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-13 09:53:53 +08:00
xige-16
08ad77c71b
Delete all repeated primary keys (#16863)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-12 14:09:53 +08:00
Cai Yudong
21a1311f66
Merge utils/Utils.h into common/Utils.h (#16762)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-03 12:05:50 +08:00
Cai Yudong
d5db4ae463
Merge utils/Types.h with common/Types.h (#16445)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-02 22:21:51 +08:00
xige-16
515d0369de
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
zhenshan.cao
65a9e01a8f
Use AssertInfo instead of assert to ensure compiling (#16533)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-25 10:27:46 +08:00
Cai Yudong
35e7ed45b3
Upgrade to knowhere v1.1.5 to fully support MinGW build (#16498)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-15 09:53:34 +08:00
zhenshan.cao
58ea38142f
Use boost dynamic_bitset in segcore (#16476)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-14 22:37:34 +08:00
xige-16
27b4cbc098
Cherry pick remove translateHits commit to mater (#16436)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-08 20:27:31 +08:00
Cai Yudong
543ec4a209
Rename log to milvus_log (#16383)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-05 22:55:30 +08:00
Jiquan Long
fd589baca7
Integrates marisa trie index (#16192)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-04-01 15:31:29 +08:00
Cai Yudong
f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-25 13:49:25 +08:00
Jiquan Long
48706f416f
Migrate scalar index from knowhere (#16174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-24 14:57:26 +08:00
congqixia
661469445c
Copy index file content to c memory (#16162)
Might be the root cause of #15896
The index content bytes were passed via unsafe.Pointer,
which shall be copy to cpp managed memory inmediately

This solution might cause a lot of memory consumption.
Maybe we need to store the index bytes in cpp memory in the first place.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-24 14:55:25 +08:00
Cai Yudong
503724be19
Optimize CMakeLists.txt under internal/core (#15770)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 10:31:55 +08:00
Cai Yudong
54b8b24151
Rename variable names for better readibility (#15700)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-22 22:15:52 +08:00
zhenshan.cao
142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-02-18 18:39:50 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
Cai Yudong
5efb234f41
[skip e2e] Reorder header files for common/SystemProperty.h (#14828)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 12:03:20 +08:00
Cai Yudong
446f5e1b15
[skip e2e] Remove discard (#14827)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 12:01:24 +08:00
Cai Yudong
6f7696549e
[skip e2e] Reorder header files for common/SystemProperty.cpp (#14823)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 11:59:29 +08:00
Cai Yudong
6c1c42f18d
[skip e2e] Reorder header files for common/Span.h (#14821)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 11:57:34 +08:00
Cai Yudong
ca7f1c1038
[skip e2e] Reorder header files for common/Schema.cpp (#14808)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 11:55:20 +08:00
zhenshan.cao
73b00c7754
[skip e2e]Update license (#14014)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-22 21:29:18 +08:00
zhenshan.cao
9a0edf20f2
[skip e2e]Update license (#14016)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-22 21:27:19 +08:00
zhenshan.cao
09bb8f0019
[skip e2e]Update license (#14015)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-22 21:25:19 +08:00
zhenshan.cao
a275417b54
[skip e2e]Update license (#13921)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-21 22:03:03 +08:00
zhenshan.cao
4415095e08
[skip e2e]Update license (#13920)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-21 22:01:12 +08:00
zhenshan.cao
a32c637776
[skip e2e]Update license (#13919)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-21 21:57:11 +08:00
cxytz01
89fee68fec
[skip e2e] Grammar correction (#13823)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-21 15:17:02 +08:00
zhenshan.cao
12bfa1a414
[skip e2e]Update license (#13817)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-20 23:42:53 +08:00
zhenshan.cao
207ab1e1f2
[skip e2e]Update license (#13816)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-20 23:41:00 +08:00
zhenshan.cao
db13166197
[skip e2e]Update license (#13815)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-20 23:39:05 +08:00
cxytz01
bdf9e338c4
[skip e2e] Grammar correction (#13770)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-20 19:20:31 +08:00
cxytz01
fcddbc2401
[skip e2e] Grammar correction (#13738)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-20 19:10:44 +08:00
zhenshan.cao
6099d4c55f
[skip e2e]Update license (#13669)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 21:14:41 +08:00
zhenshan.cao
9506e75e21
[skip e2e]Update license (#13668)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 20:54:42 +08:00
zhenshan.cao
dcebee2367
[skip e2e]Update license (#13667)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 20:52:45 +08:00
zhenshan.cao
177c57a7c7
[skip ci]Update license (#13532)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-16 20:19:41 +08:00