Cai Yudong
|
9dc3bbecbd
|
Change the type of slice_nqs and slice_topks from int32_t[] to int64_t[] (#18867)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-29 11:36:56 +08:00 |
|
Cai Yudong
|
305601ad25
|
Add API SearchOnSealedChunk() to search on sealed segment without index (#18830)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-25 18:16:55 +08:00 |
|
Cai Yudong
|
dcf45df029
|
Optimize API vector_search parameter in segcore (#18827)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-25 16:16:54 +08:00 |
|
congqixia
|
0db281c4ff
|
Fix DataType::bool cast to double (#18690)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-17 16:14:49 +08:00 |
|
Cai Yudong
|
d878cc2ec0
|
Rename real_topK_per_nq_ to topks_per_nq_prefix_sum_ in SearchResult struct (#18634)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-16 00:32:48 +08:00 |
|
xige-16
|
dbb96a8b70
|
Fix pk2offset occupy too much memory (#18325)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-08-11 10:48:38 +08:00 |
|
Cai Yudong
|
7cd37fc6dd
|
Merge FloatSearch() and BinarySearch() into SearchOnGrowing() (#18498)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-03 11:56:36 +08:00 |
|
bigsheeper
|
cef8b1e7cc
|
Enable jemalloc (#18349)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-07-20 22:22:31 +08:00 |
|
Jeng.Gwan
|
638f6c36e9
|
Support to get real row count of segment (#18115)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
|
2022-07-18 09:58:28 +08:00 |
|
xige-16
|
54d17bc5da
|
Fix query too slow when insert multi repeated pk data (#18231)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-07-13 10:22:26 +08:00 |
|
Jeng.Gwan
|
a926a9eb66
|
Fix redundant string copy of PlaceholderGroup (#18236)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
|
2022-07-12 15:48:25 +08:00 |
|
Cai Yudong
|
015a2f0866
|
Let growing segment call knowhere brute search API (#18227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-07-12 11:58:25 +08:00 |
|
bigsheeper
|
22508f36d3
|
Get search field id from search plan and log if loaded index when search segments (#18183)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-07-08 20:18:22 +08:00 |
|
zhagnlu
|
257da153ce
|
Fix core dump when nq has no topk result (#17923) (#18051)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-07-05 19:48:20 +08:00 |
|
Cai Yudong
|
a001412e12
|
Replace faiss::MetricType with knowhere::MetricType (#17891)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-06-29 14:20:19 +08:00 |
|
bigsheeper
|
b657e58370
|
Remove temporary variable to prevent memory fragmentation (#17728)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-28 16:30:23 +08:00 |
|
Enwei Jiao
|
16c3aedc15
|
refine complie configuration (#17502)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-06-24 21:12:15 +08:00 |
|
Cai Yudong
|
7385770014
|
Upgrade to knowhere-v1.1.12 (#17692)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-06-24 10:34:18 +08:00 |
|
Cai Yudong
|
e78269f450
|
Optimize search related interface in segcore (#17568)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-06-23 18:16:13 +08:00 |
|
bigsheeper
|
1722431699
|
Checking for existence in map in segcore (#17700)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-22 18:16:14 +08:00 |
|
bigsheeper
|
92d06b2e30
|
Purge memory by the memory state and try to purge after each search (#17565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-17 17:46:10 +08:00 |
|
bigsheeper
|
cdcdfa1ea5
|
Disable jemalloc and use malloc_trim instead (#17538)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-14 11:12:09 +08:00 |
|
xige-16
|
36ad989590
|
Fix segOffset grater than insert barrier when mark delete (#17444)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-10 20:02:08 +08:00 |
|
bigsheeper
|
2d9a52206d
|
Use jemalloc in QueryNode, DataNode and IndexNode (#17470)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-10 11:24:08 +08:00 |
|
xige-16
|
6d078ebe7a
|
Print more information when loading fields with different lines (#17448)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-08 20:16:06 +08:00 |
|
bigsheeper
|
af108b5bda
|
Add malloc_trim after reduce search result (#17423)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-08 00:12:05 +08:00 |
|
bigsheeper
|
f38637c227
|
Pass PlaceholderGroup pointer to prevent memory copy in SegCore (#17389)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-06 21:34:05 +08:00 |
|
bigsheeper
|
9f786dd752
|
Remove unnecessary bitset flip in Search and Query (#17387)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-06 17:38:05 +08:00 |
|
xige-16
|
56778787be
|
Reverse data from scalar index (#17145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-26 14:58:01 +08:00 |
|
xige-16
|
7d810ac159
|
Fix query empty when insert same pk after deletion (#17222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-25 22:06:00 +08:00 |
|
zhenshan.cao
|
08a4dff41d
|
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-23 16:41:58 +08:00 |
|
Jiquan Long
|
99b4042f8c
|
Disable segment small index (#16935)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-05-18 15:27:56 +08:00 |
|
xige-16
|
935b729a0c
|
Fix multiple deletes not taking effect (#17033)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-16 18:39:56 +08:00 |
|
Jiquan Long
|
c5149c7e85
|
Replace text codec of pb with binary codec (#16955)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-05-13 09:53:53 +08:00 |
|
xige-16
|
08ad77c71b
|
Delete all repeated primary keys (#16863)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-12 14:09:53 +08:00 |
|
Letian Jiang
|
b3eb2b1d0d
|
Support deltaLog loading on growing segment (#16903)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
|
2022-05-12 11:59:53 +08:00 |
|
bigsheeper
|
64d2793fe9
|
Fix wrong result topks when reduce search result (#16815)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-06 21:17:51 +08:00 |
|
Xiaofan
|
337ad53613
|
Support config small index nprobe and nlist (#16731)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-05-05 09:49:50 +08:00 |
|
Cai Yudong
|
21a1311f66
|
Merge utils/Utils.h into common/Utils.h (#16762)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-05-03 12:05:50 +08:00 |
|
Cai Yudong
|
6a62ff18bf
|
Support easylogging config for segcore and knowhere (#16751)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-05-03 08:39:49 +08:00 |
|
Cai Yudong
|
d5db4ae463
|
Merge utils/Types.h with common/Types.h (#16445)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-05-02 22:21:51 +08:00 |
|
xige-16
|
515d0369de
|
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
|
2022-04-29 13:35:49 +08:00 |
|
yah01
|
3f5733b738
|
Return the local variable directly, make RVO enabled (#16201)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-04-22 17:43:42 +08:00 |
|
zhenshan.cao
|
58ea38142f
|
Use boost dynamic_bitset in segcore (#16476)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-04-14 22:37:34 +08:00 |
|
Cai Yudong
|
70bd6b6e6d
|
Remove dependency on knowhere::scalar (#16458)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-04-12 09:49:33 +08:00 |
|
Cai Yudong
|
71cd7ba67a
|
Add configuration common.indexSliceSize (#16438)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-04-08 20:29:33 +08:00 |
|
xige-16
|
27b4cbc098
|
Cherry pick remove translateHits commit to mater (#16436)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-04-08 20:27:31 +08:00 |
|
Cai Yudong
|
a37479d728
|
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416)
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
|
2022-04-08 15:29:31 +08:00 |
|
Cai Yudong
|
6c4d497d73
|
Fix mac build error (#16415)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-04-07 17:29:31 +08:00 |
|
Jiquan Long
|
fd589baca7
|
Integrates marisa trie index (#16192)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-04-01 15:31:29 +08:00 |
|