1576 Commits

Author SHA1 Message Date
Wang Xiangyu
6fd4f593e9
Change config version to 0.6 (#4006)
* change config version to 0.6, update description of cache.max_concurrent_insert_request_size

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* add description for logs.log_to_stdout and logs.log_to_file

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* [skip ci] remove shards

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-10-16 12:09:04 +08:00
yukun
e5343371f1
Return wrong entities when real result number is less than topk (#4003)
* Server crashed when search using java-sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Return wrong entities when real result number is less than topk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-15 13:59:19 +00:00
op-hunter
cdd40689f5
withdraw pr2467 on branch 0.11.0 (#4002)
Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-10-15 11:39:49 +00:00
yukun
eb4a14adf0
Change ge le to gte lte (#3988)
* Change ge le to gte lte

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* cpp lint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* The error message returned is unclear if query param is wrong

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-15 16:13:58 +08:00
yukun
9d06bf3dcf
Server crashed when search using java-sdk (#3994)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-15 16:11:30 +08:00
XuanYang-cn
42470b86b3
support log to stdout (#3993)
* support log to stdout

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* justfy set config

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-10-15 16:08:32 +08:00
groot
05232f23b4
refine log (#3991)
* refine log

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine log

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-15 14:28:02 +08:00
groot
36e0c11509
cache structured field index (#3984)
* cache structured field index

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-14 18:28:42 +08:00
yukun
504ee1085c
Web_impl restful doc bugs (#3983)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-14 18:25:18 +08:00
shengjun.li
cdb2b98a3e
add conf stat_optimizer_enable (#3986)
* add conf stat_optimizer_enable

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify the blas threshold

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-14 09:50:23 +00:00
groot
cfe8b0a364
stop build index thread when server is shutdown (#3982)
* stop build index thread when server is shutdown

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-14 14:18:58 +08:00
yukun
edb0e84078
Add data wrapper in the result of getEntity (#3960)
* The result format is wrong returned by get collections

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add data in the result of search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add data in the result of getEntity

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Restful readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change table to collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add /status in restful readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix InsertEntities restful readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-14 11:27:06 +08:00
yukun
76ed2fb45c
The 'num' in return of search is incorrect when use http-api (#3975)
* The 'num' in return of search is incorrect when use http-api

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add collection name check in GetCollectionInfo

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-14 09:58:56 +08:00
groot
5d9248a1e9
avoid unnecessery waiting for build idnex (#3974)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-13 15:09:26 +08:00
groot
ad6e88a3b4
rename segment_row_count to segment_row_limit (#3972)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-13 12:12:41 +08:00
cqy123456
df36925b13
fix 3903 (#3958)
Signed-off-by: cqy <yaya645@126.com>
2020-10-12 07:34:11 +00:00
chen qingxiang
5278625f74
improve checksum performance (#3956)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-10-12 14:21:28 +08:00
yukun
da6d15057e
The result format is wrong returned by get collections (#3948)
* The result format is wrong returned by get collections

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add data in the result of search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-11 19:29:29 +08:00
chen qingxiang
7f396a631a
improve file read speed (#3944)
* improve file read speed

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix ExtraFileInfoTest bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-10-10 18:47:02 +08:00
groot
c7be9b96da
improve GetEntityByID performance (#3932)
* improve GetEntityByID performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* reduce check sum

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine log

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-10 16:19:02 +08:00
groot
fe8060f4a0
fix wal bug for delete entity (#3940)
* fix wal bug for delete entity

Signed-off-by: groot <yihua.mo@zilliz.com>

* add unittest

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-10 15:59:44 +08:00
yukun
cb753909bd
Params in Restful-api is different from the params in other SDKs (#3926)
* Fix Restful api

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add data in GetEntityByID in restful api

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Get method with null payload problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix clang-tidy

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove index_name in DeleteIndex

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix search readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix search readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-10-10 07:29:08 +00:00
XuanYang-cn
d37648bd02
Fix build bug (#3939)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2020-10-10 14:07:26 +08:00
groot
2aad1f540c
fix build index log error (#3928)
* fix build index log error

Signed-off-by: groot <yihua.mo@zilliz.com>

* reduce unnecessary log

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-09 16:12:22 +08:00
XuanYang-cn
810d9f54b9
fix pq distance calculation outofrange according to faiss suggests (#3925)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-10-09 11:22:12 +08:00
groot
cff80c9e34
refine query code (#3913)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-09 09:41:37 +08:00
shengjun.li
77aecc31bc
Let bitset all functions inline (#3904)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-28 14:23:45 +00:00
groot
5e60e61042
add wal sync config (#3899)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-28 08:13:39 +00:00
groot
45ecc9ae9a
return build index error message to client (#3895)
* return build index error message to client

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refne build index relate code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-28 07:08:39 +00:00
groot
6a517fff3c
rewrite ListIdInSegment (#3887)
* rewrite list id in segment

Signed-off-by: yhmo <mummyhome@163.com>

* add unitest

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-27 15:31:18 +08:00
shengjun.li
e318eb34a9
knowhere unittest add to check CPU instruction set (#3892)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-27 15:15:13 +08:00
chen qingxiang
a4c061d2f9
fix gpu check bug (#3888)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-27 02:29:36 +00:00
shengjun.li
0d6c3587b4
code Refactoring (#3885)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-26 16:51:14 +08:00
groot
f945416d10
reduce uid copy (#3875)
* reduce uid copy

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-26 16:23:49 +08:00
Wang Xiangyu
eed4dade0a
If the number of tasks to be executed great equal than 1, stop loading (#3881)
* If the number of tasks to be executed great equal than 2, stop loading

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* limit 1 to execute task

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-26 16:14:38 +08:00
XuanYang-cn
8c79ba16ff
fix pq distances cal bug (#3876)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-09-26 09:46:08 +08:00
shengjun.li
2eec5607f7
let bitset nullptr it no deletion and no filter (#3872)
* fix bitset

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* check bitset

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-25 16:42:33 +08:00
groot
2d20795839
validate binary index type (#3869)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-25 08:20:21 +00:00
chen qingxiang
8b6089aed4
fix gpu check bug (#3866)
* fix gpu check bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-25 14:25:50 +08:00
XuPeng-SH
b2386626de
(db/snapshot): fix bug in metadata snapshot that handling CollectionCommit and PartitionCommit mappings (#3864)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-09-25 14:13:19 +08:00
groot
53360cda66
reduce uid copy during search (#3867)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-25 05:59:16 +00:00
cqy123456
7fcaa5be45
Set the bitset of searching (#3858)
Signed-off-by: cqy <yaya645@126.com>
2020-09-25 11:33:34 +08:00
groot
7c1d0b05c7
reduce insert memory copy (#3842)
* avoid memory copy for insert request

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* add more log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* format code

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-25 01:59:57 +00:00
Wang Xiangyu
367c996b38
catch-load-config-exception (#3857)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

remove unused code

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-24 18:01:32 +08:00
groot
1871bd1337
add more wal log (#3850)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-23 18:49:33 +08:00
groot
2248cc104b
validate structured index type (#3848)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-23 06:18:28 +00:00
cqy123456
77443319b8
Fix the multi-gpus building index enable problem (#3845)
Signed-off-by: cqy <yaya645@126.com>
2020-09-23 10:59:09 +08:00
groot
30e3420677
avoid insert hangs (#3841)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-22 11:35:18 +00:00
chen qingxiang
30f4ba3ce8
remove the flush step in drop collection request processing (#3840)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-22 11:13:00 +00:00
shengjun.li
20440a835e when the topk of gpu search >2048 ,turning into the cpu search (#3640)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-22 19:12:46 +08:00