admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,016 Commits 146 Branches 196 Tags
Commit Graph

1360 Commits

Author SHA1 Message Date
groot
5e60e61042
add wal sync config (#3899) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-28 08:13:39 +00:00
groot
45ecc9ae9a
return build index error message to client (#3895) 
* return build index error message to client

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refne build index relate code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-28 07:08:39 +00:00
groot
6a517fff3c
rewrite ListIdInSegment (#3887) 
* rewrite list id in segment

Signed-off-by: yhmo <mummyhome@163.com>

* add unitest

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-27 15:31:18 +08:00
shengjun.li
e318eb34a9
knowhere unittest add to check CPU instruction set (#3892) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-27 15:15:13 +08:00
chen qingxiang
a4c061d2f9
fix gpu check bug (#3888) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-27 02:29:36 +00:00
shengjun.li
0d6c3587b4
code Refactoring (#3885) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-26 16:51:14 +08:00
groot
f945416d10
reduce uid copy (#3875) 
* reduce uid copy

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-26 16:23:49 +08:00
Wang Xiangyu
eed4dade0a
If the number of tasks to be executed great equal than 1, stop loading (#3881) 
* If the number of tasks to be executed great equal than 2, stop loading

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* limit 1 to execute task

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-26 16:14:38 +08:00
XuanYang-cn
8c79ba16ff
fix pq distances cal bug (#3876) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-26 09:46:08 +08:00
shengjun.li
2eec5607f7
let bitset nullptr it no deletion and no filter (#3872) 
* fix bitset

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* check bitset

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-25 16:42:33 +08:00
groot
2d20795839
validate binary index type (#3869) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-25 08:20:21 +00:00
chen qingxiang
8b6089aed4
fix gpu check bug (#3866) 
* fix gpu check bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-25 14:25:50 +08:00
XuPeng-SH
b2386626de
(db/snapshot): fix bug in metadata snapshot that handling CollectionCommit and PartitionCommit mappings (#3864) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-25 14:13:19 +08:00
groot
53360cda66
reduce uid copy during search (#3867) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-25 05:59:16 +00:00
cqy123456
7fcaa5be45
Set the bitset of searching (#3858) 
Signed-off-by: cqy <yaya645@126.com>
 2020-09-25 11:33:34 +08:00
groot
7c1d0b05c7
reduce insert memory copy (#3842) 
* avoid memory copy for insert request

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* add more log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* format code

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-25 01:59:57 +00:00
Wang Xiangyu
367c996b38
catch-load-config-exception (#3857) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

remove unused code

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-24 18:01:32 +08:00
groot
1871bd1337
add more wal log (#3850) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-23 18:49:33 +08:00
groot
2248cc104b
validate structured index type (#3848) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-23 06:18:28 +00:00
cqy123456
77443319b8
Fix the multi-gpus building index enable problem (#3845) 
Signed-off-by: cqy <yaya645@126.com>
 2020-09-23 10:59:09 +08:00
groot
30e3420677
avoid insert hangs (#3841) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-22 11:35:18 +00:00
chen qingxiang
30f4ba3ce8
remove the flush step in drop collection request processing (#3840) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-22 11:13:00 +00:00
shengjun.li
20440a835e when the topk of gpu search >2048 ,turning into the cpu search (#3640) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
dddf697e90 GPU search turn into CPU search when nprobe >gpu_max_k (#3586) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
af2e7d9a88 Allow more choices for the parameter ‘m’ of CPU IVF_PQ #3254 (#3508) 
* ivfpq fixed m problem

Signed-off-by: cqy <yaya645@126.com>

* ivfpq fixed m problem

Signed-off-by: cqy <yaya645@126.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
f55500632a
Fix the error message should be updated if search on index IVF_SQ8_HYBRID with CPU (#3820) 
* sq8h index search

Signed-off-by: cqy <yaya645@126.com>
 2020-09-22 15:02:27 +08:00
chen qingxiang
9658a23059
Limit the number of insert requests processing concurrently (#3830) 
* Limit the number of insert requests processing concurrently

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* code format

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the variable name

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change comment

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-22 14:15:05 +08:00
groot
18b0447d8d
fix wal recovery issue (#3818) 
* fix wal recovery issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-22 01:43:05 +00:00
Wang Xiangyu
88ed4bbe59
add hidden config engine.max_partition_num (#3817) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-21 18:36:54 +08:00
groot
b2eb82e5ef
use multi-segments operation to flush (#3804) 
* use multi-segments operation to flush

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-19 09:12:32 +00:00
shengjun.li
6bd5dc3feb
Fix the crash caused by empty index param (#3803) 
* fix crash caused by empty index param

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix C++ SDK examples

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-18 08:34:33 +00:00
shengjun.li
0749b3793c
fix the limit of nprobe and nlist (#3797) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-18 14:15:56 +08:00
yukun
486aacc47b
Improve MergeTopkToResultSet performance (#3788) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix MergeTopkToResultSet performance problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-18 04:04:29 +00:00
groot
f6f8b66298
avoid snapshot warning during deleting entity (#3798) 
* avoid snapshot warning

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-18 03:59:47 +00:00
chen qingxiang
dd52655f0a
Fix the bug of file not close when check sum failed. (#3783) 
* Fix the bug of file not close when check sum failed.

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the log level to error

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix cpp lint problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-17 19:12:38 +08:00
groot
0b81bcfb68
avoid dead circle when merge failed (#3787) 
* avoid dead circle when merge failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 18:52:46 +08:00
groot
e8f5b5c691
add adaptive merge strategy (#3780) 
* add adaptive merge

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 16:07:07 +08:00
yukun
7e0b16ca46
Fix webserver readme for 0.11.0 (#3765) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-17 10:09:08 +08:00
shengjun.li
582087ad38
hold FaissIVFQuantizerPtr in IVFSQHybrid (#3770) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-16 15:56:35 +08:00
groot
e26bcc1900
modify merge strategy (#3757) 
* modify merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* clean code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:52:39 +08:00
Wang Xiangyu
49884b3338
close lockfile when server stop (#3737) 
* close lockfile when server stop

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix something error

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:48:24 +08:00
groot
c0ab29ab4a
#3756 ignore deleted docs file if it doesnt exist (#3766) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:28:54 +08:00
Wang Xiangyu
c8c9679444
fix trace level log files missing (#3769) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:19:48 +08:00
BossZou
b524222998
New operation named MultiSegmentsOperation support multi-segments during flush (#3733) 
* Add multiSegmentsOpera

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* rish test

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add new operation MultiSegmentsOperation

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Recoveray ut itls

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* fix judeg bug

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-16 10:14:06 +08:00
Wang Xiangyu
2c11122466
fix config usage (#3747) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-15 23:48:44 +08:00
XuPeng-SH
600ce3cecc
(db/snapshot): fix GC PartitionCommit (#3750) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 19:23:26 +08:00
XuPeng-SH
97d0b119ce
Apply more stale check rules for Operations (#3721) 
* (db/snapshot): Update Operations to handle stale errors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some print in ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 14:35:01 +08:00
groot
6ce00fb043
#3722 rename segment_row_count to segment_row_limit (#3724) 
* #3722 rename segment_row_count to segment_row_limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unitest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest 3

Signed-off-by: groot <yihua.mo@zilliz.com>

* wal issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* bloom magic number

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-15 14:33:11 +08:00
yukun
b6010dfd1f
GET_PAGE_ENTITY sometimes failed in test_web (#3735) 
* [skip ci]Unfit property name segment_row_count in 0.11

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* GET_PAGE_ENTITY sometimes failed in test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-15 14:19:07 +08:00
chen qingxiang
c7a5358b56
add some check to avoid server crash (#3715) 
* add some check to avoid server crash

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* rm useless code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-14 16:38:37 +08:00