admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,997 Commits 137 Branches 188 Tags
Commit Graph

1535 Commits

Author SHA1 Message Date
cqy123456
7fcaa5be45
Set the bitset of searching (#3858) 
Signed-off-by: cqy <yaya645@126.com>
 2020-09-25 11:33:34 +08:00
groot
7c1d0b05c7
reduce insert memory copy (#3842) 
* avoid memory copy for insert request

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* add more log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* format code

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-25 01:59:57 +00:00
Wang Xiangyu
367c996b38
catch-load-config-exception (#3857) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

remove unused code

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-24 18:01:32 +08:00
groot
1871bd1337
add more wal log (#3850) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-23 18:49:33 +08:00
groot
2248cc104b
validate structured index type (#3848) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-23 06:18:28 +00:00
cqy123456
77443319b8
Fix the multi-gpus building index enable problem (#3845) 
Signed-off-by: cqy <yaya645@126.com>
 2020-09-23 10:59:09 +08:00
groot
30e3420677
avoid insert hangs (#3841) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-22 11:35:18 +00:00
chen qingxiang
30f4ba3ce8
remove the flush step in drop collection request processing (#3840) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-22 11:13:00 +00:00
shengjun.li
20440a835e when the topk of gpu search >2048 ,turning into the cpu search (#3640) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
dddf697e90 GPU search turn into CPU search when nprobe >gpu_max_k (#3586) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
af2e7d9a88 Allow more choices for the parameter ‘m’ of CPU IVF_PQ #3254 (#3508) 
* ivfpq fixed m problem

Signed-off-by: cqy <yaya645@126.com>

* ivfpq fixed m problem

Signed-off-by: cqy <yaya645@126.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
f55500632a
Fix the error message should be updated if search on index IVF_SQ8_HYBRID with CPU (#3820) 
* sq8h index search

Signed-off-by: cqy <yaya645@126.com>
 2020-09-22 15:02:27 +08:00
chen qingxiang
9658a23059
Limit the number of insert requests processing concurrently (#3830) 
* Limit the number of insert requests processing concurrently

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* code format

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the variable name

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change comment

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-22 14:15:05 +08:00
BossZou
95d5d60088
update oatpp md5 (#3832) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-22 11:45:28 +08:00
groot
18b0447d8d
fix wal recovery issue (#3818) 
* fix wal recovery issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-22 01:43:05 +00:00
Wang Xiangyu
88ed4bbe59
add hidden config engine.max_partition_num (#3817) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-21 18:36:54 +08:00
groot
b2eb82e5ef
use multi-segments operation to flush (#3804) 
* use multi-segments operation to flush

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-19 09:12:32 +00:00
BossZou
13d8877517
Fix web start fail for IP family (#3778) 
* Fix web start fail for ip family

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* update oatpp md5

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add more detail case

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-19 04:10:11 +00:00
shengjun.li
6bd5dc3feb
Fix the crash caused by empty index param (#3803) 
* fix crash caused by empty index param

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix C++ SDK examples

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-18 08:34:33 +00:00
shengjun.li
0749b3793c
fix the limit of nprobe and nlist (#3797) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-18 14:15:56 +08:00
yukun
486aacc47b
Improve MergeTopkToResultSet performance (#3788) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix MergeTopkToResultSet performance problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-18 04:04:29 +00:00
groot
f6f8b66298
avoid snapshot warning during deleting entity (#3798) 
* avoid snapshot warning

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-18 03:59:47 +00:00
chen qingxiang
dd52655f0a
Fix the bug of file not close when check sum failed. (#3783) 
* Fix the bug of file not close when check sum failed.

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the log level to error

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix cpp lint problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-17 19:12:38 +08:00
groot
0b81bcfb68
avoid dead circle when merge failed (#3787) 
* avoid dead circle when merge failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 18:52:46 +08:00
groot
e8f5b5c691
add adaptive merge strategy (#3780) 
* add adaptive merge

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 16:07:07 +08:00
yukun
7e0b16ca46
Fix webserver readme for 0.11.0 (#3765) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-17 10:09:08 +08:00
shengjun.li
582087ad38
hold FaissIVFQuantizerPtr in IVFSQHybrid (#3770) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-16 15:56:35 +08:00
groot
e26bcc1900
modify merge strategy (#3757) 
* modify merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* clean code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:52:39 +08:00
Wang Xiangyu
49884b3338
close lockfile when server stop (#3737) 
* close lockfile when server stop

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix something error

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:48:24 +08:00
groot
c0ab29ab4a
#3756 ignore deleted docs file if it doesnt exist (#3766) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:28:54 +08:00
Wang Xiangyu
c8c9679444
fix trace level log files missing (#3769) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:19:48 +08:00
BossZou
b524222998
New operation named MultiSegmentsOperation support multi-segments during flush (#3733) 
* Add multiSegmentsOpera

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* rish test

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add new operation MultiSegmentsOperation

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Recoveray ut itls

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* fix judeg bug

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-16 10:14:06 +08:00
Wang Xiangyu
2c11122466
fix config usage (#3747) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-15 23:48:44 +08:00
XuPeng-SH
600ce3cecc
(db/snapshot): fix GC PartitionCommit (#3750) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 19:23:26 +08:00
Jin Hai
12c573abdc
Improve code of dabloom (#3694) 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-09-15 17:25:14 +08:00
XuPeng-SH
97d0b119ce
Apply more stale check rules for Operations (#3721) 
* (db/snapshot): Update Operations to handle stale errors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some print in ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 14:35:01 +08:00
groot
6ce00fb043
#3722 rename segment_row_count to segment_row_limit (#3724) 
* #3722 rename segment_row_count to segment_row_limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unitest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest 3

Signed-off-by: groot <yihua.mo@zilliz.com>

* wal issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* bloom magic number

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-15 14:33:11 +08:00
yukun
b6010dfd1f
GET_PAGE_ENTITY sometimes failed in test_web (#3735) 
* [skip ci]Unfit property name segment_row_count in 0.11

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* GET_PAGE_ENTITY sometimes failed in test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-15 14:19:07 +08:00
chen qingxiang
c7a5358b56
add some check to avoid server crash (#3715) 
* add some check to avoid server crash

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* rm useless code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-14 16:38:37 +08:00
groot
7e1345c28f
fix delete entity performance issue (#3667) 
* fix delete entity performance issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* force flush for delete

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve delete performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix delete performce issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang

Signed-off-by: groot <yihua.mo@zilliz.com>

* segment row count min limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge 0.11.0

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-14 16:38:25 +08:00
XuPeng-SH
bd2a3d6e63
(db/snapshot): Implement FlushableMappingField for better metadata snapshot (#3655) 
* Update metadata for mappings

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 2

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 3

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 4

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 5

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 6

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 7

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): optimize PartitionCommit metadata implementation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): optimize PartitionCommit metadata implementation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update mock logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-14 16:24:23 +08:00
XuanYang-cn
8215e11e78
Fix#3689 Client get stuck if drop collection during creating index (#3714) 
* fix jaccard distance compute

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* edit changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-14 15:46:57 +08:00
chen qingxiang
a8943f824c
fix snapshot not release bug (#3708) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-12 23:07:45 +08:00
groot
ed494c67d4
add log (#3680) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-12 03:32:06 +00:00
XuanYang-cn
3e542bdcf5
fix3626 (#3699) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-12 09:46:36 +08:00
XuPeng-SH
7af413bcc7
(db/snapshot): update LSN logic (#3682) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-11 16:07:30 +08:00
groot
37d2a68658
avoid dabloom warning (#3674) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-10 02:57:04 +00:00
chen qingxiang
de071d5939
add memory limit check (#3669) 
* add memory limit check

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add changelog

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the implementation of memory check

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* revert code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* revert code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-10 02:21:17 +00:00
XuanYang-cn
c5ac77bd86
Fix loadcollection memory usage is one times larger than expect (#3664) 
* rm new rearanged_data to avoid additional memory usage

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix cpu version

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix data_ deconstruct twice error

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-09 19:11:50 +08:00
Xiaohai Xu
6bd1755d00
fix nprobe error (#3658) 
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-09-08 11:07:31 +00:00