admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,997 Commits 137 Branches 188 Tags
Commit Graph

5997 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cqy123456
7fcaa5be45
Set the bitset of searching (#3858) 
Signed-off-by: cqy <yaya645@126.com>
 2020-09-25 11:33:34 +08:00
groot
7c1d0b05c7
reduce insert memory copy (#3842) 
* avoid memory copy for insert request

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* add more log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* format code

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-25 01:59:57 +00:00
Wang Xiangyu
367c996b38
catch-load-config-exception (#3857) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

remove unused code

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-24 18:01:32 +08:00
ThreadDao
a04a8ad1ff
add test insert binary (#3853) 
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-09-24 14:11:13 +08:00
del-zhenwu
bbeb56f41e
remove persistence (#3801) 
* remove persistence

Signed-off-by: zw <zw@milvus.io>

* set cpu.limits=12.0 in regression test

Signed-off-by: zw <zw@milvus.io>

* set cpu.limits=12.0 in regression test

Signed-off-by: zw <zw@milvus.io>

* debug cpu-limits

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-24 14:08:17 +08:00
groot
1871bd1337
add more wal log (#3850) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-23 18:49:33 +08:00
groot
2248cc104b
validate structured index type (#3848) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-23 06:18:28 +00:00
cqy123456
77443319b8
Fix the multi-gpus building index enable problem (#3845) 
Signed-off-by: cqy <yaya645@126.com>
 2020-09-23 10:59:09 +08:00
groot
30e3420677
avoid insert hangs (#3841) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-22 11:35:18 +00:00
chen qingxiang
30f4ba3ce8
remove the flush step in drop collection request processing (#3840) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-22 11:13:00 +00:00
shengjun.li
20440a835e when the topk of gpu search >2048 ,turning into the cpu search (#3640) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
dddf697e90 GPU search turn into CPU search when nprobe >gpu_max_k (#3586) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
af2e7d9a88 Allow more choices for the parameter ‘m’ of CPU IVF_PQ #3254 (#3508) 
* ivfpq fixed m problem

Signed-off-by: cqy <yaya645@126.com>

* ivfpq fixed m problem

Signed-off-by: cqy <yaya645@126.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-22 19:12:46 +08:00
cqy123456
f55500632a
Fix the error message should be updated if search on index IVF_SQ8_HYBRID with CPU (#3820) 
* sq8h index search

Signed-off-by: cqy <yaya645@126.com>
 2020-09-22 15:02:27 +08:00
chen qingxiang
9658a23059
Limit the number of insert requests processing concurrently (#3830) 
* Limit the number of insert requests processing concurrently

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* code format

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the variable name

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change comment

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-22 14:15:05 +08:00
BossZou
95d5d60088
update oatpp md5 (#3832) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-22 11:45:28 +08:00
Cai Yudong
e1e2d75875
optimize pytest (#3833) 
* update collection cases to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* combine const.py with constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update entity cases to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix typo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_compact to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove redundant variables in test_config

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_flush to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_index to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_partition to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update collection cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update entity cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update collection cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove const from all tests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_mix

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update stability cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-09-22 11:32:05 +08:00
groot
18b0447d8d
fix wal recovery issue (#3818) 
* fix wal recovery issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-22 01:43:05 +00:00
Cai Yudong
94634b1d5f
[skip ci] update milvus_python_test/README.md (#3826) 
* [skip ci] update milvus_python_test/README.md

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* [skip ci] update service type

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-09-21 19:23:57 +08:00
Wang Xiangyu
88ed4bbe59
add hidden config engine.max_partition_num (#3817) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-21 18:36:54 +08:00
del-zhenwu
0de671f638
[skip ci] add index case (#3807) 
* [skip ci] add index case

Signed-off-by: zw <zw@milvus.io>

* remove restart case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-21 10:04:03 +08:00
groot
b2eb82e5ef
use multi-segments operation to flush (#3804) 
* use multi-segments operation to flush

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-19 09:12:32 +00:00
BossZou
13d8877517
Fix web start fail for IP family (#3778) 
* Fix web start fail for ip family

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* update oatpp md5

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add more detail case

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-19 04:10:11 +00:00
shengjun.li
6bd5dc3feb
Fix the crash caused by empty index param (#3803) 
* fix crash caused by empty index param

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix C++ SDK examples

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-18 08:34:33 +00:00
shengjun.li
0749b3793c
fix the limit of nprobe and nlist (#3797) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-18 14:15:56 +08:00
yukun
486aacc47b
Improve MergeTopkToResultSet performance (#3788) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix MergeTopkToResultSet performance problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-18 04:04:29 +00:00
groot
f6f8b66298
avoid snapshot warning during deleting entity (#3798) 
* avoid snapshot warning

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-18 03:59:47 +00:00
chen qingxiang
dd52655f0a
Fix the bug of file not close when check sum failed. (#3783) 
* Fix the bug of file not close when check sum failed.

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the log level to error

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix cpp lint problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-17 19:12:38 +08:00
groot
0b81bcfb68
avoid dead circle when merge failed (#3787) 
* avoid dead circle when merge failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 18:52:46 +08:00
groot
e8f5b5c691
add adaptive merge strategy (#3780) 
* add adaptive merge

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 16:07:07 +08:00
yukun
7e0b16ca46
Fix webserver readme for 0.11.0 (#3765) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-17 10:09:08 +08:00
del-zhenwu
2237f33084
segment_row_limit (#3755) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-16 17:15:32 +08:00
shengjun.li
582087ad38
hold FaissIVFQuantizerPtr in IVFSQHybrid (#3770) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-16 15:56:35 +08:00
groot
e26bcc1900
modify merge strategy (#3757) 
* modify merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* clean code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:52:39 +08:00
Wang Xiangyu
49884b3338
close lockfile when server stop (#3737) 
* close lockfile when server stop

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix something error

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:48:24 +08:00
groot
c0ab29ab4a
#3756 ignore deleted docs file if it doesnt exist (#3766) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:28:54 +08:00
Wang Xiangyu
c8c9679444
fix trace level log files missing (#3769) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:19:48 +08:00
BossZou
b524222998
New operation named MultiSegmentsOperation support multi-segments during flush (#3733) 
* Add multiSegmentsOpera

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* rish test

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add new operation MultiSegmentsOperation

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Recoveray ut itls

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* fix judeg bug

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-16 10:14:06 +08:00
Wang Xiangyu
2c11122466
fix config usage (#3747) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-15 23:48:44 +08:00
quicksilver
48c86dbbda
Set a timeout for a whole job on Github action pipeline (#3746) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-09-15 19:25:09 +08:00
XuPeng-SH
600ce3cecc
(db/snapshot): fix GC PartitionCommit (#3750) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 19:23:26 +08:00
ThreadDao
fbca2c99fa
Add case for segment and update case nprobe 0 and partition limit (#3751) 
* case segment_row_count

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* fix case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-09-15 19:09:04 +08:00
Jin Hai
12c573abdc
Improve code of dabloom (#3694) 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-09-15 17:25:14 +08:00
XuPeng-SH
97d0b119ce
Apply more stale check rules for Operations (#3721) 
* (db/snapshot): Update Operations to handle stale errors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some print in ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 14:35:01 +08:00
groot
6ce00fb043
#3722 rename segment_row_count to segment_row_limit (#3724) 
* #3722 rename segment_row_count to segment_row_limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unitest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest 3

Signed-off-by: groot <yihua.mo@zilliz.com>

* wal issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* bloom magic number

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-15 14:33:11 +08:00
yukun
b6010dfd1f
GET_PAGE_ENTITY sometimes failed in test_web (#3735) 
* [skip ci]Unfit property name segment_row_count in 0.11

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* GET_PAGE_ENTITY sometimes failed in test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-15 14:19:07 +08:00
del-zhenwu
590a480550
[skip ci] disable two compact cases (#3731) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-15 10:18:33 +08:00
del-zhenwu
daecef4b70
scale nb in test case (#3564) 
* scale nb in test case

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* add shell script to generate test.yaml used to change default build_index_threshold

Signed-off-by: zw <zw@milvus.io>

* fix groovy script

Signed-off-by: zw <zw@milvus.io>

* fix groovy script

Signed-off-by: zw <zw@milvus.io>

* fix groovy write file

Signed-off-by: zw <zw@milvus.io>

* add restart cases

Signed-off-by: zw <zw@milvus.io>

* add restart cases

Signed-off-by: zw <zw@milvus.io>

* fix some bugs

Signed-off-by: zw <zw@milvus.io>

* disable limit partition case

Signed-off-by: zw <zw@milvus.io>

* add cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-14 16:55:12 +08:00
chen qingxiang
c7a5358b56
add some check to avoid server crash (#3715) 
* add some check to avoid server crash

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* rm useless code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-14 16:38:37 +08:00
groot
7e1345c28f
fix delete entity performance issue (#3667) 
* fix delete entity performance issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* force flush for delete

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve delete performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix delete performce issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang

Signed-off-by: groot <yihua.mo@zilliz.com>

* segment row count min limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge 0.11.0

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-14 16:38:25 +08:00