admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,972 Commits 146 Branches 196 Tags
Commit Graph

5972 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yukun
486aacc47b
Improve MergeTopkToResultSet performance (#3788) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Readme.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix MergeTopkToResultSet performance problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-18 04:04:29 +00:00
groot
f6f8b66298
avoid snapshot warning during deleting entity (#3798) 
* avoid snapshot warning

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-18 03:59:47 +00:00
chen qingxiang
dd52655f0a
Fix the bug of file not close when check sum failed. (#3783) 
* Fix the bug of file not close when check sum failed.

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the log level to error

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix cpp lint problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-17 19:12:38 +08:00
groot
0b81bcfb68
avoid dead circle when merge failed (#3787) 
* avoid dead circle when merge failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 18:52:46 +08:00
groot
e8f5b5c691
add adaptive merge strategy (#3780) 
* add adaptive merge

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-17 16:07:07 +08:00
yukun
7e0b16ca46
Fix webserver readme for 0.11.0 (#3765) 
* Fix WebServer README.md

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-17 10:09:08 +08:00
del-zhenwu
2237f33084
segment_row_limit (#3755) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-16 17:15:32 +08:00
shengjun.li
582087ad38
hold FaissIVFQuantizerPtr in IVFSQHybrid (#3770) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-16 15:56:35 +08:00
groot
e26bcc1900
modify merge strategy (#3757) 
* modify merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* clean code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:52:39 +08:00
Wang Xiangyu
49884b3338
close lockfile when server stop (#3737) 
* close lockfile when server stop

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix something error

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:48:24 +08:00
groot
c0ab29ab4a
#3756 ignore deleted docs file if it doesnt exist (#3766) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-16 14:28:54 +08:00
Wang Xiangyu
c8c9679444
fix trace level log files missing (#3769) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-16 14:19:48 +08:00
BossZou
b524222998
New operation named MultiSegmentsOperation support multi-segments during flush (#3733) 
* Add multiSegmentsOpera

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* rish test

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add new operation MultiSegmentsOperation

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Recoveray ut itls

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* fix judeg bug

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-16 10:14:06 +08:00
Wang Xiangyu
2c11122466
fix config usage (#3747) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-15 23:48:44 +08:00
quicksilver
48c86dbbda
Set a timeout for a whole job on Github action pipeline (#3746) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-09-15 19:25:09 +08:00
XuPeng-SH
600ce3cecc
(db/snapshot): fix GC PartitionCommit (#3750) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 19:23:26 +08:00
ThreadDao
fbca2c99fa
Add case for segment and update case nprobe 0 and partition limit (#3751) 
* case segment_row_count

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* fix case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-09-15 19:09:04 +08:00
Jin Hai
12c573abdc
Improve code of dabloom (#3694) 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-09-15 17:25:14 +08:00
XuPeng-SH
97d0b119ce
Apply more stale check rules for Operations (#3721) 
* (db/snapshot): Update Operations to handle stale errors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some print in ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-15 14:35:01 +08:00
groot
6ce00fb043
#3722 rename segment_row_count to segment_row_limit (#3724) 
* #3722 rename segment_row_count to segment_row_limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unitest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest 3

Signed-off-by: groot <yihua.mo@zilliz.com>

* wal issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* bloom magic number

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-15 14:33:11 +08:00
yukun
b6010dfd1f
GET_PAGE_ENTITY sometimes failed in test_web (#3735) 
* [skip ci]Unfit property name segment_row_count in 0.11

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* GET_PAGE_ENTITY sometimes failed in test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-15 14:19:07 +08:00
del-zhenwu
590a480550
[skip ci] disable two compact cases (#3731) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-15 10:18:33 +08:00
del-zhenwu
daecef4b70
scale nb in test case (#3564) 
* scale nb in test case

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* add shell script to generate test.yaml used to change default build_index_threshold

Signed-off-by: zw <zw@milvus.io>

* fix groovy script

Signed-off-by: zw <zw@milvus.io>

* fix groovy script

Signed-off-by: zw <zw@milvus.io>

* fix groovy write file

Signed-off-by: zw <zw@milvus.io>

* add restart cases

Signed-off-by: zw <zw@milvus.io>

* add restart cases

Signed-off-by: zw <zw@milvus.io>

* fix some bugs

Signed-off-by: zw <zw@milvus.io>

* disable limit partition case

Signed-off-by: zw <zw@milvus.io>

* add cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-14 16:55:12 +08:00
chen qingxiang
c7a5358b56
add some check to avoid server crash (#3715) 
* add some check to avoid server crash

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* rm useless code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-14 16:38:37 +08:00
groot
7e1345c28f
fix delete entity performance issue (#3667) 
* fix delete entity performance issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* force flush for delete

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve delete performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix delete performce issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang

Signed-off-by: groot <yihua.mo@zilliz.com>

* segment row count min limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge 0.11.0

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-14 16:38:25 +08:00
XuPeng-SH
bd2a3d6e63
(db/snapshot): Implement FlushableMappingField for better metadata snapshot (#3655) 
* Update metadata for mappings

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 2

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 3

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 4

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 5

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 6

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Update metadata for mappings 7

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): optimize PartitionCommit metadata implementation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): optimize PartitionCommit metadata implementation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update mock logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-14 16:24:23 +08:00
XuanYang-cn
8215e11e78
Fix#3689 Client get stuck if drop collection during creating index (#3714) 
* fix jaccard distance compute

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* edit changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-14 15:46:57 +08:00
chen qingxiang
a8943f824c
fix snapshot not release bug (#3708) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-12 23:07:45 +08:00
groot
ed494c67d4
add log (#3680) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-12 03:32:06 +00:00
XuanYang-cn
3e542bdcf5
fix3626 (#3699) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-12 09:46:36 +08:00
XuPeng-SH
7af413bcc7
(db/snapshot): update LSN logic (#3682) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-11 16:07:30 +08:00
XuanYang-cn
243660094f
fix #3672 0.11.0 docker image is 200M larger due to the un-expected installation of openblas (#3686) 
* fix #3672

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix #3672

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-09-11 02:13:19 +00:00
Cai Yudong
639a356245
[skip ci] update milvus_python_test/README.md (#3687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-09-10 17:16:23 +08:00
groot
37d2a68658
avoid dabloom warning (#3674) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-10 02:57:04 +00:00
chen qingxiang
de071d5939
add memory limit check (#3669) 
* add memory limit check

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add changelog

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the implementation of memory check

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* revert code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* revert code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-09-10 02:21:17 +00:00
XuanYang-cn
c5ac77bd86
Fix loadcollection memory usage is one times larger than expect (#3664) 
* rm new rearanged_data to avoid additional memory usage

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix cpu version

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix data_ deconstruct twice error

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-09-09 19:11:50 +08:00
ThreadDao
f4236d4c53
[skip ci] update case for get entity by with invalid ids (#3665) 
* update case get entity by deleted id

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] delete unuse fun

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix case for get entity invalid id

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-09-09 14:48:27 +08:00
ThreadDao
821373e9c6
fix get entity by deleted id (#3661) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-09-09 14:46:55 +08:00
Xiaohai Xu
6bd1755d00
fix nprobe error (#3658) 
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-09-08 11:07:31 +00:00
groot
2fde7ea98f
set wal lsn to meta (#3638) 
* wal lsn

Signed-off-by: groot <yihua.mo@zilliz.com>

* temp comment

Signed-off-by: groot <yihua.mo@zilliz.com>

* recovery from meta lsn

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-08 09:51:19 +00:00
groot
5564f7b6ec
Clear cache after merge (#3645) 
* rewrite merge code

Signed-off-by: groot <yihua.mo@zilliz.com>

* clear cache after merge

Signed-off-by: groot <yihua.mo@zilliz.com>

* clear cache after drop

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* clear index cache after drop

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-08 09:50:12 +00:00
yukun
2601f5dff0
Proto of C++ sdk is different from milvus server (#3654) 
* Fix getEntity when no query_params and payload is provided in webserver

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change entities object to json::array

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Proto of C++ sdk is different from milvus server

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-09-08 09:42:52 +00:00
ThreadDao
bef59af85f
[skip ci] update callback test and binary search test (#3657) 
* [skip ci] confirm pr 3599 and 3601

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] add case callback

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update search binary collection

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update search binary collection

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update search binary collection

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-09-08 17:26:15 +08:00
Cai Yudong
c95d77a3a6
add build option -rdynamic in CMakeList.txt (#3632) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-09-08 01:59:11 +00:00
groot
7fede6ffc1
rewrite dabloom (#3629) 
* rewrite dabloom

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* unittest

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-07 08:26:29 +00:00
Wang Xiangyu
5de3386155
fix building index check (#3628) 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-07 07:34:51 +00:00
BossZou
1a10525471
Fix crash where getting octets information (#3625) 
* Fix crash where getting octets information

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Code format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-07 14:21:27 +08:00
XuPeng-SH
7e51b1fa6d
(db/snapshot): fix InActiveResourcesGCEvent bug (#3611) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-09-07 09:45:10 +08:00
shengjun.li
10eae7100e
add to check query dim (#3620) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-07 09:34:58 +08:00
Cai Yudong
ed50cb303f
[skip ci] use List<List<Byte>> for binary searchParam (#3622) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-09-05 19:08:29 +08:00