del-zhenwu
2237f33084
segment_row_limit ( #3755 )
...
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-09-16 17:15:32 +08:00
shengjun.li
582087ad38
hold FaissIVFQuantizerPtr in IVFSQHybrid ( #3770 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-16 15:56:35 +08:00
groot
e26bcc1900
modify merge strategy ( #3757 )
...
* modify merge strategy
Signed-off-by: groot <yihua.mo@zilliz.com>
* clean code
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-16 14:52:39 +08:00
Wang Xiangyu
49884b3338
close lockfile when server stop ( #3737 )
...
* close lockfile when server stop
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
* fix something error
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-16 14:48:24 +08:00
groot
c0ab29ab4a
#3756 ignore deleted docs file if it doesnt exist ( #3766 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-16 14:28:54 +08:00
Wang Xiangyu
c8c9679444
fix trace level log files missing ( #3769 )
...
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-16 14:19:48 +08:00
BossZou
b524222998
New operation named MultiSegmentsOperation support multi-segments during flush ( #3733 )
...
* Add multiSegmentsOpera
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* rish test
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Add new operation MultiSegmentsOperation
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Recoveray ut itls
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* fix judeg bug
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-09-16 10:14:06 +08:00
Wang Xiangyu
2c11122466
fix config usage ( #3747 )
...
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-15 23:48:44 +08:00
quicksilver
48c86dbbda
Set a timeout for a whole job on Github action pipeline ( #3746 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-09-15 19:25:09 +08:00
XuPeng-SH
600ce3cecc
(db/snapshot): fix GC PartitionCommit ( #3750 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-09-15 19:23:26 +08:00
ThreadDao
fbca2c99fa
Add case for segment and update case nprobe 0 and partition limit ( #3751 )
...
* case segment_row_count
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
* fix case
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
2020-09-15 19:09:04 +08:00
Jin Hai
12c573abdc
Improve code of dabloom ( #3694 )
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-09-15 17:25:14 +08:00
XuPeng-SH
97d0b119ce
Apply more stale check rules for Operations ( #3721 )
...
* (db/snapshot): Update Operations to handle stale errors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add some print in ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-09-15 14:35:01 +08:00
groot
6ce00fb043
#3722 rename segment_row_count to segment_row_limit ( #3724 )
...
* #3722 rename segment_row_count to segment_row_limit
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unitest
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest 3
Signed-off-by: groot <yihua.mo@zilliz.com>
* wal issue
Signed-off-by: groot <yihua.mo@zilliz.com>
* bloom magic number
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-15 14:33:11 +08:00
yukun
b6010dfd1f
GET_PAGE_ENTITY sometimes failed in test_web ( #3735 )
...
* [skip ci]Unfit property name segment_row_count in 0.11
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* GET_PAGE_ENTITY sometimes failed in test_web
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-09-15 14:19:07 +08:00
del-zhenwu
590a480550
[skip ci] disable two compact cases ( #3731 )
...
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-09-15 10:18:33 +08:00
del-zhenwu
daecef4b70
scale nb in test case ( #3564 )
...
* scale nb in test case
Signed-off-by: zw <zw@milvus.io>
* update cases
Signed-off-by: zw <zw@milvus.io>
* update cases
Signed-off-by: zw <zw@milvus.io>
* add shell script to generate test.yaml used to change default build_index_threshold
Signed-off-by: zw <zw@milvus.io>
* fix groovy script
Signed-off-by: zw <zw@milvus.io>
* fix groovy script
Signed-off-by: zw <zw@milvus.io>
* fix groovy write file
Signed-off-by: zw <zw@milvus.io>
* add restart cases
Signed-off-by: zw <zw@milvus.io>
* add restart cases
Signed-off-by: zw <zw@milvus.io>
* fix some bugs
Signed-off-by: zw <zw@milvus.io>
* disable limit partition case
Signed-off-by: zw <zw@milvus.io>
* add cases
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-09-14 16:55:12 +08:00
chen qingxiang
c7a5358b56
add some check to avoid server crash ( #3715 )
...
* add some check to avoid server crash
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* rm useless code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-14 16:38:37 +08:00
groot
7e1345c28f
fix delete entity performance issue ( #3667 )
...
* fix delete entity performance issue
Signed-off-by: groot <yihua.mo@zilliz.com>
* force flush for delete
Signed-off-by: groot <yihua.mo@zilliz.com>
* improve delete performance
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix delete performce issue
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix hang
Signed-off-by: groot <yihua.mo@zilliz.com>
* segment row count min limit
Signed-off-by: groot <yihua.mo@zilliz.com>
* merge 0.11.0
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failed
Signed-off-by: groot <yihua.mo@zilliz.com>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-14 16:38:25 +08:00
XuPeng-SH
bd2a3d6e63
(db/snapshot): Implement FlushableMappingField for better metadata snapshot ( #3655 )
...
* Update metadata for mappings
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 5
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 6
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 7
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): optimize PartitionCommit metadata implementation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): optimize PartitionCommit metadata implementation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update mock logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-09-14 16:24:23 +08:00
XuanYang-cn
8215e11e78
Fix#3689 Client get stuck if drop collection during creating index ( #3714 )
...
* fix jaccard distance compute
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* edit changelog
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-09-14 15:46:57 +08:00
chen qingxiang
a8943f824c
fix snapshot not release bug ( #3708 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-12 23:07:45 +08:00
groot
ed494c67d4
add log ( #3680 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-12 03:32:06 +00:00
XuanYang-cn
3e542bdcf5
fix3626 ( #3699 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-09-12 09:46:36 +08:00
XuPeng-SH
7af413bcc7
(db/snapshot): update LSN logic ( #3682 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-09-11 16:07:30 +08:00
XuanYang-cn
243660094f
fix #3672 0.11.0 docker image is 200M larger due to the un-expected installation of openblas ( #3686 )
...
* fix #3672
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix #3672
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-09-11 02:13:19 +00:00
Cai Yudong
639a356245
[skip ci] update milvus_python_test/README.md ( #3687 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-10 17:16:23 +08:00
groot
37d2a68658
avoid dabloom warning ( #3674 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-10 02:57:04 +00:00
chen qingxiang
de071d5939
add memory limit check ( #3669 )
...
* add memory limit check
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* format code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* add changelog
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* change the implementation of memory check
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* revert code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* revert code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-10 02:21:17 +00:00
XuanYang-cn
c5ac77bd86
Fix loadcollection memory usage is one times larger than expect ( #3664 )
...
* rm new rearanged_data to avoid additional memory usage
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix cpu version
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix data_ deconstruct twice error
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-09-09 19:11:50 +08:00
ThreadDao
f4236d4c53
[skip ci] update case for get entity by with invalid ids ( #3665 )
...
* update case get entity by deleted id
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] delete unuse fun
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] fix case for get entity invalid id
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-09-09 14:48:27 +08:00
ThreadDao
821373e9c6
fix get entity by deleted id ( #3661 )
...
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-09-09 14:46:55 +08:00
Xiaohai Xu
6bd1755d00
fix nprobe error ( #3658 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-09-08 11:07:31 +00:00
groot
2fde7ea98f
set wal lsn to meta ( #3638 )
...
* wal lsn
Signed-off-by: groot <yihua.mo@zilliz.com>
* temp comment
Signed-off-by: groot <yihua.mo@zilliz.com>
* recovery from meta lsn
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-08 09:51:19 +00:00
groot
5564f7b6ec
Clear cache after merge ( #3645 )
...
* rewrite merge code
Signed-off-by: groot <yihua.mo@zilliz.com>
* clear cache after merge
Signed-off-by: groot <yihua.mo@zilliz.com>
* clear cache after drop
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
* clear index cache after drop
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-08 09:50:12 +00:00
yukun
2601f5dff0
Proto of C++ sdk is different from milvus server ( #3654 )
...
* Fix getEntity when no query_params and payload is provided in webserver
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change entities object to json::array
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Proto of C++ sdk is different from milvus server
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-09-08 09:42:52 +00:00
ThreadDao
bef59af85f
[skip ci] update callback test and binary search test ( #3657 )
...
* [skip ci] confirm pr 3599 and 3601
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] add case callback
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* update search binary collection
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* update search binary collection
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* update search binary collection
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-09-08 17:26:15 +08:00
Cai Yudong
c95d77a3a6
add build option -rdynamic in CMakeList.txt ( #3632 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-08 01:59:11 +00:00
groot
7fede6ffc1
rewrite dabloom ( #3629 )
...
* rewrite dabloom
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-07 08:26:29 +00:00
Wang Xiangyu
5de3386155
fix building index check ( #3628 )
...
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-07 07:34:51 +00:00
BossZou
1a10525471
Fix crash where getting octets information ( #3625 )
...
* Fix crash where getting octets information
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Code format
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-09-07 14:21:27 +08:00
XuPeng-SH
7e51b1fa6d
(db/snapshot): fix InActiveResourcesGCEvent bug ( #3611 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-09-07 09:45:10 +08:00
shengjun.li
10eae7100e
add to check query dim ( #3620 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-07 09:34:58 +08:00
Cai Yudong
ed50cb303f
[skip ci] use List<List<Byte>> for binary searchParam ( #3622 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-05 19:08:29 +08:00
Cai Yudong
4b004737c2
[skip ci] add test for compactAsync callback ( #3618 )
...
* [skip ci] add test for compactAsync callback
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* [skip ci] use Nullable instead
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-05 16:22:12 +08:00
XuanYang-cn
a1f0ff01ef
fix aws build error ( #3607 )
...
* fix aws build
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix aws include directories
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-09-05 13:57:07 +08:00
ThreadDao
c1c9c616fc
[skip ci] add case for dsl search vectors ( #3613 )
...
* [skip ci] add case for index with builder
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] add search case with multi must
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] add search case
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] update create_index2 and binary search
Signed-off-by: zongyufen <zongyufen@foxmail.com>
* [skip ci] add dsl test case
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-09-05 05:54:50 +00:00
quicksilver
742439269e
Update Milvus Dev Test environment ( #3604 )
...
* Update Milvus Dev Test environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Update Milvus Dev Test environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* update requirements.txt in test_env
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-09-05 03:59:20 +00:00
chen qingxiang
97daa9c88e
fix cache not clear bug in ut ( #3595 )
...
* fix cache not clear bug in ut
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* add todo
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-09-05 10:47:19 +08:00
yukun
b1bf945c48
Fix getEntity when no query_params and payload is provided in webserver ( #3600 )
...
* Fix getEntity when no query_params and payload is provided in webserver
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change entities object to json::array
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-09-05 10:39:20 +08:00
