202 Commits

Author SHA1 Message Date
cqy123456
77200fd322
fix index HNSW_PQ/SQ in test_get_collection_stats_after_index_created has no index type (#3883)
* change tests

Signed-off-by: cqy <yaya645@126.com>
2020-09-26 15:16:19 +08:00
del-zhenwu
3e4c9ae632
add hnsw pq/sq case (#3863)
* add hnsw pq/sq case

Signed-off-by: zw <zw@milvus.io>

* change some cases from l2 to l1

Signed-off-by: zw <zw@milvus.io>

* disable hnsw_pq/sq in 0.11.0

Signed-off-by: zw <zw@milvus.io>

* fix groovy

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-09-26 10:50:51 +08:00
ThreadDao
a04a8ad1ff
add test insert binary (#3853)
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
2020-09-24 14:11:13 +08:00
shengjun.li
20440a835e when the topk of gpu search >2048 ,turning into the cpu search (#3640)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-22 19:12:46 +08:00
Cai Yudong
e1e2d75875
optimize pytest (#3833)
* update collection cases to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* combine const.py with constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update entity cases to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix typo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_compact to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove redundant variables in test_config

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_flush to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_index to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_partition to use constants.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update collection cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update entity cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update collection cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove const from all tests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test_mix

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update stability cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-22 11:32:05 +08:00
Cai Yudong
94634b1d5f
[skip ci] update milvus_python_test/README.md (#3826)
* [skip ci] update milvus_python_test/README.md

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* [skip ci] update service type

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-21 19:23:57 +08:00
del-zhenwu
0de671f638
[skip ci] add index case (#3807)
* [skip ci] add index case

Signed-off-by: zw <zw@milvus.io>

* remove restart case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-09-21 10:04:03 +08:00
groot
e8f5b5c691
add adaptive merge strategy (#3780)
* add adaptive merge

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-17 16:07:07 +08:00
del-zhenwu
2237f33084
segment_row_limit (#3755)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-09-16 17:15:32 +08:00
ThreadDao
fbca2c99fa
Add case for segment and update case nprobe 0 and partition limit (#3751)
* case segment_row_count

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* fix case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
2020-09-15 19:09:04 +08:00
groot
6ce00fb043
#3722 rename segment_row_count to segment_row_limit (#3724)
* #3722 rename segment_row_count to segment_row_limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unitest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest 3

Signed-off-by: groot <yihua.mo@zilliz.com>

* wal issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* bloom magic number

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-15 14:33:11 +08:00
del-zhenwu
590a480550
[skip ci] disable two compact cases (#3731)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-09-15 10:18:33 +08:00
del-zhenwu
daecef4b70
scale nb in test case (#3564)
* scale nb in test case

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* add shell script to generate test.yaml used to change default build_index_threshold

Signed-off-by: zw <zw@milvus.io>

* fix groovy script

Signed-off-by: zw <zw@milvus.io>

* fix groovy script

Signed-off-by: zw <zw@milvus.io>

* fix groovy write file

Signed-off-by: zw <zw@milvus.io>

* add restart cases

Signed-off-by: zw <zw@milvus.io>

* add restart cases

Signed-off-by: zw <zw@milvus.io>

* fix some bugs

Signed-off-by: zw <zw@milvus.io>

* disable limit partition case

Signed-off-by: zw <zw@milvus.io>

* add cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-09-14 16:55:12 +08:00
groot
7e1345c28f
fix delete entity performance issue (#3667)
* fix delete entity performance issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* force flush for delete

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve delete performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix delete performce issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang

Signed-off-by: groot <yihua.mo@zilliz.com>

* segment row count min limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge 0.11.0

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-14 16:38:25 +08:00
Cai Yudong
639a356245
[skip ci] update milvus_python_test/README.md (#3687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-09-10 17:16:23 +08:00
ThreadDao
821373e9c6
fix get entity by deleted id (#3661)
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-09-09 14:46:55 +08:00
Xiaohai Xu
6bd1755d00
fix nprobe error (#3658)
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-09-08 11:07:31 +00:00
Wang Xiangyu
80c5ff5a23
Update ConfigMgr::Set behavior (#3546)
* Update ConfigMgr::Set behavior

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* Update python tests

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* update cmd status

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* update endpoint status

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* recover state endpoint

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* update

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-09-04 17:07:07 +08:00
del-zhenwu
ffba23d6d0
remove set config case (#3587)
* remove set config case

Signed-off-by: zw <zw@milvus.io>

* fix case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-09-04 14:16:50 +08:00
cqy123456
e4a2c0c1da
Fix #3515: error should be raised if tag name as params of has_partition is set invalid (#3545)
* change tag name

Signed-off-by: cqy <yaya645@126.com>

* tag name support $

Signed-off-by: cqy <yaya645@126.com>
2020-09-03 15:10:26 +08:00
ThreadDao
f8f0bd87a5
Add test case: insert with disable auto flush and get entity with multi thread (#3569)
* add multi threads get entity case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* get multi threads case and insert disable flush case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update

Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-09-03 11:29:01 +08:00
groot
848c7a33d3
merge Pr3529 to 0.11 (#3543)
* split insert data accordding to segment row count

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-09-01 18:21:35 +08:00
yukun
20bc6cf90e
SearchTask::nq() should not return 0 (#3522)
* SearchTask::nq() should not return 0

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Search failed with regex tag name

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix some error message in web server

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dev_test

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-31 14:12:49 +08:00
del-zhenwu
2a1bf34e67
add cases (#3517)
* [skip ci] update restart policy to Never

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update restart policy to Never

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update timeout in cases

Signed-off-by: zw <zw@milvus.io>

* add cases

Signed-off-by: zw <zw@milvus.io>

* reset restart policy in CI

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-29 18:36:00 +08:00
yukun
c9580e3701
Restrict the content of partition_tag (#3473)
* ListIDInSegment get wrong result when delete more than one ids

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Restrict the content of partition_tag

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* ci retry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test case

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dev-test

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-28 14:08:32 +08:00
groot
5ff0070bf3
merge pr3467 (#3481)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-08-27 14:08:28 +08:00
Xiaohai Xu
c6d0bfb3e5
fix index check (#3478)
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-08-27 14:07:45 +08:00
del-zhenwu
35763853a7
add test case: list id after delete more entities & add compact with invalid threshold (#3444)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-25 17:19:18 +08:00
jinhai
d2749b22ce Create branch 0.11.0
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-08-25 10:09:28 +08:00
XuanYang-cn
7326784e30
Fix Server get stuck if create index with invalide metric types after entities inserted (#3428)
* add create index with invalid metric type case

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bin index validation

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-24 23:17:42 +08:00
chen qingxiang
ed1195edb2
remove the _id fileld when get collection info (#3414)
* fix the bug of issue #3336

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-24 03:45:53 +00:00
chen qingxiang
2e5ff884c1
fix the bugs of delete all and compact (#3395)
* fix the bugs of delete all and compact

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the wrong usages in unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the bug of insert makes no effect

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add character check in ExtraFileInfo and change the const size and type

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-22 10:37:27 +00:00
BossZou
c66e40ccff
[skip ci] comment unused insert case (#3405)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-22 16:54:18 +08:00
ThreadDao
49218f5490
fix dsl term with multi fields (#3403)
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-22 16:41:31 +08:00
del-zhenwu
d34be8bc79
Skip flat search params (#3381)
* assert top ids

Signed-off-by: zw <zw@milvus.io>

* update milvus-helm to 0.11.0

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-21 16:25:28 +08:00
Xiaohai Xu
b437639b7a
#3309 Error should be raised if search binary collection with metric_type: L2 (#3349)
* add check

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-08-20 18:22:09 +08:00
ThreadDao
2a2cf0fe9f
fix search without insert data (#3339)
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-20 14:44:29 +08:00
Xiaohai Xu
07ece74b70
#3295 Server crashed during creating index (#3307)
* fix binary case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix validation

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* exception by reference

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-08-19 15:43:41 +08:00
del-zhenwu
d9e9d52f3b
enable some cases (#3325)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-19 15:30:50 +08:00
del-zhenwu
dfecfb85db
enable binary search cases (#3312)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-18 22:26:44 +08:00
ThreadDao
cb74d0a30b
Fix invalid ranges and delete logging (#3303)
* invalid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* delete gen invalid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-18 18:48:18 +08:00
del-zhenwu
d993bcc989
remove todo case (#3296)
* remove todo case

Signed-off-by: zw <zw@milvus.io>

* remove todo case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-18 16:50:51 +08:00
del-zhenwu
0dfe08471b
[skip ci] disable ubuntu && update case (#3244)
* [skip ci] disable ubuntu && update case

Signed-off-by: zw <zw@milvus.io>

* some cases set level-1 from level-2

Signed-off-by: zw <zw@milvus.io>

* add get collection info case: after index created

Signed-off-by: zw <zw@milvus.io>

* add -1 in invalid ints

Signed-off-by: zw <zw@milvus.io>

* remove douban pip during install python-lib

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-15 01:18:24 +08:00
ThreadDao
892b16633b
update dsl search case (#3225)
* [skip ci] add dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci]fix test bug in whether user defined id (#3192)

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] add dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* Fix TestSearchDSL level 2 bugs (#3185)

* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] update dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* fix valid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>

Co-authored-by: chen qingxiang <67679556+godchen0212@users.noreply.github.com>
Co-authored-by: yukun <kun.yu@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-14 15:02:42 +08:00
chen qingxiang
6f6a1bfd82
fix cmd req bug and fix test case bug (#3241)
* [skip ci]fix test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* cancel change config

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix Cmd req bug and change config test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case in config and throw inmutable params problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-13 06:14:50 +00:00
yukun
92e2a26a78
Fix test_query_range_valid_ranges bug (#3224)
* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateIndex in C++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk range test

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search_ip_index_partitions

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_query_range_valid_ranges

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-12 14:29:33 +08:00
chen qingxiang
3ec8c382d6
fix compact bug and change some test case level from 2 to 1 (#3219)
* fix compact bug and change some test case level from 2 to 1

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix ping test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-12 10:56:33 +08:00
del-zhenwu
46f2f20d77
[skip ci] fix compact case bug (#3212)
* [skip ci] use pymilvus-test, remove personal git repo

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add pytest dry-run

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix compact case bug

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add search case: search with different metric_type

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add search case: search with different metric_type

Signed-off-by: zw <zw@milvus.io>

* fix index.py

Signed-off-by: zw <zw@milvus.io>

* get_stats changed: some cases disabled

Signed-off-by: zw <zw@milvus.io>

* fix case bug

Signed-off-by: zw <zw@milvus.io>

* fix case bug

Signed-off-by: zw <zw@milvus.io>

* set search binary level-2

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-08-11 20:46:34 +08:00
yukun
0b25f4c015
Fix CreateIndex bug in C++ sdk (#3216)
* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateIndex in C++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk range test

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search_ip_index_partitions

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-11 17:16:54 +08:00
chen qingxiang
202a8b7244
fix GetEntityBug and part of test case bug (#3200)
* fix GetEntityBug and part of test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-11 02:46:59 +00:00