admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
18,382 Commits 137 Branches 188 Tags
Commit Graph

1579 Commits

Author SHA1 Message Date
groot
d20328bc05
test: Avoid unstable case of bulkinsert (#28757) 
test: There are too many test cases for bulkinsert+partition_key. Each
case creates 10 bulkinsert tasks to import a file with 100~200 rows. The
default num_partitions is 64 for partition_key. So, each task will
generate 64 tiny segments. There are 10 cases, each case 10 tasks, each
task 64 tiny segment, totally there are 6400 tiny segments generated.
And all these segment row count is less than 1024, no need to build
index, and take part in compaction. There will be lots of compaction
tasks generated. It costs too much time to process these compaction
tasks. Eventually, some cases are timeout after waiting 5 minutes for
their segments to be ready and cases fail.

Specifying the num_partitions to a small value can avoid this problem.

pr: https://github.com/milvus-io/milvus/pull/28679

```
[2023-11-21T03:41:16.187Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[int_scalar-True-True] PASSED [ 54%]
[2023-11-21T03:41:42.796Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[int_scalar-False-True] PASSED [ 57%]
[2023-11-21T03:42:04.694Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[string_scalar-True-True] PASSED [ 60%]
[2023-11-21T03:42:31.205Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[string_scalar-False-True] PASSED [ 63%]
[2023-11-21T03:43:38.876Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_multi_numpy_files[10-150-13-True] XPASS [ 66%]
[2023-11-21T03:49:00.357Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_multi_numpy_files[10-150-13-False] XFAIL [ 69%]
[2023-11-21T03:53:51.811Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[int_scalar-True] FAILED [ 72%]
[2023-11-21T03:58:58.283Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[int_scalar-False] FAILED [ 75%]
[2023-11-21T04:02:04.696Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[string_scalar-True] PASSED [ 78%]
[2023-11-21T04:02:26.608Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[string_scalar-False] PASSED [ 81%]
```

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-11-28 10:34:31 +08:00
yah01
5ca7851f4a
enhance: refine error messages (#28424) (#28614) 
- Split the simple reason and full detail
- Refine existing error messages related: #28422
related: https://github.com/milvus-io/milvus/issues/28422
pr: #28424

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-11-24 10:04:24 +08:00
zhuwenxing
558e301236
test:skip a bulk insert testcase temporarily (#28621) 
skip a bulk insert test case temporarily.
It is a known issue but needs more time to solve. skip the test case is
for not blocking other PR

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-11-21 19:12:22 +08:00
ThreadDao
d582193772
Add test cases for L0 delete (#28382) 
- test delete records in delta logs, WAL, L0 segment

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2023-11-14 10:26:24 +08:00
zhuwenxing
c7fe443b93
[test]Remove xfail for a bulk insert testcase (#28283) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-11-13 11:48:18 +08:00
nico
9451720a31
update test cases for 2.3 branch (#28335) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-11-13 09:34:20 +08:00
cai.zhang
c8cab4dfc3
No hit when the index exceeds the array length (#28302) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2023-11-09 22:10:32 +08:00
nico
4d95a7368d
update pymilvus version (#28299) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-11-09 19:04:22 +08:00
zhuwenxing
765aaf3e88
[skip e2e][cherry-pick]Mark a case as xfail (#28248) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-11-07 18:22:05 +08:00
nico
7616414083
update pymilvus version (#27918) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-26 09:46:09 +08:00
yanliang567
8b5b33fce0
Update simd compatibility test (#27880) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2023-10-25 17:20:14 +08:00
nico
de26231976
update nightly test cases (#27911) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-25 17:18:12 +08:00
nico
ec99eb1759
Add test cases of array contains (#27889) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-24 19:24:19 +08:00
zhuwenxing
906b348e00
[skip e2e]Update chaos duration time (#27879) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-24 11:47:59 +08:00
nico
6e6de17a8c
update pymilvus version (#27791) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-24 09:28:21 +08:00
nico
a693af014f
Add test cases of array (#27603) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-24 09:26:31 +08:00
zhuwenxing
0c33ddb7c5
[skip e2e]Skip creating index when it was already created (#27849) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-23 11:48:09 +08:00
zhuwenxing
5923f109a0
[test]Add concurrent test in ci (#27633) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-23 11:46:21 +08:00
zhuwenxing
38fc652fdd
[test]Reduce some op frequency (#27826) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-23 11:44:22 +08:00
nico
6b33420b3a
modify error code nightly cases (#27788) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-23 10:14:10 +08:00
zhuwenxing
5247ea3fd1
[skip e2e]Update the method whether vector field is indexed (#27820) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-20 14:02:07 +08:00
nico
d52a74f78f
add senario: rename collection in a new db (#27400) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-20 10:42:07 +08:00
nico
02d5aeaf2b
Add test cases of scann index (#27784) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-20 09:58:07 +08:00
zhenshan.cao
020ad9a6bc
Rectify wrong exception messages associated with Array datatype (#27769) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-10-19 17:24:07 +08:00
aoiasd
177d0351ec
fix unstable unit test of delete (#27738) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-10-19 07:18:16 +08:00
nico
9ed3cfd925
add test cases (#27376) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-17 14:16:08 +08:00
nico
5dbcdf777d
update pymilvus verison (#27724) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-17 10:38:10 +08:00
nico
76bb0a7bd8
update pymilvus version and modify Error code & msg improvement (#27609) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-16 09:16:07 +08:00
zhuwenxing
5b405ca28a
[skip e2e]Remove compact in concurrent test (#27666) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-12 15:13:34 +08:00
nico
2a7d3d8dd2
Add test cases of COSINE logic optimize (#27647) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-10-12 13:01:34 +08:00
ThreadDao
722e3db6b8
Add case query filter json field (#27575) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2023-10-11 17:01:40 +08:00
zhuwenxing
1bad19a121
[test]Fix apply chaos condition (#27625) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-11 14:11:33 +08:00
Gao
7a65b6fb85
Limit faiss ivf index build thread num and fix ut (#27567) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-10-11 10:33:33 +08:00
smellthemoon
3b8d1ec5fd
Modify unstable ut (#27602) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-10-10 20:01:32 +08:00
nico
f9137d880b
Modify nightly test cases (#27517) 
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
 2023-10-10 11:53:34 +08:00
nico
2d58691126
modify test case search index partitions (#27554) 
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
 2023-10-10 11:51:33 +08:00
yanliang567
df6e0b7a2c
Skip a test for issue 27462 (#27551) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2023-10-09 14:55:32 +08:00
zhuwenxing
fc429cabba
[test]Fix timeout in create index (#27437) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-10-08 15:09:31 +08:00
aoiasd
2607357147
Fix some unstable complex delete test (#27497) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-10-07 17:57:31 +08:00
yanliang567
0bad7a32d2
Imporve bulk insert test in timeout (#27500) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2023-10-07 17:43:33 +08:00
yah01
8394b3a1ec
Block creating new error from status reason (#27426) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-07 11:29:32 +08:00
Jiquan Long
ace352aa95
Fix case test_partition_key_on_multi_numpy_files (#27421) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-09-28 18:15:27 +08:00
zhuwenxing
01c4499a12
[skip e2e]Use default timeout for creating index in chaos test (#27434) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-09-28 15:57:27 +08:00
nico
35c1bea25c
set scann create index timeout to 1200s (#27373) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-09-26 18:59:31 +08:00
yanliang567
3e864d4210
Merge bulkinsert partition key enable tests from 2.2.0 branch (#27372) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2023-09-26 18:43:32 +08:00
nico
f1257cf11b
update test cases nightly (#27353) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-09-26 17:17:28 +08:00
yah01
6539a5ae2c
Refine DataCoord status (#27262) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-26 17:15:27 +08:00
nico
c321ac183c
modify unstable test cases about delete (#27319) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-09-25 18:43:27 +08:00
zhuwenxing
e1da980ba3
[skip e2e]Update resource for chaos test (#27337) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2023-09-25 11:31:26 +08:00
nico
9d77c1dcda
Add test cases of delete by complex expr - part two (#27316) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2023-09-25 09:01:26 +08:00