yanliang567 bbb3f90051
Update tests chaos and remove useless code (#5821)
* [skip ci] Add flush checker in monitor thread

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci] update chaos parser

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci] Update chaos tests

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci] Move chaos to python_client folder

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci] Remove useless code and comments

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci] Use delayed assert for always assert everything

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-06-17 11:49:57 +08:00

106 lines
2.6 KiB
YAML

# Testcases All-in-one
# pod kill
# standalone
# 3 pods(standalone-ha-blabla, etcd, minio)
# cluster-1-node
# 11 pods(proxy, master, query node, query service, data node, data service,
# index node, index service, pulsar, etcd, minio)
# cluster-n-nodes
# 11 pods* n: kill one and kill all
Collections:
-
testcase:
name: test_standalone_podkill
chaos: chaos_standalone_podkill.yaml
expectation:
cluster_1_node:
create: fail
insert: fail
flush: fail
index: fail
search: fail
query: fail
cluster_n_nodes:
search: degrade # keep functional, but performance degraded
query: degrade
-
testcase:
name: test_querynode_podkill
chaos: chaos_querynode_podkill.yaml
expectation:
cluster_1_node:
search: fail
query: fail
cluster_n_nodes:
search: degrade # keep functional, but performance degraded
query: degrade
-
testcase:
name: test_queryservice_podkill
chaos: chaos_queryservice_podkill.yaml
-
testcase:
name: test_datanode_podkill
chaos: chaos_datanode_podkill.yaml
expectation:
cluster_1_node:
insert: succ
flush: fail
cluster_n_nodes:
insert: degrade
-
testcase:
name: test_dataservice_podkill
chaos: chaos_dataservice_podkill.yaml
-
testcase:
name: test_indexnode_podkill
chaos: chaos_indexnode_podkill.yaml
-
testcase:
name: test_indexservice_podkill
chaos: chaos_indexservice_podkill.yaml
-
testcase:
name: test_proxy_podkill
chaos: chaos_proxy_podkill.yaml
expectation:
cluster_1_node:
create: fail
insert: fail
flush: fail
index: fail
search: fail
query: fail
cluster_n_nodes:
insert: degrade
-
testcase:
name: test_master_podkill
chaos: chaos_master_podkill.yaml
-
testcase:
name: test_etcd_podkill
chaos: chaos_etcd_podkill.yaml
-
testcase:
name: test_minio_podkill
chaos: chaos_minio_podkill.yaml
-
testcase:
name: test_querynode_cpu100p
chaos: chaos_querynode_cpu100p.yaml
# and 10 more for the other pods
-
testcase:
name: test_querynode_mem100p
chaos: chaos_querynode_mem100p.yaml
# and 10 more for the other pods
-
testcase:
name: test_querynode_network_isolation
chaos: chaos_querynode_network_isolation.yaml
# and 10 more for the other pods