del-zhenwu a5beec86f2 Change lang cn to en in reademe (#971)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en
2020-01-13 13:56:15 +08:00

39 lines
1.1 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# Quick start
### Description
- Test cases can be organized with `yaml `
- Test can run with local mode or helm mode
### Demos
1. Using jenkins + helm mode
![](assets/Parameters.png)
2. Local test
`python3 main.py --local --host=*.* --port=19530 --suite=suites/gpu_search_performance_random50m.yaml`
### Definitions of test suites
Testers need to write test suite config if adding a customizised test into the current test framework
The following are the searching performance test suite
![](assets/gpu_search_performance_random50m-yaml.png)
1. search_performance: the test typealso we have`build_performance`,`insert_performance`,`accuracy`,`stability`,`search_stability`
2. tables: list of test cases
3. The following fields are in the `table` field
- server: milvus的server_config
- table_name: currently support one table
- run_count: search count
- search_params: params of search_vectors
## Test result
The result of searching performance![](assets/milvus-nightly-performance-new-jenkins.png)
Test result will be uploaded, and will be used to judge if the test run pass or failed