milvus/tests/benchmark/README.md
Cai Yudong 84110d2684 Add tests/benchmark and tests/python_test using new python SDK
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-02-25 17:35:36 +08:00

40 lines
1.1 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# Quick start
### Description
This project is used to test performance/reliability/stability for milvus server
- Test cases can be organized with `yaml`
- Test can run with local mode or helm mode
### Usage:
`pip install requirements.txt`
if using local mode, the following libs is optional
`pymongo==3.10.0`
`kubernetes==10.0.1`
### Demos
1. Local test
`python3 main.py --local --host=*.* --port=19530 --suite=suites/gpu_search_performance_random50m.yaml`
### Definitions of test suites
Testers need to write test suite config if adding a customizised test into the current test framework
1. search_performance: the test typealso we have`build_performance`,`insert_performance`,`accuracy`,`stability`,`search_stability`
2. tables: list of test cases
3. The following fields are in the `table` field
- server: run host
- milvus: config in milvus
- collection_name: currently support one collection
- run_count: search count
- search_params: params of query
## Test result
Test result will be uploaded if tests run in helm mode, and will be used to judge if the test run pass or failed