mirror of
https://gitee.com/milvus-io/milvus.git
synced 2026-01-01 00:15:30 +08:00
a0faf1a786
* refactoring(create_table done) * refactoring * refactor server delivery (insert done) * refactoring server module (count_table done) * server refactor done * cmake pass * refactor server module done. * set grpc response status correctly * format done. * fix redefine ErrorMap() * optimize insert reducing ids data copy * optimize grpc request with reducing data copy * clang format * [skip ci] Refactor server module done. update changlog. prepare for PR * remove explicit and change int32_t to int64_t * add web server * [skip ci] add license in web module * modify header include & comment oatpp environment config * add port configure & create table in handler * modify web url * simple url complation done & add swagger * make sure web url * web functionality done. debuging * add web unittest * web test pass * add web server port * add web server port in template * update unittest cmake file * change web server default port to 19121 * rename method in web module & unittest pass * add search case in unittest for web module * rename some variables * fix bug * unittest pass * web prepare * fix cmd bug(check server status) * update changlog * add web port validate & default set * clang-format pass * add web port test in unittest * add CORS & redirect root to swagger ui * add web status * web table method func cascade test pass * add config url in web module * modify thirdparty cmake to avoid building oatpp test * clang format * update changlog * add constants in web module * reserve Config.cpp * fix constants reference bug * replace web server with async module * modify component to support async * format * developing controller & add test clent into unittest * add web port into demo/server_config * modify thirdparty cmake to allow build test * remove unnecessary comment * add endpoint info in controller * finish web test(bug here) * clang format * add web test cpp to lint exclusions * check null field in GetConfig * add macro RETURN STATUS DTo * fix cmake conflict * fix crash when exit server * remove surplus comments & add http param check * add uri /docs to direct swagger * format * change cmd to system * add default value & unittest in web module * add macros to judge if GPU supported * add macros in unit & add default in index dto & print error message when bind http port fail * format (fix #788) * fix cors bug (not completed) * comment cors * change web framework to simple api * comments optimize * change to simple API * remove comments in controller.hpp * remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger * add ep cmake args to sqlite * clang-format * change a format * test pass * change name to * fix compiler issue(oatpp-swagger depend on oatpp) * add & in start_server.h * specify lib location with oatpp and oatpp-swagger * add comments * add swagger definition * [skip ci] change http method options status code * remove oatpp swagger(fix #970) * remove comments * check Start web behavior * add default to cpu_cache_capacity * remove swagger component.hpp & /docs url * remove /docs info * remove /docs in unittest * remove space in test rpc * remove repeate info in CHANGLOG * change cache_insert_data default value as a constant * [skip ci] Fix some broken links (#960) * [skip ci] Fix broken link * [skip ci] Fix broken link * [skip ci] Fix broken link * [skip ci] Fix broken links * fix issue 373 (#964) * fix issue 373 * Adjustment format * Adjustment format * Adjustment format * change readme * #966 update NOTICE.md (#967) * remove comments * check Start web behavior * add default to cpu_cache_capacity * remove swagger component.hpp & /docs url * remove /docs info * remove /docs in unittest * remove space in test rpc * remove repeate info in CHANGLOG * change cache_insert_data default value as a constant * adjust web port cofig place * rename web_port variable * set advanced config name add DEFAULT Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com> Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com> Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
176 lines
14 KiB
Plaintext
176 lines
14 KiB
Plaintext
# Licensed to the Apache Software Foundation (ASF) under one
|
|
# or more contributor license agreements. See the NOTICE file
|
|
# distributed with this work for additional information
|
|
# regarding copyright ownership. The ASF licenses this file
|
|
# to you under the Apache License, Version 2.0 (the
|
|
# "License"); you may not use this file except in compliance
|
|
# with the License. You may obtain a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing,
|
|
# software distributed under the License is distributed on an
|
|
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
# KIND, either express or implied. See the License for the
|
|
# specific language governing permissions and limitations
|
|
# under the License.
|
|
|
|
version: 0.1
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# Server Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# address | IP address that Milvus server monitors. | IP | 0.0.0.0 |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# port | Port that Milvus server monitors. Port range (1024, 65535) | Integer | 19530 |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# deploy_mode | Milvus deployment type: | DeployMode | single |
|
|
# | single, cluster_readonly, cluster_writable | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# time_zone | Use UTC-x or UTC+x to specify a time zone. | Timezone | UTC+8 |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# web_port | Port that Milvus web server monitors. | Integer | 19121 |
|
|
# | Port range (1024, 65535) | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
server_config:
|
|
address: 0.0.0.0
|
|
port: 19530
|
|
deploy_mode: single
|
|
time_zone: UTC+8
|
|
web_port: 19121
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# DataBase Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# backend_url | URL for metadata storage, using SQLite (for single server | URL | sqlite://:@:/ |
|
|
# | Milvus) or MySQL (for distributed cluster Milvus). | | |
|
|
# | Format: dialect://username:password@host:port/database | | |
|
|
# | Keep 'dialect://:@:/', 'dialect' can be either 'sqlite' or | | |
|
|
# | 'mysql', replace other texts with real values. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# insert_buffer_size | Buffer size used for data insertion. | Integer | 1 (GB) |
|
|
# | The sum of 'insert_buffer_size' and 'cpu_cache_capacity' | | |
|
|
# | must be less than system memory size. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# preload_table | A comma-separated list of table names that need to be pre- | StringList | |
|
|
# | loaded when Milvus server starts up. | | |
|
|
# | '*' means preload all existing tables. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
db_config:
|
|
backend_url: sqlite://:@:/
|
|
insert_buffer_size: 1
|
|
preload_table:
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# Storage Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# primary_path | Primary directory used to save meta data, vector data and | Path | /var/lib/milvus |
|
|
# | index data. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# secondary_path | A semicolon-separated list of secondary directories used | Path | |
|
|
# | to save vector data and index data. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# minio_enable | Enable MinIO storage or not. | Boolean | false |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# minio_address | MinIO storage service IP address. | IP | 127.0.0.1 |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# minio_port | MinIO storage service port. Port range (1024, 65535) | Integer | 9000 |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# minio_access_key | MinIO storage service access key. | String | minioadmin |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# minio_secret_key | MinIO storage service secret key. | String | minioadmin |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# minio_bucket | MinIO storage service bucket name. | String | milvus-bucket |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
storage_config:
|
|
primary_path: @MILVUS_DB_PATH@
|
|
secondary_path:
|
|
minio_enable: false
|
|
minio_address: 127.0.0.1
|
|
minio_port: 9000
|
|
minio_access_key: minioadmin
|
|
minio_secret_key: minioadmin
|
|
minio_bucket: milvus-bucket
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# Metric Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# enable_monitor | Enable monitoring function or not. | Boolean | false |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# address | Pushgateway address | IP | 127.0.0.1 +
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# port | Pushgateway port, port range (1024, 65535) | Integer | 9091 |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
metric_config:
|
|
enable_monitor: false
|
|
address: 127.0.0.1
|
|
port: 9091
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# Cache Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# cpu_cache_capacity | The size of CPU memory used for caching data for faster | Integer | 4 (GB) |
|
|
# | query. The sum of 'cpu_cache_capacity' and | | |
|
|
# | 'insert_buffer_size' must be less than system memory size. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# cache_insert_data | Whether to load inserted data into cache immediately for | Boolean | false |
|
|
# | hot query. If want to simultaneously insert and query | | |
|
|
# | vectors, it's recommended to enable this config. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
cache_config:
|
|
cpu_cache_capacity: 4
|
|
cache_insert_data: false
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# Engine Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# use_blas_threshold | A Milvus performance tuning parameter. This value will be | Integer | 1100 |
|
|
# | compared with 'nq' to decide if OpenBLAS should be used. | | |
|
|
# | If nq >= use_blas_threshold, OpenBLAS will be used, search | | |
|
|
# | response times will be stable but the search speed will be | | |
|
|
# | slower; if nq < use_blas_threshold, SSE will be used, | | |
|
|
# | search speed will be faster but search response times will | | |
|
|
# | fluctuate. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# gpu_search_threshold | A Milvus performance tuning parameter. This value will be | Integer | 1000 |
|
|
# | compared with 'nq' to decide if the search computation will| | |
|
|
# | be executed on GPUs only. | | |
|
|
# | If nq >= gpu_search_threshold, the search computation will | | |
|
|
# | be executed on GPUs only; | | |
|
|
# | if nq < gpu_search_threshold, the search computation will | | |
|
|
# | be executed on both CPUs and GPUs. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
engine_config:
|
|
use_blas_threshold: 1100
|
|
gpu_search_threshold: 1000
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# GPU Resource Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# enable | Enable GPU resources or not. | Boolean | false |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# cache_capacity | The size of GPU memory per card used for cache. | Integer | 1 (GB) |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# search_resources | The list of GPU devices used for search computation. | DeviceList | gpu0 |
|
|
# | Must be in format gpux. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# build_index_resources| The list of GPU devices used for index building. | DeviceList | gpu0 |
|
|
# | Must be in format gpux. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
gpu_resource_config:
|
|
enable: true
|
|
cache_capacity: 1
|
|
search_resources:
|
|
- gpu0
|
|
build_index_resources:
|
|
- gpu0
|
|
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# Tracing Config | Description | Type | Default |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
# json_config_path | Absolute path for tracing config file. | Path | |
|
|
# | Leave it empty, a no-op tracer will be created. | | |
|
|
#----------------------+------------------------------------------------------------+------------+-----------------+
|
|
tracing_config:
|
|
json_config_path:
|