admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-29 23:15:28 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,706 Commits 136 Branches 186 Tags
Commit Graph

44 Commits

Author SHA1 Message Date
BossZou
61517339ea Fix http server bug (#1096) 
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

* check offset and pagesize (fix #1082)

* improve error message if offset or page_size is not legal (fix #1075)

* add log into web module

* update changlog

* check gpu sources setting when assign repeated value (fix #990)

* update changlog

* clang-format pass

* add default handler in http handler

* [skip ci] improve error msg when check gpu resources

* change check offset way

* remove func IsIntStr

* add case

* change int32 to int64 when check number str

* add log in we module(doing)

* update test case

* add log in web controller

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
 2020-01-19 19:19:09 +08:00
Cai Yudong
a909f95c6c #1078 Move 'insert_buffer_size' to Cache Config section (#1085) 
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-01-18 10:08:46 +08:00
Cai Yudong
364fc25766 rename 'minio' to 's3' in Storage Config section (#1088) 
* #1002 rename 'minio' to 's3' in Storage Config section

* #1002 clang format
 2020-01-18 10:07:46 +08:00
BossZou
a0faf1a786 Add http server (#956) 
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* set advanced config name add DEFAULT

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
 2020-01-13 13:55:48 +08:00
Cai Yudong
69d42a3d70 remove collector from config (#939) 
* #931 remove collector from config

* #931 fix test_metrics build error
 2020-01-07 16:14:38 +08:00
yukun
a92a43e282 Add push mode for prometheus monitor (#905) 
* Add push mode for prometheus monitor

* format code

* fix for comments

* fix test_MetricBase bug

* Change ip to address in config
 2020-01-06 18:35:10 +08:00
Cai Yudong
28da6c73d0 #908 move primary_path and secondary_path to storage config (#909) 2020-01-04 15:44:46 +08:00
Cai Yudong
b9d9b8ecc2 support minio storage (#895) 
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
 2020-01-04 10:39:52 +08:00
Cai Yudong
7c02c3760e #771 add ProcessCommand() to process pre-defined commands (#777) 2019-12-17 10:48:28 +08:00
Cai Yudong
41d7500f61 support config cli test 2 (#764) 
* #665 support get/set config via CLI

* #665 support get/set config via CLI

* #665 add unittest for config CLI

* #665 remove config_node_map_

* #665 remove config_node_map_

* #665 fix clang-format

* #665 fix clang-format

* #665 update changelog

* #665 code clean

* #665 update API interface

* #665 update API interface

* #665 handle server status

* #665 handle unknown command

* #665 update debug log

* #665 rollback CmdRequest.cpp
 2019-12-14 15:11:02 +08:00
Zhiru Zhu
e99896ac62 Add Opentracing (#729) 
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
 2019-12-10 15:24:54 +08:00
yudong.cai
59f17fcc59 #605 print more messages when server start 2019-11-29 15:02:13 +08:00
yudong.cai
2aad94b678 #560 add version in server config file 2019-11-28 16:12:39 +08:00
groot
2b805489a1 #485 Increase code coverage rate 2019-11-23 11:34:45 +08:00
wxyu
a9bc655cfb Read gpu config only gpu_resource_config.enable=true fix #467 2019-11-21 17:26:11 +08:00
yudong.cai
c89bb6699e #306 Use int64 for all config integer 2019-11-20 14:26:39 +08:00
yudong.cai
37df2b6fc4 #346 rename gpu_resource_config.enable_gpu to gpu_resource_config.enable 2019-11-20 10:22:42 +08:00
fishpenguin
7f5c2fefd8 Remove OnlyGpuPass and add MILVUS_GPU_VERSION define 2019-11-19 19:18:54 +08:00
yudong.cai
0d1923c61f #346 update gpu resource config APIs 2019-11-19 15:49:40 +08:00
fishpenguin
caacf40ed2 fix for config change 2019-11-19 14:18:45 +08:00
yudong.cai
fddfd1eb03 #346 update config APIs to support build index with multiple GPUs 2019-11-18 18:47:52 +08:00
fishpenguin
35f1796355 fix conflicts 2019-11-18 14:32:09 +08:00
fishpenguin
513ad3b842 Support build index with multiple gpu 2019-11-18 11:38:48 +08:00
groot
57e3c14825 fix unittest failure 2019-11-07 18:46:27 +08:00
Zhiru Zhu
3c0c4646b0 issue 229, 230 and 237 2019-11-07 15:35:53 +08:00
groot
55bfdd3fb6 merge 0.5.2 into 0.6.0 2019-11-06 11:39:30 +08:00
yudong.cai
d6bf525309 #200 fix clang-format 2019-11-05 17:45:02 +08:00
yudong.cai
c1f8dd2a23 #200 disable search resource has only CPU 2019-11-05 17:39:33 +08:00
youny626
bede77751e clang format 2019-11-05 13:35:24 +08:00
youny626
4ca6b59b91 add CPU version 2019-11-05 10:23:59 +08:00
yudong.cai
35bad8b63f #175 add invalid config unittest 
Former-commit-id: 86f629e902b707a5b0aaed17e4ecb9d1e46e5070
 2019-11-03 13:06:29 +08:00
fishpenguin
2f28f053d2 change gpu_index to device_id 
Former-commit-id: 6993e98e19e31f942ffee5833b593a59cffa94a7
 2019-11-02 11:26:08 +08:00
fishpenguin
44d648c3af #164 - Add CPU version for building index 
Former-commit-id: 02f9f2a04dc765f41c474af04659f70d121cdc18
 2019-11-01 17:01:57 +08:00
yudong.cai
6ad1ed74e9 #159 Change the configuration name from 'use_gpu_threshold' to 'gpu_search_threshold' 
Former-commit-id: b4e576b389a720d66ec5455ca05b20184c8c911d
 2019-11-01 14:51:20 +08:00
wxyu
4df6f4b5a9 Not return error when search_resources and index_build_device set cpu 
Former-commit-id: 0e0313e59cfbf8f8b17fc62db02f2e21a25d25a2
 2019-10-31 16:58:47 +08:00
wxyu
7dc552fdea New config opion use_gpu_threshold 
Former-commit-id: 3d33145d8fa473f2b81cc98022c1bb93853a2fbc
 2019-10-30 19:57:55 +08:00
starlord
bb43a77130 update message 
Former-commit-id: 0a5ad5dfd42d76032c5008d9d9e4e2213b161232
 2019-10-29 17:19:02 +08:00
starlord
dcc7fbd439 update message 
Former-commit-id: 84f9b8ce2ac8050128f678754123ae2716e3b342
 2019-10-29 16:50:55 +08:00
starlord
c63c622cf5 update message 
Former-commit-id: 568dbdc5d6dc233716682ebec33e6bd3dfe45500
 2019-10-29 16:06:27 +08:00
starlord
a78e928dfa #90 The server start error messages could be improved to enhance user experience 
Former-commit-id: e3ad89ab67f2c46bc4cb4e6d094a7763fb098664
 2019-10-29 15:16:04 +08:00
starlord
12b7d6f5d8 #90 The server start error messages could be improved to enhance user experience 
Former-commit-id: 746b126621cd845c2848bb850b5c2eb6d3b65a6d
 2019-10-28 20:24:13 +08:00
yudong.cai
4d1fb143e1 MS-665 rename build_index_gpu to index_build_device, and move it to resource config 
Former-commit-id: f3da7963531406da7a22fbf5ab95caa8e920344a
 2019-10-18 16:32:28 +08:00
yudong.cai
30534bee23 MS-653 fix when config check fail, Milvus close without message 
Former-commit-id: b9ff8c2228d07b6abe9d72f87e06bee823a05363
 2019-10-15 15:59:56 +08:00
starlord
41d37f9648 re-organize project 
Former-commit-id: 898c2c8b0b2cfdc1b8664062aa0ea910a93566dd
 2019-10-14 09:51:48 +08:00