BossZou
0e25bab619
Fix inconsistent reading and writing when using mishards (# 2367) ( #2442 )
...
* Fix inconsistent reading and writing when using mishards (# 2367)
Signed-off-by: yhz <413554850@qq.com>
* CI retry
Signed-off-by: yhz <413554850@qq.com>
2020-05-29 13:32:49 +08:00
groot
dcb60f3021
performance issues ( #2438 )
...
* performance issues
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix bugs
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* preload collection issue
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* uncomment boring log
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* reduce unittest time
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* reduce metric test time cost
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-28 00:19:08 +08:00
Cai Yudong
b532a69c8b
clean compile warning ( #2380 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-19 17:58:23 +00:00
Cai Yudong
eba33cc46d
Caiyd 090 rename config ( #2340 )
...
* rename config items
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update config unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update config unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update log rotate default value
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update parameter usage in LogUtil.cpp (#3 )
Signed-off-by: wxyu <xy.wang@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix ut
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: Wang XiangYu <scsven@qq.com>
2020-05-14 17:57:18 +00:00
BossZou
3c7c9ad645
Change url for behavior 'get_entities_by_id' ( #2330 ) ( #2336 )
...
Signed-off-by: yhz <413554850@qq.com>
2020-05-14 21:01:20 +08:00
BossZou
1b7aeaffdf
Fix server start failed when mode is 'read_only' ( #2294 )
...
* fix deploy bug
Signed-off-by: yhz <413554850@qq.com>
* fix unittest fail
Signed-off-by: yhz <413554850@qq.com>
* remove unused yml
Signed-off-by: yhz <413554850@qq.com>
* change to readonly
Signed-off-by: yhz <413554850@qq.com>
2020-05-12 09:28:10 +08:00
groot
fb49e580c5
rewrite HasPartition ( #2289 )
...
* rewrite HasPartition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* miss file
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* use layered merge
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* sdk HasPartition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* rename sdk api
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: groot <yihua.mo@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 09:27:58 +08:00
op-hunter
b6e16af8f8
update unittest config version ( #2299 )
...
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-05-11 22:00:21 +08:00
BossZou
8d732656a7
Fix show partitions failed in http module ( fix #2228 ) ( #2234 )
...
* Fix show partitions failed in http module (fix #2228 )
Signed-off-by: yhz <413554850@qq.com>
* catch json string convert error
Signed-off-by: yhz <413554850@qq.com>
2020-05-10 12:49:26 +00:00
Cai Yudong
cf6be092ab
code clean ( #2265 )
...
* use macro STATUS_CHECK
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* comment S3 related config APIs
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-09 01:51:04 +00:00
BossZou
1811254de6
Obtain running rpc requests information ( #2240 ) ( #2241 )
...
* add cmd to get requests
Signed-off-by: yhz <413554850@qq.com>
* forward class declaration
Signed-off-by: yhz <413554850@qq.com>
* Obtain running rpc requests information (fix #2240 )
Signed-off-by: yhz <413554850@qq.com>
* Fix unittest compile failed issue
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Log error with msg
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-08 11:17:48 +00:00
yukun
1516d71a55
Add attributes to mysql and wal ( #2229 )
...
* Add hybrid operation into mysql
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add Hybrid into wal
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add unittest for hybrid wal
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix wal unittest bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix hybrid_insert unittest bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix codacy/PR quality
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change test_rpc port to 19531
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-07 06:14:58 +00:00
BossZou
82ab21aec3
Http update endpoints ( #2187 )
...
* replace table with collection in http module
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add search_by_ids in http module
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add API
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add new API and unittest
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Update endpoint in http module(#2186 ); change vector id to string format(2185)
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* allow filter when show partition
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* move constant variables defination to .cpp
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-06 14:07:35 +08:00
Wang XiangYu
ff48427911
Log file rotating ( #2207 )
...
* log file rotating
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update changelog
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix compile failed
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-30 23:31:14 +08:00
BossZou
2c889636ab
Check Storage permission ( #2174 )
...
* add class storage checker
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* code format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* code format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add cpu instruction sets check (#2055 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add more details for storage
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Check storage path permission (fix #2173 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Fix logs path access fail issue
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-29 17:23:32 +00:00
feisiyicl
b3aa06fce1
add config simd_type ( #2179 )
...
* add config simd_type
Signed-off-by: feisiyicl <7764126@qq.com>
* update changelog
Signed-off-by: feisiyicl <7764126@qq.com>
2020-04-29 17:46:36 +08:00
Wang XiangYu
3be8aad1af
Merge config file ( #2168 )
...
* Using el::Configurations Class init easylog
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add logs config constant
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add config check function
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add config get function
Signed-off-by: wxyu <xy.wang@zilliz.com>
* logs config set function
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update InitLog function
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix clang-format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update server_config.template
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update changelog
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-28 20:21:21 +08:00
BossZou
4ab92f3032
Add config to switch off web server ( #2137 )
...
* Add a config parameter to switch off http server (fix #2057 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify web enable config name
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix cmake bug & output exanption msg
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* rename web enbale config as web_enable
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* optimize code
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* log out errno
Signed-off-by: yhz <413554850@qq.com>
2020-04-28 17:04:04 +08:00
BossZou
bf42dbd5b6
Gpu check ( #2129 )
...
* add GpuCheck class
Signed-off-by: yhz <413554850@qq.com>
* Check gpu environment
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add server checker unittest
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-04-27 16:56:12 +08:00
Wang XiangYu
12b3bf0693
Add instance lock ( #2060 )
...
* Add instance lock
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update message
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update unittest CMakeLists.txt
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix clang-format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-26 08:31:18 +00:00
groot
82f4c289eb
New api HasPartition, SearchByID, GetVectorsByID ( #2056 )
...
* modify proto
Signed-off-by: groot <yihua.mo@zilliz.com>
* modify c sdk
Signed-off-by: groot <yihua.mo@zilliz.com>
* rewrite search by id
Signed-off-by: groot <yihua.mo@zilliz.com>
* change cases
Signed-off-by: zw <zw@zilliz.com>
* fix cases
Signed-off-by: zw <zw@zilliz.com>
* fix wal case
Signed-off-by: zw <zw@zilliz.com>
* fix search by id
Signed-off-by: groot <yihua.mo@zilliz.com>
* modify sdk
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* add search_by_ids case
Signed-off-by: zw <zw@zilliz.com>
* disable test_search)by_ids
Signed-off-by: zw <zw@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
2020-04-25 14:49:32 +08:00
yukun
67d8a9b54c
Add http interface for hybrid search ( #2079 )
...
* Add http interface for hybrid search
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add unittest for http hybrid interface
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* clang format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix codacy quality
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-25 13:19:17 +08:00
Aredcap
b55f249938
Assert cmd reply ( #2030 )
...
* Assert cmd reply
Signed-off-by: Aredcap <zhangleilei19@mails.ucas.ac.cn>
* fix unittest error
Signed-off-by: Aredcap <zhangleilei19@mails.ucas.ac.cn>
2020-04-23 11:22:58 +08:00
yukun
ff9697b184
Change input format for attributes ( #1990 )
...
* Change input of attributes
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix unittest for new attrs format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix float type for new format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Use new HEntity
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add sdk_hybrid
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add metric_type assign in CreateHybridCollection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix for clang-format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Read engine_type from extra_params
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove todo annotation
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove some comments
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add DescribeHybridCollection request
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove unused code
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-22 06:12:46 +00:00
yukun
3e1b2ab4a0
Filtering by numeric scalar fields prototype ( #1919 )
...
* Add hybrid request handler
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add C++ sdk for createcollection and insertentities
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add RequestHandler
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add test case for hybrid insert
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix sqlite bug for createcollection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridQuery Handler DBImpl and ExecBinaryQuery
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridSearch sdk
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridSearch test case
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HybridSearch bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HybridSearch crash bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change void* to vector<uint8_t> in Attr codec
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add context and new search task
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add merge for Hybrid
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add AST validation
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add unittest for hybrid
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix hybrid search nq bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix bugs after merge master
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix clang format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix unittest bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix Codacy
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix compact unittest bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove grpc request in hybridsearchcontext
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix some codacy quality issue
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HYBRID_DB_TEST bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Annotate new search task
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add Hybrid RPC handler unittest
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix logs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridSearch unittest
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-16 14:54:12 +08:00
groot
93244a2a79
#1705 Limit the insert data batch size ( #1936 )
...
* #1705 Limit the insert data batch size
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-16 00:18:23 +08:00
Jin Hai
f8a28699b4
Change to 0.8.0 and rename from preload_table to preload_collection ( #1904 )
...
* Create new branch 0.8.0 and change preload_table to preload_collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
* update helm version
Signed-off-by: zw <zw@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
2020-04-11 19:01:29 +08:00
groot
e25c5af2d7
rename table to collection ( #1888 )
...
* rename table to collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* rename collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* rename
Signed-off-by: groot <yihua.mo@zilliz.com>
* Update change log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-10 19:17:33 +08:00
Jin Hai
35276ffcb0
Rename from table to collection ( #1857 )
...
* Change HasTable to HasCollection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change HasTable to HasCollection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compile
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table to collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change Table to Collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change Table to Collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change Table to Collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change Table to Collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change Table to Collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix Unit test
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-03 23:12:41 +08:00
Jin Hai
68625cbf1c
Fix 1724 ( #1821 )
...
* #1724 Remove unused unittests
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part2
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part3
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part4
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part5
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_id to collection_id
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table to collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_ to collection_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table_id_ to collection_id_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Change table_name to collection_name
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Reformat
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableFile to Segment
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableSchema to CollectionSchema
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix compile lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 17:37:55 +08:00
groot
a3935eed71
unitest validation ( #1788 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-28 19:26:39 +08:00
BossZou
4cd5d8dd1b
Add Superstructure/Substructure in http module ( #1785 )
...
* add sub/super-structure in http module
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update http test case
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add Superstructure/Substructure in http module (fix #1784 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-28 14:41:24 +08:00
groot
0da3c712ec
HasTable with a not exist table name, return error status ( #1761 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-26 19:59:49 +08:00
groot
c4b7be8ed6
#1728 Optimize request handler to combine similar query ( #1743 )
...
* modify changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* improve search qps
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix hang bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix combine request result bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* add unittest for combine request
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failure
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-26 14:26:02 +08:00
groot
99470b4dfa
#1702 Optimize request handler to combine similar query ( #1727 )
...
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine request code
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* combine search request
Signed-off-by: groot <yihua.mo@zilliz.com>
* combine search request
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1728 Optimize request handler to combine similar query
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* remove some log
2020-03-23 18:26:18 +08:00
Cai Yudong
538c377e65
Caiyd 1689 fix sq8h fail ( #1723 )
...
* #1689 fix SQ8H search fail on SIFT-1B dataset
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix bug
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix gpu search fail
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* revert segment back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_gpuresource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_gpuresource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-23 10:48:15 +08:00
Cai Yudong
5950deddfc
#1678 remove CUSTOMIZATION macro ( #1707 )
...
* #1678 remove CUSTOMIZATION macro
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable faiss_benchmark
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-20 10:24:27 +08:00
Cai Yudong
588ef95d76
Caiyd refactor knowhere ( #1687 )
...
* add new knowhere
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* build pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* rename algo
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* add archive
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* all unittest pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* test_binary pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move knowhere into namespace milvus
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update hnsw
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapterMgr
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move SetBlacklist/GetBlacklist to VecIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VectorAdapter and rename SearchById to QueryById
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update interface in ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus build pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus IDMAP sdk_simple pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_schedule
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version Milvus build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update BinaryIVF BuildAll
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VecIndexFactory
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix knowhere unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix SPTAG unittest
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version unittest build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_engine
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change BinarySet key back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change IndexType to string, and add compatible API for 0.7.0
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix IndexHNSW build warning
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_cache
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix write_index error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-19 19:24:20 +08:00
BossZou
504a9e30ab
Optimize config cpu_cache_capacity / gpu_cache_capacity setter ( #1572 ) ( #1629 )
...
* add gpu cache config handler
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove 0.8.0 from config version map
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* clean config header reference
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix bug in web readme
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* reduce gpu config handler to gpu resources handler
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add engine config
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify handler hook(fix #1572 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* initalize value in handler by config default
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* code style format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix compile error in release mode
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* resolve faiss blas threshold init in DBWrapper
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify cache header
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove comments
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* order headers
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* convert gpu res config to lower case
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* CI retry
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* adjust header order in cpu cache mar file
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* improve config test case
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* code format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-19 10:17:53 +08:00
groot
55ecfd5930
#1663 PQ index parameter m validation ( #1677 )
...
* #1663 PQ index parameter m validation
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failure
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-18 18:26:38 +08:00
groot
802d62eb24
#1651 Check validity of dimension when collection metric type is binary one ( #1666 )
...
* #1648 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1651 Check validity of dimension when collection metric type is binary one
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-03-16 16:26:12 +08:00
groot
6c826c1308
#1648 The cache cannot be used all when the type is binary ( #1648 )
...
* #1648 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-15 20:45:11 +08:00
yudong.cai
b50f23d4d6
Merge remote-tracking branch 'main/master' into caiyd_1546_move_config
2020-03-10 22:09:27 +08:00
Jin Hai
8f12749816
Merge pull request #1498 from cydrain/caiyd_add_version_check
...
#1463 enable config version check
2020-03-10 11:17:56 +08:00
Yhz
b3b3111a7a
change create index url
...
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-08 22:26:28 +08:00
yudong.cai
c29877901f
Merge remote-tracking branch 'main/master' into caiyd_1546_move_config
2020-03-07 21:09:49 +08:00
BossZou
0fcdc31c7c
Update resources name in HTTP module ( #1545 )
...
* set preload_table correctly (fix #1524 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update res name in http module (fix #1544 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add bool convertor function
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix test fail
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* optimize update config method & add boolean conversion comments
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove comments
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-07 20:56:01 +08:00
yudong.cai
6b81dd55df
#1536 move Config.cpp to config directory
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 17:02:21 +08:00
groot
a08b51c2b6
merge json to master to get docker image ( #1500 )
...
* General proto api for NNS libraries
Signed-off-by: groot <yihua.mo@zilliz.com>
* refactor confadapter
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* update test_add
Signed-off-by: zhenwu <zw@zilliz.com>
* update knowhere
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update test cases
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* Update cases
* C++ sdk for json parameters
Signed-off-by: groot <yihua.mo@zilliz.com>
* update unittest
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix case
Signed-off-by: del-zhenwu <zw@zilliz.com>
* modify test_index.py
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update sptag
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* Build Pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* knowhere/wrapper ut pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update util
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* fix wal case
Signed-off-by: del-zhenwu <zw@zilliz.com>
* modify test_search_vectors
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update ci
Signed-off-by: del-zhenwu <zw@zilliz.com>
* update util
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* modify test_search_vectoes
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* add hnsw in http module & modify index apis
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify search in http module
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix build error
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix typo in test_index and test_search
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* index apis in http module done
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix build index bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* search apis unittest pass
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* web test pass
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update confadapter
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update util
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix vectors results bug (fix #1476 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* clang format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update test
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* fix unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
* add test_config
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix a build error
Signed-off-by: groot <yihua.mo@zilliz.com>
* add invalid param search test
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* fix range check
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* cpmpact/flush case passed
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* validate json parameters in request
Signed-off-by: groot <yihua.mo@zilliz.com>
* add unittest cases
Signed-off-by: groot <yihua.mo@zilliz.com>
* update test index/search
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update test_config
Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>
* fix
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* support nsg and ivf-nlist
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* fix validation bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* remove rnsg cases
Signed-off-by: zhenwu <zw@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* Update changelog
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix typo
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* add pq to test_index && multithread test
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* add pq to test_search
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* Fix format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix config bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix config test
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* disable config test case
Signed-off-by: zhenwu <zw@zilliz.com>
Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: zhenwu <zw@zilliz.com>
Co-authored-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Co-authored-by: shengjh <jianghong.sheng@zilliz.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
Co-authored-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: del-zhenwu <zhenxiang.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-07 15:23:34 +08:00
BossZou
1963f3b9e9
Make cache_insert_data take effect in-service(# 1521) ( #1540 )
...
* make cache_insert_data take effect in-service (fix #1521 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* complete omitted config setter
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* cache_insert_data take effect for MemTable
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add config test
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* rename config handler
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-07 09:34:35 +08:00
