admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-30 15:35:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,277 Commits 136 Branches 186 Tags
Commit Graph

878 Commits

Author SHA1 Message Date
Cai Yudong
f218217064
optimize similarity template (#2227) 
* optimize similarity template

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-06 08:53:16 +00:00
groot
ac8e9ff020
write error (#2184) 
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-06 16:52:37 +08:00
BossZou
82ab21aec3
Http update endpoints (#2187) 
* replace table with collection in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add search_by_ids in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add API

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new API and unittest

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update endpoint in http module(#2186); change vector id to string format(2185)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* allow filter when show partition

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move constant variables defination to .cpp

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-05-06 14:07:35 +08:00
jackyu2020
86510aa295
check the return value of fscanf (#2218) 
Signed-off-by: e <ych05zh@163.com>
 2020-05-03 01:49:57 +00:00
Cai Yudong
ed2ee8873b
fix SingleIndexTest.IVFSQHybrid unittest (#2215) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-02 10:24:35 +00:00
Wang XiangYu
ff48427911
Log file rotating (#2207) 
* log file rotating

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-30 23:31:14 +08:00
Cai Yudong
0032c13445
Error out when index SQ8H run in CPU mode (#2204) 
* Error out when index SQ8H run in CPU mode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update cmake

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-04-30 15:22:29 +00:00
BossZou
b458034ad5
Fix Fail to access WAL storage path (#2196) (#2198) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-30 09:47:12 +00:00
zxf2017
14b3e95960
add head file to fix two build warnings (#2195) 
* add head file to fix two build warnings

Signed-off-by: zxf <zhuxiaofeng07936@hellobike.com>

* fstream.h => fstream

Signed-off-by: zxf <zhuxiaofeng07936@hellobike.com>

Co-authored-by: zxf <zhuxiaofeng07936@hellobike.com>
 2020-04-30 06:10:44 +00:00
Wang XiangYu
be2feb1531
Log with request id (#2192) 
* add function to get request id

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update log in GrpcRequestHandler

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update request id format

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-30 13:39:55 +08:00
feisiyicl
e77fd12286
Feisiyicl 2190 memory usage (#2191) 
* rename MILVUS_ENABLE_PROFILING to ENABLE_CPU_PROFILING, and add ENABLE_MEM_PROFILING

Signed-off-by: feisiyicl <7764126@qq.com>

* optimize ReadOnlyArrayInvertedLists

Signed-off-by: feisiyicl <7764126@qq.com>

* update changelog

Signed-off-by: feisiyicl <7764126@qq.com>

* retry ci

Signed-off-by: feisiyicl <7764126@qq.com>

* fix build issue

Signed-off-by: feisiyicl <7764126@qq.com>
 2020-04-30 02:03:54 +00:00
BossZou
2c889636ab
Check Storage permission (#2174) 
* add class storage checker

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add cpu instruction sets check (#2055)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add more details for storage

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Check storage path permission (fix #2173)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Fix logs path access fail issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-04-29 17:23:32 +00:00
feisiyicl
9b2368016c
#1946 fix load index file CPU2GPU fail during searching (#2182) 
Signed-off-by: feisiyicl <7764126@qq.com>
 2020-04-29 20:01:52 +08:00
shengjun.li
a76e705a92
Using elkan K-Means to improve IVF (#2180) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-04-29 19:58:50 +08:00
feisiyicl
b3aa06fce1
add config simd_type (#2179) 
* add config simd_type

Signed-off-by: feisiyicl <7764126@qq.com>

* update changelog

Signed-off-by: feisiyicl <7764126@qq.com>
 2020-04-29 17:46:36 +08:00
BossZou
0a2b77c363
Upgrade http thirdparty oatpp to v1.0.0 (fix #2153) (#2157) 
* Upgrade thirdparty oatpp to v1.0.0 (fix #2153)

Signed-off-by: yhz <413554850@qq.com>

* adjust header order

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-28 15:57:51 +00:00
groot
ebb01aa9b2
Fix failed to open file (#2138) 
* file reference

Signed-off-by: groot <yihua.mo@zilliz.com>

* print info

Signed-off-by: groot <yihua.mo@zilliz.com>

* avoid metric crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* apply delete bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* has partition check

Signed-off-by: groot <yihua.mo@zilliz.com>

* duplicate id search

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-04-28 21:10:01 +08:00
Wang XiangYu
3be8aad1af
Merge config file (#2168) 
* Using el::Configurations Class init easylog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add logs config constant

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add config check function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add config get function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* logs config set function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update InitLog function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update server_config.template

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-28 20:21:21 +08:00
BossZou
4ab92f3032
Add config to switch off web server (#2137) 
* Add a config parameter to switch off http server (fix #2057)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify web enable config name

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix cmake bug & output exanption msg

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* rename web enbale config as web_enable

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* log out errno

Signed-off-by: yhz <413554850@qq.com>
 2020-04-28 17:04:04 +08:00
op-hunter
1b25bacee2
build openblas by source (#2154) 
* build openblas by source

Signed-off-by: cmli <chengming.li@zilliz.com>

* remove openblas md5

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-04-27 22:48:14 +08:00
Wang XiangYu
b65f5072f3
fix server start failed if wal directory exist (#2144) 
* fix server start failed if wal directory exist

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add wal_enable check

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile error

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-27 20:05:04 +08:00
BossZou
bf42dbd5b6
Gpu check (#2129) 
* add GpuCheck class

Signed-off-by: yhz <413554850@qq.com>

* Check gpu environment

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add server checker unittest

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-27 16:56:12 +08:00
Jin Hai
b6d681f458
Merge pull request #2139 from longer-is-better/patch-1 
delete unused file
 2020-04-27 16:17:15 +08:00
AzAz
2a7e116a67
remove uint64_t j from parameters (#2147) 
Signed-off-by: talentAN <adam_an02@163.com>
 2020-04-27 16:15:49 +08:00
AzAz
b3028baed8
Add log for error status (#2148) 
Signed-off-by: talentAN <adam_an02@163.com>
 2020-04-27 16:13:11 +08:00
Cai Yudong
1384484b7d
Caiyd 2039 avx sse (#2136) 
* #2039 clean redundant compile options

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 add distances_avx.h and distances_avx.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 add ScalarQuantizerDC_avx.cpp, ScalarQuantizerDC_avx.h and ScalarQuantizerCodec_avx.h

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 remove -mavx2 from default compile option

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 clean code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 clean code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-04-27 15:01:47 +08:00
Gracieeea
509b87f103
replace int with size_t (#2140) 
Signed-off-by: Gracieeea <sly_freesoul@icloud.com>
 2020-04-27 04:52:11 +00:00
JinHai-CN
7b1b75a90d Fix lint error 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-27 10:26:05 +08:00
JinHai-CN
adc6dc38bf Fix compiling error 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-27 10:25:07 +08:00
dongwei
2c6fcacdbd delete unused file 
Signed-off-by: dongwei <d279617552@gmail.com>
 2020-04-26 23:21:06 +08:00
Cai Yudong
150cca6bbf
Caiyd 1946 cpu2gpu getres (#2124) 
* #1946 use new log format in knowhere

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1946 add more debug info for GPU device initialize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-04-26 18:29:21 +08:00
Wang XiangYu
12b3bf0693
Add instance lock (#2060) 
* Add instance lock

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update message

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update unittest CMakeLists.txt

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-04-26 08:31:18 +00:00
shana0325
53133aafac
train func add catch excetpion (#2096) 
* train func add catch excetpion

Signed-off-by: shana0325 <645842705@qq.com>

* Fix lint error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-26 11:29:20 +08:00
chen lu
d22f3c2c5f
[skip ci] remove useless log (#2119) 
Signed-off-by: yiuluchen 1093633856@qq.com
 2020-04-26 10:19:31 +08:00
BossZou
8edb7b6a09
add cpu instruction sets check (#2055) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-26 00:59:25 +08:00
groot
777c36a0ac
#1997 index file missed after compact (#2108) 
* #1997 index file missed after compact

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-04-25 22:06:26 +08:00
JinHai-CN
9db19a9a20 Merge remote-tracking branch 'main/master' 2020-04-25 18:58:59 +08:00
GuoRentong
fed865c7c9
Values of type 'const size_t' may not fit into the receiver type 'int' (#2109) 
Signed-off-by: GuoRentong <rt.guo@outlook.com>

Co-authored-by: guo rentong <grt@guodeMacBook-Pro.local>
 2020-04-25 18:35:04 +08:00
yxm1536
4c108c7578
Rename MemMenagerFactory.cpp/h to MemManagerFactory.cpp/h (#2093) 
* Rename MemMenagerFactory.cpp to MemManagerFactory.cpp

Signed-off-by: yxm1536 <62009483+yxm1536@users.noreply.github.com>

* Rename MemMenagerFactory.h to MemManagerFactory.h

Signed-off-by: yxm1536 <62009483+yxm1536@users.noreply.github.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-25 16:57:14 +08:00
czp
b454f462c1
put error when call Flush (#2097) 
Signed-off-by: beautifulpython <2426009680@qq.com>
 2020-04-25 16:13:32 +08:00
grtoverflow
6fe2cf1580
Update ConfAdapter.cpp (#2106) 
Signed-off-by: grtoverflow <grtoverflow@gmail.com>
 2020-04-25 16:12:58 +08:00
xge-zilliz
42b1983625
Delete useless boolean (#2107) 
Signed-off-by: xge-zilliz <xi.ge@zilliz.com>
 2020-04-25 15:49:43 +08:00
dd-He
c33df2ee20
Use emplace_back instead of push_back (#2103) 
Signed-off-by: dd-He <1843757857@qq.com>
 2020-04-25 15:37:23 +08:00
chengpu
6d2c50ac21
Use std::copy to replace forloop assignment (#2087) 
Signed-off-by: chengpu <chengpu@live.com>
 2020-04-25 15:28:31 +08:00
binbin12580
2247d58cc4
Unused variable: ids (#2088) 
Signed-off-by:  binbin12580 <1565196967@qq.com>
 2020-04-25 15:26:16 +08:00
Cross
7deef8029f
Update GrpcRequestHandler.cpp (#2085) 
Signed-off-by: Cross <xinyuanm9@gmail.com>
 2020-04-25 14:53:49 +08:00
groot
82f4c289eb
New api HasPartition, SearchByID, GetVectorsByID (#2056) 
* modify proto

Signed-off-by: groot <yihua.mo@zilliz.com>

* modify c sdk

Signed-off-by: groot <yihua.mo@zilliz.com>

* rewrite search by id

Signed-off-by: groot <yihua.mo@zilliz.com>

* change cases

Signed-off-by: zw <zw@zilliz.com>

* fix cases

Signed-off-by: zw <zw@zilliz.com>

* fix wal case

Signed-off-by: zw <zw@zilliz.com>

* fix search by id

Signed-off-by: groot <yihua.mo@zilliz.com>

* modify sdk

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* add search_by_ids case

Signed-off-by: zw <zw@zilliz.com>

* disable test_search)by_ids

Signed-off-by: zw <zw@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
 2020-04-25 14:49:32 +08:00
lwglgy
7e52815fb6
DBImpl.cpp::ExecWalRecord need to process error status in case wal::MXLogType::Entity (#2083) 
Signed-off-by: lwglgy <1486111482@qq.com>
 2020-04-25 13:24:24 +08:00
yukun
67d8a9b54c
Add http interface for hybrid search (#2079) 
* Add http interface for hybrid search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest for http hybrid interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-04-25 13:19:17 +08:00
Jin Hai
6d87dc3c72
Merge pull request #2084 from lee-eve/master 
Unused variable: offsets
 2020-04-25 13:18:19 +08:00