admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-03 01:12:25 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,067 Commits 138 Branches 188 Tags
Commit Graph

199 Commits

Author SHA1 Message Date
Cai Yudong
dbbf91db28
remove unnecessary lock (#1801) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-30 14:13:02 +08:00
JinHai-CN
4574f9d998 Merge branch '0.7.1' 2020-03-29 18:50:10 +08:00
shengjun.li
52ac810a1f
fix share_ptr array (#1786) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-28 20:27:07 +08:00
Cai Yudong
a7932b0365
#1781 fix search hang with SQ8H (#1783) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-28 13:08:42 +08:00
Cai Yudong
ac443e37ac
Caiyd 1689 gpu out of memory (#1776) 
* #1689 update cache stragegy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1689 add lock when change cache capacity

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1689 update cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-27 19:24:10 +08:00
op-hunter
310d5d70bc
Annoy support (#1746) 
* add annoy source code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add annoy knowhere

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* annoy local gtest passed

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix lint error and update changelog

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix compile error

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update connect timeout in test cases

Signed-off-by: zw <zw@milvus.io>

* fix some potential bugs

Signed-off-by: cmli <chengming.li@zilliz.com>

* retry ci

Signed-off-by: cmli <chengming.li@zilliz.com>

* rerun ci!

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix errors tested by c++ sdk

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
 2020-03-27 09:52:31 +08:00
Cai Yudong
207b854c3f
Caiyd 1655 gpu ivfflat delete (#1767) 
* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update segment interfaces

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update some interfaces

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-26 21:58:48 +08:00
Tinkerrr
243e843aac
fix #1747 (#1757) 
* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update.

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* lint pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* UPDATE CASE: search with tag not exist

Signed-off-by: zw <zw@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>
 2020-03-26 18:28:24 +08:00
groot
c4b7be8ed6
#1728 Optimize request handler to combine similar query (#1743) 
* modify changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve search qps

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix combine request result bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* add unittest for combine request

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-26 14:26:02 +08:00
Cai Yudong
d34bd505ba
#1735 fix search fail with gpu out of memory using ivf_flag (#1748) 
* #1735 fix search fail with gpu out of memory using ivf_flag

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 add lock for each GpuCacheMgr instance

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 optimize cache debug info

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 set smaller cache threshold

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 update cache debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 fix cache issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-25 19:54:50 +08:00
groot
0e914949e8
#1734 Opentracing for combined search request (#1737) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-24 14:44:01 +08:00
Cai Yudong
538c377e65
Caiyd 1689 fix sq8h fail (#1723) 
* #1689 fix SQ8H search fail on SIFT-1B dataset

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix bug

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix gpu search fail

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* revert segment back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_gpuresource

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_gpuresource

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-23 10:48:15 +08:00
Jin Hai
9443af3e87
#1719 Remove unused log (#1720) 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-03-21 12:48:41 +08:00
groot
fe2595fa38
#1686 API search_in_files cannot work correctly when vectors is store… (#1701) 
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-20 12:14:07 +08:00
Cai Yudong
5950deddfc
#1678 remove CUSTOMIZATION macro (#1707) 
* #1678 remove CUSTOMIZATION macro

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable faiss_benchmark

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-20 10:24:27 +08:00
Cai Yudong
588ef95d76
Caiyd refactor knowhere (#1687) 
* add new knowhere

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* build pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* rename algo

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* add archive

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* all unittest pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* test_binary pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move knowhere into namespace milvus

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update hnsw

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapterMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move SetBlacklist/GetBlacklist to VecIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VectorAdapter and rename SearchById to QueryById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update interface in ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus IDMAP sdk_simple pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_server

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_schedule

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version Milvus build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update BinaryIVF BuildAll

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VecIndexFactory

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix knowhere unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix SPTAG unittest

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version unittest build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_engine

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change BinarySet key back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change IndexType to string, and add compatible API for 0.7.0

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix IndexHNSW build warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix write_index error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code clean

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
 2020-03-19 19:24:20 +08:00
BossZou
504a9e30ab
Optimize config cpu_cache_capacity / gpu_cache_capacity setter (#1572) (#1629) 
* add gpu cache config handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove 0.8.0 from config version map

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* clean config header reference

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix bug in web readme

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* reduce gpu config handler to gpu resources handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add engine config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify handler hook(fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* initalize value in handler by config default

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix compile error in release mode

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* resolve faiss blas threshold init in DBWrapper

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify cache header

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* order headers

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* convert gpu res config to lower case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* CI retry

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* adjust header order in cpu cache mar file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* improve config test case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-19 10:17:53 +08:00
Zhiru Zhu
3de34d3831
#1619 (#1620) 
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-16 19:33:28 +08:00
groot
802d62eb24
#1651 Check validity of dimension when collection metric type is binary one (#1666) 
* #1648 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1651 Check validity of dimension when collection metric type is binary one

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-03-16 16:26:12 +08:00
groot
6c826c1308
#1648 The cache cannot be used all when the type is binary (#1648) 
* #1648 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-15 20:45:11 +08:00
shengjun.li
4088f5e9a2
#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure (#1647) 
* add substructure & superstructure

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* support c++sdk by lin.xiaojun

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* optimizer omp for BinaryFlat; add tutorial

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-14 10:03:00 +08:00
shengjun.li
7c3a673bfe
check table lsn (#1622) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-03-13 11:56:12 +08:00
Zhiru Zhu
04f00bbe91
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-12 16:43:18 +08:00
Jin Hai
87214f742b
Merge pull request #1550 from cydrain/caiyd_1546_move_config 
Caiyd 1546 move config
 2020-03-11 18:41:35 +08:00
JinHai-CN
664a1ab4e1 Fix format 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 14:06:47 +08:00
JinHai-CN
a5cb8f994d Update time print log 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 13:36:48 +08:00
JinHai-CN
fbe5531ba0 Test 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 12:06:15 +08:00
yudong.cai
6454943aca Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-11 09:40:42 +08:00
groot
6e6d06ca4a #1598 Server down during mixed operations 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-11 09:30:39 +08:00
Jin Hai
81d767ea2f
Merge pull request #1612 from youny626/fix#1598 
Fix #1598
 2020-03-11 00:18:30 +08:00
yudong.cai
49db61ea50 Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-11 00:10:22 +08:00
Zhiru Zhu
50804ecaf5
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 22:42:59 +08:00
yudong.cai
b50f23d4d6 Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-10 22:09:27 +08:00
Zhiru Zhu
5b0b226bc4
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 22:03:17 +08:00
groot
120ea4d0e3 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 19:56:06 +08:00
groot
8872054603 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 19:47:23 +08:00
groot
17ec3d5e21 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 18:58:50 +08:00
groot
9bb2f4b728 typo 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 21:14:14 +08:00
groot
13d3cff9b7 #1580 Old segment folder not removed after merge / compact if create_index is called before adding data 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 20:52:10 +08:00
groot
c68b5eb744 typo 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 20:21:26 +08:00
groot
81b0275cc3 typo 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 19:57:18 +08:00
groot
4068c2ac3a merge master branch 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 18:17:53 +08:00
groot
0ec50358b7 #1583 Default index_params should be "{}" for IDMAP table 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 17:36:25 +08:00
groot
e18e0a11cc #1571 Meta engine type become IDMAP after drop index for BINARY table 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 11:59:57 +08:00
Zhiru Zhu
b3bba221d0
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-09 11:43:33 +08:00
groot
37fd79631d #1571 Meta engine type become IDMAP after drop index for BINARY table 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 11:14:12 +08:00
Jin Hai
929a976b11
Merge pull request #1559 from yhmo/ppp 
#1556 Index file not create after table and index create
 2020-03-08 14:01:08 +08:00
groot
1829624a43 #1556 Index file not create after table and index create 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-08 11:59:25 +08:00
yudong.cai
7cd2138e3c Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-08 11:11:09 +08:00
groot
a145791060 fix sqlite bug 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-08 10:27:36 +08:00