admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-30 15:35:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,019 Commits 136 Branches 186 Tags
Commit Graph

845 Commits

Author SHA1 Message Date
Cai Yudong
588ef95d76
Caiyd refactor knowhere (#1687) 
* add new knowhere

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* build pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* rename algo

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* add archive

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* all unittest pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* test_binary pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move knowhere into namespace milvus

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update hnsw

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapterMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move SetBlacklist/GetBlacklist to VecIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VectorAdapter and rename SearchById to QueryById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update interface in ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus IDMAP sdk_simple pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_server

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_schedule

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version Milvus build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update BinaryIVF BuildAll

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VecIndexFactory

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix knowhere unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix SPTAG unittest

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version unittest build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_engine

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change BinarySet key back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change IndexType to string, and add compatible API for 0.7.0

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix IndexHNSW build warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix write_index error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code clean

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
 2020-03-19 19:24:20 +08:00
shengjun.li
72ad100a90
modify bitset from deque to vector (#1696) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-19 16:16:14 +08:00
op-hunter
fdd51400d2
#1660 support IVFPQ CPU delete (#1695) 
* support IVFPQ CPU delete

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update CHANGELOG.md

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
 2020-03-19 12:26:03 +08:00
BossZou
504a9e30ab
Optimize config cpu_cache_capacity / gpu_cache_capacity setter (#1572) (#1629) 
* add gpu cache config handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove 0.8.0 from config version map

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* clean config header reference

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix bug in web readme

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* reduce gpu config handler to gpu resources handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add engine config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify handler hook(fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* initalize value in handler by config default

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix compile error in release mode

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* resolve faiss blas threshold init in DBWrapper

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify cache header

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* order headers

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* convert gpu res config to lower case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* CI retry

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* adjust header order in cpu cache mar file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* improve config test case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-19 10:17:53 +08:00
Xiaohai Xu
1543f8dc37
#1653 IndexFlat performance improvement for NQ < thread_number (#1690) 
* optimize sse

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* optimizer BinaryDistance

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix superstructure

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-03-18 18:27:57 +08:00
groot
55ecfd5930
#1663 PQ index parameter m validation (#1677) 
* #1663 PQ index parameter m validation

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-18 18:26:38 +08:00
Xiaohai Xu
59dab6cb84
#1653 IndexFlat performance improvement for NQ < thread_number (#1674) 
* Optimize index flat L2/IP for SSE

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* parallel optimization

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix threshold

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
 2020-03-16 21:32:05 +08:00
Zhiru Zhu
3de34d3831
#1619 (#1620) 
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-16 19:33:28 +08:00
groot
802d62eb24
#1651 Check validity of dimension when collection metric type is binary one (#1666) 
* #1648 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1651 Check validity of dimension when collection metric type is binary one

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-03-16 16:26:12 +08:00
groot
6c826c1308
#1648 The cache cannot be used all when the type is binary (#1648) 
* #1648 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-15 20:45:11 +08:00
Cai Yudong
512fe6233c
#1649 fix Milvus crash on old cpu (#1652) 
* #1649 fix Milvus crash on old cpu

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1649 update debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-14 18:03:23 +08:00
shengjun.li
4088f5e9a2
#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure (#1647) 
* add substructure & superstructure

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* support c++sdk by lin.xiaojun

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* optimizer omp for BinaryFlat; add tutorial

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-14 10:03:00 +08:00
shengjun.li
7c3a673bfe
check table lsn (#1622) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-03-13 11:56:12 +08:00
BossZou
dfa25f88e2
fix demo bug in HTTP doc (fix #1634) (#1640) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-13 11:16:55 +08:00
denin
055041881c fix crashes 
Signed-off-by: denin <dvzubarev@yandex.ru>
 2020-03-12 17:29:54 +03:00
yudong.cai
4cf2b2b392 Merge remote-tracking branch 'main/master' into caiyd_1548_move_store 2020-03-12 20:05:57 +08:00
Zhiru Zhu
04f00bbe91
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-12 16:43:18 +08:00
yudong.cai
058c993a99 update header file 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 16:26:56 +08:00
yudong.cai
817ea8b9e1 #1548 add FSHandler 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 11:40:12 +08:00
yudong.cai
28a0f1de01 #1548 move store/Directory.cpp to storage 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 11:38:17 +08:00
Lutkin Wang
c24e2a0111
Update README.md 
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
 2020-03-12 09:34:25 +08:00
yudong.cai
67fad34065 Merge remote-tracking branch 'main/master' into caiyd_1547_rename_storage_file 2020-03-11 18:43:02 +08:00
Jin Hai
87214f742b
Merge pull request #1550 from cydrain/caiyd_1546_move_config 
Caiyd 1546 move config
 2020-03-11 18:41:35 +08:00
Jin Hai
ad0f26f98e
Merge pull request #1538 from cydrain/caiyd_codec_opt 
Caiyd codec opt
 2020-03-11 18:41:17 +08:00
yudong.cai
539ce69305 Merge remote-tracking branch 'main/master' into caiyd_1547_rename_storage_file 2020-03-11 15:31:04 +08:00
JinHai-CN
664a1ab4e1 Fix format 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 14:06:47 +08:00
JinHai-CN
a5cb8f994d Update time print log 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 13:36:48 +08:00
JinHai-CN
fbe5531ba0 Test 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 12:06:15 +08:00
yudong.cai
98da92afd2 Merge remote-tracking branch 'main/master' into caiyd_1547_rename_storage_file 2020-03-11 11:25:10 +08:00
yudong.cai
6454943aca Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-11 09:40:42 +08:00
groot
6e6d06ca4a #1598 Server down during mixed operations 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-11 09:30:39 +08:00
Jin Hai
81d767ea2f
Merge pull request #1612 from youny626/fix#1598 
Fix #1598
 2020-03-11 00:18:30 +08:00
yudong.cai
49db61ea50 Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-11 00:10:22 +08:00
Zhiru Zhu
50804ecaf5
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 22:42:59 +08:00
yudong.cai
b50f23d4d6 Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-10 22:09:27 +08:00
Zhiru Zhu
5b0b226bc4
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 22:03:17 +08:00
Zhiru Zhu
404d607eb6
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 21:34:47 +08:00
Zhiru Zhu
561e2f5fc8
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 21:07:11 +08:00
groot
120ea4d0e3 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 19:56:06 +08:00
groot
8872054603 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 19:47:23 +08:00
groot
17ec3d5e21 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 18:58:50 +08:00
Jin Hai
2a6e70d5f0
Merge branch 'master' into fix#1598 2020-03-10 18:10:23 +08:00
Jin Hai
17d2618544
Merge pull request #1602 from BossZou/http-doc 
fix link error in http doc
 2020-03-10 17:31:24 +08:00
Zhiru Zhu
9d4b7fda62
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 16:40:53 +08:00
Zhiru Zhu
4625bf3710
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 16:40:17 +08:00
Yhz
f722119188 add options methods for system 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-10 15:59:08 +08:00
Jin Hai
442bf43402
Merge pull request #1600 from yhmo/binary 
sdk typo
 2020-03-10 15:22:34 +08:00
Yhz
596d41b111 fix link error in http doc (fix #1601) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-10 14:45:11 +08:00
Yhz
487bbfa758 change index type link address 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-10 14:35:16 +08:00
Yhz
1b5d299f58 fix show tables results typo 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-10 14:12:48 +08:00