格雷大大
bf4cea1d1f
add log 4 annoy if index has been built when BuildAll interface invoked ( #2071 )
...
* add log 4 annoy if index has been built when BuildAll interface invoked
Signed-off-by: grace <yan.gu@zilliz.com>
* fix lint error
Signed-off-by: grace <yan.gu@zilliz.com>
2020-04-24 19:38:21 +08:00
Yoya
44e8e02065
remove unused function "preprocessor" ( #2034 )
...
Signed-off-by: Yoya <taydycn@gmail.com>
2020-04-22 20:16:55 +08:00
Fierralin
72cae5221c
Move NULL to nullptr ( #2027 )
...
* Move NULL to nullptr
Signed-off-by: Fierralin <fierralin@hotmail.com>
* Try fix
Signed-off-by: Fierralin <fierralin@hotmail.com>
2020-04-22 18:39:04 +08:00
Ben
9bfd48cdf5
move the definiation to cpp file ( #2033 )
...
Signed-off-by: Ben <sckim2008@gmail.com>
2020-04-22 15:16:37 +08:00
Jin Hai
aca299166c
Merge pull request #2026 from mileyzjq/code_polish
...
Fix unused code and clarify params
2020-04-22 11:59:29 +08:00
sahuang
9e78cde3f2
Fix
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-22 10:47:12 +08:00
Accagain
c7eb9b0fa2
add safty check 4 annoy load index ( #2022 )
...
Signed-off-by: cms <chenmaosen0@gmail.com>
2020-04-22 10:00:46 +08:00
mileyzjq
72d80aca74
fix unused code and clarify params
...
Signed-off-by: mileyzjq <mileyzha@gmail.com>
2020-04-21 22:08:50 +08:00
nameczz
5bcd3034c6
remove unused function "normalize_vector" ( #2015 )
...
Signed-off-by: nameczz <nameczz@126.com>
2020-04-21 15:53:17 +08:00
bo huang
574ff66c01
add safty check 4 annoy load index ( #2009 )
...
Signed-off-by: bo-huang <1013767522@qq.com>
2020-04-21 14:23:42 +08:00
Cai Yudong
f039032c8c
Caiyd 1965 unify metric cal ( #2008 )
...
* #1965 add metric algorithm benchmark for FAISS
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 add metric algorithm benchmark for NSG
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 add metric algorithm benchmark for ANNOY
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 add metric algorithm benchmark for HNSW
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* calculate average time
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 annoy/nsg/hnsw all use faiss distance algorithm
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 support AVX512/AVX2/SSE42
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1965 fix hnsw ip calculation error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-21 14:22:33 +08:00
Morry Niu
75ca0d96b6
keep bitset naming consistent ( #2004 )
...
Signed-off-by: Xinyao Niu <morryniu123@gmail.com>
2020-04-21 09:40:49 +08:00
smiling849
50ddc49332
fix hnsw code format ( #1987 )
...
Signed-off-by: Zhonglei Song <szl_84@sina.com>
2020-04-19 12:00:45 +08:00
Jin Hai
59035d9892
#1454 Improve code quality ( #1948 )
...
* Improve code quality
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Improve code quality
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Improve code quality
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix issue
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-17 21:05:17 +08:00
Jin Hai
0323aa1aad
Merge 080 ( #1940 )
...
* #1910 C++ SDK GetIDsInSegment could not work for large dataset (#1911 )
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1903 Fix invalid annoy result (#1912 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* #1914 : Partition max size should be 4096 (#1915 )
Signed-off-by: jinhai <hai.jin@zilliz.com>
* add log (#1913 )
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: groot <yihua.mo@zilliz.com>
* partition limit 4096
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix py test
Signed-off-by: groot <yihua.mo@zilliz.com>
* update server version (#1916 )
Signed-off-by: zw <zw@zilliz.com>
* Update to 0.8.0 (#1918 )
* Create new branch 0.8.0 and change preload_table to preload_collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
* update helm version
Signed-off-by: zw <zw@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
* fix issue 1901 (#1920 )
* fix issue 1901
Signed-off-by: cmli <chengming.li@zilliz.com>
* update change log
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
* #1900 (#1923 )
* add log
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix #1900
Signed-off-by: groot <yihua.mo@zilliz.com>
* Upgrade mishards to 0.8.0 (#1933 )
* update grpc server of milvus & rename table name to collection
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Skip CI
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Caiyd 1883 fix rw (#1926 )
* #1883 use DiskIO
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix logic error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
* #1928 Too many data and uid copies when loading files (#1931 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
* Update mishards configure files (#1938 )
* Update web readme
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] update configure files
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] rename table to collection
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Update test.groovy
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update test.groovy
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: jinhai <hai.jin@zilliz.com>
Co-authored-by: groot <yhmo@zeronedata.com>
Co-authored-by: shengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: op-hunter <ophunter52@gmail.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-04-15 21:32:20 +08:00
Wang XiangYu
890fe08e7c
Refactor LOG macro and improve log format ( #1927 )
...
* update log format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add new log macro
Signed-off-by: wxyu <xy.wang@zilliz.com>
* use new log macro instead
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* add SetThreadName function
Signed-off-by: wxyu <xy.wang@zilliz.com>
* clang-format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* set thread name
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* add changelog
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add git ignore .swp file
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update log level in LogUtil.cpp
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-15 14:44:00 +08:00
shengjun.li
b04b3e942c
#1897 add heap_swap_top ( #1898 )
...
* add heap_swap_top
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix wrong code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-04-11 12:56:32 +08:00
Cai Yudong
a05ec6a972
Caiyd 1885 optimize knowhere ut ( #1889 )
...
* optimize knowhere unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize knowhere util
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-09 23:37:13 +08:00
Cai Yudong
cc3b75b6b7
code revert ( #1877 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-07 18:58:18 +08:00
Cai Yudong
bf6d22e2f5
#1873 fix index file serialize to incorrect path ( #1874 )
...
* #1873 fix index file serialize to incorrect path
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* not create sq8h index when gpu disabled
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-07 16:25:46 +08:00
op-hunter
54337e9361
refactor knowhere inner unittest for annoy and hnsw, which a… ( #1855 )
...
* skip ci, refactor knowhere inner unittest for annoy and hnsw, which aimed to remove logs of std output
Signed-off-by: cmli <chengming.li@zilliz.com>
* skip ci, fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix annoy load bugs and add serialize test 4 annoy and hnsw
Signed-off-by: cmli <chengming.li@zilliz.com>
* update changelog
Signed-off-by: cmli <chengming.li@zilliz.com>
* update lower bound of annoy search_k param
Signed-off-by: cmli <chengming.li@zilliz.com>
* lint errorgit add src/utils/ValidationUtil.cpp
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-03 14:14:04 +08:00
Cai Yudong
7ccfa5b9f0
Caiyd 1627 move rw index ( #1833 )
...
* #1627 move read/write index into codec
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update WriteVectorIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-02 22:44:45 +08:00
Xiaohai Xu
f82aa4f493
#1849 Support NSG Deletion ( #1839 )
...
* nsg delete
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix request
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix clang
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix typo
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* [skip ci] add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix test_nsg and changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix test
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix test case
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix clang-format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Polish
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-02 20:46:58 +08:00
Jin Hai
0e0739ef87
1845 no UT log ( #1846 )
...
* #1845 No UT log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* No UT log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-02 09:48:29 +08:00
op-hunter
6e7fb831bd
add annoy params validate check ( #1829 )
...
* fix bug & solve compile warning from annoylib
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-02 09:47:45 +08:00
Xiaohai Xu
2fcf2855ce
fix sq8h deletion ( #1830 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-01 20:50:48 +08:00
Jin Hai
68625cbf1c
Fix 1724 ( #1821 )
...
* #1724 Remove unused unittests
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part2
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part3
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part4
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part5
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_id to collection_id
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table to collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_ to collection_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table_id_ to collection_id_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Change table_name to collection_name
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Reformat
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableFile to Segment
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableSchema to CollectionSchema
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix compile lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 17:37:55 +08:00
Cai Yudong
531fca8869
Caiyd 1655 gpu ivfflat delete ( #1809 )
...
* support GPUIVF delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* calc bitset offset correctly
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support GPUSQ8 delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support GPUIVFPQ delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest for GPU delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* delete FAISS compile option -DFAISS_USE_FLOAT16
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-01 10:42:48 +08:00
Xiaohai Xu
88cf5e2bd8
Optimize functions ( #1803 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 18:11:08 +08:00
Xiaohai Xu
8a731dea39
Add Unittest for IDMAP ( #1774 )
...
* gpu idmap unittest
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix clang format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix build issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* small fix
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix case
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix back
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Compact code
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* efficient code
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix GPU search hang
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 14:08:56 +08:00
shengjun.li
52ac810a1f
fix share_ptr array ( #1786 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-28 20:27:07 +08:00
op-hunter
4b996cd622
fix commpile error because of interface changed ( #1773 )
...
* fix commpile error because of interface changed
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix comiple error
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-27 13:07:57 +08:00
op-hunter
310d5d70bc
Annoy support ( #1746 )
...
* add annoy source code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add annoy knowhere
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* annoy local gtest passed
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix lint error and update changelog
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix compile error
Signed-off-by: cmli <chengming.li@zilliz.com>
* Update connect timeout in test cases
Signed-off-by: zw <zw@milvus.io>
* fix some potential bugs
Signed-off-by: cmli <chengming.li@zilliz.com>
* retry ci
Signed-off-by: cmli <chengming.li@zilliz.com>
* rerun ci!
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix errors tested by c++ sdk
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
2020-03-27 09:52:31 +08:00
Cai Yudong
207b854c3f
Caiyd 1655 gpu ivfflat delete ( #1767 )
...
* update sdk
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update segment interfaces
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update some interfaces
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-26 21:58:48 +08:00
Xiaohai Xu
f93b464172
#1654 GPU Index Flat Delete ( #1736 )
...
* Add Flat Index Delete
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix log
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix bitset
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix reference
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-26 18:36:46 +08:00
shengjun.li
e9f7422bc5
fix binary flat may retruns wrong distance when nq larger than 1 ( #1760 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-26 16:45:49 +08:00
Tinkerrr
cda57cf77f
Update NSG ( #1744 )
...
* enable IP and fix crash
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update.
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* lint pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-25 16:24:18 +08:00
Jin Hai
f4d7dd6c93
#1724 Remove unused unittests ( #1725 )
...
* #1724 Remove unused unittests
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part2
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part3
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part4
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part5
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-24 10:11:10 +08:00
shengjun.li
5fc875a020
#1603 modify substructure/superstructure to perfect match ( #1718 )
...
* modify substructure/superstructure to perfect match
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Update cases
Signed-off-by: zw <zw@zilliz.com>
* Fix case bug
Signed-off-by: zw <zw@zilliz.com>
* set invalid distance infinite
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Add distance cases
Signed-off-by: zw <zw@zilliz.com>
* Fix test cases
Signed-off-by: zw <zw@zilliz.com>
* Re-trigger ci
Signed-off-by: zw <zw@zilliz.com>
* fix wrong code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Fix test case
Signed-off-by: zw <zw@zilliz.com>
* Fix case
Signed-off-by: zw <zw@zilliz.com>
* Fix cases
Signed-off-by: zw <zw@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
2020-03-24 10:10:56 +08:00
op-hunter
4fa45dc754
#1661 support HNSW deletion on nmslib ( #1729 )
...
* support HNSW deletion on nmslib
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update changelog
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix lint error on test_hnsw.cpp
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-23 18:04:46 +08:00
Cai Yudong
538c377e65
Caiyd 1689 fix sq8h fail ( #1723 )
...
* #1689 fix SQ8H search fail on SIFT-1B dataset
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix bug
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix gpu search fail
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* revert segment back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_gpuresource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_gpuresource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-23 10:48:15 +08:00
Jin Hai
450573849b
#267 Improve search performance: reduce delay ( #1717 )
...
* #267 Improve search performance: reduce delay
Signed-off-by: jinhai <haijin.chn@gmail.com>
* #267 Improve search performance: reduce delay - update CHANGELOG
Signed-off-by: jinhai <haijin.chn@gmail.com>
* #267 Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #267 Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #267 Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #267 Update format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-23 09:26:58 +08:00
Cai Yudong
5950deddfc
#1678 remove CUSTOMIZATION macro ( #1707 )
...
* #1678 remove CUSTOMIZATION macro
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable faiss_benchmark
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-20 10:24:27 +08:00
Cai Yudong
588ef95d76
Caiyd refactor knowhere ( #1687 )
...
* add new knowhere
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* build pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* rename algo
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* add archive
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* all unittest pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* test_binary pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move knowhere into namespace milvus
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update hnsw
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapterMgr
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move SetBlacklist/GetBlacklist to VecIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VectorAdapter and rename SearchById to QueryById
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update interface in ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus build pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus IDMAP sdk_simple pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_schedule
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version Milvus build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update BinaryIVF BuildAll
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VecIndexFactory
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix knowhere unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix SPTAG unittest
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version unittest build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_engine
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change BinarySet key back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change IndexType to string, and add compatible API for 0.7.0
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix IndexHNSW build warning
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_cache
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix write_index error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-19 19:24:20 +08:00
shengjun.li
72ad100a90
modify bitset from deque to vector ( #1696 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-19 16:16:14 +08:00
op-hunter
fdd51400d2
#1660 support IVFPQ CPU delete ( #1695 )
...
* support IVFPQ CPU delete
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update CHANGELOG.md
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-19 12:26:03 +08:00
Xiaohai Xu
1543f8dc37
#1653 IndexFlat performance improvement for NQ < thread_number ( #1690 )
...
* optimize sse
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* optimizer BinaryDistance
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix superstructure
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-18 18:27:57 +08:00
Xiaohai Xu
59dab6cb84
#1653 IndexFlat performance improvement for NQ < thread_number ( #1674 )
...
* Optimize index flat L2/IP for SSE
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* parallel optimization
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix threshold
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-16 21:32:05 +08:00
Cai Yudong
512fe6233c
#1649 fix Milvus crash on old cpu ( #1652 )
...
* #1649 fix Milvus crash on old cpu
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1649 update debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-14 18:03:23 +08:00
shengjun.li
4088f5e9a2
#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure ( #1647 )
...
* add substructure & superstructure
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* support c++sdk by lin.xiaojun
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* optimizer omp for BinaryFlat; add tutorial
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-14 10:03:00 +08:00
