Morry Niu
75ca0d96b6
keep bitset naming consistent ( #2004 )
...
Signed-off-by: Xinyao Niu <morryniu123@gmail.com>
2020-04-21 09:40:49 +08:00
smiling849
50ddc49332
fix hnsw code format ( #1987 )
...
Signed-off-by: Zhonglei Song <szl_84@sina.com>
2020-04-19 12:00:45 +08:00
Jin Hai
59035d9892
#1454 Improve code quality ( #1948 )
...
* Improve code quality
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Improve code quality
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Improve code quality
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix issue
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-17 21:05:17 +08:00
Jin Hai
0323aa1aad
Merge 080 ( #1940 )
...
* #1910 C++ SDK GetIDsInSegment could not work for large dataset (#1911 )
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1903 Fix invalid annoy result (#1912 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* #1914 : Partition max size should be 4096 (#1915 )
Signed-off-by: jinhai <hai.jin@zilliz.com>
* add log (#1913 )
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: groot <yihua.mo@zilliz.com>
* partition limit 4096
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix py test
Signed-off-by: groot <yihua.mo@zilliz.com>
* update server version (#1916 )
Signed-off-by: zw <zw@zilliz.com>
* Update to 0.8.0 (#1918 )
* Create new branch 0.8.0 and change preload_table to preload_collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
* update helm version
Signed-off-by: zw <zw@zilliz.com>
* Update CHANGELOG
Signed-off-by: jinhai <hai.jin@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
* fix issue 1901 (#1920 )
* fix issue 1901
Signed-off-by: cmli <chengming.li@zilliz.com>
* update change log
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
* #1900 (#1923 )
* add log
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix #1900
Signed-off-by: groot <yihua.mo@zilliz.com>
* Upgrade mishards to 0.8.0 (#1933 )
* update grpc server of milvus & rename table name to collection
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Skip CI
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Caiyd 1883 fix rw (#1926 )
* #1883 use DiskIO
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix logic error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
* #1928 Too many data and uid copies when loading files (#1931 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
* Update mishards configure files (#1938 )
* Update web readme
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] update configure files
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] rename table to collection
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Update test.groovy
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update test.groovy
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: jinhai <hai.jin@zilliz.com>
Co-authored-by: groot <yhmo@zeronedata.com>
Co-authored-by: shengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: op-hunter <ophunter52@gmail.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-04-15 21:32:20 +08:00
Wang XiangYu
890fe08e7c
Refactor LOG macro and improve log format ( #1927 )
...
* update log format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add new log macro
Signed-off-by: wxyu <xy.wang@zilliz.com>
* use new log macro instead
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* add SetThreadName function
Signed-off-by: wxyu <xy.wang@zilliz.com>
* clang-format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* set thread name
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* add changelog
Signed-off-by: wxyu <xy.wang@zilliz.com>
* add git ignore .swp file
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update log level in LogUtil.cpp
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-15 14:44:00 +08:00
shengjun.li
b04b3e942c
#1897 add heap_swap_top ( #1898 )
...
* add heap_swap_top
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix wrong code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-04-11 12:56:32 +08:00
Cai Yudong
a05ec6a972
Caiyd 1885 optimize knowhere ut ( #1889 )
...
* optimize knowhere unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize knowhere util
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-09 23:37:13 +08:00
Cai Yudong
cc3b75b6b7
code revert ( #1877 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-07 18:58:18 +08:00
Cai Yudong
bf6d22e2f5
#1873 fix index file serialize to incorrect path ( #1874 )
...
* #1873 fix index file serialize to incorrect path
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* not create sq8h index when gpu disabled
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-07 16:25:46 +08:00
op-hunter
54337e9361
refactor knowhere inner unittest for annoy and hnsw, which a… ( #1855 )
...
* skip ci, refactor knowhere inner unittest for annoy and hnsw, which aimed to remove logs of std output
Signed-off-by: cmli <chengming.li@zilliz.com>
* skip ci, fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix annoy load bugs and add serialize test 4 annoy and hnsw
Signed-off-by: cmli <chengming.li@zilliz.com>
* update changelog
Signed-off-by: cmli <chengming.li@zilliz.com>
* update lower bound of annoy search_k param
Signed-off-by: cmli <chengming.li@zilliz.com>
* lint errorgit add src/utils/ValidationUtil.cpp
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-03 14:14:04 +08:00
Cai Yudong
7ccfa5b9f0
Caiyd 1627 move rw index ( #1833 )
...
* #1627 move read/write index into codec
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update WriteVectorIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-02 22:44:45 +08:00
Xiaohai Xu
f82aa4f493
#1849 Support NSG Deletion ( #1839 )
...
* nsg delete
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix request
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix clang
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix typo
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* [skip ci] add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix test_nsg and changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix test
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix test case
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix clang-format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Polish
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-02 20:46:58 +08:00
Jin Hai
0e0739ef87
1845 no UT log ( #1846 )
...
* #1845 No UT log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* No UT log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-02 09:48:29 +08:00
op-hunter
6e7fb831bd
add annoy params validate check ( #1829 )
...
* fix bug & solve compile warning from annoylib
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-02 09:47:45 +08:00
Xiaohai Xu
2fcf2855ce
fix sq8h deletion ( #1830 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-01 20:50:48 +08:00
Jin Hai
68625cbf1c
Fix 1724 ( #1821 )
...
* #1724 Remove unused unittests
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part2
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part3
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part4
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part5
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_id to collection_id
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table to collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_ to collection_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table_id_ to collection_id_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Change table_name to collection_name
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Reformat
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableFile to Segment
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableSchema to CollectionSchema
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix compile lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 17:37:55 +08:00
Cai Yudong
531fca8869
Caiyd 1655 gpu ivfflat delete ( #1809 )
...
* support GPUIVF delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* calc bitset offset correctly
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support GPUSQ8 delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support GPUIVFPQ delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest for GPU delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* delete FAISS compile option -DFAISS_USE_FLOAT16
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-01 10:42:48 +08:00
Xiaohai Xu
88cf5e2bd8
Optimize functions ( #1803 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 18:11:08 +08:00
Xiaohai Xu
8a731dea39
Add Unittest for IDMAP ( #1774 )
...
* gpu idmap unittest
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix clang format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix build issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* small fix
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix case
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix back
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Compact code
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* efficient code
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix GPU search hang
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 14:08:56 +08:00
shengjun.li
52ac810a1f
fix share_ptr array ( #1786 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-28 20:27:07 +08:00
op-hunter
4b996cd622
fix commpile error because of interface changed ( #1773 )
...
* fix commpile error because of interface changed
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix comiple error
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-27 13:07:57 +08:00
op-hunter
310d5d70bc
Annoy support ( #1746 )
...
* add annoy source code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add annoy knowhere
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* annoy local gtest passed
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix lint error and update changelog
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix compile error
Signed-off-by: cmli <chengming.li@zilliz.com>
* Update connect timeout in test cases
Signed-off-by: zw <zw@milvus.io>
* fix some potential bugs
Signed-off-by: cmli <chengming.li@zilliz.com>
* retry ci
Signed-off-by: cmli <chengming.li@zilliz.com>
* rerun ci!
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix errors tested by c++ sdk
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
2020-03-27 09:52:31 +08:00
Cai Yudong
207b854c3f
Caiyd 1655 gpu ivfflat delete ( #1767 )
...
* update sdk
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update segment interfaces
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update some interfaces
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-26 21:58:48 +08:00
Xiaohai Xu
f93b464172
#1654 GPU Index Flat Delete ( #1736 )
...
* Add Flat Index Delete
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix log
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix bitset
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix reference
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-26 18:36:46 +08:00
shengjun.li
e9f7422bc5
fix binary flat may retruns wrong distance when nq larger than 1 ( #1760 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-26 16:45:49 +08:00
Tinkerrr
cda57cf77f
Update NSG ( #1744 )
...
* enable IP and fix crash
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update.
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* lint pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-25 16:24:18 +08:00
Jin Hai
f4d7dd6c93
#1724 Remove unused unittests ( #1725 )
...
* #1724 Remove unused unittests
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part2
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part3
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part4
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part5
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-24 10:11:10 +08:00
shengjun.li
5fc875a020
#1603 modify substructure/superstructure to perfect match ( #1718 )
...
* modify substructure/superstructure to perfect match
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Update cases
Signed-off-by: zw <zw@zilliz.com>
* Fix case bug
Signed-off-by: zw <zw@zilliz.com>
* set invalid distance infinite
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Add distance cases
Signed-off-by: zw <zw@zilliz.com>
* Fix test cases
Signed-off-by: zw <zw@zilliz.com>
* Re-trigger ci
Signed-off-by: zw <zw@zilliz.com>
* fix wrong code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Fix test case
Signed-off-by: zw <zw@zilliz.com>
* Fix case
Signed-off-by: zw <zw@zilliz.com>
* Fix cases
Signed-off-by: zw <zw@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
2020-03-24 10:10:56 +08:00
op-hunter
4fa45dc754
#1661 support HNSW deletion on nmslib ( #1729 )
...
* support HNSW deletion on nmslib
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update changelog
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix lint error on test_hnsw.cpp
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-23 18:04:46 +08:00
Cai Yudong
538c377e65
Caiyd 1689 fix sq8h fail ( #1723 )
...
* #1689 fix SQ8H search fail on SIFT-1B dataset
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix bug
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix gpu search fail
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* revert segment back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_gpuresource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_gpuresource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-23 10:48:15 +08:00
Jin Hai
450573849b
#267 Improve search performance: reduce delay ( #1717 )
...
* #267 Improve search performance: reduce delay
Signed-off-by: jinhai <haijin.chn@gmail.com>
* #267 Improve search performance: reduce delay - update CHANGELOG
Signed-off-by: jinhai <haijin.chn@gmail.com>
* #267 Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #267 Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #267 Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #267 Update format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-23 09:26:58 +08:00
Cai Yudong
5950deddfc
#1678 remove CUSTOMIZATION macro ( #1707 )
...
* #1678 remove CUSTOMIZATION macro
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable faiss_benchmark
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-20 10:24:27 +08:00
Cai Yudong
588ef95d76
Caiyd refactor knowhere ( #1687 )
...
* add new knowhere
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* build pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* rename algo
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* add archive
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* all unittest pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* test_binary pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move knowhere into namespace milvus
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update hnsw
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapterMgr
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move SetBlacklist/GetBlacklist to VecIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VectorAdapter and rename SearchById to QueryById
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update interface in ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus build pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus IDMAP sdk_simple pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_schedule
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version Milvus build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update BinaryIVF BuildAll
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VecIndexFactory
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix knowhere unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix SPTAG unittest
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version unittest build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_engine
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change BinarySet key back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change IndexType to string, and add compatible API for 0.7.0
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix IndexHNSW build warning
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_cache
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix write_index error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-19 19:24:20 +08:00
shengjun.li
72ad100a90
modify bitset from deque to vector ( #1696 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-19 16:16:14 +08:00
op-hunter
fdd51400d2
#1660 support IVFPQ CPU delete ( #1695 )
...
* support IVFPQ CPU delete
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update CHANGELOG.md
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-19 12:26:03 +08:00
Xiaohai Xu
1543f8dc37
#1653 IndexFlat performance improvement for NQ < thread_number ( #1690 )
...
* optimize sse
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* optimizer BinaryDistance
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix superstructure
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-18 18:27:57 +08:00
Xiaohai Xu
59dab6cb84
#1653 IndexFlat performance improvement for NQ < thread_number ( #1674 )
...
* Optimize index flat L2/IP for SSE
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* parallel optimization
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix threshold
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-16 21:32:05 +08:00
Cai Yudong
512fe6233c
#1649 fix Milvus crash on old cpu ( #1652 )
...
* #1649 fix Milvus crash on old cpu
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1649 update debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-14 18:03:23 +08:00
shengjun.li
4088f5e9a2
#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure ( #1647 )
...
* add substructure & superstructure
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* support c++sdk by lin.xiaojun
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* optimizer omp for BinaryFlat; add tutorial
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-14 10:03:00 +08:00
denin
055041881c
fix crashes
...
Signed-off-by: denin <dvzubarev@yandex.ru>
2020-03-12 17:29:54 +03:00
yudong.cai
b50f23d4d6
Merge remote-tracking branch 'main/master' into caiyd_1546_move_config
2020-03-10 22:09:27 +08:00
xiaojun.lin
0ffc7017ff
update.
...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 21:33:10 +08:00
Nicky
e96d7279b2
update
...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
2020-03-09 21:21:36 +08:00
xiaojun.lin
7b493cb835
fix
...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 20:08:31 +08:00
Nicky
2d96646356
update.
...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
2020-03-09 16:33:28 +08:00
yudong.cai
c29877901f
Merge remote-tracking branch 'main/master' into caiyd_1546_move_config
2020-03-07 21:09:49 +08:00
Cai Yudong
0fd9bf8e70
#1529 fix server crash when cache_insert_data enabled ( #1541 )
...
* #1529 fix server crash when cache_insert_data enabled
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1529 fix bug
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1529 code opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1529 set uids for CopyGpuToCpu()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 20:54:26 +08:00
yudong.cai
6b81dd55df
#1536 move Config.cpp to config directory
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 17:02:21 +08:00
groot
a08b51c2b6
merge json to master to get docker image ( #1500 )
...
* General proto api for NNS libraries
Signed-off-by: groot <yihua.mo@zilliz.com>
* refactor confadapter
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* update test_add
Signed-off-by: zhenwu <zw@zilliz.com>
* update knowhere
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update test cases
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* Update cases
* C++ sdk for json parameters
Signed-off-by: groot <yihua.mo@zilliz.com>
* update unittest
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix case
Signed-off-by: del-zhenwu <zw@zilliz.com>
* modify test_index.py
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update sptag
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* Build Pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* knowhere/wrapper ut pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update util
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* fix wal case
Signed-off-by: del-zhenwu <zw@zilliz.com>
* modify test_search_vectors
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update ci
Signed-off-by: del-zhenwu <zw@zilliz.com>
* update util
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* modify test_search_vectoes
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* add hnsw in http module & modify index apis
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify search in http module
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix build error
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix typo in test_index and test_search
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* index apis in http module done
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix build index bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* search apis unittest pass
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* web test pass
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update confadapter
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update util
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix vectors results bug (fix #1476 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* clang format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update test
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* fix unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
* add test_config
Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix a build error
Signed-off-by: groot <yihua.mo@zilliz.com>
* add invalid param search test
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* fix range check
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* cpmpact/flush case passed
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failures
Signed-off-by: groot <yihua.mo@zilliz.com>
* validate json parameters in request
Signed-off-by: groot <yihua.mo@zilliz.com>
* add unittest cases
Signed-off-by: groot <yihua.mo@zilliz.com>
* update test index/search
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* update test_config
Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>
* fix
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* support nsg and ivf-nlist
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* fix validation bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* remove rnsg cases
Signed-off-by: zhenwu <zw@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* Update changelog
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix typo
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* add pq to test_index && multithread test
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* add pq to test_search
Signed-off-by: shengjh <jianghong.sheng@zilliz.com>
* Fix format
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix config bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix config test
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* disable config test case
Signed-off-by: zhenwu <zw@zilliz.com>
Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: zhenwu <zw@zilliz.com>
Co-authored-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Co-authored-by: shengjh <jianghong.sheng@zilliz.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
Co-authored-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: del-zhenwu <zhenxiang.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-07 15:23:34 +08:00
Tinkerrr
8cd1ec9819
fix 1507 ( #1509 )
...
* fix
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update..
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* comment ut
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* Fix lint error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* update....
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update....
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* Fix typo
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix typo
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-06 22:14:58 +08:00