175 Commits

Author SHA1 Message Date
Tinkerrr
abd91eab82
Fix HNSW crash (#1262)
* fix

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update.

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-02-19 17:16:48 +08:00
Jin Hai
e1027e9e65
#1240 Update license declaration of each file (#1241)
* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-02-17 23:40:58 +08:00
Tinkerrr
191a8c9941
Fix #1140 (#1162)
* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix2

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix3

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update changelog

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
2020-02-14 12:04:09 +08:00
shengjh
4dee7dfac6
Improve codecov (#1095)
* Optimize config test. Dir src/config 99% lines covered

* add unittest coverage

* optimize cache&config unittest

* code format

* format

* format code

* fix merge conflict

* cover src/utils unittest

*  '#831 fix exe_path judge error'

* #831 fix exe_path judge error

* add some unittest coverage

* add some unittest coverage

* improve coverage of src/wrapper

* improve src/wrapper coverage

* *test optimize db/meta unittest

* fix bug

* *test optimize mysqlMetaImpl unittest

* *style: format code

* import server& scheduler unittest coverage

* handover next work

* *test: add some test_meta test case

* *format code

* *fix: fix typo

* feat(codecov): improve code coverage for src/db(#872)

* feat(codecov): improve code coverage for src/db/engine(#872)

* feat(codecov): improve code coverage(#872)

* fix config unittest bug

* feat(codecov): improve code coverage core/db/engine(#872)

* feat(codecov): improve code coverage core/knowhere

* feat(codecov): improve code coverage core/knowhere

* feat(codecov): improve code coverage

* feat(codecov): fix cpu test some error

* feat(codecov): improve code coverage

* feat(codecov): rename some fiu

* fix(db/meta): fix switch/case default action

* feat(codecov): improve code coverage(#872)
* fix error caused by merge code
* format code

* feat(codecov): improve code coverage & format code(#872)

* feat(codecov): fix test error(#872)

* feat(codecov): fix unittest test_mem(#872)

* feat(codecov): fix unittest(#872)

* feat(codecov): fix unittest for resource manager(#872)

* feat(codecov): code format (#872)

* feat(codecov): trigger ci(#872)

* fix(RequestScheduler): remove a wrong sleep statement

* test(test_rpc): fix rpc test

* Fix format issue

* Remove unused comments

* Fix unit test error

Co-authored-by: ABNER-1 <ABNER-1@users.noreply.github.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-02-11 23:03:29 +08:00
Cai Yudong
8f7060a945
remove Nvidia owned files from faiss (#1136)
* #1135 remove Nvidia owned files from faiss

* Revert "#1135 remove Nvidia owned files from faiss"

This reverts commit 3bc007c28c8df5861fdd0452fd64c0e2e719eda2.

* #1135 remove Nvidia API implementation

* #1135 remove Nvidia owned files from faiss
2020-02-10 20:42:02 +08:00
Tinkerrr
829cb4bbec
Support hnsw (#1131)
* add hnsw

* add config

* format...

* format..
2020-02-08 11:00:00 +08:00
quicksilver
5ec1baaede run hadolint with reviewdog (#1060)
* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint
2020-01-16 19:59:26 +08:00
groot
0f1aa5f8bb Tanimoto distance (#1016)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface

* Define interface (#832)

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface Attach files by dragging & dropping, selecting or pasting them. 

Co-authored-by: groot <yihua.mo@zilliz.com>

* faiss & knowhere

* faiss & knowhere (#842)

* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* faiss & knowhere

Co-authored-by: groot <yihua.mo@zilliz.com>

* support binary input

* code lint

* add wrapper interface

* add knowhere unittest

* sdk support binary

* support using metric tanimoto and hamming

* sdk binary insert/query example

* fix bug

* fix bug

* update wrapper

* format

* Improve unittest and fix bugs

* delete printresult

* fix bug

* #823 Support binary vector tanimoto metric

* fix typo

* dimension limit to 32768

* fix

* dimension limit to 32768

* fix describe index bug

* fix #886

* fix #889

* add jaccard cases

* hamming dev-test case

* change test_connect

* Add tanimoto cases

* change the output type of hamming

* add abs

* merge master

* rearrange changelog id

* modify feature description

Co-authored-by: Yukikaze-CZR <48198922+Yukikaze-CZR@users.noreply.github.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-01-14 19:22:27 +08:00
Jin Hai
a876ae1b64
Change C++ standard to c++17 (#911)
* [skip ci]#668 - Update badge of README

* Fix README.md

* Fix README.md

* Merge remote-tracking branch 'upstream/master'

* #910 Change c++ standard to c++17

* Remove unused headers
2020-01-04 18:48:22 +08:00
Yukikaze-CZR
397a757f6f IVFTest.gpu_seal_test unittest failed #805 (#888)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* IVFTest.gpu_seal_test unittest failed #805

* rerun jenkins CI

* fix test_util
2020-01-02 14:03:28 +08:00
Heisenberg-Y
1e72267a65 add cpu mode for built-in Faiss (#841)
* add cpu mode for built-in Faiss

* delete customization options on build stage

* delete faiss version

* delete customization options on build stage

* fix unittest problem in cpu mode

* fix unittest problem in cpu mode

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2019-12-28 17:28:11 +08:00
quicksilver
03ec41070a Remove Jfrog Cache on Jenkins CI (#827)
* specify multiple urls on sqlite_orm download stage

* fix bug

* fix bug

* specify multiple urls on opentracing download stage

* fix bug

* specify multiple urls on download stage

* delete jfrog cache

* print jenkins enviroment variables

* print jenkins enviroment variables

* fix check_ccache.sh bug

* debug

* Update Jenkinfile

* Add build enviroment resource limit on Jenkins CI

* remove Jfrog cache build option
2019-12-26 10:33:05 +08:00
Tinkerrr
d37670bd3e Remove Arrow (#817)
* replace arrow

* format

* update changelog

* code-style

* fix bug

* fix 2

* fix 3

* fix 4

* change build timeout on Jenkinsfile
2019-12-25 15:34:51 +08:00
Zhiru Zhu
8e3b4ccd57 Use openblas / lapack from apt install (#739)
* remove build openblas/lapack and use find_package

* update ubuntu_build_deps.sh

* update build image

* update build image

* update CHANGELOG

* trigger ci

* update image

* update centos build envvironment image on Jenkins CI

* trigger ci
2019-12-21 13:37:53 +08:00
Cai Yudong
04bd700668 fix Milvus crash when searching and building index simultaneously using SQ8H (#794)
* #715 fix Milvus crash when searching and building index simultaneously using SQ8H

* #715 fix update
2019-12-19 21:45:14 +08:00
quicksilver
186cab364f add codecov github actions 2019-12-17 20:08:58 +08:00
quicksilver
a6e774aed6 enable build milvus on centos7 2019-12-13 21:21:33 +08:00
Yukikaze-CZR
47621f06fb clang-format (#743)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format
2019-12-11 14:06:04 +08:00
Yukikaze-CZR
f37509213b Add log to debug #678 (#733)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__
2019-12-10 16:47:35 +08:00
Yukikaze-CZR
8574b8b93f add code coverage rate and fix #670 (#693) 2019-12-04 19:37:13 +08:00
JinHai-CN
a320846606 Add a comment on readonly invertedlist and pin memory 2019-12-03 11:27:49 +08:00
Nicky
3a87f16b74 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-12-01 15:30:34 +08:00
Jin Hai
23dffbf3b5
Merge pull request #635 from JinHai-CN/GPUCompile
#634 - FAISS GPU version is compiled with O0
2019-12-01 13:13:45 +08:00
bugfixer
216a534eff #634 - FAISS GPU version is compiled with O0 2019-12-01 01:52:17 +00:00
bugfixer
c1bd16a55e #631 - FAISS isn't compiled with O3 option 2019-12-01 01:40:11 +00:00
Nicky
d721e385d1 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-11-30 20:40:00 +08:00
Jin Hai
e705fa3007
Merge pull request #609 from cydrain/caiyd_handle_search_exception
handle search exception
2019-11-30 19:47:16 +08:00
xiaojun.lin
28ca297115 fix unittest 2019-11-30 19:19:01 +08:00
xiaojun.lin
31da89d9a2 format code 2019-11-30 18:07:26 +08:00
xiaojun.lin
6b84ec5f79 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-11-30 18:04:22 +08:00
xiaojun.lin
8f09b1f230 solve part of the problem about nsg 2019-11-30 17:23:10 +08:00
yudong.cai
3af4da6d52 #331 update clang-format 2019-11-30 09:29:34 +08:00
yudong.cai
3a0cc24d57 #331 update exception handle when search fail 2019-11-30 09:29:34 +08:00
yudong.cai
93f2ce45f4 #331 add exception handle when search fail 2019-11-30 09:29:34 +08:00
fishpenguin
fdfb397918 fix test_nsg failed bug 2019-11-29 20:17:37 +08:00
fishpenguin
6fcd2a13da fix CPU version bug 2019-11-29 15:57:42 +08:00
fishpenguin
fd304cf4b4 remove #if 2019-11-29 14:52:08 +08:00
fishpenguin
4b8a72f9ae NSG build failed using GPU-edition if set gpu_enable false 2019-11-29 11:38:27 +08:00
Yukikaze-CZR
dd5ec085b6 #552 Server down during building index_type: IVF_PQ using GPU-edition 2019-11-28 15:08:05 +08:00
Yukikaze-CZR
5a5e76fe6a #552 Server down during building index_type: IVF_PQ using GPU-edition 2019-11-28 14:37:23 +08:00
Jin Hai
7e394a26a2
Merge pull request #583 from cydrain/caiyd_update_faiss_benchmark
[skip ci] update ground truth check
2019-11-28 13:53:48 +08:00
JinHai-CN
88f7dc56a2 Integrate internal faiss
Remove faiss docs
2019-11-28 11:42:54 +08:00
yudong.cai
a685ab2602 #527 update ground truth check 2019-11-28 11:27:57 +08:00
yudong.cai
e3354fd95e #527 update ground truth check 2019-11-28 11:15:46 +08:00
Jin Hai
b0a680f5bb
Merge pull request #575 from youny626/0.6.0
Add AVX flags when building faiss
2019-11-27 15:55:38 +08:00
Zhiru Zhu
29fa7700db add avx flags when building faiss 2019-11-27 15:03:05 +08:00
Yukikaze-CZR
47abe4ff47 #504 The code coverage rate of core/src/scheduler/optimizer is too low 2019-11-27 14:21:53 +08:00
xiaojun.lin
88cb2b5991 NSG support MetricType IP 2019-11-26 17:15:14 +08:00
Jin Hai
03fe979301
Merge pull request #528 from Heisenberg-Y/0.6.0-ezio
Fix building error in faiss benchmark when using faiss 1.6.0
2019-11-25 23:17:29 +08:00
Jin Hai
88ca2c805f
Merge pull request #521 from tinkerlin/issue-465
Fix Issue 465
2019-11-25 23:09:52 +08:00