127 Commits

Author SHA1 Message Date
Cai Yudong
ef0e3145eb
#1105 update error message when creating IVFSQ8H index without GPU resources (#1117) 2020-02-08 11:25:10 +08:00
Tinkerrr
829cb4bbec
Support hnsw (#1131)
* add hnsw

* add config

* format...

* format..
2020-02-08 11:00:00 +08:00
Cai Yudong
364fc25766 rename 'minio' to 's3' in Storage Config section (#1088)
* #1002 rename 'minio' to 's3' in Storage Config section

* #1002 clang format
2020-01-18 10:07:46 +08:00
groot
0f1aa5f8bb Tanimoto distance (#1016)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface

* Define interface (#832)

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface Attach files by dragging & dropping, selecting or pasting them. 

Co-authored-by: groot <yihua.mo@zilliz.com>

* faiss & knowhere

* faiss & knowhere (#842)

* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* faiss & knowhere

Co-authored-by: groot <yihua.mo@zilliz.com>

* support binary input

* code lint

* add wrapper interface

* add knowhere unittest

* sdk support binary

* support using metric tanimoto and hamming

* sdk binary insert/query example

* fix bug

* fix bug

* update wrapper

* format

* Improve unittest and fix bugs

* delete printresult

* fix bug

* #823 Support binary vector tanimoto metric

* fix typo

* dimension limit to 32768

* fix

* dimension limit to 32768

* fix describe index bug

* fix #886

* fix #889

* add jaccard cases

* hamming dev-test case

* change test_connect

* Add tanimoto cases

* change the output type of hamming

* add abs

* merge master

* rearrange changelog id

* modify feature description

Co-authored-by: Yukikaze-CZR <48198922+Yukikaze-CZR@users.noreply.github.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-01-14 19:22:27 +08:00
aaronjin2010
c787b84daa refactor code and add error log (#976)
* refactor code and add error log

* remove the space

* refactor

* refactor
2020-01-13 09:30:14 +08:00
れいげん あらたか
5d2d34791d fix #651; use initialized instead of shutting_down_ (#993) 2020-01-11 09:27:21 +08:00
Cai Yudong
3c02b4b581 add s3 mock for unittest (#937)
* #815 change S3 client_ptr_ to shared_ptr

* #815 install test_storage to unittest

* #815 add MockS3Client.h for unittest

* #815 optimize MockS3Client.h

* #815 update unittest

* #815 update unittest

* #815 fix clang-format

* #815 use FIU for unittest

* #815 enable FIU in jenkins

* #815 update unittest

* #815 enable FIU in docker build
2020-01-08 10:39:05 +08:00
yukun
a92a43e282 Add push mode for prometheus monitor (#905)
* Add push mode for prometheus monitor

* format code

* fix for comments

* fix test_MetricBase bug

* Change ip to address in config
2020-01-06 18:35:10 +08:00
Cai Yudong
b9d9b8ecc2 support minio storage (#895)
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
2020-01-04 10:39:52 +08:00
shengjh
ba36d18d10 Fix mysqlmetaimpl (#869)
* *fix mysqlMetaImpl Initialize failed create directory

* *style: format code

* *style: format code

* *style: format code

* *style: format code

* *fix: sqliteMetaImpl Initialize failed create directory

* add empty line to trigger CI
2020-01-02 17:32:41 +08:00
Heisenberg-Y
1e72267a65 add cpu mode for built-in Faiss (#841)
* add cpu mode for built-in Faiss

* delete customization options on build stage

* delete faiss version

* delete customization options on build stage

* fix unittest problem in cpu mode

* fix unittest problem in cpu mode

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2019-12-28 17:28:11 +08:00
groot
86b83fb32a #744 do not return partition table for show_tables (#747) 2019-12-13 10:54:17 +08:00
Zhiru Zhu
e99896ac62 Add Opentracing (#729)
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
2019-12-10 15:24:54 +08:00
groot
5bec93bffa Set nlist to default after drop index (#719)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log

* #696 metric_type changed from IP to L2

* #696 metric_type changed from IP to L2

* #696 metric_type changed from IP to L2
2019-12-06 14:30:17 +08:00
groot
ebb4cedeb7 #696 metric_type changed from IP to L2 (#710)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log

* #696 metric_type changed from IP to L2
2019-12-05 17:32:41 +08:00
groot
564095fd8d #674 server down in stability test (#708)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log
2019-12-05 16:50:53 +08:00
Cai Yudong
5970450d48 #705 fix search SQ8H crash without GPU resource (#706) 2019-12-05 11:42:09 +08:00
groot
20e0710661 Add important log (#694)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log
2019-12-04 16:19:52 +08:00
yudong.cai
f330d9f902 #658 Milvus error out when building SQ8H index without GPU resources 2019-12-03 15:50:27 +08:00
Jin Hai
cb27794411
Merge pull request #657 from gaolizhou/0.6.0
use better names for timing MACROs milvus-io#556
2019-12-03 14:17:14 +08:00
Lizhou Gao
fab1bbc860 replace the missing D_SEC 2019-12-03 13:50:22 +08:00
groot
27f6166d50 fix typo 2019-12-03 10:59:30 +08:00
Lizhou Gao
6c14297a29 use better names for timing MACROs milvus-io#556 2019-12-03 10:49:00 +08:00
groot
6b52973b04 #654 Random crash when frequently insert vector one by one 2019-12-02 19:51:33 +08:00
groot
3df535e11e #649 Typo partiton should be partition 2019-12-02 15:39:16 +08:00
groot
62b6db567d add more logs 2019-12-02 11:57:43 +08:00
groot
8862756d11 typo 2019-12-02 10:56:11 +08:00
groot
07ac2e32c0 merge 0.6.0 2019-12-02 10:30:22 +08:00
Jin Hai
91b165d3cc
Merge pull request #624 from cydrain/caiyd_fix_gpu_index
fix gpu index build hang when gpu resources disabled
2019-11-30 17:43:07 +08:00
groot
8ca2d52bff fix mysql bug 2019-11-30 17:02:40 +08:00
groot
0b3f7e15c0 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-30 16:26:02 +08:00
groot
66b698186c modify log 2019-11-30 16:19:37 +08:00
Jin Hai
6f58f7550b
Merge pull request #608 from fishpenguin/0.6.0-yk-refactor-scheduler
NSG build failed using GPU-edition if set gpu_enable false
2019-11-30 16:16:04 +08:00
groot
2e3caca4da more log 2019-11-30 15:38:14 +08:00
yudong.cai
de440acaa0 #579 fix CPU version build error 2019-11-30 14:03:46 +08:00
yudong.cai
525b6df0b6 #579 update index build error message 2019-11-30 12:00:47 +08:00
yudong.cai
dcbe1a0c3f #579 when gpu resources disabled, use cpu index instead 2019-11-30 11:26:40 +08:00
Jin Hai
7b949861a8
Merge pull request #614 from cydrain/caiyd_remove_cpu_version_macro
#611 remove MILVUS_CPU_VERSION
2019-11-30 10:13:05 +08:00
fishpenguin
fdfb397918 fix test_nsg failed bug 2019-11-29 20:17:37 +08:00
groot
844feab926 more log 2019-11-29 19:15:11 +08:00
groot
bc2dba26a2 refine code 2019-11-29 18:15:28 +08:00
groot
736c348cfc add log 2019-11-29 17:20:16 +08:00
groot
c220e0e157 refine code 2019-11-29 16:18:57 +08:00
yudong.cai
a023511f16 #611 remove MILVUS_CPU_VERSION 2019-11-29 16:02:08 +08:00
groot
ce10d1c86e merge 0.6.0 2019-11-29 14:49:53 +08:00
groot
af5c5b3bdb #606 no log generated during building index with CPU 2019-11-29 14:47:13 +08:00
groot
22e86eb0a0 fix a bug 2019-11-29 12:47:38 +08:00
groot
85211d537f reconstruct code 2019-11-29 12:38:18 +08:00
groot
095b1243e6 add more log 2019-11-29 11:37:31 +08:00
groot
cc5c0bf2f2 mysql ongoing files 2019-11-29 10:55:59 +08:00