1213 Commits

Author SHA1 Message Date
Yuki Yamada
96e795f496
docs: fix Response status code (#5120)
Signed-off-by: wf-yamaday <e155417k@st.u-gakugei.ac.jp>
2021-05-11 09:48:32 +08:00
shengjun.li
21ea92ec7e
fix memory leak (#4767)
* fix memory leak
(1) Minor memory leak when querying on BinaryFlat
(2) Minor memory leak when building NSG index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix mismatch new[]/delete[]

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* rm useless folder

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix memory leak in UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-03 16:19:29 +08:00
shengjun.li
5ad002effa
fix minor memory leak when querying by IVF_SQ8H (#4758)
* fix minor memory leak when querying by IVF_SQ8H

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix mismatch malloc/free new/delete

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-01 19:57:53 +08:00
Wang Xiangyu
ae24e756fb
Update version name (#4751)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-27 10:50:28 +08:00
shengjun.li
cf11726712
Minor memory leak when building IVF_SQ8 on GPU (#4750)
* fix memory leak in knowhere UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix life cycle of variable in knowhere exception

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix memory leak when building ivf_sq8 index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-26 13:48:19 +00:00
shengjun.li
af54fd155b
(1) fix Status destructor (#4745)
(2) fix grpc-milvus URL
(3) fix hnsw uninitialized variable

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-26 12:26:02 +08:00
shengjun.li
0f7c0a8662
update version to 1.0.0-beta (#4737)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-25 02:04:01 +00:00
shengjun.li
10c8cd4e9f
Support logging to stdout (#4738)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-24 18:54:19 +08:00
op-hunter
9a5c15320a The GPU cache holds much more data than the configured value (#4720)
* The GPU cache holds much more data than the configured value

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and remove the useless variable G_BYTE and unit

Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 15:30:15 +08:00
shengjun.li
895ae9db88
Add an optional parameter 'nbtis' for IVF_PQ (#4709)
* Add an optional parameter 'nbtis' for IVF_PQ

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix test

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 07:29:25 +00:00
shengjun.li
09f0730f8d
Code Refactoring (#4702)
* remove useless code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Code Refactoring

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-09 09:25:15 +00:00
shengjun.li
1211e9bac3
BinaryFlat support AVX2 (#4694)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-04 08:42:42 +00:00
shengjun.li
bbbf254b7c
Fix binaryflat (#4681)
* fix binary distance

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* improve the performance of BinaryFlat

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* avoid negative zero in Tanimoto

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 17:11:02 +08:00
yukun
3efbab1df5
make metrics label configurable (#4677)
* update to 0.10.6

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Configurable metric labels

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Roll back clienTest modify

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 10:45:36 +08:00
shengjun.li
f942f0b823
fix errors in .mds (#4644)
* Updated logo and architecture links. (#2529)

Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>

* Fixed broken links. (#2902)

Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>

* Minor editorial updates. (#2946)

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

* fix cuda version requirement (#2909)

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* [skip ci] Updated INSTALL.md.  (#3016)

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

* [skip ci] Fixed broken links. (#3304)

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

* [skip ci] update install from code (#3855)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] update cmake version (#4084)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] Update the foundation name. (#4438)

Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>

* [skip ci] Added a space for readability (#4465)

Added a space between the heart emoji and the word for better readability.

Signed-off-by: Mark Berger <maberger0811@gmail.com>

* [skip ci] Update links and fix dead links. (#4496)

Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>

* [skip ci] fix errors in mds

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: PahudPlus <64403786+PahudPlus@users.noreply.github.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: AmyYH <68527082+AmyYH@users.noreply.github.com>
Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
Co-authored-by: ireneontheway5 <75291211+ireneontheway5@users.noreply.github.com>
Co-authored-by: Mark Berger <maberger0811@gmail.com>
2021-01-22 19:16:40 +08:00
yukun
f709349cc8
[skip ci]Fix restful api doc for loadcollection (#4627)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-01-19 19:05:52 +08:00
groot
810f5e6f70
fix random crash for scheduler task (#4563)
* fix random crash for scheduler task

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix unittest crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-01-04 13:12:05 +00:00
groot
89bbe1ee4d
#4492 while share file system servcie became abnormal, the milvus can not supply query service (#4506)
* modify changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #4492 while share file system servcie became abnormal, the milvus can not supply query service

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-25 02:12:58 +00:00
shengjun.li
f9222da52b
fix MapOffsetToUid (#4493)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-23 10:22:09 +08:00
groot
705e5cde8e
modify http request for load_collection change (#4494)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-22 11:10:14 +00:00
groot
22cca00af3
LoadCollection api change for C++ sdk (#4491)
* LoadCollection api change for C++ sdk

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-22 06:14:23 +00:00
op-hunter
646baed233
remove useless mutex in knowhere indexes and refactor BuildAll interf… (#4487)
* remove useless mutex in knowhere indexes

Signed-off-by: cmli <chengming.li@zilliz.com>

* refactor BuildAll interface 4 NSG and SPTAG

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-22 09:35:20 +08:00
groot
607ec31fbc
#4484 Milvus only search default partition if search parameter partition_tags contains _default (#4486)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-21 08:30:10 +00:00
shengjun.li
a07526c98e
Optimize the process of indexing and querying (#4455)
* fix index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix engine

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 17:53:39 +08:00
groot
805212a0dc
#4307 expand load_collection to load partition (#4443)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-11 17:44:48 +08:00
groot
62098d760e
#4378 Multi-threads to call load_collection and search cause Milvus hang (#4408)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-08 19:14:53 +08:00
shengjun.li
47542a747c
update version info for 0.10.5 (#4409)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-08 18:22:21 +08:00
BossZou
2d57c5cd52
Upgrade mishards for v0.10.4 (#4356)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-02 18:00:19 +08:00
shengjun.li
bf5fdc3131
Fix memory leak in IVF indexes (#4325)
* fix memory lead in IVF indexes

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] modify change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-01 09:36:04 +08:00
Xiaohai Xu
99245c0c63
#4174 Search out of memory: CPU2GPU1 with index flat (#4178)
* Fix gpu resource issue

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix_ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-05 13:57:50 +08:00
groot
124d914bb5
#4169 Collection does not exist when drop partition and count entities concurrently (#4175)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-11-04 18:55:13 +08:00
groot
001c8513fe
#4082 Expose MAX_PARTITION_LIMIT to config (#4138)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-31 16:39:26 +08:00
groot
d41835585a
remove dependency of sqlite_orm (#4129)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-30 01:59:11 +00:00
jackhouchina
a9e82f37a9
#4122 fix can not open fpga device in FPGA (#4123)
* This is my commit message for fix can not open fpga

Signed-off-by: jack hou <364427912@qq.com>

* create one index for fpga

Signed-off-by: jack hou <364427912@qq.com>

* fix code format

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-29 18:45:02 +08:00
groot
762f5f296f
#4066 Rewrite SqliteMetaImpl to discard sqlite_orm (#4114)
* #4066 Rewrite SqliteMetaImpl to discard sqlite_orm

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-29 15:29:02 +08:00
groot
84083294c3
fix typo of #4075 (#4094)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-26 14:06:52 +08:00
groot
773deab62e
#4075 Improve performance for create large amount of partitions (#4083)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-24 10:35:58 +08:00
cqy123456
52dbf7ed3b
Let uid be shared pointer to not copy really in 0.10.4 (#4064)
* Let uid be shared pointer to not copy really in 0.10.4

Signed-off-by: cqy <yaya645@126.com>
2020-10-23 19:30:13 +08:00
jackhouchina
8d5c1a87d5
#3773 milvus support IVF_PQ run on fpga device (#3996)
* This is my commit message Signed-off-by jack hou Developer <364427912@qq.com>

Signed-off-by: root <364427912@qq.com>

* fix build with -u -a

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix run on GPU

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ThirdPartyPackages.cmake

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-23 09:41:28 +08:00
cqy123456
0b020b8255
sq8h loading problem (#4060)
Signed-off-by: cqy <yaya645@126.com>
2020-10-22 17:11:46 +08:00
shengjun.li
8e0f0a3437
Revert PR3525 and PR3553 (#4014)
* Revert "add NGT index (#3525)"

This reverts commit c2ba9be24986d3155c4b87ae01601233246a9540.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Revert "[skip ci]add license (#3553)"

This reverts commit 5787a2af4d44a7258c37b9f481c286dbd7b6b44f.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-17 18:51:00 +08:00
shengjun.li
235c51c385
Fix server crashed during search with index pq (#3954)
* fix pq distances cal bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix pq distance calculation outofrange according to faiss suggests

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-10-17 09:42:19 +08:00
groot
23b94306fa
#3998 fix a dead lock issue (#4011)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-10-16 19:29:48 +08:00
op-hunter
e2f63c9bd1
withdraw pr 2467, which is a failure optimization of k-selection (#3999)
Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-10-15 20:43:25 +08:00
shengjun.li
3596d07e74
fix version (#3971)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-13 15:42:30 +08:00
cqy123456
19bda5cf97
The search of SQ8H index is slower than the previous version (#3957)
Signed-off-by: cqy <yaya645@126.com>
2020-10-12 19:55:26 +08:00
Wang Xiangyu
6836c81f44
Support topk up to 16384 on GPU (#3936)
* large topk on gpu

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* change GPU_QUERY_MAX_TOPK to 16384

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-12 09:48:04 +08:00
chen qingxiang
f46e2a621d
fix the bug of DeleteTask state not change (#3935)
* fix the bug of DeleteTask state not change

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-10-10 14:16:31 +08:00
Wang Xiangyu
e397dd20b9
Disable query slicing (#3931)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-10 09:43:25 +08:00
lighteningzhang
237ce2aba3
Modify faiss files to reduce the usage of GPU in 0.10.4 (#3893)
* Modify faiss files to reduce the usage of GPU in 0.10.4

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Change the format of the code and release memories of arrays resident on host

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Change the format of the code and release memories of arrays resident on host, fix some typos

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Delete some blank lines

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Temporarily comment the delete function in IVFFlat.cu

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Uncomment some delete functions

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Uncomment some delete functions

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Use tensor to replace arrays in IVFFlat.cu

Signed-off-by: lighteningzhang <lighteningzhang@163.com>

* Fix some typos

Signed-off-by: lighteningzhang <lighteningzhang@163.com>
2020-09-28 17:58:32 +08:00