5612 Commits

Author SHA1 Message Date
LocoRichard
3dd4376c8f [skip ci] contributing&readme_proofread (#4919)
* [skip ci] contributing&readme_proofread

Signed-off-by: LocoRichard <lichen.wang@zilliz.com>
2021-04-19 10:15:19 +08:00
Eric Shen
6b1c09c8c0 docker: move compose file from root path to docker folder (#4890)
* docker: move compose file

Signed-off-by: Eric Shen <ericshenyuhao@outlook.com>
2021-04-19 10:15:11 +08:00
shengjun.li
f65cd0b6ba
server config version is 0.5 (#4951)
* server config version is 0.5

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] add config history

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-19 10:12:56 +08:00
groot
b46a27609a
change proto for new api (#4947)
* modify proto for new api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Add new api in webserver

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add new api in sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* lint code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* implement release collection

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* update proto

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix a crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: fishpenguin <kun.yu@zilliz.com>
2021-04-16 15:57:14 +08:00
shengjun.li
6d8441b186
not to load uids from disk if it is cached (#4946)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-16 10:21:04 +08:00
ophunter233
5d1df500f6
accelerate elkan_kmeans (#4937)
Signed-off-by: cmli <chengming.li@zilliz.com>
2021-04-14 19:25:50 +08:00
groot
446af1c46a
Milvus waste time during building index for small segment (#4936)
fix #4933

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-14 18:01:51 +08:00
shengjun.li
09dea5ab74
remove useless code (#4934)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-14 18:00:04 +08:00
groot
0cd3b3a05c
When an index created on the empty collection, the server will respond immediately (#4932)
* fix #4838

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-14 16:34:30 +08:00
groot
7f290fb3b5
fix wrong results of merged different 'topk' queries (#4924)
* fix #4797

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-13 17:30:59 +08:00
shengjun.li
b11e1949b6
improve ApplyDeletes (#4918)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-12 19:48:21 +08:00
groot
e391e0d9f4
[skip ci] change sdk readme (#4917)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-12 10:33:35 +08:00
shengjun.li
30766421f3
Improve the performance of get_vectors_by_id (#4913)
* cache id bloom filter

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* improve getVectorsById

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-10 10:35:54 +08:00
groot
f31bf268a2
fix failure to open vector index in mishards (#4910)
* fix #4778

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-09 15:28:51 +08:00
shengjun.li
ed9d54fcdd
GPU cache will be cleaned up in time after the collection is dropped (#4909)
* To clean up GPU cache in time after the collection is dropped

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* remove IF getIndex

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-08 19:10:09 +08:00
shengjun.li
0b920304d2
Fix the capacity of bloom filter (#4895)
* modify dablooms and ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify codecs

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-08 14:16:25 +08:00
groot
c20e0bfd4f
avoid read-only node merging data (#4900)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-06 15:29:22 +08:00
shengjun.li
2372053568
knowhere code refactoring (#4875)
(1) remove row count check in knowhere
(2) add MatchNlist in BinIVF
(3) fix compile warnings caused by GETTENSOR

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-31 14:29:06 +08:00
shengjun.li
d9ca18b6ad
Fix the crash when query for a large topk on GPU Flat (#4866)
* Fix the crash when query for a large topk on GPU Flat

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fill in the CHANGELOG.md

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-30 09:55:02 +08:00
shengjun.li
db6e250dd5
update HNSW (#4856)
* update HNSW
(1) add license
(2) fix the wrong iterative node as v0.5.0
(3) add IF searchKnnCloserFirst as v0.5.0
(4) improve addPoint

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update workflows

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-26 13:16:31 +08:00
BossZou
1c4570caa9
Add mishards comments (#4834)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-03-23 11:05:20 +08:00
Ji Bin
c1fe9f6351
storage: enabling s3 storage support. (#4792)
* storage: enabling s3 storage support.

- very raw idea for support s3 storage, not enabled by default.
- need enabling compiled(cmake) with MILVUS_WITH_AWS.
- simple integration tested with ceph/radowsgw.

Signed-off-by: Ji Bin <matrixji@live.com>

* storage: enabling s3, rebase and improvments

- Do not do CachePut in DefaultIdBloomFilterFormat::create, since bloom
fileter file may not synced with memory at that moment.

Signed-off-by: Ji Bin <matrixji@live.com>
2021-03-12 11:45:09 +08:00
op-hunter
fa07bf5390
fix exception handling of the db meta (#4790)
* fix definite memleak

Signed-off-by: cmli <chengming.li@zilliz.com>
2021-03-09 09:59:26 +08:00
shengjun.li
8c57957e1b
remove wal entity (#4789)
Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2021-03-08 17:52:36 +08:00
BossZou
781b17262f
[skip ci] Shards v1.0.0 (#4784)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-03-08 09:57:28 +08:00
shengjun.li
b79bd07586
fix failure handling in SystemInfo (#4783)
* fix memory leak in scheduler UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix fail in SystemInfo

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix Dockerfile

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-06 04:56:46 +00:00
BossZou
ecc6bcfc7f
Update oatpp third-party link (#4774)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-03-05 15:44:33 +08:00
shengjun.li
21ea92ec7e
fix memory leak (#4767)
* fix memory leak
(1) Minor memory leak when querying on BinaryFlat
(2) Minor memory leak when building NSG index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix mismatch new[]/delete[]

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* rm useless folder

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix memory leak in UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
v1.0.0
2021-03-03 16:19:29 +08:00
shengjun.li
c29d1d9aa3
[skip ci] CI nightly open (#4768)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-03 14:52:50 +08:00
shengjun.li
5ad002effa
fix minor memory leak when querying by IVF_SQ8H (#4758)
* fix minor memory leak when querying by IVF_SQ8H

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix mismatch malloc/free new/delete

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-01 19:57:53 +08:00
shengjun.li
dbdf120b7b
[skip ci] add issue 4754 changlog (#4755)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-27 11:39:03 +08:00
Wang Xiangyu
ae24e756fb
Update version name (#4751)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-27 10:50:28 +08:00
Wang Xiangyu
9c509534df
[skip ci] Update CODEOWNERS (#4753)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-27 10:50:04 +08:00
shengjun.li
cf11726712
Minor memory leak when building IVF_SQ8 on GPU (#4750)
* fix memory leak in knowhere UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix life cycle of variable in knowhere exception

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix memory leak when building ivf_sq8 index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-26 13:48:19 +00:00
shengjun.li
af54fd155b
(1) fix Status destructor (#4745)
(2) fix grpc-milvus URL
(3) fix hnsw uninitialized variable

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-26 12:26:02 +08:00
Wang Xiangyu
f5d7d917f7
update code owners (#4747)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-26 11:49:30 +08:00
BossZou
e0562101f5
Fix mishards probe test bug (#4744)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-02-25 19:15:23 +08:00
shengjun.li
0f7c0a8662
update version to 1.0.0-beta (#4737)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-25 02:04:01 +00:00
shengjun.li
10c8cd4e9f
Support logging to stdout (#4738)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-24 18:54:19 +08:00
Wang Xiangyu
3570650083
change codeowners (#4732)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-22 10:56:11 +08:00
op-hunter
9a5c15320a The GPU cache holds much more data than the configured value (#4720)
* The GPU cache holds much more data than the configured value

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and remove the useless variable G_BYTE and unit

Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 15:30:15 +08:00
shengjun.li
895ae9db88
Add an optional parameter 'nbtis' for IVF_PQ (#4709)
* Add an optional parameter 'nbtis' for IVF_PQ

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix test

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 07:29:25 +00:00
shengjun.li
09f0730f8d
Code Refactoring (#4702)
* remove useless code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Code Refactoring

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-09 09:25:15 +00:00
ThreadDao
97a5d9055e
Add cases for search with the dimension that isn't a power of 2 (#4703) 2021-02-09 10:52:40 +08:00
WangJian
3cd1b37278
[skip ci] change type of tps and qps from int64_t to double (#4705)
fix bug: QPS will be zero when TPS is less than 1 in sdk/examples/sdk_qps

Signed-off-by: WangJian <wangjian4500@gmail.com>
2021-02-09 10:25:04 +08:00
shengjun.li
c8dec9f02f
[skip ci] update change log (#4698)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-06 04:08:01 +00:00
shengjun.li
1211e9bac3
BinaryFlat support AVX2 (#4694)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-04 08:42:42 +00:00
shengjun.li
bbbf254b7c
Fix binaryflat (#4681)
* fix binary distance

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* improve the performance of BinaryFlat

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* avoid negative zero in Tanimoto

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 17:11:02 +08:00
yukun
3efbab1df5
make metrics label configurable (#4677)
* update to 0.10.6

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Configurable metric labels

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Roll back clienTest modify

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 10:45:36 +08:00
Wang Xiangyu
87c48faf4f
update CODEOWNERS (#4673)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 19:03:48 +08:00