admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,640 Commits 146 Branches 196 Tags
Commit Graph

1251 Commits

Author SHA1 Message Date
shengjun.li
623ae55ff5
Improve IVF query on GPU when no entity deleted (#5204) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-14 11:29:57 +08:00
shengjun.li
2e4aaff531
Remove daemonize code (#5181) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-13 09:19:06 +08:00
ophunter233
0ec2a6d33a
Enable gpu cache (#5161) 
* enable gpu cache

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-05-12 09:51:28 +08:00
yukun
fe55f5353f
[skip ci]Fix webserver readme (#5099) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-04-30 11:17:13 +08:00
shengjun.li
c19290b1ba
fix crash when creating a GPU IVF index (#5097) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-30 11:01:18 +08:00
groot
6a9990168a
Fix #5063 (#5071) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-28 10:00:48 +08:00
groot
5667d00344
Index type returned by get_collection_stats() is incorrect (#5052) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-26 14:17:57 +08:00
groot
3d3799967c
Failed to set timezone like "UTC + 5:30" (#5042) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-26 09:24:21 +08:00
ophunter233
5e5067f1ae
add validation of parameter nbits for IndexIVFPQ on Gpu version (#5011) 
* add validate of parameter nbits for IndexIVFPQ on Gpu version

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-04-23 17:31:49 +08:00
groot
6fb9a82974
Fix #5008 (#5009) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-23 17:19:50 +08:00
shengjun.li
3451fa642a
fix nlist adapter (#5000) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-23 11:33:01 +08:00
ophunter233
0ede2fcf1c
fix the wrong size of new operate (#4999) 
* fix the wrong size of new operate

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-04-22 20:21:19 +08:00
shengjun.li
26d84621aa
improve parallel (#4993) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-22 17:41:31 +08:00
groot
afb53bbb22
set version (#4967) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-20 17:32:45 +08:00
shengjun.li
4a7f9d8ab1
[skip ci] fix change log (#4962) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-20 15:58:55 +08:00
shengjun.li
121b7961f3
fix delete by id in wal (#4961) 
* fix delete by id in wal

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-19 18:40:57 +08:00
groot
0c5638ec1f
Add unit case for getvectorbyid (#4955) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-19 14:59:18 +08:00
shengjun.li
f65cd0b6ba
server config version is 0.5 (#4951) 
* server config version is 0.5

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] add config history

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-19 10:12:56 +08:00
groot
b46a27609a
change proto for new api (#4947) 
* modify proto for new api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Add new api in webserver

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add new api in sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* lint code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* implement release collection

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* update proto

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix a crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: fishpenguin <kun.yu@zilliz.com>
 2021-04-16 15:57:14 +08:00
shengjun.li
6d8441b186
not to load uids from disk if it is cached (#4946) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-16 10:21:04 +08:00
ophunter233
5d1df500f6
accelerate elkan_kmeans (#4937) 
Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-04-14 19:25:50 +08:00
groot
446af1c46a
Milvus waste time during building index for small segment (#4936) 
fix #4933

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-14 18:01:51 +08:00
shengjun.li
09dea5ab74
remove useless code (#4934) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-14 18:00:04 +08:00
groot
0cd3b3a05c
When an index created on the empty collection, the server will respond immediately (#4932) 
* fix #4838

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-14 16:34:30 +08:00
groot
7f290fb3b5
fix wrong results of merged different 'topk' queries (#4924) 
* fix #4797

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-13 17:30:59 +08:00
shengjun.li
b11e1949b6
improve ApplyDeletes (#4918) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-12 19:48:21 +08:00
shengjun.li
30766421f3
Improve the performance of get_vectors_by_id (#4913) 
* cache id bloom filter

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* improve getVectorsById

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-10 10:35:54 +08:00
groot
f31bf268a2
fix failure to open vector index in mishards (#4910) 
* fix #4778

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-09 15:28:51 +08:00
shengjun.li
ed9d54fcdd
GPU cache will be cleaned up in time after the collection is dropped (#4909) 
* To clean up GPU cache in time after the collection is dropped

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* remove IF getIndex

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-08 19:10:09 +08:00
shengjun.li
0b920304d2
Fix the capacity of bloom filter (#4895) 
* modify dablooms and ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify codecs

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-08 14:16:25 +08:00
groot
c20e0bfd4f
avoid read-only node merging data (#4900) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-06 15:29:22 +08:00
shengjun.li
2372053568
knowhere code refactoring (#4875) 
(1) remove row count check in knowhere
(2) add MatchNlist in BinIVF
(3) fix compile warnings caused by GETTENSOR

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-03-31 14:29:06 +08:00
shengjun.li
d9ca18b6ad
Fix the crash when query for a large topk on GPU Flat (#4866) 
* Fix the crash when query for a large topk on GPU Flat

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fill in the CHANGELOG.md

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-03-30 09:55:02 +08:00
shengjun.li
db6e250dd5
update HNSW (#4856) 
* update HNSW
(1) add license
(2) fix the wrong iterative node as v0.5.0
(3) add IF searchKnnCloserFirst as v0.5.0
(4) improve addPoint

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update workflows

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-03-26 13:16:31 +08:00
Ji Bin
c1fe9f6351
storage: enabling s3 storage support. (#4792) 
* storage: enabling s3 storage support.

- very raw idea for support s3 storage, not enabled by default.
- need enabling compiled(cmake) with MILVUS_WITH_AWS.
- simple integration tested with ceph/radowsgw.

Signed-off-by: Ji Bin <matrixji@live.com>

* storage: enabling s3, rebase and improvments

- Do not do CachePut in DefaultIdBloomFilterFormat::create, since bloom
fileter file may not synced with memory at that moment.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-03-12 11:45:09 +08:00
op-hunter
fa07bf5390
fix exception handling of the db meta (#4790) 
* fix definite memleak

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-03-09 09:59:26 +08:00
shengjun.li
8c57957e1b
remove wal entity (#4789) 
Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2021-03-08 17:52:36 +08:00
shengjun.li
b79bd07586
fix failure handling in SystemInfo (#4783) 
* fix memory leak in scheduler UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix fail in SystemInfo

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix Dockerfile

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-03-06 04:56:46 +00:00
BossZou
ecc6bcfc7f
Update oatpp third-party link (#4774) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2021-03-05 15:44:33 +08:00
shengjun.li
21ea92ec7e
fix memory leak (#4767) 
* fix memory leak
(1) Minor memory leak when querying on BinaryFlat
(2) Minor memory leak when building NSG index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix mismatch new[]/delete[]

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* rm useless folder

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix memory leak in UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-03-03 16:19:29 +08:00
shengjun.li
5ad002effa
fix minor memory leak when querying by IVF_SQ8H (#4758) 
* fix minor memory leak when querying by IVF_SQ8H

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix mismatch malloc/free new/delete

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-03-01 19:57:53 +08:00
Wang Xiangyu
ae24e756fb
Update version name (#4751) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-02-27 10:50:28 +08:00
shengjun.li
cf11726712
Minor memory leak when building IVF_SQ8 on GPU (#4750) 
* fix memory leak in knowhere UT

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix life cycle of variable in knowhere exception

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix memory leak when building ivf_sq8 index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-26 13:48:19 +00:00
shengjun.li
af54fd155b
(1) fix Status destructor (#4745) 
(2) fix grpc-milvus URL
(3) fix hnsw uninitialized variable

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-26 12:26:02 +08:00
shengjun.li
0f7c0a8662
update version to 1.0.0-beta (#4737) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-25 02:04:01 +00:00
shengjun.li
10c8cd4e9f
Support logging to stdout (#4738) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-24 18:54:19 +08:00
op-hunter
9a5c15320a The GPU cache holds much more data than the configured value (#4720) 
* The GPU cache holds much more data than the configured value

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and remove the useless variable G_BYTE and unit

Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-19 15:30:15 +08:00
shengjun.li
895ae9db88
Add an optional parameter 'nbtis' for IVF_PQ (#4709) 
* Add an optional parameter 'nbtis' for IVF_PQ

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix test

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-19 07:29:25 +00:00
shengjun.li
09f0730f8d
Code Refactoring (#4702) 
* remove useless code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Code Refactoring

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-09 09:25:15 +00:00
shengjun.li
1211e9bac3
BinaryFlat support AVX2 (#4694) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-02-04 08:42:42 +00:00