groot
f31bf268a2
fix failure to open vector index in mishards ( #4910 )
...
* fix #4778
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-09 15:28:51 +08:00
shengjun.li
ed9d54fcdd
GPU cache will be cleaned up in time after the collection is dropped ( #4909 )
...
* To clean up GPU cache in time after the collection is dropped
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* remove IF getIndex
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-08 19:10:09 +08:00
shengjun.li
0b920304d2
Fix the capacity of bloom filter ( #4895 )
...
* modify dablooms and ut
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* modify codecs
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-08 14:16:25 +08:00
groot
c20e0bfd4f
avoid read-only node merging data ( #4900 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-04-06 15:29:22 +08:00
shengjun.li
2372053568
knowhere code refactoring ( #4875 )
...
(1) remove row count check in knowhere
(2) add MatchNlist in BinIVF
(3) fix compile warnings caused by GETTENSOR
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-31 14:29:06 +08:00
shengjun.li
d9ca18b6ad
Fix the crash when query for a large topk on GPU Flat ( #4866 )
...
* Fix the crash when query for a large topk on GPU Flat
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fill in the CHANGELOG.md
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-30 09:55:02 +08:00
shengjun.li
db6e250dd5
update HNSW ( #4856 )
...
* update HNSW
(1) add license
(2) fix the wrong iterative node as v0.5.0
(3) add IF searchKnnCloserFirst as v0.5.0
(4) improve addPoint
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* update workflows
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-26 13:16:31 +08:00
BossZou
1c4570caa9
Add mishards comments ( #4834 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-03-23 11:05:20 +08:00
Ji Bin
c1fe9f6351
storage: enabling s3 storage support. ( #4792 )
...
* storage: enabling s3 storage support.
- very raw idea for support s3 storage, not enabled by default.
- need enabling compiled(cmake) with MILVUS_WITH_AWS.
- simple integration tested with ceph/radowsgw.
Signed-off-by: Ji Bin <matrixji@live.com>
* storage: enabling s3, rebase and improvments
- Do not do CachePut in DefaultIdBloomFilterFormat::create, since bloom
fileter file may not synced with memory at that moment.
Signed-off-by: Ji Bin <matrixji@live.com>
2021-03-12 11:45:09 +08:00
op-hunter
fa07bf5390
fix exception handling of the db meta ( #4790 )
...
* fix definite memleak
Signed-off-by: cmli <chengming.li@zilliz.com>
2021-03-09 09:59:26 +08:00
shengjun.li
8c57957e1b
remove wal entity ( #4789 )
...
Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2021-03-08 17:52:36 +08:00
BossZou
781b17262f
[skip ci] Shards v1.0.0 ( #4784 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-03-08 09:57:28 +08:00
shengjun.li
b79bd07586
fix failure handling in SystemInfo ( #4783 )
...
* fix memory leak in scheduler UT
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix fail in SystemInfo
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix Dockerfile
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-06 04:56:46 +00:00
BossZou
ecc6bcfc7f
Update oatpp third-party link ( #4774 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-03-05 15:44:33 +08:00
shengjun.li
21ea92ec7e
fix memory leak ( #4767 )
...
* fix memory leak
(1) Minor memory leak when querying on BinaryFlat
(2) Minor memory leak when building NSG index
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix mismatch new[]/delete[]
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* rm useless folder
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix memory leak in UT
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
v1.0.0
2021-03-03 16:19:29 +08:00
shengjun.li
c29d1d9aa3
[skip ci] CI nightly open ( #4768 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-03 14:52:50 +08:00
shengjun.li
5ad002effa
fix minor memory leak when querying by IVF_SQ8H ( #4758 )
...
* fix minor memory leak when querying by IVF_SQ8H
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix mismatch malloc/free new/delete
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-01 19:57:53 +08:00
shengjun.li
dbdf120b7b
[skip ci] add issue 4754 changlog ( #4755 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-27 11:39:03 +08:00
Wang Xiangyu
ae24e756fb
Update version name ( #4751 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-27 10:50:28 +08:00
Wang Xiangyu
9c509534df
[skip ci] Update CODEOWNERS ( #4753 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-27 10:50:04 +08:00
shengjun.li
cf11726712
Minor memory leak when building IVF_SQ8 on GPU ( #4750 )
...
* fix memory leak in knowhere UT
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix life cycle of variable in knowhere exception
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix memory leak when building ivf_sq8 index
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-26 13:48:19 +00:00
shengjun.li
af54fd155b
(1) fix Status destructor ( #4745 )
...
(2) fix grpc-milvus URL
(3) fix hnsw uninitialized variable
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-26 12:26:02 +08:00
Wang Xiangyu
f5d7d917f7
update code owners ( #4747 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-26 11:49:30 +08:00
BossZou
e0562101f5
Fix mishards probe test bug ( #4744 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-02-25 19:15:23 +08:00
shengjun.li
0f7c0a8662
update version to 1.0.0-beta ( #4737 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-25 02:04:01 +00:00
shengjun.li
10c8cd4e9f
Support logging to stdout ( #4738 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-24 18:54:19 +08:00
Wang Xiangyu
3570650083
change codeowners ( #4732 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-22 10:56:11 +08:00
op-hunter
9a5c15320a
The GPU cache holds much more data than the configured value ( #4720 )
...
* The GPU cache holds much more data than the configured value
Signed-off-by: cmli <chengming.li@zilliz.com>
* update changelog and remove the useless variable G_BYTE and unit
Signed-off-by: cmli <chengming.li@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 15:30:15 +08:00
shengjun.li
895ae9db88
Add an optional parameter 'nbtis' for IVF_PQ ( #4709 )
...
* Add an optional parameter 'nbtis' for IVF_PQ
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix test
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 07:29:25 +00:00
shengjun.li
09f0730f8d
Code Refactoring ( #4702 )
...
* remove useless code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Code Refactoring
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix ut
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-09 09:25:15 +00:00
ThreadDao
97a5d9055e
Add cases for search with the dimension that isn't a power of 2 ( #4703 )
2021-02-09 10:52:40 +08:00
WangJian
3cd1b37278
[skip ci] change type of tps and qps from int64_t to double ( #4705 )
...
fix bug: QPS will be zero when TPS is less than 1 in sdk/examples/sdk_qps
Signed-off-by: WangJian <wangjian4500@gmail.com>
2021-02-09 10:25:04 +08:00
shengjun.li
c8dec9f02f
[skip ci] update change log ( #4698 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-06 04:08:01 +00:00
shengjun.li
1211e9bac3
BinaryFlat support AVX2 ( #4694 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-04 08:42:42 +00:00
shengjun.li
bbbf254b7c
Fix binaryflat ( #4681 )
...
* fix binary distance
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* improve the performance of BinaryFlat
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* avoid negative zero in Tanimoto
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 17:11:02 +08:00
yukun
3efbab1df5
make metrics label configurable ( #4677 )
...
* update to 0.10.6
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Configurable metric labels
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Roll back clienTest modify
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 10:45:36 +08:00
Wang Xiangyu
87c48faf4f
update CODEOWNERS ( #4673 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 19:03:48 +08:00
Wang Xiangyu
b9ae598377
[skip ci] Update mergify ( #4657 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-25 15:29:43 +08:00
ireneontheway5
84a44b2f56
[skip ci] Fix the dead link in README.md. ( #4651 )
...
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2021-01-25 15:27:23 +08:00
shengjun.li
893e8bb020
update .github ( #4653 )
...
* Update PULL_REQUEST_TEMPLATE.md (#2639 )
Signed-off-by: jinhai <hai.jin@zilliz.com>
* optimize config code (#2996 )
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update pull request template
Signed-off-by: wxyu <xy.wang@zilliz.com>
* [skip ci] update pull request template (#3008 )
Signed-off-by: wxyu <xy.wang@zilliz.com>
* [skip ci] Update PR template
Signed-off-by: jinhai <hai.jin@zilliz.com>
* update PULL_REQUEST_TEMPLATE.md
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci] Update ISSUE template
Signed-off-by: jinhai <hai.jin@zilliz.com>
* [skip ci]fix template doc (#3268 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci]update issue template (#3379 )
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
* [skip ci]remove cherry-pick section in PULL REQUEST TEMPLATE (#3571 )
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
* [skip ci] add enhancement issue template (#3585 )
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2021-01-23 11:06:42 +08:00
shengjun.li
f942f0b823
fix errors in .mds ( #4644 )
...
* Updated logo and architecture links. (#2529 )
Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>
* Fixed broken links. (#2902 )
Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>
* Minor editorial updates. (#2946 )
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
* fix cuda version requirement (#2909 )
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* [skip ci] Updated INSTALL.md. (#3016 )
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
* [skip ci] Fixed broken links. (#3304 )
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
* [skip ci] update install from code (#3855 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci] update cmake version (#4084 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci] Update the foundation name. (#4438 )
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Added a space for readability (#4465 )
Added a space between the heart emoji and the word for better readability.
Signed-off-by: Mark Berger <maberger0811@gmail.com>
* [skip ci] Update links and fix dead links. (#4496 )
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] fix errors in mds
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: PahudPlus <64403786+PahudPlus@users.noreply.github.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: AmyYH <68527082+AmyYH@users.noreply.github.com>
Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
Co-authored-by: ireneontheway5 <75291211+ireneontheway5@users.noreply.github.com>
Co-authored-by: Mark Berger <maberger0811@gmail.com>
2021-01-22 19:16:40 +08:00
Starlord
19cd3d8f7c
fix: shards/requirements.txt to reduce vulnerabilities ( #4647 )
...
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-RSA-570831
- https://snyk.io/vuln/SNYK-PYTHON-SQLALCHEMY-590109
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-1014645
Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2021-01-22 15:42:03 +08:00
Starlord
57efa7640a
fix: tests/milvus_python_test/requirements_no_pymilvus.txt to reduce vulnerabilities ( #4641 )
...
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PY-1049546
Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2021-01-22 15:40:39 +08:00
yukun
f709349cc8
[skip ci]Fix restful api doc for loadcollection ( #4627 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-01-19 19:05:52 +08:00
BossZou
4175ac1f22
[skip ci] mishards upgrade for milvus 0.10.5 ( #4581 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
v0.10.5
2021-01-06 08:49:22 +00:00
BossZou
4eda95e63b
[skip ci] fix mishards error when invoking load_collection ( #4569 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-01-05 09:43:50 +00:00
BossZou
9088b2c711
Fix shards mismatch pod name ( #4565 )
...
* skip pod if name mismatch
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* [skip ci] update changlog
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* [skip ci] fix variable name typo
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-01-05 03:12:36 +00:00
groot
810f5e6f70
fix random crash for scheduler task ( #4563 )
...
* fix random crash for scheduler task
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix unittest crash
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-01-04 13:12:05 +00:00
BossZou
ec0291a08d
[skip ci] complete k8s provider deleting pod logic ( #4553 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-31 03:39:49 +00:00
ThreadDao
e0d33e5546
[skip ci] add case for load partition and fix connect case and update concurrent search ( #4535 )
2020-12-29 15:31:19 +08:00