admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
19,923 Commits 137 Branches 188 Tags
Commit Graph

1482 Commits

Author SHA1 Message Date
Gao
7ef28927e6
fix: [2.4] fix binary vector data size (#33751) 
issue #22837 
pr: #33750

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-06-12 20:11:55 +08:00
zhagnlu
729001c3a8
fix: clean vector memory (#33692) (#33708) 
pr: #33692

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-07 18:17:53 +08:00
wei liu
a425a041a8
enhance: Remove unnecessary log info during load segment (#33663) (#33670) 
pr: #33663

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-06 17:11:50 +08:00
foxspy
beaa94f170
enhance: [2.4] support sparse cardinal hnsw index (#33662) 
issue: https://github.com/milvus-io/milvus/issues/29419
pr: https://github.com/milvus-io/milvus/pull/33656

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
Co-authored-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-06-06 14:47:54 +08:00
Buqian Zheng
0ecdd5a59c
enhance: [2.4] Improve GetVectorById of Sparse Float Vector (#33652) 
issue: https://github.com/milvus-io/milvus/issues/29419
pr: #33209 

codecov will fail due to newly added ut in test_sealed.cpp skipped due
to https://github.com/milvus-io/milvus/issues/33210

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-06-06 13:55:51 +08:00
congqixia
084140b093
enhance: [2.4] Make hasMoreResult accurate when hit number larger than limit(#33609) (#33642) 
Cherry-pick from master
pr: #33609

See also milvus-io/milvus-sdk-go#756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-06 11:45:51 +08:00
foxspy
58a7111599
enhance: [cherry-pick] add autoindex mapping for binary/sparse datatype (#33625) 
issue: #22837 
pr: #33624

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-06-06 10:33:52 +08:00
cqy123456
443197bdfc
enhance: [cherry-pick]disk index support binary_vector (#33575) 
issue:https://github.com/milvus-io/milvus/issues/22837
related https://github.com/milvus-io/milvus/pull/33631

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-05 19:37:57 +08:00
zhagnlu
f94a72252c
enhance: optimize some cache to reduce memory usage (#33560) 
pr: https://github.com/milvus-io/milvus/pull/33534
pr: #33599

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-05 19:21:52 +08:00
Chun Han
627b787aed
fix: query iterator lack results(#33137) (#33422) (#33506) 
related: #33137 
pr: https://github.com/milvus-io/milvus/pull/33422

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-06-05 18:51:52 +08:00
Gao
b32c14f96b
fix: [2.4] correct get vector data size for bf16/fp16/binary vector (#33488) 
issue: #22837 
pr: #33377

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-06-05 14:31:57 +08:00
yihao.dai
3a037884ac
fix: Fix exception info is missing (#33393) (#33396) 
Replace based std::exception to prevent "object slicing"

issue: https://github.com/milvus-io/milvus/issues/33392

pr: https://github.com/milvus-io/milvus/pull/33393

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-04 15:15:48 +08:00
Buqian Zheng
38e5e33196
enhance: [2.4] update knowhere version (#33491) 
issue: https://github.com/milvus-io/milvus/issues/33489
pr: #33490
update knowhere version to latest. remove usage of seed_ef as it be
replaced by existing ef.

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-05-31 10:17:50 +08:00
Alexander Guzhva
713c9ce4c7
fix: [Cherry-pick][2.4] make milvus compilable using gcc-13 (#33441) 
issue: https://github.com/milvus-io/milvus/issues/30190
pr: https://github.com/milvus-io/milvus/pull/30149

add a missing header

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
 2024-05-29 16:19:45 +08:00
Alexander Guzhva
5a668a17a9
enhance: [Cherry-pick][2.4] Upgrade bitset for ARM SVE (#33440) 
issue: https://github.com/milvus-io/milvus/issues/32826
pr: https://github.com/milvus-io/milvus/pull/32718
improve ARM SVE performance for internal/core/src/bitset

Baseline timings for gcc 11.4 + Graviton 3 + manually enabled SVE:
https://gist.github.com/alexanderguzhva/a974b50134c8bb9255fb15f144e5ac83

Candidate timings for gcc 11.4 + Graviton 3 + manually enabled SVE:
https://gist.github.com/alexanderguzhva/19fc88f4ad3757e05e0f7feaf563b3d3

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
 2024-05-29 16:17:51 +08:00
cai.zhang
ef10d15658
fix: [2.4]Throw an exception after all the threads in thread pool finished (#32810) (#33314) 
issue: #32487
master pr: #32810

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-05-23 17:55:40 +08:00
Buqian Zheng
ec33024637
fix: [2.4] in segcore validate search sparse vector to make sure it is legal (#33312) 
pr: #32856

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-05-23 17:35:40 +08:00
foxspy
2b62324d7b
enhance: Update Knowhere version (#33310) 
/kind branch-feature

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-05-23 16:53:40 +08:00
congqixia
3c31499bbc
enhance: [2.4]Assert insert data length not overflow int (#33248) (#33271) 
Cherry-pick from master
pr: #33248 
When InsertData is too large for cpp proto unmarshalling, the error
message is confusing since the length is overflowed

This PR adds assertion for insert data length.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-05-22 19:07:40 +08:00
Gao
3777eb2f68
enhance: update knowhere new version (#33043) 
for milvus new release, knowhere update to latest release version

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-05-14 20:45:32 +08:00
sre-ci-robot
09cca1fb51
[automated] Update Knowhere Commit (#33030) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-05-14 01:47:32 +08:00
foxspy
f6777267e3
enhance: add score compute consistency config for knowhere (#32997) 
issue: https://github.com/milvus-io/milvus/issues/32583
related: #32584

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-05-13 14:21:31 +08:00
Gao
f7d29118a5
enhance: update knowhere version (#32931) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-05-10 16:13:31 +08:00
Buqian Zheng
bb7765cbd6
fix: fix Indexing.Iterator ut: build index with all data at once (#32844) 
issue: #32843

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-05-10 11:31:30 +08:00
aoiasd
54a51b1236
enhance: Support dynamic config for opentelemetry trace (#32169) 
relate: https://github.com/milvus-io/milvus/issues/31940

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-05-09 17:43:30 +08:00
sre-ci-robot
3d78b90fe7
[automated] Update Knowhere Commit (#32872) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-05-09 01:57:30 +08:00
Jiquan Long
035a508722
fix: make sure inverted index has only one segment (#32858) 
issue: #32717

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-05-08 21:25:30 +08:00
Chun Han
01c2684355
enhance: [skip e2e] disable unstable ut temporarily (#32836) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-05-08 12:17:29 +08:00
Jiquan Long
9837ad6a8d
enhance: remove deprecated api (#32808) 
issue: #32728

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-05-07 20:03:30 +08:00
Jiquan Long
1f58cda957
enhance: add more trace for search & query (#32734) 
issue: https://github.com/milvus-io/milvus/issues/32728

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-05-07 13:03:29 +08:00
Bingyi Sun
fecd9c21ba
feat: LRU cache implementation (#32567) 
issue: https://github.com/milvus-io/milvus/issues/32783
This pr is the implementation of lru cache on branch lru-dev.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
Co-authored-by: chyezh <chyezh@outlook.com>
Co-authored-by: MrPresent-Han <chun.han@zilliz.com>
Co-authored-by: Ted Xu <ted.xu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: wayblink <anyang.wang@zilliz.com>
 2024-05-06 20:29:30 +08:00
liliu-z
a43baa0323
enhance: Upgrade knowhere to 2.3.1 (#32699) 
/kind improvement

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2024-04-29 17:21:26 +08:00
PowderLi
6289f3a9eb
fix: build milvus in rockylinux8 (#32619) 
issue: #32299

1. xz utils recovers
2. forget to install ninja

Signed-off-by: PowderLi <min.li@zilliz.com>
 2024-04-29 14:53:26 +08:00
Buqian Zheng
858599d831
enhance: sparse float vector to support brute force iterator and range search (#32635) 
issue: #29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-04-29 14:35:26 +08:00
presburger
cb1dbf20c7
enhance:remove openblas from conan (#32002) 
issue: #30683

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-04-28 20:13:25 +08:00
smellthemoon
46d7298407
fix: file not find test_parquet.cpp (#32644) 
#32646

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-04-26 16:57:27 +08:00
smellthemoon
4fb8044a27
enhance: delete some no lint code (#32182) 
#31728

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-04-26 14:15:26 +08:00
Jiquan Long
ccce1e928a
fix: regex query can't handle text with newline (#32569) 
issue: https://github.com/milvus-io/milvus/issues/32482

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-04-26 12:01:26 +08:00
Jiquan Long
c002745902
enhance: retrieve output fields after local reduce (#32346) 
issue: #31822

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-04-25 09:49:26 +08:00
sre-ci-robot
b703d6cdbe
[automated] Update Knowhere Commit (#32586) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-25 02:27:24 +08:00
PowderLi
29922829da
fix: [restful v2] parameters of create collection (#32485) 
issue: #31176

Signed-off-by: PowderLi <min.li@zilliz.com>
 2024-04-24 09:43:29 +08:00
sre-ci-robot
15558112c5
[automated] Update Knowhere Commit (#32516) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-23 01:33:23 +08:00
Gao
0fab265eed
enhance: update knowhere and some header changes (#32468) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-04-22 15:47:26 +08:00
zhagnlu
93f0c262c1
fix: add bitset sve support macro protect (#32463) 
#32137

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-04-19 18:05:21 +08:00
presburger
e2541f04eb
fix: crash on arm64 (#31951) (#31980) 
issue: #31953

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-04-17 18:03:20 +08:00
zhagnlu
9248a6a149
fix: remove sve flags (#32270) 
#32129

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-04-16 15:21:19 +08:00
chyezh
e19d17076f
fix: delete may lost when enable lru cache, some field should be reset when ReleaseData (#32012) 
issue: #30361

- Delete may be lost when segment is not data-loaded status in lru
cache. skip filtering to fix it.

- `stats_` and `variable_fields_avg_size_` should be reset when
`ReleaseData`

- Remove repeat load delta log operation in lru.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-04-16 11:17:20 +08:00
wei liu
0d849a6c0a
fix: fix collectionInfo leak in datacoord (#32175) 
issue: #32029

lack of logic to clean collection info in datacoord's meta, This PR
clean collection info after drop channel, to avoid collection info leak
in datacoord

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-04-15 16:33:19 +08:00
Chun Han
337cc0756d
fix: lack good results for insufficient ef(#29883) (#32080) 
related: #29883

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-04-13 22:13:23 +08:00
Jiquan Long
4fb85be525
fix: put inverted index into local storage (#32209) 
issue: https://github.com/milvus-io/milvus/issues/32154

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-04-13 21:57:19 +08:00