admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-03 09:22:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,969 Commits 138 Branches 188 Tags
Commit Graph

21969 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Zhen Ye
96a010da7a
fix: msgstream adaptor may not gc quickly after comsumed (#40555) 
issue: #40540

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-12 14:00:04 +08:00
Spade A
95e2680a36
fix: ref collection for search/query (#40549) 
ref https://github.com/milvus-io/milvus/issues/40473

Collection is got without ref which means the collection could be
releases and the struct could be freed during the search which leads
schema inconsistency.

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-12 11:30:07 +08:00
Bingyi Sun
0698d04f7d
enhance: Upgrade simdjson version (#40538) 
issue: https://github.com/milvus-io/milvus/issues/40519
simdjson returns better error code in newer version.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-11 15:04:05 +08:00
cai.zhang
e5f50076ec
enhance: Only check element type with not null array (#40446) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-11 14:58:07 +08:00
yihao.dai
a33c9372ce
fix: Fix channel not balance on datanodes (#40422) 
1. Prevent channels from being assigned to only one datanode during
datacoord startup.
2. Optimize the channel assignment policy by considering newly assigned
channels.
3. Make msgdispatcher manager lock-free.

issue: https://github.com/milvus-io/milvus/issues/40421,
https://github.com/milvus-io/milvus/issues/37630

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-11 14:56:16 +08:00
Bingyi Sun
a729bb84ba
enhance: add json path escape and replace $meta with dynamic field name (#40407) 
issue: #35528

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-11 14:00:05 +08:00
Zhen Ye
d9fe8f0dcf
fix: [skip e2e] wab unittest may failure (#40470) 
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-11 11:34:06 +08:00
congqixia
3899b0f0d4
fix: Add duplicated type/index params check creating collection (#40462) 
Related to #40461

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-11 10:14:11 +08:00
aoiasd
3afc3a83ff
fix: rocksmq consumer register not concurrent safe (#39387) 
relate: https://github.com/milvus-io/milvus/issues/39336

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-11 00:56:04 +08:00
junjiejiangjjj
359e7efd8e
feat: Add function running monitoring (#40358) 
#35856 
#40004 
1. Optimize model verification logic
2. Add profiling code

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-03-10 22:28:05 +08:00
Bingyi Sun
0a7e692b6f
fix: Fix null offset loading in inverted index (#40523) 
issue: #40516

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-10 22:12:04 +08:00
sparknack
3f2f57c67f
fix: add collection flush before sparse searching in pytest (#40522) 
issue: #40501

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
 2025-03-10 22:10:05 +08:00
Cai Yudong
2bd2cca04a
enhance: Truly support multi vector data types in SearchBruteForce (#40499) 
Issue: #38666

Signed-off-by: CaiYudong <yudong.cai@zilliz.com>
 2025-03-10 18:36:03 +08:00
yihao.dai
2ca2e2dbc8
fix: Fix parsing import endTs (#40332) 
Parsing import beginTs, endTs as a hybrid timestamp.

issue: https://github.com/milvus-io/milvus/issues/40326

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-10 17:38:04 +08:00
XuanYang-cn
e6c46a25ea
enhance: Use correct counter metrics for overall wa calculation (#40394) 
- Use CounterVec to calculate sum of increase during a time period.
- Use entries number instead of binlog size

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-10 16:34:06 +08:00
congqixia
391804c7fb
enhance: Add channel seal policy based on blocking l0 (#40505) 
Related to #40502

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-10 16:28:04 +08:00
foxspy
2eaf997dce
enhance: Automatically Close Knowhere Automated PRs (#40498) 
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-03-10 15:01:05 +08:00
XuanYang-cn
6f70e6d1e1
enhance: Log start position of delete msgs (#40315) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-10 14:58:05 +08:00
binbin
345538d10a
test: Add test cases for part of json path index (#40445) 
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2025-03-10 14:30:07 +08:00
sre-ci-robot
cadf0e5a6d
[automated][skip e2e] Bump milvus version to v2.5.6 (#40495) 
Bump milvus version to v2.5.6
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-10 12:52:06 +08:00
sre-ci-robot
a6d4121034
[automated] Update Knowhere Commit (#40486) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-10 12:28:04 +08:00
XuanYang-cn
4bebca6416
enhance: Replace currRows with NumOfRows (#40074) 
See also: #40068

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-10 12:16:03 +08:00
Xiaofan
1c9d43ee9f
fix: rockmq race condition (#40482) 
fix #40481

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-10 10:54:04 +08:00
cai.zhang
d6a650bd14
fix: Skip executing stats for zero segment (#40448) 
issue: #40241

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-09 21:14:02 +08:00
smellthemoon
faae8ee518
fix: store wrong offset when build tantivy in nullable field (#40452) 
#40454

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2025-03-09 09:34:04 +08:00
sre-ci-robot
2c287dfd10 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2025-03-09 00:01:58 +00:00
Xiaofan
73bda08ec9
doc: json storage format (#40479) 
the design doc for the json storage improvemnet

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-08 09:48:02 +08:00
congqixia
c348e61bdb
fix: [GoSDK] move metaheader to client in case of race (#40443) 
See failure run in #40352

This PR:
- move metaheader map to client struct from config
- set default value for field schema

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-07 17:06:02 +08:00
congqixia
a56b24054f
enhance: [GoSDK] Support alter/drop index properties (#40417) 
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-06 21:40:04 +08:00
shaoyue
2cd03a20d4
enhance: [skip e2e] upgrade go toolchain to 1.22.7, remove unnecessary binary (#40398) 
part of: #40370

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
 2025-03-06 21:34:04 +08:00
Bingyi Sun
37b118d55d
fix: Skip loading primary key if index has raw data (#39921) 
issue: https://github.com/milvus-io/milvus/issues/39907

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-06 17:46:02 +08:00
congqixia
7fbeb5624e
enhance: Avoid convert body byte slice to string in httpserver (#40405) 
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-06 16:28:02 +08:00
congqixia
5c5273f95e
fix: Pass Knapsnak ptr to avoid compact multiple times (#40400) 
Related to #40388

The small segments may be put into bucket twice due to value parameter
of Knapsnap.packWith

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-06 15:42:03 +08:00
nico
80213c0f6f
test: update teardown collection after rename (#40379) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-03-06 10:36:09 +08:00
nico
ed61abb391
test: update test cases (#40371) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-03-06 10:34:14 +08:00
congqixia
16bc2e8087
enhance: [GoSDK] support update ts caching policy (#40381) 
Related to #39093

This PR add update timestamp check and retry policy according to the
design of the related issue

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-05 21:36:08 +08:00
congqixia
5b0881c93d
enhance: [GoSDK] Add DescribeReplica API & sync rbac v2 (#40373) 
Related to #31293 #37031

This PR:
- Add DescribeReplica API
- Add unified RBAC v2 API names(AddPrivilegesToGroup,
RemovePrivilegesFromGroup, GrantPrivilegeV2, RevokePrivilegeV2)
- Mark old ones deprecated

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-05 21:34:11 +08:00
sthuang
e0ec1aceeb
fix: skip storage v2 unstable ut for now (#40378) 
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-03-05 20:30:39 +08:00
congqixia
fde80bc8b7
enhance: Remove debug log in rg handler v2 (#40376) 
Remove debug log in resource group handler

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-05 19:18:00 +08:00
Spade A
3db56560fb
fix: fix concurrent issues in null offset (#40363) 
issue: #40308
This issue fixes these two concurrent issues:
1. element in null_offset is used to set bitset where the size of bitset
is initialized by tantivy document count. However, there may still be
some documents that are not committed in tantivy but are null in
null_offset. So array out of range occurs.
2. null_offset can be read and write concurrently but there's no
synchronization protection.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-05 17:48:00 +08:00
Ted Xu
878ce56079
fix: correct memory size estimation on arrays (#40312) 
See: #40342

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2025-03-05 16:54:09 +08:00
Zhen Ye
1637cf5664
enhance: better logging for grpc resolver (#40337) 
issue: #40311

- better logging for grpc resolver
- remove the redundant streaming node manage client when streaming
service is disable

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-05 15:12:01 +08:00
Ted Xu
96952ad3c5
fix: compaction task cannot be genereted if size greater than max size (#40348) 
See: #40343

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-05 14:40:01 +08:00
yihao.dai
004a1875dc
enhance: Introduce batch subscription in msgdispatcher (#39863) 
Introduce a batch subscription mechanism in msgdispatcher: the
msgdispatcher now includes a vchannel watch task queue, where all
vchannels in the queue will subscribe to the MQ only once and pull
messages from the oldest vchannel checkpoint to the latest.

issue: https://github.com/milvus-io/milvus/issues/39862

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-05 14:38:02 +08:00
Bingyi Sun
be4d09561b
fix: Fix missing null or non-exist key in json index (#40336) 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-05 11:48:02 +08:00
sthuang
63a7c4570e
feat: storage v2 sync (#39663) 
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-03-05 11:22:15 +08:00
SimFG
a3755cf409
fix: improve error handling and unit tests for InitMetaCache function (#40322) 
- issue: #40320

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-05 11:08:13 +08:00
yanliang567
4437dae479
test: Add search iterator with external filter func neg tests (#40303) 
related issue: https://github.com/milvus-io/milvus/issues/39985

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-03-05 10:58:00 +08:00
junjiejiangjjj
b2e630b1a1
feat: Support TEI serving and support int8 embedding (#40199) 
#35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-03-05 10:18:00 +08:00
sthuang
a6396ddda5
enhance: storage v2 clang format version 12 (#40287) 
change storage v2 clang-format version from 14 to 12 to match with
Milvus.
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-03-04 21:52:40 +08:00