admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-06 10:52:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,985 Commits 137 Branches 188 Tags
Commit Graph

21985 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Spade A
f36d1562bd
enhance: add metrics for random sample (#40634) 
issue: #39541

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-13 21:42:11 +08:00
yihao.dai
bab30a41bf
enhance: Improve import error msgs (#40567) 
issue: https://github.com/milvus-io/milvus/issues/40208

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-13 21:02:07 +08:00
Xiaofan
7210fc9780
feature: add a prefix on environment config (#40623) 
fix #40622

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-13 16:44:07 +08:00
Zhen Ye
f6fb4bc442
fix: backoff will retry infinitely after reaching max elapse (#40589) 
issue: #40588

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-13 16:24:06 +08:00
congqixia
e93d53ca28
doc: Add README for go milvusclient (#40630) 
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-13 16:02:07 +08:00
ThreadDao
aaf8ddcec6
test: add cases for go client rbac APIs (#40352) 
issue: #33419
- add cases for go client rbac APIs
- add dbName params for grant/revoke v1 & v2 api
- add dbName in GrantItem

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-03-13 14:28:08 +08:00
yihao.dai
b2a8694686
enhance: Merge IndexNode and DataNode (#40272) 
Merge DataNode and IndexNode into DataNode.

issue: https://github.com/milvus-io/milvus/issues/39115

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-13 14:26:11 +08:00
Ted Xu
df4285c9ef
enhance: API integration with storage v2 in clustering-compactions (#40133) 
See #39173

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2025-03-13 14:12:06 +08:00
wei liu
972e47043a
enhance: Remove CPU profile to prevent blocking stop progress (#40460) 
issue: #39735
related to #39726

- Removed CPU profile dump from util.go's pprof collection
- Avoid potential blocking in StopCPUProfile() during shutdown
- Maintain goroutine/heap/block/mutex profiles for diagnostics
- Ensure safe shutdown timeout handling without profile stalls

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-03-13 10:00:09 +08:00
Zhen Ye
5735c3ef19
fix: too many memory usage of streaming node (#40606) 
issue: #40592

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-13 07:10:07 +08:00
Xiaofan
fb48b3c7ac
fix: empty sparse row in importer (#40585) 
fix #40584

parquet bulk writer can not finish 0 dim sparse vector.

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-13 01:29:41 +08:00
Spade A
9f3bd55755
fix: avoid panic when field not exists in schema in query node (#40541) 
ref #40473

This PR is a workaround to avoid the panic described in the issue.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-12 22:44:08 +08:00
jaime
c8a96377bb
enhance: move object storage client creation to pkg package (#40440) 
issue: #40439

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2025-03-12 20:38:07 +08:00
yihao.dai
27c7cbbc72
fix: Fix QueryNodeNumEntities metric (#40602) 
fix QueryNodeNumEntities metric introduced by pr
https://github.com/milvus-io/milvus/pull/39536

issue: https://github.com/milvus-io/milvus/issues/38162

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-12 19:08:05 +08:00
wei liu
0420dc1eb1
fix: use correct delete checkpoint to prevent premature data cleanup (#40366) 
issue: #40292
related to #39552

- Fix incorrect delete checkpoint usage in SyncDistribution
- Change checkpoint parameter from action.GetCheckpoint() to
action.GetDeleteCP() in SyncTargetVersion call
- This resolves the issue where delete buffer data was being cleaned
prematurely due to wrong checkpoint reference

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-03-12 15:00:08 +08:00
sthuang
c0e03b6ca4
fix: rbac star privilege return empty when listing policy (#40553) 
related: https://github.com/milvus-io/milvus/issues/40547

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-03-12 14:16:05 +08:00
Zhen Ye
96a010da7a
fix: msgstream adaptor may not gc quickly after comsumed (#40555) 
issue: #40540

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-12 14:00:04 +08:00
Spade A
95e2680a36
fix: ref collection for search/query (#40549) 
ref https://github.com/milvus-io/milvus/issues/40473

Collection is got without ref which means the collection could be
releases and the struct could be freed during the search which leads
schema inconsistency.

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-12 11:30:07 +08:00
Bingyi Sun
0698d04f7d
enhance: Upgrade simdjson version (#40538) 
issue: https://github.com/milvus-io/milvus/issues/40519
simdjson returns better error code in newer version.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-11 15:04:05 +08:00
cai.zhang
e5f50076ec
enhance: Only check element type with not null array (#40446) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-11 14:58:07 +08:00
yihao.dai
a33c9372ce
fix: Fix channel not balance on datanodes (#40422) 
1. Prevent channels from being assigned to only one datanode during
datacoord startup.
2. Optimize the channel assignment policy by considering newly assigned
channels.
3. Make msgdispatcher manager lock-free.

issue: https://github.com/milvus-io/milvus/issues/40421,
https://github.com/milvus-io/milvus/issues/37630

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-11 14:56:16 +08:00
Bingyi Sun
a729bb84ba
enhance: add json path escape and replace $meta with dynamic field name (#40407) 
issue: #35528

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-11 14:00:05 +08:00
Zhen Ye
d9fe8f0dcf
fix: [skip e2e] wab unittest may failure (#40470) 
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-11 11:34:06 +08:00
congqixia
3899b0f0d4
fix: Add duplicated type/index params check creating collection (#40462) 
Related to #40461

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-11 10:14:11 +08:00
aoiasd
3afc3a83ff
fix: rocksmq consumer register not concurrent safe (#39387) 
relate: https://github.com/milvus-io/milvus/issues/39336

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-11 00:56:04 +08:00
junjiejiangjjj
359e7efd8e
feat: Add function running monitoring (#40358) 
#35856 
#40004 
1. Optimize model verification logic
2. Add profiling code

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-03-10 22:28:05 +08:00
Bingyi Sun
0a7e692b6f
fix: Fix null offset loading in inverted index (#40523) 
issue: #40516

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-10 22:12:04 +08:00
sparknack
3f2f57c67f
fix: add collection flush before sparse searching in pytest (#40522) 
issue: #40501

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
 2025-03-10 22:10:05 +08:00
Cai Yudong
2bd2cca04a
enhance: Truly support multi vector data types in SearchBruteForce (#40499) 
Issue: #38666

Signed-off-by: CaiYudong <yudong.cai@zilliz.com>
 2025-03-10 18:36:03 +08:00
yihao.dai
2ca2e2dbc8
fix: Fix parsing import endTs (#40332) 
Parsing import beginTs, endTs as a hybrid timestamp.

issue: https://github.com/milvus-io/milvus/issues/40326

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-10 17:38:04 +08:00
XuanYang-cn
e6c46a25ea
enhance: Use correct counter metrics for overall wa calculation (#40394) 
- Use CounterVec to calculate sum of increase during a time period.
- Use entries number instead of binlog size

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-10 16:34:06 +08:00
congqixia
391804c7fb
enhance: Add channel seal policy based on blocking l0 (#40505) 
Related to #40502

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-10 16:28:04 +08:00
foxspy
2eaf997dce
enhance: Automatically Close Knowhere Automated PRs (#40498) 
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-03-10 15:01:05 +08:00
XuanYang-cn
6f70e6d1e1
enhance: Log start position of delete msgs (#40315) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-10 14:58:05 +08:00
binbin
345538d10a
test: Add test cases for part of json path index (#40445) 
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2025-03-10 14:30:07 +08:00
sre-ci-robot
cadf0e5a6d
[automated][skip e2e] Bump milvus version to v2.5.6 (#40495) 
Bump milvus version to v2.5.6
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-10 12:52:06 +08:00
sre-ci-robot
a6d4121034
[automated] Update Knowhere Commit (#40486) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-10 12:28:04 +08:00
XuanYang-cn
4bebca6416
enhance: Replace currRows with NumOfRows (#40074) 
See also: #40068

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-10 12:16:03 +08:00
Xiaofan
1c9d43ee9f
fix: rockmq race condition (#40482) 
fix #40481

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-10 10:54:04 +08:00
cai.zhang
d6a650bd14
fix: Skip executing stats for zero segment (#40448) 
issue: #40241

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-09 21:14:02 +08:00
smellthemoon
faae8ee518
fix: store wrong offset when build tantivy in nullable field (#40452) 
#40454

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2025-03-09 09:34:04 +08:00
sre-ci-robot
2c287dfd10 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2025-03-09 00:01:58 +00:00
Xiaofan
73bda08ec9
doc: json storage format (#40479) 
the design doc for the json storage improvemnet

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-08 09:48:02 +08:00
congqixia
c348e61bdb
fix: [GoSDK] move metaheader to client in case of race (#40443) 
See failure run in #40352

This PR:
- move metaheader map to client struct from config
- set default value for field schema

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-07 17:06:02 +08:00
congqixia
a56b24054f
enhance: [GoSDK] Support alter/drop index properties (#40417) 
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-06 21:40:04 +08:00
shaoyue
2cd03a20d4
enhance: [skip e2e] upgrade go toolchain to 1.22.7, remove unnecessary binary (#40398) 
part of: #40370

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
 2025-03-06 21:34:04 +08:00
Bingyi Sun
37b118d55d
fix: Skip loading primary key if index has raw data (#39921) 
issue: https://github.com/milvus-io/milvus/issues/39907

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-06 17:46:02 +08:00
congqixia
7fbeb5624e
enhance: Avoid convert body byte slice to string in httpserver (#40405) 
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-06 16:28:02 +08:00
congqixia
5c5273f95e
fix: Pass Knapsnak ptr to avoid compact multiple times (#40400) 
Related to #40388

The small segments may be put into bucket twice due to value parameter
of Knapsnap.packWith

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-06 15:42:03 +08:00
nico
80213c0f6f
test: update teardown collection after rename (#40379) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-03-06 10:36:09 +08:00