admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,844 Commits 146 Branches 196 Tags
Commit Graph

21844 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
congqixia
cd8d7efc96
enhance: [2.5] Add an extra parameter for slow log (#40759) 
Cherry-pick from master
pr: #40758
Related to #40756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 18:10:13 +08:00
congqixia
d1359010d0
enhance: [2.5][GoSDK] Add README and examples for milvusclient (#40747) 
Cherry-pick from master
pr: #40630 #40643
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 18:02:18 +08:00
sre-ci-robot
38127e2c76
[automated] Bump milvus version to v2.5.7 (#40770) 
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-19 18:00:24 +08:00
cai.zhang
0cfe835cac
enhance: [2.5] Support slot for index task and stats task (#40288) 
issue: #39101 

master pr: #39084

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-19 16:50:11 +08:00
congqixia
e49294cd16
enhance: [2.5] Add buffer forwarder for stream delta loading (#40559) (#40699) 
Cherry-pick from master
pr: #40559
See also #40558
Related to #35303 & #38066 as well

This PR:
- Add `BufferedForward` to limit memory usage forwarding stream delete
- Add `UseLoad` flag to determine `Delete` shall use `segment.Delete` or
`segment.LoadDelta`
- Fix delegator accidentally use always true candidate while load
streaming delta

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-19 10:28:14 +08:00
Buqian Zheng
667fc7f91d
fix: [2.5] use NewInsertDataWithFunctionOutputField when importing binlog file (#40742) 
issue: https://github.com/milvus-io/milvus/issues/40740
pr: https://github.com/milvus-io/milvus/pull/40741

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-19 00:22:34 +08:00
Xianhui Lin
78f3d69a2f
fix: jsonstats Negative numbers cannot be filtered out (#40734) 
fix: jsonstats Negative numbers cannot be filtered out
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
pkg/v2.5.7 		2025-03-18 22:35:53 +08:00
Chun Han
aebbfc7c7b
fix: mmap properties failed to apply when creating collection(#40511) (#40515) 
related: #40511
pr: https://github.com/milvus-io/milvus/pull/40512

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-03-18 22:05:19 +08:00
cai.zhang
d4e2f581f9
fix: [2.5] Do not delete the centroids file when sampling fails instead wait GC (#40702) 
issue: #40700 

pr: #40701

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-18 22:00:20 +08:00
yihao.dai
aca9dd9105
fix: [2.5] Fix messages loss during seek (#40736) 
issue: https://github.com/milvus-io/milvus/issues/40733

pr: https://github.com/milvus-io/milvus/pull/40735

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-18 21:56:33 +08:00
congqixia
6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 (#40728) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:58:15 +08:00
congqixia
8de5174e4d
fix: [2.5] Remove lag targets after main dispatcher (#40717) 
Related to #40716

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:10:34 +08:00
cqy123456
2fbfd86146
fix:[2.5]fix growing index ut (#40724) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-18 19:04:15 +08:00
Xianhui Lin
705b3c90a5
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when enable JsonKeyStats (#40661) 
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when
enable JsonKeyStats.The reason is that the file path of the jsonkeyindex
has changed.
issue: https://github.com/milvus-io/milvus/issues/40649
，https://github.com/milvus-io/milvus/issues/40669
https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-18 17:32:16 +08:00
zhagnlu
e47682aa55
fix:add clear bitmap input for every batch loop (#40722) 
#40685
cherry-pick part from pr: #39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-18 17:27:02 +08:00
congqixia
162cfb4609
fix: [2.5] Protect getSegmentIndexes with rlock (#40720) 
Cherry-pick from master
pr: #40719
Related to #40718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 16:40:47 +08:00
Zhen Ye
167d058682
enhance: remove redundant resource key watch operation, just keep consistency of wal (#40503) 
issue: #38399
pr: #40235

related PR: #39522

- Just implement exclusive broadcaster between broadcast message with
same resource key to keep same order in different wal.
- After simplify the broadcast model, original watch-based broadcast is
too complicated and redundant, remove it.
- Add metrics for broadcast.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-18 15:46:25 +08:00
zhuwenxing
d9635c6f86
test: [cherry-pick]add empty sparse in import test (#40683) 
pr: https://github.com/milvus-io/milvus/pull/40682

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-18 15:18:13 +08:00
foxspy
0dc4b73c81
fix: [2.5] avoid segmentation faults caused by retrieving empty vector datasets (#40546) 
issue: #40544 
pr: #40545

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-03-18 14:58:13 +08:00
Bingyi Sun
b0078ceae3
fix: Fix json test (#40710) 
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/40671

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-18 12:52:13 +08:00
cqy123456
b8abd91962
enhance[2.5]: add more config for interimIndex to support more refine mode (#40429) 
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2025-03-17 22:04:12 +08:00
XuanYang-cn
f455923ac9
enhance: Use correct counter metrics for overall wa calculation (#40394) (#40679) 
pr: #40394

- Use CounterVec to calculate sum of increase during a time period.
- Use entries number instead of binlog size

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-17 15:06:19 +08:00
XuanYang-cn
d457ccc0e8
enhance: [25]Log start position of delete msgs (#40315) (#40678) 
pr: #40315

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-17 15:02:09 +08:00
Bingyi Sun
9145885f40
enhance: Record simdjson error (#40671) 
issue: #35528
pr: #40647

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-15 12:48:08 +08:00
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter (#40648) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-14 21:36:10 +08:00
Bingyi Sun
0a3435f53a
fix: Fix null offset loading in inverted index (#40524) 
issue: #40516 
pr: https://github.com/milvus-io/milvus/pull/40523

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-14 18:32:09 +08:00
Gao
09f7a60fe1
enhance: [2.5] make segment prune config refreshable (#40632) 
pr: #40539

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2025-03-14 16:12:09 +08:00
SimFG
a3c60a03b5
feat: [2.5] add DDLDB rate type and related quota configurations (#40653) 
- issue: #40650
- pr: #40651

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-14 15:36:17 +08:00
zhagnlu
6b9e141ada
enhance: reorder sub expr for conjunct expr (#40186) 
pr:#39872

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-14 15:16:08 +08:00
congqixia
d8a2c1a907
enhance: [2.5] Add channel seal policy based on blocking l0 (#40505) (#40535) 
Cherry-pick from 2.5
pr: #40505
Related to #40502

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-14 10:02:12 +08:00
cai.zhang
bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo (#40466) 
issue: #40341 

master pr: #40464

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-14 00:14:08 +08:00
Bingyi Sun
33e9db1539
fix: cherry pick json prs (#40621) 
issue: #35528 
pr: #40604 
this pr includes some prs:
1. #40604 
2. #40611 
3. #40619

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-13 20:36:10 +08:00
Xianhui Lin
f5e9dea2aa
fix: [2.5]fix the garbage cleanup logic of jsonkey stats && improve json key stats filer (#40039) 
fix: fix the garbage collection cleanup logic of jsonkey stats &&
improve json key stats filer
issue: https://github.com/milvus-io/milvus/issues/36995
https://github.com/milvus-io/milvus/issues/40034
https://github.com/milvus-io/milvus/issues/40041
https://github.com/milvus-io/milvus/issues/40106
https://github.com/milvus-io/milvus/issues/40138
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-03-13 20:18:10 +08:00
cai.zhang
f6c4ad52f0
enhance: [2.5] Refine task meta with key lock (#40353) 
issue: #39101 

master pr: #39084

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-13 19:18:08 +08:00
Bingyi Sun
d8f51ca852
fix: Catch invalid json pointer error (#40626) 
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40625

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-13 16:10:09 +08:00
wei liu
4a3a1b7cc7
enhance: Remove CPU profile to prevent blocking stop progress (#40459) 
pr: #40460
- Removed CPU profile dump from util.go's pprof collection
- Avoid potential blocking in StopCPUProfile() during shutdown
- Maintain goroutine/heap/block/mutex profiles for diagnostics
- Ensure safe shutdown timeout handling without profile stalls

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-03-13 14:40:11 +08:00
yihao.dai
cd8f1fe0e4
enhance: [2.5] Remove unnecessary collection and partition label from the metrics (#40593) 
/kind improvement

pr: https://github.com/milvus-io/milvus/pull/39536

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-13 12:24:08 +08:00
sthuang
9542271554
fix: [2.5] rbac star privilege return empty when listing policy (#40557) 
cherry-pick from master: https://github.com/milvus-io/milvus/pull/40553
related: https://github.com/milvus-io/milvus/issues/40547

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-03-13 00:42:09 +08:00
Spade A
ec6f8bac6d
fix: [2.5] avoid panic when field not exists in schema in query node (#40542) 
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40541

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-12 22:14:09 +08:00
Spade A
bcec7c5087
fix: [2.5] ref collection for search/query (#40550) 
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40549

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-03-12 20:12:09 +08:00
Xiaofan
a7dd0eda9e
fix: [2.5] empty row for sparse vector (#40586) 
fix: #40584 
pr: #40585

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-03-12 16:42:06 +08:00
yihao.dai
b0ad3d9444
enhance: [2.5] Improve import error msgs (#40597) 
issue: https://github.com/milvus-io/milvus/issues/40208

pr: https://github.com/milvus-io/milvus/pull/40567

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-12 14:36:08 +08:00
Bingyi Sun
bd4170106d
fix: cherry pick json index related prs (#40568) 
issue: #35528 
pr: #40407 
this pr includes some json index related pr:
1. #40407
2. #40538 
3. #40419

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-11 21:00:09 +08:00
congqixia
d0763cb84d
enhance: [2.5] Fix Array.h clang format issue (#40536) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-11 15:58:09 +08:00
congqixia
004668b14c
fix: [2.5] Add duplicated type/index params check creating collection (#40465) 
Cherry-pick from master
pr: #40462
Related to #40461

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-11 10:14:11 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313) 
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-10 22:14:05 +08:00
sparknack
3b847712bd
fix: add collection flush before sparse searching in pytest (#40510) 
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
 2025-03-10 19:14:04 +08:00
congqixia
14ca0dfc7c
enhance: [2.5] Avoid convert body byte slice to string in httpserver (#40405) (#40414) 
Cherry-pick from master
pr: #40405
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-10 14:44:05 +08:00
congqixia
9cf2cb66e1
fix: [2.5][GoSDK] move metaheader to client in case of race (#40444) 
Cherry-pick from master
pr: #40443
See failure run in #40352

This PR:
- move metaheader map to client struct from config
- set default value for field schema

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
client/v2.5.1 		2025-03-10 11:18:04 +08:00
sre-ci-robot
7e27452a9b
[automated] Bump milvus version to v2.5.6 (#40493) 
Bump milvus version to v2.5.6
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-10 11:00:05 +08:00