Xianhui Lin
2710eb3fc9
fix: [2.5] Json Stats filter the data is double but the filter expr is int ( #40771 )
...
Json Stats filter the data is double but the filter is int
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr:https://github.com/milvus-io/milvus/pull/38039
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-03-19 20:22:13 +08:00
congqixia
cd8d7efc96
enhance: [2.5] Add an extra parameter for slow log ( #40759 )
...
Cherry-pick from master
pr: #40758
Related to #40756
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-19 18:10:13 +08:00
congqixia
d1359010d0
enhance: [2.5][GoSDK] Add README and examples for milvusclient ( #40747 )
...
Cherry-pick from master
pr: #40630 #40643
Related to #31293
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-19 18:02:18 +08:00
sre-ci-robot
38127e2c76
[automated] Bump milvus version to v2.5.7 ( #40770 )
...
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-19 18:00:24 +08:00
cai.zhang
0cfe835cac
enhance: [2.5] Support slot for index task and stats task ( #40288 )
...
issue: #39101
master pr: #39084
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-19 16:50:11 +08:00
congqixia
e49294cd16
enhance: [2.5] Add buffer forwarder for stream delta loading ( #40559 ) ( #40699 )
...
Cherry-pick from master
pr: #40559
See also #40558
Related to #35303 & #38066 as well
This PR:
- Add `BufferedForward` to limit memory usage forwarding stream delete
- Add `UseLoad` flag to determine `Delete` shall use `segment.Delete` or
`segment.LoadDelta`
- Fix delegator accidentally use always true candidate while load
streaming delta
---------
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-19 10:28:14 +08:00
Buqian Zheng
667fc7f91d
fix: [2.5] use NewInsertDataWithFunctionOutputField when importing binlog file ( #40742 )
...
issue: https://github.com/milvus-io/milvus/issues/40740
pr: https://github.com/milvus-io/milvus/pull/40741
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-19 00:22:34 +08:00
Xianhui Lin
78f3d69a2f
fix: jsonstats Negative numbers cannot be filtered out ( #40734 )
...
fix: jsonstats Negative numbers cannot be filtered out
issue: https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-03-18 22:35:53 +08:00
Chun Han
aebbfc7c7b
fix: mmap properties failed to apply when creating collection( #40511 ) ( #40515 )
...
related: #40511
pr: https://github.com/milvus-io/milvus/pull/40512
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-18 22:05:19 +08:00
cai.zhang
d4e2f581f9
fix: [2.5] Do not delete the centroids file when sampling fails instead wait GC ( #40702 )
...
issue: #40700
pr: #40701
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-18 22:00:20 +08:00
yihao.dai
aca9dd9105
fix: [2.5] Fix messages loss during seek ( #40736 )
...
issue: https://github.com/milvus-io/milvus/issues/40733
pr: https://github.com/milvus-io/milvus/pull/40735
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-18 21:56:33 +08:00
congqixia
6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 ( #40728 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-18 19:58:15 +08:00
congqixia
8de5174e4d
fix: [2.5] Remove lag targets after main dispatcher ( #40717 )
...
Related to #40716
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-18 19:10:34 +08:00
cqy123456
2fbfd86146
fix:[2.5]fix growing index ut ( #40724 )
...
issue: https://github.com/milvus-io/milvus/issues/27678
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-03-18 19:04:15 +08:00
Xianhui Lin
705b3c90a5
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when enable JsonKeyStats ( #40661 )
...
fix: Failed to rolling upgrade from v2.5.6 to new 2.5 version when
enable JsonKeyStats.The reason is that the file path of the jsonkeyindex
has changed.
issue: https://github.com/milvus-io/milvus/issues/40649
，https://github.com/milvus-io/milvus/issues/40669
https://github.com/milvus-io/milvus/issues/40707
master-pr: https://github.com/milvus-io/milvus/pull/38039
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-03-18 17:32:16 +08:00
zhagnlu
e47682aa55
fix:add clear bitmap input for every batch loop ( #40722 )
...
#40685
cherry-pick part from pr: #39872
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-18 17:27:02 +08:00
congqixia
162cfb4609
fix: [2.5] Protect getSegmentIndexes with rlock ( #40720 )
...
Cherry-pick from master
pr: #40719
Related to #40718
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-18 16:40:47 +08:00
Zhen Ye
167d058682
enhance: remove redundant resource key watch operation, just keep consistency of wal ( #40503 )
...
issue: #38399
pr: #40235
related PR: #39522
- Just implement exclusive broadcaster between broadcast message with
same resource key to keep same order in different wal.
- After simplify the broadcast model, original watch-based broadcast is
too complicated and redundant, remove it.
- Add metrics for broadcast.
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-18 15:46:25 +08:00
zhuwenxing
d9635c6f86
test: [cherry-pick]add empty sparse in import test ( #40683 )
...
pr: https://github.com/milvus-io/milvus/pull/40682
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-18 15:18:13 +08:00
foxspy
0dc4b73c81
fix: [2.5] avoid segmentation faults caused by retrieving empty vector datasets ( #40546 )
...
issue: #40544
pr: #40545
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-03-18 14:58:13 +08:00
Bingyi Sun
b0078ceae3
fix: Fix json test ( #40710 )
...
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/40671
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-18 12:52:13 +08:00
cqy123456
b8abd91962
enhance[2.5]: add more config for interimIndex to support more refine mode ( #40429 )
...
issue: https://github.com/milvus-io/milvus/issues/27678
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-03-17 22:04:12 +08:00
XuanYang-cn
f455923ac9
enhance: Use correct counter metrics for overall wa calculation ( #40394 ) ( #40679 )
...
pr: #40394
- Use CounterVec to calculate sum of increase during a time period.
- Use entries number instead of binlog size
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-03-17 15:06:19 +08:00
XuanYang-cn
d457ccc0e8
enhance: [25]Log start position of delete msgs ( #40315 ) ( #40678 )
...
pr: #40315
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-03-17 15:02:09 +08:00
Bingyi Sun
9145885f40
enhance: Record simdjson error ( #40671 )
...
issue: #35528
pr: #40647
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-15 12:48:08 +08:00
Bingyi Sun
ae8a9cebb8
fix: fix json index not-equal filter ( #40648 )
...
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/40647
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 21:36:10 +08:00
Bingyi Sun
0a3435f53a
fix: Fix null offset loading in inverted index ( #40524 )
...
issue: #40516
pr: https://github.com/milvus-io/milvus/pull/40523
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 18:32:09 +08:00
Gao
09f7a60fe1
enhance: [2.5] make segment prune config refreshable ( #40632 )
...
pr: #40539
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-03-14 16:12:09 +08:00
SimFG
a3c60a03b5
feat: [2.5] add DDLDB rate type and related quota configurations ( #40653 )
...
- issue: #40650
- pr: #40651
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-14 15:36:17 +08:00
zhagnlu
6b9e141ada
enhance: reorder sub expr for conjunct expr ( #40186 )
...
pr:#39872
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-14 15:16:08 +08:00
congqixia
d8a2c1a907
enhance: [2.5] Add channel seal policy based on blocking l0 ( #40505 ) ( #40535 )
...
Cherry-pick from 2.5
pr: #40505
Related to #40502
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-14 10:02:12 +08:00
cai.zhang
bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo ( #40466 )
...
issue: #40341
master pr: #40464
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-14 00:14:08 +08:00
Bingyi Sun
33e9db1539
fix: cherry pick json prs ( #40621 )
...
issue: #35528
pr: #40604
this pr includes some prs:
1. #40604
2. #40611
3. #40619
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-13 20:36:10 +08:00
Xianhui Lin
f5e9dea2aa
fix: [2.5]fix the garbage cleanup logic of jsonkey stats && improve json key stats filer ( #40039 )
...
fix: fix the garbage collection cleanup logic of jsonkey stats &&
improve json key stats filer
issue: https://github.com/milvus-io/milvus/issues/36995
https://github.com/milvus-io/milvus/issues/40034
https://github.com/milvus-io/milvus/issues/40041
https://github.com/milvus-io/milvus/issues/40106
https://github.com/milvus-io/milvus/issues/40138
pr: https://github.com/milvus-io/milvus/pull/38039
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-03-13 20:18:10 +08:00
cai.zhang
f6c4ad52f0
enhance: [2.5] Refine task meta with key lock ( #40353 )
...
issue: #39101
master pr: #39084
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-13 19:18:08 +08:00
Bingyi Sun
d8f51ca852
fix: Catch invalid json pointer error ( #40626 )
...
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/40625
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-13 16:10:09 +08:00
wei liu
4a3a1b7cc7
enhance: Remove CPU profile to prevent blocking stop progress ( #40459 )
...
pr: #40460
- Removed CPU profile dump from util.go's pprof collection
- Avoid potential blocking in StopCPUProfile() during shutdown
- Maintain goroutine/heap/block/mutex profiles for diagnostics
- Ensure safe shutdown timeout handling without profile stalls
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-03-13 14:40:11 +08:00
yihao.dai
cd8f1fe0e4
enhance: [2.5] Remove unnecessary collection and partition label from the metrics ( #40593 )
...
/kind improvement
pr: https://github.com/milvus-io/milvus/pull/39536
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-13 12:24:08 +08:00
sthuang
9542271554
fix: [2.5] rbac star privilege return empty when listing policy ( #40557 )
...
cherry-pick from master: https://github.com/milvus-io/milvus/pull/40553
related: https://github.com/milvus-io/milvus/issues/40547
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-13 00:42:09 +08:00
Spade A
ec6f8bac6d
fix: [2.5] avoid panic when field not exists in schema in query node ( #40542 )
...
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40541
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-12 22:14:09 +08:00
Spade A
bcec7c5087
fix: [2.5] ref collection for search/query ( #40550 )
...
ref https://github.com/milvus-io/milvus/issues/40473
cherry-pick: https://github.com/milvus-io/milvus/pull/40549
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-12 20:12:09 +08:00
Xiaofan
a7dd0eda9e
fix: [2.5] empty row for sparse vector ( #40586 )
...
fix : #40584
pr: #40585
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-03-12 16:42:06 +08:00
yihao.dai
b0ad3d9444
enhance: [2.5] Improve import error msgs ( #40597 )
...
issue: https://github.com/milvus-io/milvus/issues/40208
pr: https://github.com/milvus-io/milvus/pull/40567
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-12 14:36:08 +08:00
Bingyi Sun
bd4170106d
fix: cherry pick json index related prs ( #40568 )
...
issue: #35528
pr: #40407
this pr includes some json index related pr:
1. #40407
2. #40538
3. #40419
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-11 21:00:09 +08:00
congqixia
d0763cb84d
enhance: [2.5] Fix Array.h clang format issue ( #40536 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-11 15:58:09 +08:00
congqixia
004668b14c
fix: [2.5] Add duplicated type/index params check creating collection ( #40465 )
...
Cherry-pick from master
pr: #40462
Related to #40461
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-11 10:14:11 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index ( #40313 )
...
issue: #35528
pr: #36750
this pr includes json path index pr and some related prs:
1. update tantivy version #39253
2. json path index #36750
3. fall back to brute force #40076
4. term filter #40140
5. bug fix #40336
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00
sparknack
3b847712bd
fix: add collection flush before sparse searching in pytest ( #40510 )
...
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-03-10 19:14:04 +08:00
congqixia
14ca0dfc7c
enhance: [2.5] Avoid convert body byte slice to string in httpserver ( #40405 ) ( #40414 )
...
Cherry-pick from master
pr: #40405
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-10 14:44:05 +08:00
congqixia
9cf2cb66e1
fix: [2.5][GoSDK] move metaheader to client in case of race ( #40444 )
...
Cherry-pick from master
pr: #40443
See failure run in #40352
This PR:
- move metaheader map to client struct from config
- set default value for field schema
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-10 11:18:04 +08:00
