22353 Commits

Author SHA1 Message Date
Zhen Ye
d32b802752
fix: remove the max_row_num for segment meta (#41680)
issue: #41544

- remove the estimate logic, so the create segment operation will not
check the collection meta anymore

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-09 20:46:53 +08:00
cai.zhang
15ffd28643
fix: Set worker totalSlot in standalone mode is half of cluster mode (#41730)
issue: #41616, #41732

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-05-09 18:30:58 +08:00
sre-ci-robot
3a69fcb26b
[automated] Update gpu Builder image changes (#41740)
Update gpu Builder image changes
See changes:
3a7b2fef57
Signed-off-by: zhikunyao zhikunyao@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-05-09 18:22:53 +08:00
zhikunyao
3a7b2fef57
enhance: update builder to use dedicated self-hosted runner (#41735)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-05-09 16:52:10 +08:00
congqixia
d791cb0979
enhance: [AddField] Support explicit dynamic output fields (#41717)
Related to #39718

After support add field with dynamic fields enabled, the masked dynamic
field shall be able to return with `$meta["name"]`

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-09 16:46:54 +08:00
Xianhui Lin
2278e9e03f
fix: set quota center metrics configuration before watch (#41706)
fix: set quota center metrics configuration before watch
issue: https://github.com/milvus-io/milvus/issues/35177

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-09 14:32:54 +08:00
congqixia
bcf94a0754
fix: Remove noexcept from CacheIndexToDiskInternal (#41725)
Related to #41219

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-09 14:16:53 +08:00
sre-ci-robot
d09763b73f
[automated] Update cpu Builder image changes (#41712)
Update cpu Builder image changes
See changes:
f0451d2f3a
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-05-09 11:58:53 +08:00
zhagnlu
f674e232b9
fix: GetValueFromConfig return nullopt instead of exception for null value (#41709)
#41707

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-05-09 11:18:53 +08:00
Zhen Ye
16d6af85c3
fix: panic when use kafka/pulsar/wp for standalone (#41683)
issue: #41682

- There's a bug in rocksmq cleanup, #41565 remove the support of nats.

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-09 11:16:54 +08:00
Zhen Ye
3dd9a1147b
enhance: add lock interceptor and recoverable txn manager (#41640)
issue: #41544

- add a lock interceptor at vchannel granularity.
- make txn manager recoverable and add FailTxnAtVChannel operation.

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-09 11:14:53 +08:00
Zhen Ye
44c0799331
fix: ignore operation when node or cluster not match (#41718)
issue: #41715

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-09 10:48:53 +08:00
Xianhui Lin
26cbc74478
fix: support infix and suffix match types in JsonStats (#41720)
fix: support infix and suffix match types in JsonStats
issue:https://github.com/milvus-io/milvus/issues/41386

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-09 10:42:53 +08:00
zhagnlu
e3c81ba1cc
enhance: use scan mode for like although inverted index exists (#41325)
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-05-09 10:36:54 +08:00
ThreadDao
caaf9b1ea4
test: fix property case and remove load default replicaNum value (#41674)
issue: #41673

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-05-09 10:14:54 +08:00
SimFG
dfd2548c1b
enhance: support more ddl apis to replicate according to cdc (#41678)
- issue: #41677

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-08 20:02:58 +08:00
junjiejiangjjj
f337d2989b
enhance : New decay function (#41634)
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
2025-05-08 17:24:54 +08:00
shaoyue
f0451d2f3a
enhance: update go version to fix cve (#41696)
/cc @congqixia @czs007

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
2025-05-08 16:04:54 +08:00
Zhen Ye
7dca7ef4d0
fix: empty growing segment cannot be recovered by streamingnode (#41666)
issue: #41665

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-08 14:50:53 +08:00
zhagnlu
39e7ad33d7
enhance: add optimize for like expr (#41066)
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-05-08 14:28:52 +08:00
foxspy
e2ddbe4962
feat: add cachinglayer to index (#41653)
issue: #41435

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-05-08 10:12:54 +08:00
nico
5c11c4add1
enhance: update pymilvus version (#41695)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-05-08 10:04:54 +08:00
congqixia
b1f3fe1f07
fix: Use sum of num_rows instead of last one (#41685)
Related to #41656

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-07 19:40:53 +08:00
Divya
3e67024d94
fix: Security Fixes for RESTful APIs (#41136)
Fix for Issue :- #41128

---------

Signed-off-by: Divya <divyaruhil999@gmail.com>
2025-05-07 18:08:54 +08:00
Zhen Ye
00cf93c043
fix: tombstone channel cp should be set as a metric (#41687)
issue: #41686

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-07 15:34:53 +08:00
Zhen Ye
05eb17aebc
fix: wrong error handling when call importv2 (#41664)
issue: #41654

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-07 15:18:52 +08:00
Bingyi Sun
0dee3ccfd7
enhance: Make user specified doc id selectable for tantivy index writer (#41528)
issue: https://github.com/milvus-io/milvus/issues/41527

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-05-07 10:48:53 +08:00
congqixia
18625d7d20
enhance: [AddField] Remove restriction that cannot add field dynamic field enabled (#41642)
Related to #39718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-07 09:58:52 +08:00
Xianhui Lin
3124d6f599
feat: add string ts type in describecollection (#41612)
feat: add string  ts type in describecollection
issue:https://github.com/milvus-io/milvus/issues/39093

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-06 14:28:52 +08:00
zhuwenxing
1e65e3232f
test: add csv import testcase and adjust import testcase tag (#41638)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-05-06 11:52:53 +08:00
Bingyi Sun
4c08090687
feat: Add json index support for json contains expr (#41478)
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-05-06 11:44:52 +08:00
Zhen Ye
f62a2e281e
enhance: add MustAsMutable... function, cooldown notifier, hardware listener (#41637)
issue: #41544

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-06 01:16:52 +08:00
Zhen Ye
de8f0af20d
enhance: use dispatcher at delegator when enable streaming (#41266)
issue: #38399

- add an adaptor type to adapt the streaming service client and
msgstream client to reuse the msgdispatcher.

Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-06 01:12:53 +08:00
SimFG
623c728dac
enhance: add timeout for message reception in mqMsgStream (#41602)
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-06 00:50:52 +08:00
Buqian Zheng
73bbf4c674
fix: error when lack_binlog_rows = 0 (#41644)
issue: https://github.com/milvus-io/milvus/issues/41643

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-05-04 00:24:56 +08:00
congqixia
c482664bf6
fix: [AddField] Add check whether new field is partition key (#41627)
Related to #41622

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-30 16:50:54 +08:00
sthuang
e9442f575d
feat: storage v2 seal segment load (#41567)
storage v2 chunked seal segment loading is based on caching layer. A
cell unit in storage v2 is a parquet row group in remote object storage,
containing all fields. Therefore, each field needs a proxy to do related
one field operations.

<img width="965" alt="Screenshot 2025-04-28 at 10 59 30"
src="https://github.com/user-attachments/assets/83e93a10-3b1d-4066-ac17-b996d5650416"
/>

related: #39173

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-04-30 14:22:58 +08:00
SimFG
3bd6268d3c
enhance: Implement OperatePrivilegeV2 message handling and unmarshal support (#41355)
- issue: #41353

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-30 12:02:53 +08:00
sthuang
6c377b6e86
feat: Storage v2 index and stats raw data (#41534)
related: #39173

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-04-30 08:48:54 +08:00
Zhen Ye
f1cba24b94
fix: stop worknode concurrently (#41608)
issue: #41445

- make multiple node stop concurrently (otherwise streamingnode stop
will be blocked by querynode).
- change vchannel count updating when collection is dropping.

Signed-off-by: chyezh <chyezh@outlook.com>
2025-04-29 23:16:53 +08:00
congqixia
f47b117991
enhance: [GoSDK] Make all valid normal column compactible with nullable (#41606)
Related to #41413

This PR
- Make normal columns treated as all valid data when insert into
nullable field
- Fix the typo of `WithPartitions` of HybridSearchOption

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-29 19:50:53 +08:00
Xiaofan
ad45a56776
doc: add support for primary index (#41462)
add design doc discuss about memory efficient primary key index.

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-04-29 19:47:57 +08:00
cai.zhang
3037c58771
enhance: DataNode no need to wait mixcoord healthy in stream mode (#41607)
Once it's confirmed that only stream mode will be used, we should remove
the datanode's dependency on mixcoord.
issue: #41611

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-29 18:12:53 +08:00
XuanYang-cn
6b08eff4fe
enhance: Expose configs Manager (#41586)
See also: #41585

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-04-29 17:12:57 +08:00
zhagnlu
cd60b965c8
enhance: add expr filter ratio monitor params (#41402)
#41401

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-29 17:02:54 +08:00
foxspy
1d99f8bd67
enhance: add force rebuild index configuration (#41473)
issue: #41431

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-04-29 16:20:56 +08:00
XuanYang-cn
b6f3fd0de1
enhance: Update to the latest CipherPlugin API (#41599)
See also: #41585

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-04-29 14:50:50 +08:00
tinswzy
b36ed03141
enhance: Add Truncate Interface to WALImpls for Log Retention Control (#41517)
#41465 Add Truncate Interface to WALImpls for Proactive Log Retention
Management

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-04-29 14:36:49 +08:00
congqixia
f3f8227cd0
enhance: [AddField] Trigger check schema in retrieve as well (#41598)
Related to #39718
Fixes milvus-io/pymilvus#2771

This PR:
- Make AsyncRetrieve task triggers "schema check" logic as well
- Rename `AddField` related methods to align with code standard

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-29 14:10:49 +08:00
Spade A
910f68c986
fix: update tantivy to fix tantivy doc out of order when merge (#41596)
issue: #41597

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-29 13:46:49 +08:00