admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,288 Commits 137 Branches 188 Tags
Commit Graph

10494 Commits

Author SHA1 Message Date
SimFG
dfd2548c1b
enhance: support more ddl apis to replicate according to cdc (#41678) 
- issue: #41677

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-05-08 20:02:58 +08:00
junjiejiangjjj
f337d2989b
enhance : New decay function (#41634) 
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-05-08 17:24:54 +08:00
Zhen Ye
7dca7ef4d0
fix: empty growing segment cannot be recovered by streamingnode (#41666) 
issue: #41665

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-08 14:50:53 +08:00
zhagnlu
39e7ad33d7
enhance: add optimize for like expr (#41066) 
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-08 14:28:52 +08:00
foxspy
e2ddbe4962
feat: add cachinglayer to index (#41653) 
issue: #41435

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-08 10:12:54 +08:00
congqixia
b1f3fe1f07
fix: Use sum of num_rows instead of last one (#41685) 
Related to #41656

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-07 19:40:53 +08:00
Divya
3e67024d94
fix: Security Fixes for RESTful APIs (#41136) 
Fix for Issue :- #41128

---------

Signed-off-by: Divya <divyaruhil999@gmail.com>
 2025-05-07 18:08:54 +08:00
Zhen Ye
00cf93c043
fix: tombstone channel cp should be set as a metric (#41687) 
issue: #41686

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-07 15:34:53 +08:00
Zhen Ye
05eb17aebc
fix: wrong error handling when call importv2 (#41664) 
issue: #41654

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-07 15:18:52 +08:00
Bingyi Sun
0dee3ccfd7
enhance: Make user specified doc id selectable for tantivy index writer (#41528) 
issue: https://github.com/milvus-io/milvus/issues/41527

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-07 10:48:53 +08:00
congqixia
18625d7d20
enhance: [AddField] Remove restriction that cannot add field dynamic field enabled (#41642) 
Related to #39718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-07 09:58:52 +08:00
Xianhui Lin
3124d6f599
feat: add string ts type in describecollection (#41612) 
feat: add string  ts type in describecollection
issue:https://github.com/milvus-io/milvus/issues/39093

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-06 14:28:52 +08:00
Bingyi Sun
4c08090687
feat: Add json index support for json contains expr (#41478) 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-06 11:44:52 +08:00
Zhen Ye
de8f0af20d
enhance: use dispatcher at delegator when enable streaming (#41266) 
issue: #38399

- add an adaptor type to adapt the streaming service client and
msgstream client to reuse the msgdispatcher.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-06 01:12:53 +08:00
Buqian Zheng
73bbf4c674
fix: error when lack_binlog_rows = 0 (#41644) 
issue: https://github.com/milvus-io/milvus/issues/41643

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-05-04 00:24:56 +08:00
congqixia
c482664bf6
fix: [AddField] Add check whether new field is partition key (#41627) 
Related to #41622

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-30 16:50:54 +08:00
sthuang
e9442f575d
feat: storage v2 seal segment load (#41567) 
storage v2 chunked seal segment loading is based on caching layer. A
cell unit in storage v2 is a parquet row group in remote object storage,
containing all fields. Therefore, each field needs a proxy to do related
one field operations.

<img width="965" alt="Screenshot 2025-04-28 at 10 59 30"
src="https://github.com/user-attachments/assets/83e93a10-3b1d-4066-ac17-b996d5650416"
/>

related: #39173

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-04-30 14:22:58 +08:00
SimFG
3bd6268d3c
enhance: Implement OperatePrivilegeV2 message handling and unmarshal support (#41355) 
- issue: #41353

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-04-30 12:02:53 +08:00
sthuang
6c377b6e86
feat: Storage v2 index and stats raw data (#41534) 
related: #39173

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-04-30 08:48:54 +08:00
Zhen Ye
f1cba24b94
fix: stop worknode concurrently (#41608) 
issue: #41445

- make multiple node stop concurrently (otherwise streamingnode stop
will be blocked by querynode).
- change vchannel count updating when collection is dropping.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-29 23:16:53 +08:00
cai.zhang
3037c58771
enhance: DataNode no need to wait mixcoord healthy in stream mode (#41607) 
Once it's confirmed that only stream mode will be used, we should remove
the datanode's dependency on mixcoord.
issue: #41611

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-04-29 18:12:53 +08:00
zhagnlu
cd60b965c8
enhance: add expr filter ratio monitor params (#41402) 
#41401

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-04-29 17:02:54 +08:00
foxspy
1d99f8bd67
enhance: add force rebuild index configuration (#41473) 
issue: #41431

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-04-29 16:20:56 +08:00
congqixia
f3f8227cd0
enhance: [AddField] Trigger check schema in retrieve as well (#41598) 
Related to #39718
Fixes milvus-io/pymilvus#2771

This PR:
- Make AsyncRetrieve task triggers "schema check" logic as well
- Rename `AddField` related methods to align with code standard

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-29 14:10:49 +08:00
Spade A
910f68c986
fix: update tantivy to fix tantivy doc out of order when merge (#41596) 
issue: #41597

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-04-29 13:46:49 +08:00
Spade A
f35e8f7420
fix: fix arm64 compile issue (#41593) 
issue: https://github.com/milvus-io/milvus/issues/41059,
https://github.com/milvus-io/milvus/issues/41510

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-04-29 13:19:25 +08:00
yihao.dai
71b14fc32b
enhance: Skip disk quota check for l0 import (#41571) 
issue: https://github.com/milvus-io/milvus/issues/41569

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-04-29 10:46:54 +08:00
Zhen Ye
9cb5271027
enhance: remove support of embeded nats mq (#41565) 
issue: #41564

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-28 23:06:49 +08:00
junjiejiangjjj
bb7df40fc1
feat: Http interface supports rerank (#41486) 
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-04-28 23:02:50 +08:00
Zhen Ye
dfbb02a5f7
enhance: make streaming message as a log field for easier coding (#41545) 
issue: #41544

- implement message can be logged as a field by zap.
- fix too many slow log for woodpecker.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-28 14:38:42 +08:00
Buqian Zheng
3de904c7ea
feat: add cachinglayer to sealed segment (#41436) 
issue: https://github.com/milvus-io/milvus/issues/41435

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-04-28 10:52:40 +08:00
cai.zhang
640f526301
fix: Update current scalar index version to compatible tantivy different versions (#41141) 
issue: #40823

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-04-27 20:44:39 +08:00
yihao.dai
16eb5eb921
enhance: Accelerate delete filtering during binlog import (#41551) 
Use map for deleteData instead of slice to accelerate delete filtering
during binlog import.

issue: https://github.com/milvus-io/milvus/issues/41550

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-04-27 18:56:38 +08:00
aoiasd
3892451880
fix: bm25 search failed when avgdl == nan (#41502) 
relate: https://github.com/milvus-io/milvus/issues/41490

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-04-27 17:34:38 +08:00
Chun Han
12cde913b5
fix: fail to get string views due to chunk bound empty loop(#41300) (#41452) 
related: #41300

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-04-27 10:40:38 +08:00
Zhen Ye
6a15790799
enhance: add interface for message and fix write ahead buffer (#41470) 
issue: #41439

- add IsPersisted and VChannel interface for message
- add WithNotPersisted() for message builder
- fix the persisted time tick lost at write ahead buffer

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-27 10:24:38 +08:00
congqixia
c0661f4e9d
enhance: Set resolve_type_alias to False to generate MockMsgHandler (#41531) 
Previously, mockery will resolve message.ImmutableXXXMessage to private
message.specializedImmutableMessage[H, B], which will not be able to
compile.

This PR set generate-mockery-interal `resolve_type_alias` to False,
which is recommented for v3 compatible, to avoid this problem.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-27 10:02:38 +08:00
congqixia
b5443ddbd0
enhance: [AddField] Reopen loaded segments after AddField (#41529) 
Related to #39718

This PR:
- Add reopen logic for growing & sealed segments
- Lazy reopen when schema version increases
- Add FinishLoad api for loading progress

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-26 08:48:39 +08:00
Buqian Zheng
1c8b9c127d
fix: Make sure segment in ut is destroyed before static MmapManager singleton (#41508) 
issue: #41507

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-04-25 18:50:38 +08:00
XuanYang-cn
dab39c610b
enhance: remove not inused DDLCodec (#41485) 
See also: #39242

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-04-25 17:26:37 +08:00
Zhen Ye
01c0356ed3
fix: make add segment operation in meta idempotent (#41515) 
issue: #41514

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-25 16:50:38 +08:00
Xianhui Lin
1a6838b496
fix: json stats add map null check before insert into tantivity (#41505) 
json stats add map null check before insert into tantivity. Json stats
index may fail if there is no data
issue:https://github.com/milvus-io/milvus/issues/41494

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-04-24 21:06:37 +08:00
Zhen Ye
a3d621cb5e
fix: remove the concurrent limits for streaming service (#41484) 
issue: #41479

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-24 20:36:38 +08:00
Zhen Ye
ecfc868dcb
fix: write buffer not unregistered when datasyncservice is gone (#41496) 
issue: #41495

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-24 19:38:38 +08:00
junjiejiangjjj
e56adc121b
enhance: refactor embedding credentials manager (#41442) 
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-04-24 14:34:38 +08:00
congqixia
dbe54c2df8
enhance: [AddField] Resolve conflicts & make WAL ts collection updatets (#41476) 
Related to #39718

This PR:
- Use WAL broadcast timestamp as Collection update timestamp
- Remove request_fields size assertion
- Remove proxy schema cache loaded field check & skip related cases
- other minor issues

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-24 12:06:39 +08:00
XuanYang-cn
540456041f
enhance: Remove not inuse binlog iterator (#41359) 
See also: #41466

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-04-24 12:04:38 +08:00
Spade A
f3d878ab3f
fix: update tantivy for fixing phrase match (#41450) 
issue: #41454
https://github.com/zilliztech/tantivy/pull/8 fixes the problem, this PR
update the tantivy.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-04-24 10:52:37 +08:00
Zhen Ye
5fd47c3c89
fix: mockery too unavailable after upgrade golang version (#41481) 
issue: #41291
pr: #41318

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-24 10:46:43 +08:00
junjiejiangjjj
f23df95a77
feat : Support decay rerank (#41223) 
https://github.com/milvus-io/milvus/issues/35856
#41312

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-04-23 20:48:39 +08:00