admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-08 01:58:34 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,257 Commits 133 Branches 183 Tags
Commit Graph

41 Commits

Author SHA1 Message Date
SimFG
91d40fa558
fix: Update logging context and upgrade dependencies (#41318) 
- issue: #41291

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-04-23 10:52:38 +08:00
Zhen Ye
b03e60558a
enhance: add proxy and datanode checker when wal balance startup (#40877) 
issue: #40532

- balance should enable only when there's no proxy and datanode which
version is lower than 2.6.0

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-04-01 11:24:22 +08:00
yihao.dai
8eb537fdd0
fix: Fix messages loss during seek (#40735) 
issue: https://github.com/milvus-io/milvus/issues/40733

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-20 20:18:11 +08:00
yihao.dai
004a1875dc
enhance: Introduce batch subscription in msgdispatcher (#39863) 
Introduce a batch subscription mechanism in msgdispatcher: the
msgdispatcher now includes a vchannel watch task queue, where all
vchannels in the queue will subscribe to the MQ only once and pull
messages from the oldest vchannel checkpoint to the latest.

issue: https://github.com/milvus-io/milvus/issues/39862

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-05 14:38:02 +08:00
congqixia
cb7f2fa6fd
enhance: Use v2 package name for pkg module (#39990) 
Related to #39095

https://go.dev/doc/modules/version-numbers

Update pkg version according to golang dep version convention

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-22 23:15:58 +08:00
aoiasd
24d2bbc441
enhance: unmashall ts msg in dispatcher instead in msgstream (#38656) 
relate: https://github.com/milvus-io/milvus/issues/38655

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-02-14 12:04:13 +08:00
tinswzy
11f8f4a378
enhance: add intent ctx to rootcoord init (#38439) 
issue: #35917 
add intent ctx to rootcoord initialization process

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
 2024-12-31 18:22:53 +08:00
SimFG
2afe2eaf3e
feat: support to replicate collection when the services contains the system tt msg (#37559) 
- issue: #37105

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-12-17 09:08:46 +08:00
SimFG
fa8ac09550
fix: the issue of replicate message exception when the ttMsgEnable config is changed dynamically (#38178) 
- issue: #38177

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-12-14 23:24:51 +08:00
tinswzy
27229f7907
enhance: refine exists log print with ctx (#38080) 
issue: #35917 
Refines exists log print with ctx

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
 2024-12-14 22:36:44 +08:00
jaime
a1e14d62c7
enhance: refine lock granularity for produers in msgstream (#38262) 
issue: #38261

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-12-06 17:14:40 +08:00
tinswzy
5768dbbb5d
enhance: refine pular related mq interfaces (#38007) 
issue: #35917 
Refines the pulsar-related mq APIs to allow the ctx to be passed down

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
 2024-12-04 20:50:39 +08:00
SimFG
821750d902
enhance: force to stop buffer message when receiving the drop collection message (#36916) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-10-17 12:53:29 +08:00
aoiasd
2c3a8b7dea
enhance: fix skip msg log with empty position info (#36626) 
All skiped message position info was nil, should print BeginTs or
MessageID instead.
relate: https://github.com/milvus-io/milvus/issues/36569

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-10-09 12:01:20 +08:00
SimFG
ddadefcb62
enhance: get msg type from the msg header to reduce the Unmarshal usage (#36409) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-09-24 10:19:20 +08:00
SimFG
c50fe71163
fix: long buffering causes mq to be unable to receive messages. (#36420) 
- issue: #36397

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-09-23 16:33:18 +08:00
congqixia
3b01b7dc9a
enhance: Produce messages of multiple topics in parallel (#36344) 
Related to #36343

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-23 11:23:11 +08:00
wei liu
c45f38aa61
enhance: Update protobuf-go to protobuf-go v2 (#34394) 
issue: #34252

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-07-29 11:31:51 +08:00
chyezh
39c7e06bc5
enhance: add message and msgstream msgpack adaptor (#34874) 
issue: #33285

- make message builder and message conversion type safe
- add adaptor type and function to adapt old msgstream msgpack and
message interface

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-07-22 20:59:42 +08:00
SimFG
c6e2900cfc
enhance: add the tick log for the tt msgstream seek method (#34397) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-07-04 10:18:09 +08:00
jaime
9630974fbb
enhance: move rocksmq from internal to pkg module (#33881) 
issue: #33956

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-25 21:18:15 +08:00
SimFG
cb99e3db34
enhance: add the includeCurrentMsg param for the Seek method (#33326) 
/kind improvement
- issue: #33325

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-05-27 10:31:41 +08:00
congqixia
12e8c6c583
enhance: Try LatestMessageID when checkpoint unmarshal fails (#33158) 
See also #33122

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-05-21 16:59:39 +08:00
congqixia
c2ac692008
enhance: Add param item to ignore bad message id in checkpoint (#33123) 
See also #33122

This pr add param item `mq.ignoreBadPosition` to control behavior when
mq failed to parse message id from checkpoint

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-05-20 11:29:37 +08:00
XuanYang-cn
f9508a4851
fix: Remove logging data when logging skip msg (#29707) 
See also: #29696

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-01-15 11:40:51 +08:00
aoiasd
9e6da45497
fix: Use uber atomic instead sync/atomic which only supported after go v1.20 (#29377) 
relate: https://github.com/milvus-io/milvus/issues/29376

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-26 16:06:49 +08:00
XuanYang-cn
48f506b077
fix: Seperate msgstream initctx with lifecycle ctx (#29308) 
The close of msgstream should be controlled by Close() not ctx from
outside when init clients

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-12-21 11:56:45 +08:00
aoiasd
46a937ac43
fix: msgstream memory leak caused by config event don't deregister (#29266) 
relate: https://github.com/milvus-io/milvus/issues/28620

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-20 20:32:44 +08:00
SimFG
9b0ecbdca7
Support to replicate the mq message (#27240) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-20 14:26:09 +08:00
zhenshan.cao
2b13078b14
Refine insert when send message (#27491) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: Cai Zhang <cai.zhang@zilliz.com>
 2023-10-18 21:12:08 +08:00
smellthemoon
a9982aa7c6
Remove topic empty restriction when preCreated topic (#27351) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-10-10 18:53:32 +08:00
SimFG
c9653b1683
Add some log and improve TestSessionProcessActiveStandBy test case (#27403) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-28 09:35:27 +08:00
SimFG
26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
congqixia
cc9974979f
Add staticcheck linter and fix existing problems (#27174) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-19 10:05:22 +08:00
yah01
45d9fb5929
Fix wrong error codes & names (#26904) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 14:41:18 +08:00
XuanYang-cn
7f1ae35e72
Add timeout in dispatcher, AsConsumer and Seek (#26686) 
See also: #25309

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-09-08 09:51:17 +08:00
congqixia
241117dd6d
Use last end position in pursuit mode (#26144) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-05 16:55:06 +08:00
congqixia
fcde5b8d7f
Add pursuit mode for mqtt msgstream (#26098) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-04 12:33:06 +08:00
congqixia
33cfb2ba2f
Fix MsgPack from mq msgstream ts not set (#25926) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-27 13:57:12 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00