Zhen Ye
31a609c21d
fix: kafka should auto reset the offset from earliest to read ( #45237 )
...
issue: #44172 , #45210 , #44851
kafka will auto reset the offset to "latest" if the offset is
Out-of-range. the recovery of milvus wal cannot read any message from
that. So once the offset is out-of-range, kafka should read from eariest
to read the latest uncleared data.
https://kafka.apache.org/documentation/#consumerconfigs_auto.offset.reset
Signed-off-by: chyezh <chyezh@outlook.com>
2025-11-03 21:07:33 +08:00
yihao.dai
51f69f32d0
feat: Add CDC support ( #44124 )
...
This PR implements a new CDC service for Milvus 2.6, providing log-based
cross-cluster replication.
issue: https://github.com/milvus-io/milvus/issues/44123
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2025-09-16 16:32:01 +08:00
Zhen Ye
8ff118a9ff
fix: call IntoMessageProto instead of Payload when rpc ( #43678 )
...
issue: #43677
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-06 14:45:40 +08:00
Zhen Ye
52950ce392
enhance: add pulsar truncate api to protect pulsar unconsumed message ( #41724 )
...
issue: #41465
- implement truncate api for pulsar based on durable subscription.
- truncate api can only be called if wal is read-write.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-05-11 20:50:55 +08:00
tinswzy
b36ed03141
enhance: Add Truncate Interface to WALImpls for Log Retention Control ( #41517 )
...
#41465 Add Truncate Interface to WALImpls for Proactive Log Retention
Management
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-04-29 14:36:49 +08:00
Zhen Ye
6982f007e2
enhance: add walimpls access mode options ( #40591 )
...
issue: #40532
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-14 10:58:11 +08:00
congqixia
cb7f2fa6fd
enhance: Use v2 package name for pkg module ( #39990 )
...
Related to #39095
https://go.dev/doc/modules/version-numbers
Update pkg version according to golang dep version convention
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 23:15:58 +08:00
Zhen Ye
bb8d1ab3bf
enhance: make new go package to manage proto ( #39114 )
...
issue: #39095
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-10 10:49:01 +08:00
Zhen Ye
285289d5b0
enhance: implement kafka for wal ( #38598 )
...
issue: #38399
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-25 10:22:50 +08:00
