8 Commits

Author	SHA1	Message	Date
congqixia	cb7f2fa6fd	enhance: Use v2 package name for pkg module (#39990) ... Related to #39095 https://go.dev/doc/modules/version-numbers Update pkg version according to golang dep version convention --------- Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2025-02-22 23:15:58 +08:00
Zhen Ye	d3e32bb599	enhance: make pchannel level flusher (#39275) ... issue: #38399 - Add a pchannel level checkpoint for flush processing - Refactor the recovery of flushers of wal - make a shared wal scanner first, then make multi datasyncservice on it Signed-off-by: chyezh <chyezh@outlook.com>	2025-02-10 16:32:45 +08:00
Zhen Ye	b1cee78a55	fix: segment stats may be inconsistent after wal closing (#39593) ... issue: #38399 - The stats may be kept after wal closing if the growing segment is not dirty. - Change the error handling of wal open to avoid redundant manager api call. Signed-off-by: chyezh <chyezh@outlook.com>	2025-02-05 10:53:10 +08:00
Zhen Ye	134952b6c5	enhance: refactor the streaming node log (#39052) ... issue: #38399 Signed-off-by: chyezh <chyezh@outlook.com>	2025-01-08 11:30:56 +08:00
yihao.dai	a4439cc911	enhance: Implement flusher in streamingNode (#34942) ... - Implement flusher to: - Manage the pipelines (creation, deletion, etc.) - Manage the segment write buffer - Manage sync operation (including receive flushMsg and execute flush) - Add a new `GetChannelRecoveryInfo` RPC in DataCoord. - Reorganize packages: `flushcommon` and `datanode`. issue: https://github.com/milvus-io/milvus/issues/33285 --------- Signed-off-by: bigsheeper <yihao.dai@zilliz.com>	2024-08-02 18:30:23 +08:00
yihao.dai	8aab6cbfac	enhance: Organize the common modules of streamingNode and dataNode (#34773) ... 1. Move the common modules of streamingNode and dataNode to flushcommon 2. Add new GetVChannels interface for rootcoord issue: https://github.com/milvus-io/milvus/issues/33285 --------- Signed-off-by: bigsheeper <yihao.dai@zilliz.com>	2024-07-22 11:33:51 +08:00
chyezh	dfe0416a70	enhance: implement streaming node server service (#34166) ... issue: #33285 - implement producing and consuming server of message - implement management operation for streaming node server --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-09 07:58:14 +08:00
chyezh	ba04981a43	enhance: implement wal managerment on streaming node (#34153) ... issue: #33285 - add lifetime control for wal. - implement distributed-safe wal manager on streaming node. --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-05 14:29:42 +08:00