4 Commits

Author	SHA1	Message	Date
Zhen Ye	0a465bb5b7	enhance: use recovery+shardmanager, remove segment assignment interceptor (#41824) ... issue: #41544 - add lock interceptor into wal. - use recovery and shardmanager to replace the original implementation of segment assignment. - remove redundant implementation and unittest. - remove redundant proto definition. - use 2 streamingnode in e2e. --------- Signed-off-by: chyezh <chyezh@outlook.com>	2025-05-14 23:00:23 +08:00
Zhen Ye	7beafe99a7	enhance: implement wal garbage collector with truncate api (#41770) ... issue: #41544 - add a truncator implementation into wal recovery storage. - add metrics for recovery storage. --------- Signed-off-by: chyezh <chyezh@outlook.com>	2025-05-13 22:08:56 +08:00
Zhen Ye	61b6ca5b73	enhance: add in mem shard manager (#41749) ... issue: #41544 - Implement in-memory shard manager to maintain the shard state at write ahead. - Remove all rpc and meta operation at write ahead, make the segment assignment logic only use wal and memory. - Refactor global stats management, add node-level flush policy. - Fix the recovery storage inconsistency bug when graceful close. Signed-off-by: chyezh <chyezh@outlook.com>	2025-05-13 12:04:56 +08:00
Zhen Ye	e675da76e4	enhance: simplify the proto message, make segment assignment code more clean (#41671) ... issue: #41544 - simplify the proto message for flush and create segment. - simplify the msg handler for flowgraph. --------- Signed-off-by: chyezh <chyezh@outlook.com>	2025-05-11 20:49:00 +08:00