congqixia
1dbc2ab8ee
enhance: [Cherry-pick] make compactor use actual buffer size to decide when to sync( #29945 ) ( #29971 ) ...
Cherry-pick from master
pr: #29945
See also: #29657
Datanode Compactor use estimated row number from schema to decide when
to sync the batch of data when executing compaction. This est value
could go way from actual size when the schema contains variable field(
say VarChar, JSON, etc.)
This PR make compactor able to check the actual buffer data size and
make it possible to sync when buffer is actually beyond max binglog
size.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-16 12:22:52 +08:00
2023-10-13 09:55:34 +08:00
2023-11-08 19:18:20 +08:00
2023-10-18 19:34:08 +08:00
2023-10-23 19:42:10 +08:00
2024-01-16 12:22:52 +08:00
2023-10-07 20:53:38 +08:00
2023-09-21 09:45:27 +08:00
2023-09-21 09:45:27 +08:00
2022-05-06 17:49:51 +08:00
2023-07-24 10:23:01 +08:00
2023-12-12 13:48:42 +08:00
2023-10-11 07:21:32 +08:00
2023-10-11 21:01:35 +08:00
2024-01-02 18:58:47 +08:00
2023-12-20 15:02:55 +08:00
2023-09-21 09:45:27 +08:00
2023-07-24 10:23:01 +08:00
2024-01-16 12:22:52 +08:00
2024-01-16 12:22:52 +08:00
2023-10-13 09:55:34 +08:00
2023-12-21 20:36:43 +08:00
2023-12-12 13:48:42 +08:00
2023-12-12 13:48:42 +08:00
2023-11-15 10:08:26 +08:00
2024-01-10 20:48:50 +08:00
2023-09-21 09:45:27 +08:00
2023-12-15 16:04:45 +08:00
2023-09-21 09:45:27 +08:00
2024-01-04 10:02:46 +08:00
2023-10-20 14:26:09 +08:00
2023-09-27 11:07:25 +08:00
2024-01-02 18:58:47 +08:00
2023-11-21 16:04:23 +08:00
2023-11-08 19:18:20 +08:00
2023-10-16 10:26:09 +08:00
2023-09-21 09:45:27 +08:00
2023-09-21 09:45:27 +08:00
2023-05-25 09:53:30 +08:00
2023-12-16 14:00:38 +08:00
2023-11-22 10:26:28 +08:00
2023-11-08 19:18:20 +08:00
2024-01-12 15:50:52 +08:00
2023-09-21 09:45:27 +08:00
2023-10-20 14:26:09 +08:00
2023-08-08 20:41:15 +08:00
2023-11-07 11:52:22 +08:00
2023-10-13 09:55:34 +08:00
2023-10-13 09:55:34 +08:00
2023-06-09 01:28:37 +08:00
2023-10-11 21:01:35 +08:00
2024-01-16 12:22:52 +08:00
2021-11-16 15:41:11 +08:00
2023-04-06 19:14:32 +08:00
2023-09-21 09:45:27 +08:00
2021-10-09 11:22:58 +08:00
2023-12-20 15:02:55 +08:00
2023-12-20 15:02:55 +08:00
2023-09-21 09:45:27 +08:00
2024-01-02 18:58:47 +08:00
2023-12-04 19:14:33 +08:00
2023-12-04 19:14:33 +08:00
2023-11-15 10:08:26 +08:00
2023-11-15 10:08:26 +08:00
2023-09-21 09:45:27 +08:00
1dbc2ab8ee