congqixia 6445880753

fix: prevent segments got flushed multiple times (#30240) ...

See also #30111

Segments could be "Flushed" only by `FlushSegments` grpc call from
datacoord by design. There are two possible reason to cause one segment
got flushed multiple times.

- Segment is in flushing state during multiple epoch in flowgraph
- Segment is flushed by flushTs & Flush segments

So this pr fix:

- Remove state change logic form FlushTs policy
- Change Flush segment into three stage way: Sealed->Flushing->Flushed
preventing multiple Flushed=true operations.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

2024-01-24 14:19:00 +08:00

..

bf_write_buffer_test.go

fix: prevent segments got flushed multiple times (#30240)

2024-01-24 14:19:00 +08:00

bf_write_buffer.go

enhance: only buffer delete if it match insert has smaller timestamp (#30122)

2024-01-19 17:28:53 +08:00

delta_buffer_test.go

Use writebuffer, sync manager refactory in datanode (#28320)

2023-11-15 15:24:18 +08:00

delta_buffer.go

Use writebuffer, sync manager refactory in datanode (#28320)

2023-11-15 15:24:18 +08:00

insert_buffer_test.go

enhance: only buffer delete if it match insert has smaller timestamp (#30122)

2024-01-19 17:28:53 +08:00

insert_buffer.go

enhance: only buffer delete if it match insert has smaller timestamp (#30122)

2024-01-19 17:28:53 +08:00

l0_write_buffer_test.go

enhance: only buffer delete if it match insert has smaller timestamp (#30122)

2024-01-19 17:28:53 +08:00

l0_write_buffer.go

enhance: only buffer delete if it match insert has smaller timestamp (#30122)

2024-01-19 17:28:53 +08:00

manager_test.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

manager.go

feat: integrate storage v2 into the write path (#28440)

2023-11-23 17:26:24 +08:00

mock_mananger.go

feat: integrate storage v2 into the write path (#28440)

2023-11-23 17:26:24 +08:00

mock_write_buffer.go

enhance: Remove commented code and fix naming issue (#28450)

2023-11-16 00:22:20 +08:00

options.go

fix: prevent segments got flushed multiple times (#30240)

2024-01-24 14:19:00 +08:00

segment_buffer.go

enhance: Write buffer time range when syncing logs (#28970)

2023-12-05 17:36:36 +08:00

sync_policy_test.go

fix: prevent segments got flushed multiple times (#30240)

2024-01-24 14:19:00 +08:00

sync_policy.go

fix: prevent segments got flushed multiple times (#30240)

2024-01-24 14:19:00 +08:00

write_buffer_test.go

enhance: make ColumnBasedInsertMsgToInsertData check field missing (#29758)

2024-01-09 11:50:48 +08:00

write_buffer.go

fix: prevent segments got flushed multiple times (#30240)

2024-01-24 14:19:00 +08:00