yihao.dai 27ea5d14dc

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976) ...

With concurrenct L0 compaction
(https://github.com/milvus-io/milvus/pull/36816), delta logs might be
written to the same L1 segment, causing logID duplication when using the
incremental beginLogID. This PR removes the beginLogID mechanism and
instead passes a log ID range, where the number of IDs in the range
equals the number of compaction segment binlogs multiplied by an
expansion factor.

issue: https://github.com/milvus-io/milvus/issues/40207

pr: https://github.com/milvus-io/milvus/pull/40960

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

2025-03-28 14:34:21 +08:00

..

clustering_compactor_test.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

clustering_compactor.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

compactor_common_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

compactor_common.go

fix: Massive memory cost when compacting (#40763)

2025-03-20 11:28:11 +08:00

compactor.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

executor_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

executor.go

enhance: Use correct counter metrics for overall wa calculation (#40394) (#40679)

2025-03-17 15:06:19 +08:00

l0_compactor_test.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

l0_compactor.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

load_stats.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

merge_sort.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

mix_compactor_test.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

mix_compactor.go

fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)

2025-03-28 14:34:21 +08:00

mock_compactor.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

priority_queue_test.go

feat: supporing hybrid search group_by (#35982)

2024-09-08 17:09:04 +08:00

priority_queue.go

feat: Support stats task to sort segment by PK (#35054)

2024-09-02 14:19:03 +08:00

segment_reader_from_binlogs.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

segment_writer_bench_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

segment_writer_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00

segment_writer.go

enhance: [2.5] Use v2 package name for pkg module (#40117)

2025-02-23 00:46:01 +08:00