congqixia 94a859c028

enhance: Add buffer forwarder for stream delta loading (#40559) ...

See also #40558
Related to #35303 & #38066 as well

This PR:
- Add `BufferedForward` to limit memory usage forwarding stream delete
- Add `UseLoad` flag to determine `Delete` shall use `segment.Delete` or
`segment.LoadDelta`
- Fix delegator accidentally use always true candidate while load
streaming delta

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

2025-03-17 15:24:10 +08:00

..

deletebuffer

enhance: Add buffer forwarder for stream delta loading (#40559)

2025-03-17 15:24:10 +08:00

buffered_forwarder_test.go

enhance: Add buffer forwarder for stream delta loading (#40559)

2025-03-17 15:24:10 +08:00

buffered_forwarder.go

enhance: Add buffer forwarder for stream delta loading (#40559)

2025-03-17 15:24:10 +08:00

delegator_data_test.go

enhance: Remove QueryCoord's scheduling of L0 segments (#39552)

2025-02-26 21:38:00 +08:00

delegator_data.go

enhance: Add buffer forwarder for stream delta loading (#40559)

2025-03-17 15:24:10 +08:00

delegator_test.go

enhance: Remove QueryCoord's scheduling of L0 segments (#39552)

2025-02-26 21:38:00 +08:00

delegator.go

enhance: Remove QueryCoord's scheduling of L0 segments (#39552)

2025-02-26 21:38:00 +08:00

delta_forward_test.go

enhance: Add buffer forwarder for stream delta loading (#40559)

2025-03-17 15:24:10 +08:00

delta_forward.go

enhance: Add buffer forwarder for stream delta loading (#40559)

2025-03-17 15:24:10 +08:00

distribution_test.go

enhance: Make dynamic load/release partition follow targets (#38059)

2024-12-05 16:24:40 +08:00

distribution.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

exclude_info_test.go

fix: Check exclude segment before add new growing segment (#31803)

2024-04-10 15:29:17 +08:00

exclude_info.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

idf_oracle_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

idf_oracle.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

mock_delegator.go

enhance: Remove QueryCoord's scheduling of L0 segments (#39552)

2025-02-26 21:38:00 +08:00

OWNERS

Fix offline set always nil (#23340)

2023-04-11 14:42:30 +08:00

scalar_pruner.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

segment_pruner_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

segment_pruner.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

snapshot_test.go

load segment with target version, avoid read redundant segment (#24929)

2023-06-27 11:48:45 +08:00

snapshot.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

types.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

util.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00