milvus

mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-08 01:58:34 +08:00

History

fix: Adjust binlog and parquet reader buffer size for import (#43495 )

1. Modify the binlog reader to stop reading a fixed 4096 rows and
instead use the calculated bufferSize to avoid generating small binlogs.
2. Use a fixed bufferSize (32MB) for the Parquet reader to prevent OOM.

issue: https://github.com/milvus-io/milvus/issues/43387

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

2025-07-23 21:28:54 +08:00

filter.go

enhance: Accelerate delete filtering during binlog import (#41551 )

2025-04-27 18:56:38 +08:00

l0_reader_test.go

fix: limit the concurency of zstd compression and decrease the memory usage of binlog generation (#42630 )

2025-06-11 09:06:34 +08:00

l0_reader.go

enhance: API integration with storage v2 in clustering-compactions (#40133 )

2025-03-13 14:12:06 +08:00

reader_test.go

fix: Adjust binlog and parquet reader buffer size for import (#43495 )