mirror of
https://gitee.com/milvus-io/milvus.git
synced 2025-12-29 06:55:27 +08:00
issue: #36686 bug reason: - The clustering compaction tasks on the datanode were never cleaned up. - The clustering compaction task contains a mapping from clustering key to buffer, this caused a large memory leak. fix: - clean the tasks on datanode by datacoord when clustering compaction finished. - reset the mapping that from clustering key to buffer on datanode when clustering finished. Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Data Node
DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.
Dependency
- KV store: a kv store that persists messages into blob storage.
- Message stream: receive messages and publish imformation
- Root Coordinator: get the latest unique IDs.
- Data Coordinator: get the flush information and which message stream to subscribe.