admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-07 17:48:29 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/datanode
History
Ted Xu 078ccf5e08
fix: the underlying record got released in clustering compaction (#43551) 
See: #43186

In this PR:

1. Flush renamed to FlushChunk, while a new Flush primitive is
introduced to serialize values to records.
2. Segment mapping in clustering compaction now process data by records
instead of values, it calls flush to all buffers after each record is
processed.

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-07-25 15:04:54 +08:00
..
allocator
fix: Fix no candidate segments error for small import (#41771)
2025-05-14 15:30:21 +08:00
compactor
fix: the underlying record got released in clustering compaction (#43551)
2025-07-25 15:04:54 +08:00
importv2
enhance: add schema version at recovery storage (#43500)
2025-07-23 21:38:54 +08:00
index
enhance: [StorageV2] Refine storage rw option usage & validation (#43175)
2025-07-11 01:14:48 +08:00
msghandlerimpl
fix: Pre-check import message to prevent pipeline block indefinitely (#42415)
2025-06-11 13:40:38 +08:00
util
enhance: Move sort stats task to sort compaction (#42562)
2025-07-08 20:22:47 +08:00
.mockery.yaml
fix: Prevent import from generating small binlogs (#43132)
2025-07-07 21:32:47 +08:00
chunk_mgr_factory.go
enhance: Merge IndexNode and DataNode (#40272)
2025-03-13 14:26:11 +08:00
data_node_test.go
enhance: Remove chunkmanager-related dependencies from datanode (#43021)
2025-07-03 14:44:45 +08:00
data_node.go
enhance: Remove chunkmanager-related dependencies from datanode (#43021)
2025-07-03 14:44:45 +08:00
index_services_test.go
enhance: apply load config changes after QueryCoord restart (#43108)
2025-07-10 14:28:48 +08:00
index_services.go
enhance: Pooling for data tasks (#41256)
2025-05-20 21:06:24 +08:00
metrics_info.go
enhance: Remove chunkmanager-related dependencies from datanode (#43021)
2025-07-03 14:44:45 +08:00
OWNERS
enhance: Merge IndexNode and DataNode (#40272)
2025-03-13 14:26:11 +08:00
README.md
doc: Fix small typo in internal/datanode/README.md (#42089)
2025-05-27 10:16:27 +08:00
services_test.go
enhance: Remove chunkmanager-related dependencies from datanode (#43021)
2025-07-03 14:44:45 +08:00
services.go
fix: Fix import fileStats incorrectly set to nil (#43463)
2025-07-22 12:37:01 +08:00

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish information
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.