admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-29 23:15:28 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/datanode
History
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204) 
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
..
allocator_test.go
[skip ci]Update license on datanode (#9960)
2021-10-15 18:03:25 +08:00
allocator.go
[skip ci]Update license on datanode (#9960)
2021-10-15 18:03:25 +08:00
binlog_io_test.go
Fix multi delete data not effect (#11422)
2021-11-09 15:01:17 +08:00
binlog_io.go
[skip ci]Fix download typo (#11577)
2021-11-10 20:11:35 +08:00
cache_test.go
[skip ci]Update license on datanode (#9960)
2021-10-15 18:03:25 +08:00
cache.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
compaction_executor_test.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
compaction_executor.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
compactor_test.go
Fix compaction generates wrong insert binlogs (#12204)
2021-11-23 17:09:15 +08:00
compactor.go
Fix compaction generates wrong insert binlogs (#12204)
2021-11-23 17:09:15 +08:00
data_node_test.go
Fix datarace between GetComponentStates and Register (#11935)
2021-11-19 13:57:12 +08:00
data_node.go
Send SIGINT to runner goroutine after etcd disconnects (#12163)
2021-11-22 16:23:17 +08:00
data_sync_service_test.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
data_sync_service.go
Add close for flushManager (#11874)
2021-11-17 10:39:15 +08:00
errors_test.go
[skip ci]Update license for datesync (#9959)
2021-10-15 18:01:38 +08:00
errors.go
[skip ci]Update license for datesync (#9959)
2021-10-15 18:01:38 +08:00
flow_graph_dd_node_test.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
flow_graph_dd_node.go
Add more specific logs (#11724)
2021-11-15 15:25:09 +08:00
flow_graph_delete_node_test.go
Apply retry for flush manager execution (#11808)
2021-11-15 17:19:10 +08:00
flow_graph_delete_node.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
flow_graph_dmstream_input_node_test.go
Add msgstream reader (#12130)
2021-11-19 15:57:12 +08:00
flow_graph_dmstream_input_node.go
Normalize datanode dminput node log (#12128)
2021-11-19 14:21:13 +08:00
flow_graph_insert_buffer_node_test.go
Apply retry for flush manager execution (#11808)
2021-11-15 17:19:10 +08:00
flow_graph_insert_buffer_node.go
Add more log for debug (#11893)
2021-11-18 10:37:41 +08:00
flow_graph_message_test.go
[skip ci]Update license for datanode (#9963)
2021-10-15 18:09:00 +08:00
flow_graph_message.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
flow_graph_node.go
[skip ci]Update license for datanode (#9963)
2021-10-15 18:09:00 +08:00
flow_graph_time_ticker_test.go
Add mergedTimetickSender for datanode (#11297)
2021-11-05 14:59:32 +08:00
flow_graph_time_ticker.go
Add mergedTimetickSender for datanode (#11297)
2021-11-05 14:59:32 +08:00
flush_manager_test.go
Add close for flushManager (#11874)
2021-11-17 10:39:15 +08:00
flush_manager.go
Fix DeltaLogs empty yet appending a deltaInfo bug (#11984)
2021-11-17 17:57:11 +08:00
flush_task_test.go
Apply retry for flush manager execution (#11808)
2021-11-15 17:19:10 +08:00
flush_task.go
Apply retry for flush manager execution (#11808)
2021-11-15 17:19:10 +08:00
meta_service_test.go
Add binlog io for compaction (#10536)
2021-10-25 20:13:51 +08:00
meta_service.go
[skip ci]Update license for datanode (#9963)
2021-10-15 18:09:00 +08:00
metrics_info.go
[skip ci]Update license for datanode (#9963)
2021-10-15 18:09:00 +08:00
mock_test.go
Fix compaction bug (#11816)
2021-11-17 10:07:13 +08:00
OWNERS
[skip ci]Update OWNERS files (#11898)
2021-11-16 15:41:11 +08:00
param_table_test.go
[skip ci]Update license for datanode (#9963)
2021-10-15 18:09:00 +08:00
param_table.go
Move node.yaml to component.yaml (#11363)
2021-11-10 14:27:37 +08:00
README.md
[skip ci]Change uppercase of MinIO (#9539)
2021-10-09 11:22:58 +08:00
segment_replica_test.go
Complete drop collection procedure in DN (#11552)
2021-11-11 20:56:49 +08:00
segment_replica.go
Fix compaction bug (#11816)
2021-11-17 10:07:13 +08:00
type_def.go
[skip ci]Update license for datanode (#9963)
2021-10-15 18:09:00 +08:00

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish imformation
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.