mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-07 17:48:29 +08:00

History

Adopt the extended state in DataCoord (#16200 )

ChannelWatchInfo with ToWatch, ToRelease will trigger a timer.
ChannelManager now reacts to different ChannelWatch states.

- WatchSuccess > log this info

- WatchFailure/WatchTimeout > ToRelease

- ReleaseSuccess > Delete, reassign if not from DropCollection

- ReleaseFailure/ReleaseTimeout > Cleanup subscription and Delete,
  reassgin if not from DropCollection.

Some Notes:
1. Reassignment will add this channel to buffer if there's only one node.

See also: #15846

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

2022-03-28 22:33:27 +08:00

allocator_test.go

Change genKey into JoinIDPath (#12959 )

2021-12-09 11:09:06 +08:00

allocator.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

binlog_io_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

binlog_io.go

Replace minio kv with minio chunk manager (#15936 )

2022-03-17 18:03:23 +08:00

cache_test.go

[skip ci]Update license on datanode (#9960 )

2021-10-15 18:03:25 +08:00

cache.go

Complete drop collection procedure in DN (#11552 )

2021-11-11 20:56:49 +08:00

compaction_executor_test.go

Fix compaction ut datarace (#15267 )

2022-01-18 17:49:39 +08:00

compaction_executor.go

Add prometheus metrics for DataNode (#15650 )

2022-02-28 19:11:55 +08:00

compactor_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

compactor.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

data_node_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

data_node.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

data_sync_service_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

data_sync_service.go

Replace minio kv with minio chunk manager (#15936 )

2022-03-17 18:03:23 +08:00

errors_test.go

[skip ci]Update license for datesync (#9959 )

2021-10-15 18:01:38 +08:00

errors.go

Normalize DataNode term in errors.go (#13688 )

2021-12-20 12:20:50 +08:00

event_manager_test.go

Extend watch/release channel logic in DataNode (#15925 )

2022-03-09 15:39:58 +08:00

event_manager.go

Extend watch/release channel logic in DataNode (#15925 )

2022-03-09 15:39:58 +08:00

flow_graph_dd_node_test.go

Reconstruct mqstream module (#15784 )

2022-03-03 21:57:56 +08:00

flow_graph_dd_node.go

Reduce the number of metrics (#16030 )

2022-03-15 21:51:21 +08:00

flow_graph_delete_node_test.go

Replace minio kv with minio chunk manager (#15936 )

2022-03-17 18:03:23 +08:00

flow_graph_delete_node.go

Reconstruct mqstream module (#15784 )

2022-03-03 21:57:56 +08:00

flow_graph_dmstream_input_node_test.go

Support configurable msgstream (#16131 )

2022-03-24 10:15:25 +08:00

flow_graph_dmstream_input_node.go

Reduce the number of metrics (#16030 )

2022-03-15 21:51:21 +08:00

flow_graph_insert_buffer_node_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

flow_graph_insert_buffer_node.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

flow_graph_manager_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

flow_graph_manager.go

Replace minio kv with minio chunk manager (#15936 )

2022-03-17 18:03:23 +08:00

flow_graph_message_test.go

[skip ci]Update license for datanode (#9963 )

2021-10-15 18:09:00 +08:00

flow_graph_message.go

Reconstruct mqstream module (#15784 )

2022-03-03 21:57:56 +08:00

flow_graph_node.go

[skip ci]Update license for datanode (#9963 )

2021-10-15 18:09:00 +08:00

flow_graph_time_ticker_test.go

Move segment statistics update to datanode tt loop (#13233 )

2021-12-15 10:53:16 +08:00

flow_graph_time_ticker.go

Move segment statistics update to datanode tt loop (#13233 )

2021-12-15 10:53:16 +08:00

flush_manager_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

flush_manager.go

Replace minio kv with minio chunk manager (#15936 )

2022-03-17 18:03:23 +08:00

flush_task_test.go

Fix flush manager injection logic with multiple segments (#12260 )

2021-11-24 18:41:16 +08:00

flush_task.go

Fix EntriesNum is not passed in flush task (#15482 )

2022-02-09 10:05:46 +08:00

meta_service_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

meta_service.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

metrics_info.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

mock_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898 )

2021-11-16 15:41:11 +08:00

README.md

[skip ci]Change uppercase of MinIO (#9539 )

2021-10-09 11:22:58 +08:00

segment_replica_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

segment_replica.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

type_def.go

[skip ci]Update license for datanode (#9963 )

2021-10-15 18:09:00 +08:00

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

KV store: a kv store that persists messages into blob storage.
Message stream: receive messages and publish imformation
Root Coordinator: get the latest unique IDs.
Data Coordinator: get the flush information and which message stream to subscribe.