mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00

History

Ten Thousand Leaves a8e1c8fa9d

Make duplicate flush recalls success and other logic update (#16755 )

Latest logic:
1) Duplicate flush calls on same segments will not result in errors (same as the original design)
2) `FlushSegments` now still flushes stale segments even if non-stale segments failed to get flushed

issue: #16749

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

2022-05-06 17:49:51 +08:00

allocator_test.go

Change genKey into JoinIDPath (#12959 )

2021-12-09 11:09:06 +08:00

allocator.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

binlog_io_test.go

Support delete varChar value (#16229 )

2022-04-02 17:43:29 +08:00

binlog_io.go

Replace minio kv with minio chunk manager (#15936 )

2022-03-17 18:03:23 +08:00

cache_test.go

Make duplicate flush recalls success and other logic update (#16755 )

2022-05-06 17:49:51 +08:00

cache.go

Make duplicate flush recalls success and other logic update (#16755 )

2022-05-06 17:49:51 +08:00

compaction_executor_test.go

Fix compaction ut datarace (#15267 )

2022-01-18 17:49:39 +08:00

compaction_executor.go

Add prometheus metrics for DataNode (#15650 )

2022-02-28 19:11:55 +08:00

compactor_test.go

Fix Compact Entity ttl param (#16665 )

2022-04-28 11:51:47 +08:00

compactor.go

Fix Compact Entity ttl param (#16665 )

2022-04-28 11:51:47 +08:00

data_node_test.go

Make duplicate flush recalls success and other logic update (#16755 )

2022-05-06 17:49:51 +08:00

data_node.go

Make duplicate flush recalls success and other logic update (#16755 )

2022-05-06 17:49:51 +08:00

data_sync_service_test.go

Add dependency factory (#16204 )

2022-04-07 22:05:32 +08:00

data_sync_service.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

errors_test.go

[skip ci]Update license for datesync (#9959 )

2021-10-15 18:01:38 +08:00

errors.go

Normalize DataNode term in errors.go (#13688 )

2021-12-20 12:20:50 +08:00

event_manager_test.go

Handle flowgraph releasing properly (#16169 )

2022-04-20 16:45:41 +08:00

event_manager.go

Handle flowgraph releasing properly (#16169 )

2022-04-20 16:45:41 +08:00

flow_graph_dd_node_test.go

Add dependency factory (#16204 )

2022-04-07 22:05:32 +08:00

flow_graph_dd_node.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

flow_graph_delete_node_test.go

Support delete varChar value (#16229 )

2022-04-02 17:43:29 +08:00

flow_graph_delete_node.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

flow_graph_dmstream_input_node_test.go

Support configurable msgstream (#16131 )

2022-03-24 10:15:25 +08:00

flow_graph_dmstream_input_node.go

Remove useless log (#16624 )

2022-04-27 10:01:47 +08:00

flow_graph_insert_buffer_node_test.go

Add dependency factory (#16204 )

2022-04-07 22:05:32 +08:00

flow_graph_insert_buffer_node.go

Simplify monitoring metrics (#16687 )

2022-04-27 23:03:47 +08:00

flow_graph_manager_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

flow_graph_manager.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

flow_graph_message_test.go

[skip ci]Update license for datanode (#9963 )

2021-10-15 18:09:00 +08:00

flow_graph_message.go

Reconstruct mqstream module (#15784 )

2022-03-03 21:57:56 +08:00

flow_graph_node.go

[skip ci]Update license for datanode (#9963 )

2021-10-15 18:09:00 +08:00

flow_graph_time_ticker_test.go

Move segment statistics update to datanode tt loop (#13233 )

2021-12-15 10:53:16 +08:00

flow_graph_time_ticker.go

Fix ticker leakage in datanode flowgraph (#16346 )

2022-04-01 19:35:29 +08:00

flush_manager_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

flush_manager.go

Simplify monitoring metrics (#16687 )

2022-04-27 23:03:47 +08:00

flush_task_test.go

Fix flush manager injection logic with multiple segments (#12260 )

2021-11-24 18:41:16 +08:00

flush_task.go

Fix EntriesNum is not passed in flush task (#15482 )

2022-02-09 10:05:46 +08:00

meta_service_test.go

Support insert string data (#15993 )

2022-03-25 14:27:25 +08:00

meta_service.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

metrics_info.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

mock_test.go

Report bulk load state (#16555 )

2022-04-21 21:37:42 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898 )

2021-11-16 15:41:11 +08:00

README.md

[skip ci]Change uppercase of MinIO (#9539 )

2021-10-09 11:22:58 +08:00

segment_replica_test.go

Support delete varChar value (#16229 )

2022-04-02 17:43:29 +08:00

segment_replica.go

Support delete varChar value (#16229 )

2022-04-02 17:43:29 +08:00

type_def.go

[skip ci]Update license for datanode (#9963 )

2021-10-15 18:09:00 +08:00

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

KV store: a kv store that persists messages into blob storage.
Message stream: receive messages and publish imformation
Root Coordinator: get the latest unique IDs.
Data Coordinator: get the flush information and which message stream to subscribe.