mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-31 16:05:30 +08:00

History

Fix DN flowgraph delete buffer logs (#18657 )

1. Remove logs about not existing segments.
2. Group logs by timestamp.
3. Log changed segments only.
4. Pair the segments reference lock and unlock log by taskID.

Resolves: #18655

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

2022-08-15 16:28:48 +08:00

allocator_test.go

[skip ci]Update license for dc channel manager (#10591 )

2021-10-25 20:19:25 +08:00

allocator.go

Fix Data race in NodeID (#16603 )

2022-04-24 22:03:44 +08:00

channel_checker_test.go

Make VChannelInfo read compatible with 2.0.2 (#17995 )

2022-07-07 21:58:22 +08:00

channel_checker.go

Make VChannelInfo read compatible with 2.0.2 (#17995 )

2022-07-07 21:58:22 +08:00

channel_manager_factory.go

Update some comments for data coord with some minor code refactoring. (#15686 )

2022-02-22 13:15:51 +08:00

channel_manager_test.go

Enhance channel manager ut (#17682 )

2022-06-23 18:08:14 +08:00

channel_manager.go

Use vchannel name in datanode subName (#18519 )

2022-08-03 17:10:36 +08:00

channel_store_test.go

Split watch operations to many transactions (#10655 )

2021-10-26 19:38:20 +08:00

channel_store.go

Make VChannelInfo read compatible with 2.0.2 (#17995 )

2022-07-07 21:58:22 +08:00

cluster_test.go

Fix an issue with bulk load with multiple DataNodes (#17324 )

2022-06-02 18:54:04 +08:00

cluster.go

Fix an issue with bulk load with multiple DataNodes (#17324 )

2022-06-02 18:54:04 +08:00

compaction_test.go

Segments can't be compacted when they have reference lock (#17649 )

2022-06-20 21:56:12 +08:00

compaction_trigger_test.go

Fix compaction selection policy (#17690 )

2022-06-22 19:00:14 +08:00

compaction_trigger.go

Refine merge operation during compacting phase (#18399 )

2022-07-28 14:52:31 +08:00

compaction.go

Segments can't be compacted when they have reference lock (#17649 )

2022-06-20 21:56:12 +08:00

const.go

Add distributed lock for segment refgerence (#16782 )

2022-05-31 16:36:03 +08:00

errors_test.go

Improve import statement (#13725 )

2021-12-20 15:46:03 +08:00

errors.go

[skip e2e] Modify code comments according to naming conventions (#13709 )

2021-12-20 11:20:43 +08:00

garbage_collector_test.go

Fix ParseSegmentIDBinlog panicks with bad input (#18413 )

2022-07-26 19:32:30 +08:00

garbage_collector.go

Fix Parse binlog path failure (#18583 )

2022-08-10 17:04:37 +08:00

handler.go

Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441 )

2022-06-16 12:00:10 +08:00

meta_test.go

Refactor handoff handler (#17806 )

2022-06-29 23:26:19 +08:00

meta_util.go

Make VChannelInfo read compatible with 2.0.2 (#17995 )

2022-07-07 21:58:22 +08:00

meta.go

Fix a nil pointer issue (#18343 )

2022-07-20 17:56:30 +08:00

metrics_info_test.go

[skip ci]Fix datacoord package name missing (#10608 )

2021-10-25 21:21:40 +08:00

metrics_info.go

Add ShowConfigurations for all remaining session (#18594 )

2022-08-12 13:20:39 +08:00

mock_test.go

Add ShowConfigurations for all remaining session (#18594 )

2022-08-12 13:20:39 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898 )

2021-11-16 15:41:11 +08:00

policy_test.go

Make DataNode release rather than delete when reassign (#17293 )

2022-06-02 13:56:04 +08:00

policy.go

Make VChannelInfo read compatible with 2.0.2 (#17995 )

2022-07-07 21:58:22 +08:00

README.md

[skip ci]Change etcd to lowercase (#9983 )

2021-10-15 18:58:37 +08:00

segment_allocation_policy_test.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

segment_allocation_policy.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

segment_info.go

Fix isCompacting flag lost after segment clone (#18248 )

2022-07-13 10:08:28 +08:00

segment_manager_test.go

Move bulk load segment lock happen early (#17612 )

2022-06-27 13:56:17 +08:00

segment_manager.go

Move bulk load segment lock happen early (#17612 )

2022-06-27 13:56:17 +08:00

segment_reference_manager_test.go

Acquiring the segment reference lock on task level (#17544 )

2022-06-15 21:38:10 +08:00

segment_reference_manager.go

Fix DN flowgraph delete buffer logs (#18657 )

2022-08-15 16:28:48 +08:00

server_test.go

Add ShowConfigurations for all remaining session (#18594 )

2022-08-12 13:20:39 +08:00

server.go

Use chunkManager rather than minio.Client in datanode garbage collection (#18092 )

2022-07-22 22:10:28 +08:00

services.go

Add ShowConfigurations for all remaining session (#18594 )

2022-08-12 13:20:39 +08:00

session_manager.go

Fix an issue with bulk load with multiple DataNodes (#17324 )

2022-06-02 18:54:04 +08:00

session.go

[skip e2e] Refine datacoord session comment (#13796 )

2021-12-20 19:48:53 +08:00

util_test.go

Refine compaction selection poliy (#17486 )

2022-06-15 23:14:10 +08:00

util.go

Make DataNode not panic if stale segment is not found during flush (#18322 )

2022-07-20 15:06:30 +08:00

README.md

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
Root Coordinator: timestamp, id and meta source.
Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.