mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-05 10:22:41 +08:00

History

Adopt the extended state in DataCoord (#16200 )

ChannelWatchInfo with ToWatch, ToRelease will trigger a timer.
ChannelManager now reacts to different ChannelWatch states.

- WatchSuccess > log this info

- WatchFailure/WatchTimeout > ToRelease

- ReleaseSuccess > Delete, reassign if not from DropCollection

- ReleaseFailure/ReleaseTimeout > Cleanup subscription and Delete,
  reassgin if not from DropCollection.

Some Notes:
1. Reassignment will add this channel to buffer if there's only one node.

See also: #15846

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

2022-03-28 22:33:27 +08:00

allocator_test.go

[skip ci]Update license for dc channel manager (#10591 )

2021-10-25 20:19:25 +08:00

allocator.go

Update codecov.yml (#15639 )

2022-02-18 18:29:50 +08:00

channel_checker_test.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

channel_checker.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

channel_manager_factory.go

Update some comments for data coord with some minor code refactoring. (#15686 )

2022-02-22 13:15:51 +08:00

channel_manager_test.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

channel_manager.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

channel_store_test.go

Split watch operations to many transactions (#10655 )

2021-10-26 19:38:20 +08:00

channel_store.go

Update some comments for data coord with some minor code refactoring. (#15686 )

2022-02-22 13:15:51 +08:00

cluster_test.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

cluster.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

compaction_policy_test.go

[skip e2e]Fix license missing issue in datacoord (#14426 )

2021-12-28 16:16:04 +08:00

compaction_policy.go

[skip e2e]Fix license missing issue in datacoord (#14425 )

2021-12-28 15:41:50 +08:00

compaction_test.go

[skip e2e]Fix license missing issue in datacoord (#14427 )

2021-12-28 15:43:51 +08:00

compaction_trigger_test.go

Implement mix compaction logic (#15542 )

2022-02-18 14:51:49 +08:00

compaction_trigger.go

Refine log level in data (#15821 )

2022-03-02 15:35:55 +08:00

compaction.go

Implement mix compaction logic (#15542 )

2022-02-18 14:51:49 +08:00

errors_test.go

Improve import statement (#13725 )

2021-12-20 15:46:03 +08:00

errors.go

[skip e2e] Modify code comments according to naming conventions (#13709 )

2021-12-20 11:20:43 +08:00

garbage_collector_test.go

Add MinioConfig in GlobalParams for all components (#15099 )

2022-01-10 17:29:34 +08:00

garbage_collector.go

Refine log level in data (#15821 )

2022-03-02 15:35:55 +08:00

handler.go

Reduce the number of metrics (#16030 )

2022-03-15 21:51:21 +08:00

meta_test.go

Make compaction not generate empty segment (#15707 )

2022-02-28 10:17:54 +08:00

meta.go

Reduce the number of metrics (#16030 )

2022-03-15 21:51:21 +08:00

metrics_info_test.go

[skip ci]Fix datacoord package name missing (#10608 )

2021-10-25 21:21:40 +08:00

metrics_info.go

[skip e2e]Sort imports (#14811 )

2022-01-05 17:17:26 +08:00

mock_test.go

Prepare for import (#16083 )

2022-03-21 15:47:23 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898 )

2021-11-16 15:41:11 +08:00

policy_test.go

Update some comments for data coord with some minor code refactoring. (#15686 )

2022-02-22 13:15:51 +08:00

policy.go

Extend watch/release channel logic in DataNode (#15925 )

2022-03-09 15:39:58 +08:00

README.md

[skip ci]Change etcd to lowercase (#9983 )

2021-10-15 18:58:37 +08:00

segment_allocation_policy_test.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

segment_allocation_policy.go

Use GlobalParamTable for all components (#13885 )

2021-12-23 18:39:11 +08:00

segment_info.go

[skip e2e]Sort imports (#14809 )

2022-01-05 14:06:48 +08:00

segment_manager_test.go

[skip e2e]Fix segment manager typo (#13644 )

2021-12-17 22:34:42 +08:00

segment_manager.go

Refine log level in data (#15821 )

2022-03-02 15:35:55 +08:00

server_test.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

server.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

services.go

Adopt the extended state in DataCoord (#16200 )

2022-03-28 22:33:27 +08:00

session_manager.go

Refine log level in data (#15821 )

2022-03-02 15:35:55 +08:00

session.go

[skip e2e] Refine datacoord session comment (#13796 )

2021-12-20 19:48:53 +08:00

util_test.go

Use CommonConfig in GlobalParams for all components (#15106 )

2022-01-10 19:03:35 +08:00

util.go

Use CommonConfig in GlobalParams for all components (#15106 )

2022-01-10 19:03:35 +08:00

README.md

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
Root Coordinator: timestamp, id and meta source.
Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.