yihao.dai c5918290e6

feat: Add import executor and manager for datanode (#29438) ...

This PR introduces novel importv2 roles for datanode:
1. Executor: To execute tasks, a import task will be divided into the
following steps: read data -> hash data -> sync data;
2. Manager: To manage all the tasks;

issue: https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

2024-01-31 20:45:04 +08:00

..

key_lock_dispatcher_test.go

feat: integrate storage v2 into the write path (#28440)

2023-11-23 17:26:24 +08:00

key_lock_dispatcher.go

fix: add back existing datanode metrics (#29360)

2023-12-22 14:20:43 +08:00

meta_writer_test.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

meta_writer.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

mock_meta_writer.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

mock_serializer.go

fix: serializer shall bypass L0 segment merge stats step (#29636)

2024-01-04 16:52:45 +08:00

mock_sync_manager.go

enhance: Log channel checkpoint source info in writebuffer (#28993)

2023-12-07 11:50:36 +08:00

options.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

serializer.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

storage_serializer_test.go

enhance: separate serializer logic from sync task (#29413)

2023-12-26 10:40:47 +08:00

storage_serializer.go

fix: Set segment level for comapct to segment (#30129)

2024-01-19 18:52:53 +08:00

storage_v2_serializer_test.go

feat: integrate storagev2 into loading segment (#29336)

2024-01-12 18:10:51 +08:00

storage_v2_serializer.go

feat: integrate storagev2 into loading segment (#29336)

2024-01-12 18:10:51 +08:00

sync_manager_test.go

enhance: make SyncManager pool size refreshable (#29224)

2023-12-15 09:58:43 +08:00

sync_manager.go

enhance: make SyncManager pool size refreshable (#29224)

2023-12-15 09:58:43 +08:00

task_test.go

enhance: reduce SyncTask AllocID call and refine code (#29701)

2024-01-05 10:04:46 +08:00

task.go

feat: Add import executor and manager for datanode (#29438)

2024-01-31 20:45:04 +08:00

taskv2_test.go

feat: integrate storagev2 into loading segment (#29336)

2024-01-12 18:10:51 +08:00

taskv2.go

feat: integrate storagev2 into loading segment (#29336)

2024-01-12 18:10:51 +08:00