mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-06 17:18:35 +08:00

History

enhance: Rename Compaction to CompactionV2 (#33858 )

Due to the removal of injection and syncSegments from the compaction, we
need to ensure that no compaction is successfully executed during the
rolling upgrade. This PR renames Compaction to CompactionV2, with the
following effects:
- New datacoord + old datanode: Utilizes the CompactionV2 interface,
resulting in the datanode error "CompactionV2 not implemented," causing
compaction to fail;
- Old datacoord + new datanode: Utilizes the CompactionV1 interface,
resulting in the datanode error "CompactionV1 not implemented," causing
compaction to fail.

issue: https://github.com/milvus-io/milvus/issues/32809

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

2024-06-16 22:07:57 +08:00

allocator

Replace manual composed grpc call with Broker methods (#27676 )

2023-10-13 09:55:34 +08:00

broker

enhance:change wrong log (#33447 )

2024-05-29 18:35:44 +08:00

compaction

enhance: Tidy compaction executor (#33778 )

2024-06-14 14:34:01 +08:00

importv2

enhance: Avoid merging insert data when buffering insert msgs (#33562 )

2024-06-13 11:15:56 +08:00

enhance: Execute bloom filter apply in parallel to speed up segment predict (#33792 )

2024-06-14 11:37:56 +08:00

iterators

enhance: Avoid merging insert data when buffering insert msgs (#33562 )

2024-06-13 11:15:56 +08:00

metacache

enhance: Execute bloom filter apply in parallel to speed up segment predict (#33792 )

2024-06-14 11:37:56 +08:00

syncmgr

enhance: Avoid merging insert data when buffering insert msgs (#33562 )

2024-06-13 11:15:56 +08:00

util

fix: Fix l0 compactor may cause DN from OOM (#33554 )

2024-06-06 14:33:52 +08:00

writebuffer

enhance: Execute bloom filter apply in parallel to speed up segment predict (#33792 )

2024-06-14 11:37:56 +08:00

cache_test.go

Make duplicate flush recalls success and other logic update (#16755 )

2022-05-06 17:49:51 +08:00

cache.go

Use typeutil.ConcurrentMap instead of sync.Map (#25846 )

2023-07-24 10:23:01 +08:00

channel_checkpoint_updater_test.go

enhance: Refine channelCpUpdater field & test (#33083 )

2024-05-16 14:19:34 +08:00

channel_checkpoint_updater.go

enhance: Add comment for channel cp updater (#33759 )

2024-06-12 20:01:55 +08:00

channel_manager_test.go

fix: channel manager's goroutine run order (#33118 )

2024-05-21 14:35:39 +08:00

channel_manager.go

fix: channel manager's goroutine run order (#33118 )

2024-05-21 14:35:39 +08:00

data_node_test.go

enhance: Remove import v1 (#31403 )

2024-03-22 15:29:09 +08:00

data_node.go

enhance: Tidy compaction executor (#33778 )

2024-06-14 14:34:01 +08:00

data_sync_service_test.go

enhance: Reduce datanode metacache frequent scan range (#33400 )

2024-05-28 14:19:42 +08:00

data_sync_service.go

enhance: Tidy compaction executor (#33778 )

2024-06-14 14:34:01 +08:00

event_manager_test.go

fix: Prevent restart timetick sender creating ut datanode (#33790 )

2024-06-12 22:29:58 +08:00

event_manager.go

doc: [skip-e2e] add comments for event manager (#33444 )

2024-06-13 17:56:06 +08:00

flow_graph_dd_node_test.go

enhance: Tidy compaction executor (#33778 )

2024-06-14 14:34:01 +08:00

flow_graph_dd_node.go

enhance: Tidy compaction executor (#33778 )

2024-06-14 14:34:01 +08:00

flow_graph_dmstream_input_node_test.go

enhance: add the includeCurrentMsg param for the Seek method (#33326 )

2024-05-27 10:31:41 +08:00

flow_graph_dmstream_input_node.go

fix: add back existing datanode metrics (#29360 )

2023-12-22 14:20:43 +08:00

flow_graph_manager_test.go

enhance: Remove rootcoord from datanode broker (#32818 )

2024-05-14 10:03:32 +08:00

flow_graph_manager.go

enhance: Make datanode exit and case TestProxy faster (#32218 )

2024-04-16 10:49:20 +08:00

flow_graph_message_test.go

Format the code (#27275 )

2023-09-21 09:45:27 +08:00

flow_graph_message.go

Format the code (#27275 )

2023-09-21 09:45:27 +08:00

flow_graph_node.go

Make flow graph retry longer (#24355 )

2023-05-25 09:53:30 +08:00

flow_graph_time_tick_node.go

enhance: Add comment for channel cp updater (#33759 )

2024-06-12 20:01:55 +08:00

flow_graph_time_ticker.go

enhance: create goroutine only once (#28594 )

2023-11-22 10:26:28 +08:00

flow_graph_write_node.go

fix: Sync dropped segment for dropped partition (#33331 )

2024-06-06 10:25:52 +08:00

flush_task_counter_test.go

Fix flushManager.isFull is too slow (#28141 )

2023-11-03 14:42:17 +08:00

flush_task_counter.go

Fix flushManager.isFull is too slow (#28141 )

2023-11-03 14:42:17 +08:00

meta_util.go

Use go-api/v2 for milvus-proto (#24770 )

2023-06-09 01:28:37 +08:00

metrics_info.go

enhance: Use struct{} for sync task future result (#32673 )

2024-04-29 10:59:26 +08:00

mock_channelmanager.go

enhance: Change DN channelmanger into interface (#29307 )

2023-12-27 16:00:48 +08:00

mock_fgmanager.go

enhance: Use struct{} for sync task future result (#32673 )

2024-04-29 10:59:26 +08:00

mock_test.go

enhance: Tidy compactor and remove dup codes (#32198 )

2024-05-23 09:53:40 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898 )

2021-11-16 15:41:11 +08:00

rate_collector_test.go

Move some modules from internal to public package (#22572 )

2023-04-06 19:14:32 +08:00

rate_collector.go

feat: support rate limiter based on db and partition levels (#31070 )

2024-04-12 16:01:19 +08:00

README.md

[skip ci]Change uppercase of MinIO (#9539 )

2021-10-09 11:22:58 +08:00

services_test.go

enhance: Rename Compaction to CompactionV2 (#33858 )

2024-06-16 22:07:57 +08:00

services.go

enhance: Rename Compaction to CompactionV2 (#33858 )

2024-06-16 22:07:57 +08:00

stats_updater_test.go

Use writebuffer, sync manager refactory in datanode (#28320 )

2023-11-15 15:24:18 +08:00

stats_updater.go

test: support multiple data/querynodes in integration test (#30618 )

2024-02-21 11:54:53 +08:00

timetick_sender_test.go

enhance: Reduce the memory usage of the timeTickSender (#30968 )

2024-03-02 10:13:01 +08:00

timetick_sender.go

enhance: optimize datanode cpu usage under large collection number (#33267 )

2024-05-25 04:43:41 +08:00

util.go

Format the code (#27275 )

2023-09-21 09:45:27 +08:00

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

KV store: a kv store that persists messages into blob storage.
Message stream: receive messages and publish imformation
Root Coordinator: get the latest unique IDs.
Data Coordinator: get the flush information and which message stream to subscribe.