admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/datanode
History
yihao.dai f978641d6a
enhance: [2.5] Enhance import integration tests and logs (#42696) 
1. Optimize the import process: skip subsequent steps and mark the task
as complete if the number of imported rows is 0.
2. Improve import integration tests:
a. Add a test to verify that autoIDs are not duplicated
b. Add a test for the corner case where all data is deleted
c. Shorten test execution time
3. Enhance import logging:
a. Print imported segment information upon completion
b. Include file name in failure logs

issue: https://github.com/milvus-io/milvus/issues/42488,
https://github.com/milvus-io/milvus/issues/42518

pr: https://github.com/milvus-io/milvus/pull/42612

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-16 20:06:38 +08:00
..
allocator
fix: [2.5] Fix no candidate segments error for small import (#41772)
2025-05-14 10:36:22 +08:00
channel
fix: ChannelManager double assignment (#41877)
2025-05-16 14:58:23 +08:00
compaction
fix: [2.5] Fix ants.Pool goroutine leak (#41893)
2025-05-16 19:12:22 +08:00
importv2
enhance: [2.5] Enhance import integration tests and logs (#42696)
2025-06-16 20:06:38 +08:00
iterators
enhance: [2.5] Use v2 package name for pkg module (#40117)
2025-02-23 00:46:01 +08:00
util
enhance: [2.5] Use v2 package name for pkg module (#40117)
2025-02-23 00:46:01 +08:00
.mockery.yaml
fix: [2.5] Fix no candidate segments error for small import (#41772)
2025-05-14 10:36:22 +08:00
data_node_test.go
enhance: [2.5] Use v2 package name for pkg module (#40117)
2025-02-23 00:46:01 +08:00
data_node.go
enhance: [2.5] Use v2 package name for pkg module (#40117)
2025-02-23 00:46:01 +08:00
metrics_info.go
enhance: [2.5] Use v2 package name for pkg module (#40117)
2025-02-23 00:46:01 +08:00
OWNERS
[skip ci]Update OWNERS files (#11898)
2021-11-16 15:41:11 +08:00
README.md
[skip ci]Change uppercase of MinIO (#9539)
2021-10-09 11:22:58 +08:00
services_test.go
fix: [2.5] Fix delete data loss due to duplicate binlogID (#40976)
2025-03-28 14:34:21 +08:00
services.go
fix: [2.5] Fix duplicate autoID between import and insert (#42520)
2025-06-05 00:54:33 +08:00

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish imformation
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.