admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-06 17:18:35 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/tests
History
wei liu bf5fde1431
fix: Prevent delegator unserviceable due to shard leader change (#42689) 
issue: #42098 #42404
Fix critical issue where concurrent balance segment and balance channel
operations cause delegator view inconsistency. When shard leader
switches between load and release phases of segment balance, it results
in loading segments on old delegator but releasing on new delegator,
making the new delegator unserviceable.

The root cause is that balance segment modifies delegator views, and if
these modifications happen on different delegators due to leader change,
it corrupts the delegator state and affects query availability.

Changes include:
- Add shardLeaderID field to SegmentTask to track delegator for load
- Record shard leader ID during segment loading in move operations
- Skip release if shard leader changed from the one used for loading
- Add comprehensive unit tests for leader change scenarios

This ensures balance segment operations are atomic on single delegator,
preventing view corruption and maintaining delegator serviceability.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-06-19 12:10:38 +08:00
..
_helm
fix: oom bookie when applying test (#42776)
2025-06-16 23:18:37 +08:00
benchmark
test: fix vulnerability of python lib (#32109)
2024-04-10 17:53:18 +08:00
docker
[automated] Update Pytest image changes (#37067)
2024-10-24 16:53:28 +08:00
go_client
enhance: [GoSDK]support run analyzer by collection field (#42642)
2025-06-17 11:16:38 +08:00
integration
fix: Prevent delegator unserviceable due to shard leader change (#42689)
2025-06-19 12:10:38 +08:00
java_client
Replace sdk source and merge tests and tests20 (#7182)
2021-08-20 11:00:56 +08:00
python_client
test: [skip e2e]remove tls connection (#42799)
2025-06-18 10:34:43 +08:00
restful_client
test: bump deps in requirements (#39530)
2025-01-24 09:53:05 +08:00
restful_client_v2
test: add concurrent index creation verification (#40174)
2025-04-17 17:18:32 +08:00
scripts
test: Add resource limit for e2e and nightly tests (#41820)
2025-05-15 14:22:22 +08:00
OWNERS
[skip ci]Update OWNERS files (#11898)
2021-11-16 15:41:11 +08:00
README_CN.md
enhance: use docker compose instead of docker-compose (#35208)
2024-08-02 19:32:32 +08:00
README.md
enhance: use docker compose instead of docker-compose (#35208)
2024-08-02 19:32:32 +08:00

README.md

Tests

E2E Test

Configuration Requirements

Operating System
Operating System Version
Amazon Linux 2023 or above
Ubuntu 20.04 or above
Mac 10.14 or above
Hardware
Hardware Type Recommended Configuration
CPU x86_64 architecture
Intel CPU Sandy Bridge or above
CPU Instruction Set
- SSE4_2
- AVX
- AVX2
- AVX512 or arm64 Linux/MacOS
Memory 16 GB or more
Software
Software Name Version
Docker 19.05 or above
Docker Compose 1.25.5 or above
jq 1.3 or above
kubectl 1.14 or above
helm 3.0 or above
kind 0.10.0 or above

Installing Dependencies

Troubleshooting Docker and Docker Compose
  1. Confirm that Docker Daemon is running：
$ docker info

  • Ensure that Docker is installed. Refer to the official installation instructions for Docker CE/EE.

  • Start the Docker Daemon if it is not already started.

  • To run Docker without root privileges, create a user group labeled docker, then add a user to the group with sudo usermod -aG docker $USER. Log out and log back into the terminal for the changes to take effect. For more information, see the official Docker documentation for Managing Docker as a Non-Root User.

  1. Check the version of Docker-Compose
$ docker compose version

docker compose version 1.25.5, build 8a1c60f6
docker-py version: 4.1.0
CPython version: 3.7.5
OpenSSL version: OpenSSL 1.1.1f  31 Mar 2020
Install jq
Install kubectl
Install helm
Install kind

Run E2E Tests

$ cd tests/scripts
$ ./e2e-k8s.sh

Getting help

You can get help with the following command:

$ ./e2e-k8s.sh --help