milvus

mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-29 06:55:27 +08:00

History

enhance: Retry reads from object storage on rate limit error (#46455 )

This PR improves the robustness of object storage operations by retrying
both explicit throttling errors (e.g. HTTP 429, SlowDown, ServerBusy).
These errors commonly occur under high concurrency and are typically
recoverable with bounded retries.

issue: https://github.com/milvus-io/milvus/issues/44772

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **New Features**
* Configurable retry support for reads from object storage and improved
mapping of transient/rate-limit errors.
* Added a retryable reader wrapper used by CSV/JSON/Parquet/Numpy import
paths.

* **Configuration**
  * New parameter to control storage read retry attempts.

* **Tests**
* Expanded unit tests covering error mapping and retry behaviors across
storage backends.
* Standardized mock readers and test initialization to simplify test
setups.

<sub>✏️ Tip: You can customize this high-level summary in your review
settings.</sub>
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

2025-12-23 11:03:18 +08:00

aliyun

enhance: move object storage client creation to pkg package (#40440 )

2025-03-12 20:38:07 +08:00

gcp

enhance: move object storage client creation to pkg package (#40440 )

2025-03-12 20:38:07 +08:00

huawei

feat: milvus support huawei cloud iam verification(#45298 ) (#45457 )

2025-11-11 14:41:41 +08:00

tencent

enhance: move object storage client creation to pkg package (#40440 )