milvus/storage at 006d71980e628ab35e69ba0b80ee34bba68fb061 - milvus - Gitea: Git with a cup of tea

admin/milvus

mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00

History

yihao.dai c796cc9414

enhance: [2.5] Retry reads from object storage on rate limit error (#46463 )

This PR improves the robustness of object storage operations by retrying
both explicit throttling errors (e.g. HTTP 429, SlowDown, ServerBusy).
These errors commonly occur under high concurrency and are typically
recoverable with bounded retries.

issue: https://github.com/milvus-io/milvus/issues/44772

pr: https://github.com/milvus-io/milvus/pull/46455

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

2025-12-23 11:15:19 +08:00

..

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

Format the code (#27275 )

2023-09-21 09:45:27 +08:00

feat: Support tencent cloud object storage for milvus (#30163 )

2024-01-23 11:28:56 +08:00

azure_object_storage_test.go

enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740 )

2024-04-25 20:41:27 +08:00

azure_object_storage.go

enhance: Add Size interface to FileReader to eliminate the StatObject call during Read (#42911 )

2025-06-25 15:26:42 +08:00

binlog_iterator_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

binlog_iterator.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

binlog_reader.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

binlog_test.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

binlog_util_test.go

Format the code (#27275 )

2023-09-21 09:45:27 +08:00

binlog_util.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

binlog_writer_test.go

enhance: binlog primary key turn off dict encoding (#34358 )

2024-07-17 17:47:44 +08:00

binlog_writer.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

data_codec_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

data_codec.go

feat:Geospatial Data Type and GIS Function support for milvus (#43661 )

2025-08-26 19:11:55 +08:00

data_sorter_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

data_sorter.go

feat:Geospatial Data Type and GIS Function support for milvus (#43661 )

2025-08-26 19:11:55 +08:00

delta_data_test.go

enhance: Return deltadata for DeleteCodec.Deserialize (#37214 )

2024-10-29 12:04:24 +08:00

delta_data.go

enhance: [2.5] Add buffer forwarder for stream delta loading (#40559 ) (#40699 )

2025-03-19 10:28:14 +08:00

event_data.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

event_header.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

event_reader.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

event_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

event_writer_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

event_writer.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

factory.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

field_stats_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

field_stats.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

field_value_test.go

enhance: Use internal json(sonic) to replace std json lib (#37708 )

2024-11-18 10:46:31 +08:00

field_value.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

gcp_native_object_storage_test.go

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214 )

2024-09-30 13:23:32 +08:00

gcp_native_object_storage.go

enhance: Add Size interface to FileReader to eliminate the StatObject call during Read (#42911 )

2025-06-25 15:26:42 +08:00

index_data_codec_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

index_data_codec.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

insert_data_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

insert_data.go

fix: [2.5] Fix import null geometry data (#45163 )

2025-10-31 12:34:10 +08:00

local_chunk_manager_test.go

enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740 )

2024-04-25 20:41:27 +08:00

local_chunk_manager.go

enhance: Add Size interface to FileReader to eliminate the StatObject call during Read (#42911 )

2025-06-25 15:26:42 +08:00

minio_object_storage_test.go

fix: Removed minio bucket after use in test (#32624 )

2024-04-28 13:51:26 +08:00

minio_object_storage.go

enhance: Add Size interface to FileReader to eliminate the StatObject call during Read (#42911 )

2025-06-25 15:26:42 +08:00

options.go

enhance: [2.5] Retry reads from object storage on rate limit error (#46463 )

2025-12-23 11:15:19 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898 )

2021-11-16 15:41:11 +08:00

partition_stats_test.go

feat: Define FieldValue, FieldStats and PartitionStats (#30286 )

2024-03-06 20:42:37 -08:00

partition_stats.go

enhance: Use internal json(sonic) to replace std json lib (#37708 )

2024-11-18 10:46:31 +08:00

payload_reader_test.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

payload_reader.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

payload_test.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

payload_writer_test.go

enhance: binlog primary key turn off dict encoding (#34358 )

2024-07-17 17:47:44 +08:00

payload_writer.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

payload.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

pk_statistics.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

primary_key_test.go

enhance: Use internal json(sonic) to replace std json lib (#37708 )

2024-11-18 10:46:31 +08:00

primary_key.go

fix: [2.5] Update logging context and upgrade dependencies (#41319 )

2025-04-24 23:50:40 +08:00

primary_keys_test.go

enhance: Add PrimaryKeys interface to reduce memory usage (#30405 )

2024-02-01 09:57:11 +08:00

primary_keys.go

enhance: [2.5] Add buffer forwarder for stream delta loading (#40559 ) (#40699 )

2025-03-19 10:28:14 +08:00

print_binlog_test.go

feat:Geospatial Data Type and GIS Function support for milvus (#43661 )

2025-08-26 19:11:55 +08:00

print_binlog.go

feat:Geospatial Data Type and GIS Function support for milvus (#43661 )

2025-08-26 19:11:55 +08:00

remote_chunk_manager_test.go

enhance: [2.5] Retry reads from object storage on rate limit error (#46463 )

2025-12-23 11:15:19 +08:00

remote_chunk_manager.go

enhance: [2.5] Retry reads from object storage on rate limit error (#46463 )

2025-12-23 11:15:19 +08:00

serde_events_test.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

serde_events.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

serde_test.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

serde.go

enhance: [2.5] Bump arrow/go to v17 (#44663 )

2025-10-09 11:47:57 +08:00

stats_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

stats.go

enhance: [2.5] optimize bm25 stats load. (#45780 )

2025-11-25 10:39:08 +08:00

storage_test.go

enhance: [2.5] Use v2 package name for pkg module (#40117 )

2025-02-23 00:46:01 +08:00

types.go

enhance: Add Size interface to FileReader to eliminate the StatObject call during Read (#42911 )

2025-06-25 15:26:42 +08:00

unsafe_test.go

[skip e2e]Update license for storage unsafe (#14452 )

2021-12-28 20:03:56 +08:00

unsafe.go

enhance: support null in go payload (#32296 )

2024-06-19 17:08:00 +08:00

utils_test.go

feat:Geospatial Data Type and GIS Function support for milvus (#43661 )

2025-08-26 19:11:55 +08:00

utils.go

feat:Geospatial Data Type and GIS Function support for milvus (#43661 )

2025-08-26 19:11:55 +08:00