sthuang 238bd30f42

fix: [StorageV2] end to end minor issues for sync, stats, and load (#42948) ...

Fix issues in end-to-end tests: 
1. **Split column groups based on schema**, rather than estimating by
average chunk row size. **Ensure column group consistency within a
segment**, to avoid errors caused by loading multiple column group
chunks simultaneously.
2. **Use sorted segmentId** when generating the stats binlog path, to
ensure consistent and correct file path resolution.
3. **Determine field IDs as follows**:
For multi-column column groups, retrieve the field ID list from
metadata.
For single-column column groups, use the column group ID directly as the
field ID.

related: #39173 
fix: #42862

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>

2025-06-27 14:44:42 +08:00

..

bench

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_cachinglayer

feat: manual evict cache after built interim index (#41836)

2025-05-16 16:34:23 +08:00

test_utils

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

CMakeLists.txt

feat: impl StructArray -- data storage support in segcore (#42406)

2025-06-12 14:38:35 +08:00

init_gtest.cpp

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_always_true_expr.cpp

enhance: support iterative filter execution (#37363)

2024-12-11 11:32:44 +08:00

test_array_bitmap_index.cpp

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

test_array_expr.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_array_inverted_index.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_array.cpp

enhance: refine array view to optimize memory usage(#38736) (#38808)

2025-01-07 13:26:55 +08:00

test_arrow_fs_c.cpp

enhance: avoid shutdown sdk api in minio cm destructor (#42459)

2025-06-04 09:58:39 +08:00

test_azure_chunk_manager.cpp

enhance: optimize milvus core building (#35610)

2024-08-23 12:35:02 +08:00

test_bf_sparse.cpp

enhance: speed up search iterator stage 1 (#37947)

2024-12-26 10:32:49 +08:00

test_bf.cpp

enhance: reduce copy of bitset and id conversion of brurtforce search (#37675)

2024-11-19 15:48:40 +08:00

test_binary.cpp

add growing segment index (#23615)

2023-04-26 10:14:41 +08:00

test_binlog_index.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_bitmap_index.cpp

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

test_bitmap.cpp

Support SIMD of several Expr (#23715) (#23717)

2023-05-12 14:11:20 +08:00

test_bitset.cpp

enhance: [bitset] extend op_find() to be able to search both 0 and 1 (#39176)

2025-01-14 09:50:58 +08:00

test_bool_index.cpp

Support SIMD of several Expr (#23715) (#23717)

2023-05-12 14:11:20 +08:00

test_c_api.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_c_stream_reduce.cpp

enhance: Use template to remove unittest duplication (#39144)

2025-01-13 09:58:57 +08:00

test_c_tokenizer.cpp

fix: support building tantivy index with low version(5) (#40822)

2025-04-02 18:46:20 +08:00

test_cached_search_iterator.cpp

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_chunk_vector.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_chunk.cpp

fix: [StorageV2] Use correct offset filling null bitmap (#42774)

2025-06-17 10:08:38 +08:00

test_chunked_column_group.cpp

feat: manual evict cache after built interim index (#41836)

2025-05-16 16:34:23 +08:00

test_chunked_column.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_chunked_segment_storage_v2.cpp

enhance: [StorageV2] field id as meta path for wide column when load (#42863)

2025-06-25 11:08:48 +08:00

test_chunked_segment.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_column_groups_c.cpp

enhance: make json path index support term filter (#40140)

2025-03-04 11:56:02 +08:00

test_common.cpp

enhance: add valid_data in span (#35030)

2024-08-02 15:40:14 +08:00

test_concurrent_vector.cpp

feat: [Sparse Float Vector] segcore basics and index building (#30357)

2024-03-11 14:45:02 +08:00

test_data_codec.cpp

fix: [StorageV2] Use correct offset filling null bitmap (#42774)

2025-06-17 10:08:38 +08:00

test_delete_record.cpp

feat: storage v2 seal segment load (#41567)

2025-04-30 14:22:58 +08:00

test_disk_file_manager_test.cpp

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

test_exec.cpp

enhance: support TTL expiration with queries returning no results (#42086)

2025-05-27 18:28:27 +08:00

test_expr_materialized_view.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_expr.cpp

fix: fix some bugs discovered by chaos tests (#42906)

2025-06-24 16:32:42 +08:00

test_float16.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_function.cpp

feat: Implement custom function module in milvus expr (#36560)

2024-10-25 15:25:30 +08:00

test_futures.cpp

enhance: async search and retrieve in cgo (#33228)

2024-06-22 09:38:02 +08:00

test_gcp_native_chunk_manager.cpp

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

test_group_by.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_group_chunk_translator.cpp

fix: [StorageV2] end to end minor issues for sync, stats, and load (#42948)

2025-06-27 14:44:42 +08:00

test_growing_index.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_growing_storage_v2.cpp

fix: [StorageV2] end to end minor issues for sync, stats, and load (#42948)

2025-06-27 14:44:42 +08:00

test_growing.cpp

feat: impl StructArray -- data storage support in segcore (#42406)

2025-06-12 14:38:35 +08:00

test_hybrid_index.cpp

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

test_index_c_api.cpp

fix: [StorageV2] index/stats task level storage v2 fs (#42191)

2025-06-10 11:06:35 +08:00

test_index_wrapper.cpp

enhance: Rename API GenDataset to GenFieldData in unittest (#39386)

2025-01-17 15:55:03 +08:00

test_indexing.cpp

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

test_init.cpp

enhance: update cagra index params in config and add params check (#29045)

2023-12-26 11:04:47 +08:00

test_integer_overflow.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_inverted_index.cpp

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

test_iterative_filter.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_json_flat_index.cpp

fix: fix some bugs discovered by chaos tests (#42906)

2025-06-24 16:32:42 +08:00

test_json_index.cpp

fix: fix some bugs discovered by chaos tests (#42906)

2025-06-24 16:32:42 +08:00

test_json_key_stats_index.cpp

fix: fix some bugs discovered by chaos tests (#42906)

2025-06-24 16:32:42 +08:00

test_kmeans_clustering.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_loading.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_local_chunk_manager.cpp

Migrate the ability to upload and download binlog to cpp (#22984)

2023-06-25 14:38:44 +08:00

test_memory_planner.cpp

feat: Storage v2 growing segment load (#41001)

2025-04-16 17:14:33 +08:00

test_minio_chunk_manager.cpp

enhance: Support MinIO TLS connection (#31311)

2024-03-21 11:15:20 +08:00

test_mmap_chunk_manager.cpp

enhance:mmapchunkmanager allocates MmapChunkDescriptor itself (#42150)

2025-06-03 14:42:31 +08:00

test_monitor.cpp

enhance: add scalar filtering and vector search latency metrics (#34785)

2024-07-19 14:01:39 +08:00

test_offset_ordered_array.cpp

enhance: remove timestamp_filter after retrieve (#35207)

2024-08-02 19:32:46 +08:00

test_offset_ordered_map.cpp

enhance: remove timestamp_filter after retrieve (#35207)

2024-08-02 19:32:46 +08:00

test_packed_c.cpp

enhance: update packed reader api (#41055)

2025-04-09 10:18:26 +08:00

test_plan_proto.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_query.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_random_sample.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_range_search_sort.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_reduce_c.cpp

…

test_reduce.cpp

Fix cpplint (#22657)

2023-03-10 09:47:54 +08:00

test_regex_query_util.cpp

fix: regex query can't handle text with newline (#32569)

2024-04-26 12:01:26 +08:00

test_regex_query.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_relational.cpp

Fix cpplint (#22657)

2023-03-10 09:47:54 +08:00

test_remote_chunk_manager.cpp

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

test_retrieve.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_rust_result.cpp

enhance: Handle rust error in c++ (#38113)

2024-12-16 19:40:45 +08:00

test_scalar_index_creator.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_scalar_index.cpp

enhance: support bitmap mmap (#35399)

2024-08-27 16:34:59 +08:00

test_sealed.cpp

fix: [StorageV2] Use correct offset filling null bitmap (#42774)

2025-06-17 10:08:38 +08:00

test_segcore.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_similarity_corelation.cpp

Add binary metric types SUBSTRUCTURE/SUPERSTRUCTURE back (#26766)

2023-08-31 20:07:00 +08:00

test_span.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_storage_v2_index_raw_data.cpp

fix: [StorageV2] Use correct group building index (#41925)

2025-05-20 13:26:23 +08:00

test_storage.cpp

fix: tidy up path for scalar index (#42676)

2025-06-18 00:42:38 +08:00

test_string_expr.cpp

fix: [AddField] Use shared_ptr of schema in plan fixing dangling ref (#42693)

2025-06-12 20:46:36 +08:00

test_string_index.cpp

fix: fix is_not_in for trie index (#42716)

2025-06-25 16:52:42 +08:00

test_text_match.cpp

fix: fix some bugs discovered by chaos tests (#42906)

2025-06-24 16:32:42 +08:00

test_thread_pool.cpp

enhance: resize high priority wqthreadpool dynamically(#40838) (#41549) (#41929)

2025-05-30 10:18:36 +08:00

test_timestamp_index.cpp

Fix cpplint (#22657)

2023-03-10 09:47:54 +08:00

test_tracer.cpp

enhance: add trace_id into segcore logs (#37656)

2024-11-18 10:20:30 +08:00

test_types.cpp

feat: Storage v2 growing segment load (#41001)

2025-04-16 17:14:33 +08:00

test_utils.cpp

enhance: add optimize for like expr (#41066)

2025-05-08 14:28:52 +08:00

test_vector_array.cpp

feat: impl StructArray -- data storage support in segcore (#42406)

2025-06-12 14:38:35 +08:00