Buqian Zheng cae0091071

feat: make SkipIndex lazyload (#41826) ...

issue: https://github.com/milvus-io/milvus/issues/41435

this PR also:

1. fixed the skip index for VARCHAR. before this PR, skip index of
VARCHAR uses the minmax of the entire column as the minmax of chunk 0,
and provides no minmax for other chunks.
2. refactored some skip index loading related code
3. partly fixed a bug in test_expr.cpp

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>

2025-05-15 01:30:23 +08:00

..

bench

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_cachinglayer

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_utils

feat: storage v2 seal segment load (#41567)

2025-04-30 14:22:58 +08:00

CMakeLists.txt

feat: storage v2 seal segment load (#41567)

2025-04-30 14:22:58 +08:00

init_gtest.cpp

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_always_true_expr.cpp

enhance: support iterative filter execution (#37363)

2024-12-11 11:32:44 +08:00

test_array_bitmap_index.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_array_expr.cpp

fix: prevent crash when contains_all/any is used with empty array (#41739)

2025-05-14 14:32:22 +08:00

test_array_inverted_index.cpp

fix: prevent crash when contains_all/any is used with empty array (#41739)

2025-05-14 14:32:22 +08:00

test_array.cpp

enhance: refine array view to optimize memory usage(#38736) (#38808)

2025-01-07 13:26:55 +08:00

test_arrow_fs_c.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_azure_chunk_manager.cpp

enhance: optimize milvus core building (#35610)

2024-08-23 12:35:02 +08:00

test_bf_sparse.cpp

enhance: speed up search iterator stage 1 (#37947)

2024-12-26 10:32:49 +08:00

test_bf.cpp

enhance: reduce copy of bitset and id conversion of brurtforce search (#37675)

2024-11-19 15:48:40 +08:00

test_binary.cpp

add growing segment index (#23615)

2023-04-26 10:14:41 +08:00

test_binlog_index.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_bitmap_index.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_bitmap.cpp

Support SIMD of several Expr (#23715) (#23717)

2023-05-12 14:11:20 +08:00

test_bitset.cpp

enhance: [bitset] extend op_find() to be able to search both 0 and 1 (#39176)

2025-01-14 09:50:58 +08:00

test_bool_index.cpp

Support SIMD of several Expr (#23715) (#23717)

2023-05-12 14:11:20 +08:00

test_c_api.cpp

fix: add params to ignore config type exception (#41776)

2025-05-13 13:48:56 +08:00

test_c_stream_reduce.cpp

enhance: Use template to remove unittest duplication (#39144)

2025-01-13 09:58:57 +08:00

test_c_tokenizer.cpp

fix: support building tantivy index with low version(5) (#40822)

2025-04-02 18:46:20 +08:00

test_cached_search_iterator.cpp

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_chunk_vector.cpp

feat: Enable more VECTOR_INT8 unittest (#39569)

2025-01-24 17:03:07 +08:00

test_chunk.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_chunked_column_group.cpp

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_chunked_column.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_chunked_segment_storage_v2.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_chunked_segment.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_column_groups_c.cpp

enhance: make json path index support term filter (#40140)

2025-03-04 11:56:02 +08:00

test_common.cpp

enhance: add valid_data in span (#35030)

2024-08-02 15:40:14 +08:00

test_concurrent_vector.cpp

feat: [Sparse Float Vector] segcore basics and index building (#30357)

2024-03-11 14:45:02 +08:00

test_data_codec.cpp

enhance: Optimize index format for improved load performance(#40838) (#40839)

2025-04-15 03:10:30 +08:00

test_delete_record.cpp

feat: storage v2 seal segment load (#41567)

2025-04-30 14:22:58 +08:00

test_disk_file_manager_test.cpp

enhance: Optimize index format for improved load performance(#40838) (#40839)

2025-04-15 03:10:30 +08:00

test_exec.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_expr_materialized_view.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_expr.cpp

feat: make SkipIndex lazyload (#41826)

2025-05-15 01:30:23 +08:00

test_float16.cpp

enhance: Use template to remove unittest duplication (#39144)

2025-01-13 09:58:57 +08:00

test_function.cpp

feat: Implement custom function module in milvus expr (#36560)

2024-10-25 15:25:30 +08:00

test_futures.cpp

enhance: async search and retrieve in cgo (#33228)

2024-06-22 09:38:02 +08:00

test_gcp_native_chunk_manager.cpp

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

test_group_by.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_group_chunk_translator.cpp

feat: cachinglayer: various improvements (#41546)

2025-05-10 09:19:16 +08:00

test_growing_index.cpp

enhance: support null in c data_datacodec and load null value (#32183)

2024-07-23 16:07:51 +08:00

test_growing_storage_v2.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_growing.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_hybrid_index.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_index_c_api.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_index_wrapper.cpp

enhance: Rename API GenDataset to GenFieldData in unittest (#39386)

2025-01-17 15:55:03 +08:00

test_indexing.cpp

enhance: Rename API GenDataset to GenFieldData in unittest (#39386)

2025-01-17 15:55:03 +08:00

test_init.cpp

enhance: update cagra index params in config and add params check (#29045)

2023-12-26 11:04:47 +08:00

test_integer_overflow.cpp

enhance: refactor executor framework V2 (#35251)

2024-09-13 20:57:09 +08:00

test_inverted_index.cpp

enhance: add optimize for like expr (#41066)

2025-05-08 14:28:52 +08:00

test_iterative_filter.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_json_index.cpp

feat: Add json index support for json contains expr (#41478)

2025-05-06 11:44:52 +08:00

test_json_key_stats_index.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_kmeans_clustering.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_loading.cpp

feat: add cachinglayer to index (#41653)

2025-05-08 10:12:54 +08:00

test_local_chunk_manager.cpp

Migrate the ability to upload and download binlog to cpp (#22984)

2023-06-25 14:38:44 +08:00

test_memory_planner.cpp

feat: Storage v2 growing segment load (#41001)

2025-04-16 17:14:33 +08:00

test_minio_chunk_manager.cpp

enhance: Support MinIO TLS connection (#31311)

2024-03-21 11:15:20 +08:00

test_mmap_chunk_manager.cpp

enhance: use segment id and type to register in MmapChunkManager and opt malloc in variableChunk (#33993)

2024-06-20 17:42:02 +08:00

test_monitor.cpp

enhance: add scalar filtering and vector search latency metrics (#34785)

2024-07-19 14:01:39 +08:00

test_offset_ordered_array.cpp

enhance: remove timestamp_filter after retrieve (#35207)

2024-08-02 19:32:46 +08:00

test_offset_ordered_map.cpp

enhance: remove timestamp_filter after retrieve (#35207)

2024-08-02 19:32:46 +08:00

test_packed_c.cpp

enhance: update packed reader api (#41055)

2025-04-09 10:18:26 +08:00

test_plan_proto.cpp

enhance: refactor executor framework V2 (#35251)

2024-09-13 20:57:09 +08:00

test_query.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_random_sample.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_range_search_sort.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_reduce_c.cpp

Fix search binary pagination failure (#22477)

2023-03-08 11:03:51 +08:00

test_reduce.cpp

Fix cpplint (#22657)

2023-03-10 09:47:54 +08:00

test_regex_query_util.cpp

fix: regex query can't handle text with newline (#32569)

2024-04-26 12:01:26 +08:00

test_regex_query.cpp

enhance: add optimize for like expr (#41066)

2025-05-08 14:28:52 +08:00

test_relational.cpp

Fix cpplint (#22657)

2023-03-10 09:47:54 +08:00

test_remote_chunk_manager.cpp

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

test_retrieve.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_rust_result.cpp

enhance: Handle rust error in c++ (#38113)

2024-12-16 19:40:45 +08:00

test_scalar_index_creator.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_scalar_index.cpp

enhance: support bitmap mmap (#35399)

2024-08-27 16:34:59 +08:00

test_sealed.cpp

feat: make SkipIndex lazyload (#41826)

2025-05-15 01:30:23 +08:00

test_segcore.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_similarity_corelation.cpp

Add binary metric types SUBSTRUCTURE/SUPERSTRUCTURE back (#26766)

2023-08-31 20:07:00 +08:00

test_span.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_storage_v2_index_raw_data.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_storage.cpp

feat: Storage v2 index and stats raw data (#41534)

2025-04-30 08:48:54 +08:00

test_string_expr.cpp

enhance: support null expr (#38772)

2025-01-02 14:16:54 +08:00

test_string_index.cpp

enhance: add optimize for like expr (#41066)

2025-05-08 14:28:52 +08:00

test_text_match.cpp

feat: add cachinglayer to sealed segment (#41436)

2025-04-28 10:52:40 +08:00

test_timestamp_index.cpp

Fix cpplint (#22657)

2023-03-10 09:47:54 +08:00

test_tracer.cpp

enhance: add trace_id into segcore logs (#37656)

2024-11-18 10:20:30 +08:00

test_types.cpp

feat: Storage v2 growing segment load (#41001)

2025-04-16 17:14:33 +08:00

test_utils.cpp

enhance: add optimize for like expr (#41066)

2025-05-08 14:28:52 +08:00