admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-06 17:18:35 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/core/unittest
History
Bingyi Sun fbf5cb4e62
feat: Add json flat index (#39917) 
issue: https://github.com/milvus-io/milvus/issues/35528

This PR introduces a JSON flat index that allows indexing JSON fields
and dynamic fields in the same way as other field types.

In a previous PR (#36750), we implemented a JSON index that requires
specifying a JSON path and casting a type. The only distinction lies in
the json_cast_type parameter. When json_cast_type is set to JSON type,
Milvus automatically creates a JSON flat index.

For details on how Tantivy interprets JSON data, refer to the [tantivy
documentation](https://github.com/quickwit-oss/tantivy/blob/main/doc/src/json.md#pitfalls-limitation-and-corner-cases).

Limitations
Array handling: Arrays do not function as nested objects. See the
[limitations
section](https://github.com/quickwit-oss/tantivy/blob/main/doc/src/json.md#arrays-do-not-work-like-nested-object)
for more details.

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-10 19:14:35 +08:00
..
bench
feat: add cachinglayer to index (#41653)
2025-05-08 10:12:54 +08:00
test_cachinglayer
feat: manual evict cache after built interim index (#41836)
2025-05-16 16:34:23 +08:00
test_utils
enhance: support TTL expiration with queries returning no results (#42086)
2025-05-27 18:28:27 +08:00
CMakeLists.txt
feat: Add json flat index (#39917)
2025-06-10 19:14:35 +08:00
init_gtest.cpp
feat: cachinglayer: various improvements (#41546)
2025-05-10 09:19:16 +08:00
test_always_true_expr.cpp
enhance: support iterative filter execution (#37363)
2024-12-11 11:32:44 +08:00
test_array_bitmap_index.cpp
fix: [StorageV2][AddField] Handle lack binlog rows in storage v2 (#42186)
2025-05-31 02:44:30 +08:00
test_array_expr.cpp
fix: prevent crash when contains_all/any is used with empty array (#41739)
2025-05-14 14:32:22 +08:00
test_array_inverted_index.cpp
fix: prevent crash when contains_all/any is used with empty array (#41739)
2025-05-14 14:32:22 +08:00
test_array.cpp
enhance: refine array view to optimize memory usage(#38736) (#38808)
2025-01-07 13:26:55 +08:00
test_arrow_fs_c.cpp
enhance: avoid shutdown sdk api in minio cm destructor (#42459)
2025-06-04 09:58:39 +08:00
test_azure_chunk_manager.cpp
enhance: optimize milvus core building (#35610)
2024-08-23 12:35:02 +08:00
test_bf_sparse.cpp
enhance: speed up search iterator stage 1 (#37947)
2024-12-26 10:32:49 +08:00
test_bf.cpp
enhance: reduce copy of bitset and id conversion of brurtforce search (#37675)
2024-11-19 15:48:40 +08:00
test_binary.cpp
add growing segment index (#23615)
2023-04-26 10:14:41 +08:00
test_binlog_index.cpp
fix: [StorageV2][AddField] Handle lack binlog rows in storage v2 (#42186)
2025-05-31 02:44:30 +08:00
test_bitmap_index.cpp
fix: [StorageV2][AddField] Handle lack binlog rows in storage v2 (#42186)
2025-05-31 02:44:30 +08:00
test_bitmap.cpp
Support SIMD of several Expr (#23715) (#23717)
2023-05-12 14:11:20 +08:00
test_bitset.cpp
enhance: [bitset] extend op_find() to be able to search both 0 and 1 (#39176)
2025-01-14 09:50:58 +08:00
test_bool_index.cpp
Support SIMD of several Expr (#23715) (#23717)
2023-05-12 14:11:20 +08:00
test_c_api.cpp
enhance: support TTL expiration with queries returning no results (#42086)
2025-05-27 18:28:27 +08:00
test_c_stream_reduce.cpp
enhance: Use template to remove unittest duplication (#39144)
2025-01-13 09:58:57 +08:00
test_c_tokenizer.cpp
fix: support building tantivy index with low version(5) (#40822)
2025-04-02 18:46:20 +08:00
test_cached_search_iterator.cpp
feat: cachinglayer: various improvements (#41546)
2025-05-10 09:19:16 +08:00
test_chunk_vector.cpp
feat: Enable more VECTOR_INT8 unittest (#39569)
2025-01-24 17:03:07 +08:00
test_chunk.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_chunked_column_group.cpp
feat: manual evict cache after built interim index (#41836)
2025-05-16 16:34:23 +08:00
test_chunked_column.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_chunked_segment_storage_v2.cpp
feat: add cachinglayer to index (#41653)
2025-05-08 10:12:54 +08:00
test_chunked_segment.cpp
feat: add cachinglayer to index (#41653)
2025-05-08 10:12:54 +08:00
test_column_groups_c.cpp
enhance: make json path index support term filter (#40140)
2025-03-04 11:56:02 +08:00
test_common.cpp
enhance: add valid_data in span (#35030)
2024-08-02 15:40:14 +08:00
test_concurrent_vector.cpp
feat: [Sparse Float Vector] segcore basics and index building (#30357)
2024-03-11 14:45:02 +08:00
test_data_codec.cpp
fix: Fix the bug of valid data write corruption (#42556)
2025-06-10 14:22:34 +08:00
test_delete_record.cpp
feat: storage v2 seal segment load (#41567)
2025-04-30 14:22:58 +08:00
test_disk_file_manager_test.cpp
enhance: Optimize index format for improved load performance(#40838) (#40839)
2025-04-15 03:10:30 +08:00
test_exec.cpp
enhance: support TTL expiration with queries returning no results (#42086)
2025-05-27 18:28:27 +08:00
test_expr_materialized_view.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_expr.cpp
feat: make SkipIndex lazyload (#41826)
2025-05-15 01:30:23 +08:00
test_float16.cpp
enhance: Use template to remove unittest duplication (#39144)
2025-01-13 09:58:57 +08:00
test_function.cpp
feat: Implement custom function module in milvus expr (#36560)
2024-10-25 15:25:30 +08:00
test_futures.cpp
enhance: async search and retrieve in cgo (#33228)
2024-06-22 09:38:02 +08:00
test_gcp_native_chunk_manager.cpp
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
2024-09-30 13:23:32 +08:00
test_group_by.cpp
feat: add cachinglayer to index (#41653)
2025-05-08 10:12:54 +08:00
test_group_chunk_translator.cpp
feat: manual evict cache after built interim index (#41836)
2025-05-16 16:34:23 +08:00
test_growing_index.cpp
enhance: InterimIndex support more index type and data type (#41021)
2025-05-28 08:40:28 +08:00
test_growing_storage_v2.cpp
feat: Storage v2 index and stats raw data (#41534)
2025-04-30 08:48:54 +08:00
test_growing.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_hybrid_index.cpp
fix: [StorageV2][AddField] Handle lack binlog rows in storage v2 (#42186)
2025-05-31 02:44:30 +08:00
test_index_c_api.cpp
fix: [StorageV2] index/stats task level storage v2 fs (#42191)
2025-06-10 11:06:35 +08:00
test_index_wrapper.cpp
enhance: Rename API GenDataset to GenFieldData in unittest (#39386)
2025-01-17 15:55:03 +08:00
test_indexing.cpp
enhance: Rename API GenDataset to GenFieldData in unittest (#39386)
2025-01-17 15:55:03 +08:00
test_init.cpp
enhance: update cagra index params in config and add params check (#29045)
2023-12-26 11:04:47 +08:00
test_integer_overflow.cpp
enhance: refactor executor framework V2 (#35251)
2024-09-13 20:57:09 +08:00
test_inverted_index.cpp
fix: [StorageV2][AddField] Handle lack binlog rows in storage v2 (#42186)
2025-05-31 02:44:30 +08:00
test_iterative_filter.cpp
feat: add cachinglayer to index (#41653)
2025-05-08 10:12:54 +08:00
test_json_flat_index.cpp
feat: Add json flat index (#39917)
2025-06-10 19:14:35 +08:00
test_json_index.cpp
enhance: Support cast function for json index (#41949)
2025-06-05 19:42:32 +08:00
test_json_key_stats_index.cpp
feat: Storage v2 index and stats raw data (#41534)
2025-04-30 08:48:54 +08:00
test_kmeans_clustering.cpp
feat: Storage v2 index and stats raw data (#41534)
2025-04-30 08:48:54 +08:00
test_loading.cpp
feat: add cachinglayer to index (#41653)
2025-05-08 10:12:54 +08:00
test_local_chunk_manager.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
test_memory_planner.cpp
feat: Storage v2 growing segment load (#41001)
2025-04-16 17:14:33 +08:00
test_minio_chunk_manager.cpp
enhance: Support MinIO TLS connection (#31311)
2024-03-21 11:15:20 +08:00
test_mmap_chunk_manager.cpp
enhance:mmapchunkmanager allocates MmapChunkDescriptor itself (#42150)
2025-06-03 14:42:31 +08:00
test_monitor.cpp
enhance: add scalar filtering and vector search latency metrics (#34785)
2024-07-19 14:01:39 +08:00
test_offset_ordered_array.cpp
enhance: remove timestamp_filter after retrieve (#35207)
2024-08-02 19:32:46 +08:00
test_offset_ordered_map.cpp
enhance: remove timestamp_filter after retrieve (#35207)
2024-08-02 19:32:46 +08:00
test_packed_c.cpp
enhance: update packed reader api (#41055)
2025-04-09 10:18:26 +08:00
test_plan_proto.cpp
enhance: refactor executor framework V2 (#35251)
2024-09-13 20:57:09 +08:00
test_query.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_random_sample.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_range_search_sort.cpp
feat: Storage v2 index and stats raw data (#41534)
2025-04-30 08:48:54 +08:00
test_reduce_c.cpp
Fix search binary pagination failure (#22477)
2023-03-08 11:03:51 +08:00
test_reduce.cpp
Fix cpplint (#22657)
2023-03-10 09:47:54 +08:00
test_regex_query_util.cpp
fix: regex query can't handle text with newline (#32569)
2024-04-26 12:01:26 +08:00
test_regex_query.cpp
fix: [StorageV2][AddField] Handle lack binlog rows in storage v2 (#42186)
2025-05-31 02:44:30 +08:00
test_relational.cpp
Fix cpplint (#22657)
2023-03-10 09:47:54 +08:00
test_remote_chunk_manager.cpp
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
2024-09-30 13:23:32 +08:00
test_retrieve.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_rust_result.cpp
enhance: Handle rust error in c++ (#38113)
2024-12-16 19:40:45 +08:00
test_scalar_index_creator.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_scalar_index.cpp
enhance: support bitmap mmap (#35399)
2024-08-27 16:34:59 +08:00
test_sealed.cpp
enhance: support TTL expiration with queries returning no results (#42086)
2025-05-27 18:28:27 +08:00
test_segcore.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_similarity_corelation.cpp
Add binary metric types SUBSTRUCTURE/SUPERSTRUCTURE back (#26766)
2023-08-31 20:07:00 +08:00
test_span.cpp
feat: add cachinglayer to sealed segment (#41436)
2025-04-28 10:52:40 +08:00
test_storage_v2_index_raw_data.cpp
fix: [StorageV2] Use correct group building index (#41925)
2025-05-20 13:26:23 +08:00
test_storage.cpp
feat: Storage v2 index and stats raw data (#41534)
2025-04-30 08:48:54 +08:00
test_string_expr.cpp
enhance: support null expr (#38772)
2025-01-02 14:16:54 +08:00
test_string_index.cpp
fix: fix is null bug for marisa index (#42420)
2025-06-05 16:40:32 +08:00
test_text_match.cpp
feat: vector field raw data to mmap by default (#41975)
2025-05-22 11:56:25 +08:00
test_thread_pool.cpp
enhance: resize high priority wqthreadpool dynamically(#40838) (#41549) (#41929)
2025-05-30 10:18:36 +08:00
test_timestamp_index.cpp
Fix cpplint (#22657)
2023-03-10 09:47:54 +08:00
test_tracer.cpp
enhance: add trace_id into segcore logs (#37656)
2024-11-18 10:20:30 +08:00
test_types.cpp
feat: Storage v2 growing segment load (#41001)
2025-04-16 17:14:33 +08:00
test_utils.cpp
enhance: add optimize for like expr (#41066)
2025-05-08 14:28:52 +08:00