Spade A 26ec841feb

feat: optimize Like query with n-gram (#41803) ...

Ref #42053

This is the first PR for optimizing `LIKE` with ngram inverted index.
Now, only VARCHAR data type is supported and only InnerMatch LIKE
(%xxx%) query is supported.


How to use it:
```
milvus_client = MilvusClient("http://localhost:19530")
schema = milvus_client.create_schema()
...
schema.add_field("content_ngram", DataType.VARCHAR, max_length=10000)
...
index_params = milvus_client.prepare_index_params()
index_params.add_index(field_name="content_ngram", index_type="NGRAM", index_name="ngram_index", min_gram=2, max_gram=3)
milvus_client.create_collection(COLLECTION_NAME, ...)
```

min_gram and max_gram controls how we tokenize the documents. For
example, for min_gram=2 and max_gram=4, we will tokenize each document
with 2-gram, 3-gram and 4-gram.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>

2025-07-01 10:08:44 +08:00

..

accesslog

enhance: add test for new parameters in access log (#42546)

2025-06-17 11:14:38 +08:00

connection

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

authentication_interceptor_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

authentication_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

cgo_util_test.go

enhance: update knowhere version (#42938)

2025-06-26 01:22:41 +08:00

cgo_util.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

channels_mgr_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

channels_mgr.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

channels_time_ticker_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

channels_time_ticker.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

condition_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

condition.go

Propagate task ctx done err for proxy (#27892)

2023-10-26 19:06:13 +08:00

count_reducer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

count_reducer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

data_coord_mock_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

database_interceptor_test.go

enhance: run analyzer should get database name from grpc context (#42398)

2025-06-05 14:26:31 +08:00

database_interceptor.go

enhance: Fill dbName for OperatePrivilegeV2Request in interceptor (#42898)

2025-06-23 18:04:41 +08:00

default_limit_reducer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

dummyreq_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

dummyreq.go

enhance: Use internal json(sonic) to replace std json lib (#37708)

2024-11-18 10:46:31 +08:00

hook_interceptor_test.go

enhance: set the rpc error code to avoid the invalid retry (#37024)

2024-10-22 10:33:26 +08:00

hook_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

http_req_impl_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

http_req_impl.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

impl_test.go

enhance: run analyzer should get database name from grpc context (#42398)

2025-06-05 14:26:31 +08:00

impl.go

enhance: Add proxy task queue metrics (#42156)

2025-06-04 11:26:32 +08:00

interface_def.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

lb_balancer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

lb_policy_test.go

fix: Fix exclude nodes clearing logic position in load balancer retry (#42577)

2025-06-17 08:15:24 +08:00

lb_policy.go

fix: Prevent delegator unserviceable due to shard leader change (#42689)

2025-06-19 12:10:38 +08:00

look_aside_balancer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

look_aside_balancer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

management_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

management.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

meta_cache_adapter_test.go

enhance: Avoid initializing casbin enforcer for each request (#29117)

2023-12-12 10:36:43 +08:00

meta_cache_adapter.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

meta_cache_test.go

enhance: Remove unused load field check from proxy (#42816)

2025-06-19 19:34:47 +08:00

meta_cache_testonly.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

meta_cache.go

enhance: Remove unused load field check from proxy (#42816)

2025-06-19 19:34:47 +08:00

metrics_info_test.go

enhance: Add proxy task queue metrics (#42156)

2025-06-04 11:26:32 +08:00

metrics_info.go

enhance: Add proxy task queue metrics (#42156)

2025-06-04 11:26:32 +08:00

mock_cache.go

fix: Fix exclude nodes clearing logic position in load balancer retry (#42577)

2025-06-17 08:15:24 +08:00

mock_channels_manager.go

feat: add NotifyDropPartition in mixcoord for droppartition in dc (#42029)

2025-05-23 18:32:26 +08:00

mock_lb_balancer.go

fix: mockery too unavailable after upgrade golang version (#41481)

2025-04-24 10:46:43 +08:00

mock_lb_policy.go

enhance: support run analyzer by loaded collection field (#42113)

2025-05-29 10:54:30 +08:00

mock_msgstream_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

mock_shardclient_manager.go

fix: Fix proxy panic at shard client manager (#42025)

2025-05-23 22:44:26 +08:00

mock_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

mock_tso_test.go

fix: mockery too unavailable after upgrade golang version (#41481)

2025-04-24 10:46:43 +08:00

msg_pack_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

msg_pack.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898)

2021-11-16 15:41:11 +08:00

privilege_cache_test.go

enhance: Add in-memory cache for casbin enforcer result (#35271)

2024-08-05 18:48:15 +08:00

privilege_cache.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

privilege_interceptor_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

privilege_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

proxy_rpc_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

proxy_test.go

enhance: make upgrading from 2.5.x less down time (#42082)

2025-05-29 23:02:29 +08:00

proxy.go

fix: Fix proxy panic at shard client manager (#42025)

2025-05-23 22:44:26 +08:00

rate_limit_interceptor_test.go

feat: add DDLDB rate type and related quota configurations (#40651)

2025-03-14 15:38:09 +08:00

rate_limit_interceptor.go

feat: add DDLDB rate type and related quota configurations (#40651)

2025-03-14 15:38:09 +08:00

reducer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

reducer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

repack_func_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

repack_func.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

replicate_stream_manager_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

replicate_stream_manager.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

rootcoord_mock_test.go

enhance: Check loaded segments before gc (#42639)

2025-06-13 17:44:38 +08:00

roundrobin_balancer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

roundrobin_balancer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

rpc_msg.go

Add slow log for read (#23272)

2023-04-14 15:30:29 +08:00

search_reduce_util_test.go

enhance: refactor rrf and weighted rerank (#42154)

2025-06-10 18:08:35 +08:00

search_reduce_util.go

enhance: refactor rrf and weighted rerank (#42154)

2025-06-10 18:08:35 +08:00

search_util.go

enhance: refactor rrf and weighted rerank (#42154)

2025-06-10 18:08:35 +08:00

segment_test.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

segment.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

shard_client_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

shard_client.go

feat: Implement partial result support on node down (#42009)

2025-05-28 00:12:28 +08:00

simple_rate_limiter_test.go

feat: support to deny dll according to database property (#40764)

2025-03-23 11:18:28 +08:00

simple_rate_limiter.go

feat: support to deny dll according to database property (#40764)

2025-03-23 11:18:28 +08:00

task_alias_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_alias.go

enhance: support more ddl apis to replicate according to cdc (#41678)

2025-05-08 20:02:58 +08:00

task_database_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_database.go

enhance: implement authorization checks for DescribeCollection and DescribeDatabase tasks (#41798)

2025-05-15 17:52:23 +08:00

task_delete_streaming.go

enhance: add delete rows into delete msg header and more metric (#41952)

2025-05-22 20:28:26 +08:00

task_delete_test.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

task_delete.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

task_flush_streaming.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_flush.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_import.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_index_test.go

feat: optimize Like query with n-gram (#41803)

2025-07-01 10:08:44 +08:00

task_index.go

enhance: remove name check for alter index task (#42953)

2025-06-26 16:32:41 +08:00

task_insert_streaming.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

task_insert_test.go

enhance: refactor embedding credentials manager (#41442)

2025-04-24 14:34:38 +08:00

task_insert.go

enhance: Print out-of-date schema ts when returning ErrSchemaMismatch (#42790)

2025-06-17 10:38:37 +08:00

task_policies_test.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

task_policies.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

task_query_test.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

task_query.go

fix: Use task timestamp to calculate TTL timestamp (#42920)

2025-06-25 20:48:42 +08:00

task_scheduler_test.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

task_scheduler.go

enhance: Add proxy task queue metrics (#42156)

2025-06-04 11:26:32 +08:00

task_search_test.go

fix: Use task timestamp to calculate TTL timestamp (#42920)

2025-06-25 20:48:42 +08:00

task_search.go

fix: Use task timestamp to calculate TTL timestamp (#42920)

2025-06-25 20:48:42 +08:00

task_statistic_test.go

feat: Implement partial result support on node down (#42009)

2025-05-28 00:12:28 +08:00

task_statistic.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_test.go

enhance: support TTL expiration with queries returning no results (#42086)

2025-05-27 18:28:27 +08:00

task_upsert_streaming.go

fix: panic when upgrading from old arch (#42422)

2025-05-31 22:56:29 +08:00

task_upsert_test.go

enhance: refactor embedding credentials manager (#41442)

2025-04-24 14:34:38 +08:00

task_upsert.go

enhance: Print out-of-date schema ts when returning ErrSchemaMismatch (#42790)

2025-06-17 10:38:37 +08:00

task_validator_test.go

feat: limit search result entries (#42522)

2025-06-05 12:08:33 +08:00

task_validator.go

feat: limit search result entries (#42522)

2025-06-05 12:08:33 +08:00

task.go

feat: supporing load priority for loading (#42413)

2025-06-17 15:22:38 +08:00

timestamp_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

timestamp.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

trace_log_interceptor_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

trace_log_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

type_def.go

[skip e2e] Add comment for pChan (#14098)

2021-12-23 21:44:12 +08:00

util_test.go

feat: Implement partial result support on node down (#42009)

2025-05-28 00:12:28 +08:00

util.go

enhance: Remove unused load field check from proxy (#42816)

2025-06-19 19:34:47 +08:00

validate_util_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

validate_util.go

feat: support multi analyzer for bm25 function (#41351)

2025-04-23 18:22:38 +08:00