Patrick Weizhi Xu 04fff74a56

feat: introduce Text data type (#39874) ...

issue: https://github.com/milvus-io/milvus/issues/39818

This PR mimics Varchar data type, allows insert, search, query, delete,
full-text search and others.
Functionalities related to filter expressions are disabled temporarily. 

Storage changes for Text data type will be in the following PRs.

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>

2025-02-19 11:04:51 +08:00

..

reduce

enhance: span tracing of c++ part (#36205)

2024-09-13 11:19:09 +08:00

AckResponder.h

enhance: add new LRU cache impl (#30360)

2024-02-27 20:58:40 +08:00

check_vec_index_c.cpp

enhance: check index with data type (#33880)

2024-06-19 10:15:59 +08:00

check_vec_index_c.h

enhance: check index with data type (#33880)

2024-06-19 10:15:59 +08:00

ChunkedSegmentSealedImpl.cpp

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

ChunkedSegmentSealedImpl.h

enhance: eliminate compile warnings (part2) (#38535)

2024-12-25 15:30:50 +08:00

CMakeLists.txt

enhance: Refine code for get_deleted_bitmap (#36819)

2024-10-28 15:19:30 +08:00

collection_c.cpp

enhance: Add try-catch and return CStatus for NewCollection (#39279)

2025-01-15 19:17:01 +08:00

collection_c.h

enhance: Add try-catch and return CStatus for NewCollection (#39279)

2025-01-15 19:17:01 +08:00

Collection.cpp

enhance: improve the segcore logs (#29372)

2023-12-23 21:52:43 +08:00

Collection.h

fix: fix searchPlan metricType modified concurrently (#30227)

2024-01-26 14:03:09 +08:00

ConcurrentVector.cpp

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

ConcurrentVector.h

enhance: Rectify run_clang_format grep command (#39534)

2025-01-23 17:07:05 +08:00

DeletedRecord.h

enhance: optimize delete init construct code (#39327)

2025-02-17 21:05:26 +08:00

FieldIndexing.cpp

feat: Update segcore for VECTOR_INT8 (#39415)

2025-01-21 11:03:03 +08:00

FieldIndexing.h

fix: bm25 brute force search need index params k1 and b (#37721)

2024-11-18 15:44:31 +08:00

IndexConfigGenerator.cpp

fix: sparse: add inverted_index_algo and dim_max_score_ratio config (#39358)

2025-02-07 16:40:44 +08:00

IndexConfigGenerator.h

fix: sparse: add inverted_index_algo and dim_max_score_ratio config (#39358)

2025-02-07 16:40:44 +08:00

InsertRecord.h

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

load_field_data_c.cpp

enhance: Enhance and correct exception module (#33705)

2024-06-23 21:22:01 +08:00

load_field_data_c.h

feat: integrate storagev2 in building index of segcore (#28768)

2023-12-05 16:48:54 +08:00

load_index_c.cpp

feat: support json index (#36750)

2025-02-15 14:06:15 +08:00

load_index_c.h

enhance: the estimate method when loading the collection (#36307)

2024-10-09 17:35:19 +08:00

map_c.cpp

feat: tantivy tokenizer binding (#35801)

2024-09-01 17:13:03 +08:00

map_c.h

feat: tantivy tokenizer binding (#35801)

2024-09-01 17:13:03 +08:00

metrics_c.cpp

fix: Avoided dereferencing NULL pointer (#34836)

2024-07-27 17:27:52 +08:00

metrics_c.h

Support show knowhere prometheus metrics (#23102)

2023-04-07 15:34:29 +08:00

packed_reader_c.cpp

feat: introduce third-party milvus-storage (#39418)

2025-01-24 17:21:13 +08:00

packed_reader_c.h

feat: introduce third-party milvus-storage (#39418)

2025-01-24 17:21:13 +08:00

packed_writer_c.cpp

feat: introduce third-party milvus-storage (#39418)

2025-01-24 17:21:13 +08:00

packed_writer_c.h

feat: introduce third-party milvus-storage (#39418)

2025-01-24 17:21:13 +08:00

pkVisitor.h

feat: LRU cache implementation (#32567)

2024-05-06 20:29:30 +08:00

plan_c.cpp

enhance: retrieve output fields after local reduce (#32346)

2024-04-25 09:49:26 +08:00

plan_c.h

enhance: retrieve output fields after local reduce (#32346)

2024-04-25 09:49:26 +08:00

Record.h

Fix deleted data is still visible (#24849)

2023-06-16 17:16:41 +08:00

reduce_c.cpp

feat: support group_size for search_group_by(#33544) (#33720)

2024-07-12 10:17:36 +08:00

reduce_c.h

enhance: add more trace for search & query (#32734)

2024-05-07 13:03:29 +08:00

ReduceStructure.h

fix:possible out-of-bound due to groupby when reduing(#30711) (#31200)

2024-03-14 13:07:03 +08:00

ReduceUtils.cpp

feat: LRU cache implementation (#32567)

2024-05-06 20:29:30 +08:00

ReduceUtils.h

feat: LRU cache implementation (#32567)

2024-05-06 20:29:30 +08:00

SealedIndexingRecord.h

enhance: add new LRU cache impl (#30360)

2024-02-27 20:58:40 +08:00

segcore_init_c.cpp

enhance: Mark cgo thread with tag name (#38000)

2024-11-26 11:22:35 +08:00

segcore_init_c.h

enhance: move segcore codes of segment into one package (#37722)

2024-11-29 10:22:36 +08:00

SegcoreConfig.cpp

Add code for PanicInfo (#27364)

2023-09-27 12:01:28 +08:00

SegcoreConfig.h

replace loaded binlog with binlog index for search performance (#27673)

2023-11-01 02:20:15 +08:00

segment_c.cpp

feat: support chunked column for sealed segment (#35764)

2024-10-12 15:04:52 +08:00

segment_c.h

feat: support keyword text match (#35923)

2024-09-10 15:11:08 +08:00

SegmentChunkReader.cpp

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

SegmentChunkReader.h

feat: Implement custom function module in milvus expr (#36560)

2024-10-25 15:25:30 +08:00

SegmentGrowing.h

enhance: revert remove duplicated pk function (#35103)

2024-08-05 10:48:17 +08:00

SegmentGrowingImpl.cpp

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

SegmentGrowingImpl.h

enhance: optimize delete init construct code (#39327)

2025-02-17 21:05:26 +08:00

SegmentInterface.cpp

fix: text match panics when enable_match is set be false (#38950)

2025-01-03 14:20:55 +08:00

SegmentInterface.h

feat: support json index (#36750)

2025-02-15 14:06:15 +08:00

SegmentSealed.h

feat: support json index (#36750)

2025-02-15 14:06:15 +08:00

SegmentSealedImpl.cpp

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

SegmentSealedImpl.h

enhance: eliminate compile warnings (part2) (#38535)

2024-12-25 15:30:50 +08:00

TimestampIndex.cpp

Re-format cpp code (#22513)

2023-03-02 15:55:49 +08:00

TimestampIndex.h

Re-format cpp code (#22513)

2023-03-02 15:55:49 +08:00

token_stream_c.cpp

feat: tantivy tokenizer binding (#35801)

2024-09-01 17:13:03 +08:00

token_stream_c.h

feat: tantivy tokenizer binding (#35801)

2024-09-01 17:13:03 +08:00

tokenizer_c.cpp

feat: Tokenizer support build with params and clone for concurrency (#37048)

2024-11-06 17:48:24 +08:00

tokenizer_c.h

feat: Tokenizer support build with params and clone for concurrency (#37048)

2024-11-06 17:48:24 +08:00

Types.h

enhance: record memory size (uncompressed) item for index (#38770)

2025-01-14 10:33:06 +08:00

Utils.cpp

feat: introduce Text data type (#39874)

2025-02-19 11:04:51 +08:00

Utils.h

enhance: refactor delete mvcc function (#38066)

2024-12-15 18:02:43 +08:00

vector_index_c.cpp

enhance: unmashall ts msg in dispatcher instead in msgstream (#38656)

2025-02-14 12:04:13 +08:00

vector_index_c.h

enhance: add an unify vector index config checker (#36844)

2024-10-28 10:11:37 +08:00