congqixia 824b26c209

enhance: [2.4] Pre-allocate space for reduce data structure (#35118) (#35137) ...

Cherry-pick from master
pr: #35118 
Grow slice & map.growWork may cause a lot when segment number is large
for big K query. This PR pre-allocate space for reduce methods to avoid
this cost.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

2024-08-01 09:59:50 +08:00

..

metricsutil

enhance: add more metrics for cache and search (#31777)

2024-04-10 10:55:17 +08:00

state

fix: async warmup will be blocked by state lock (#33687)

2024-06-07 14:23:54 +08:00

cgo_util.go

enhance: async search and retrieve in cgo (#34200)

2024-07-04 13:02:09 +08:00

collection.go

fix: Unify querynode metrics cleanup in collection release (#32805)

2024-05-07 15:41:29 +08:00

count_reducer_test.go

enhance: retrieve output fields after local reduce (#32346)

2024-04-25 09:49:26 +08:00

count_reducer.go

enhance: retrieve output fields after local reduce (#32346)

2024-04-25 09:49:26 +08:00

default_limit_reducer.go

fix: two-phase retrieval on lru-segment (#32945) (#33313)

2024-05-23 16:25:40 +08:00

index_attr_cache_test.go

fix: predict inverted index resource usage more reasonably (#31615)

2024-03-27 19:33:09 +08:00

index_attr_cache.go

enhance: Add memory size for binlog (#33025)

2024-05-15 12:59:34 +08:00

load_field_data_info.go

fix: Use correct pools for all CGO methods in segments pkg (#30274)

2024-01-26 10:09:00 +08:00

load_index_info.go

feat: support inverted index for array (#33452) (#34053)

2024-06-24 10:50:03 +08:00

manager_test.go

enhance: [cherry-pick]growing segment support mmap (#34110)

2024-06-25 14:52:07 +08:00

manager.go

feat: [cherry-pick] Major compaction (#34326)

2024-07-02 18:29:01 +08:00

mock_collection_manager.go

fix: Remove QueryNodeEntitiesSize after segment/collection released (#31290)

2024-03-15 15:43:04 +08:00

mock_data.go

enhance: unify data generation test APIs (#32955)

2024-05-14 14:33:33 +08:00

mock_loader.go

feat: LRU cache implementation (#32567)

2024-05-06 20:29:30 +08:00

mock_segment_manager.go

fix: load operation when segment is on releasing (#33699)

2024-06-14 11:47:57 +08:00

mock_segment.go

enhance: Use BatchPkExist to reduce bloom filter func call cost (#33752)

2024-06-12 17:45:58 +08:00

OWNERS

Fix offline set always nil (#23340)

2023-04-11 14:42:30 +08:00

plan_test.go

enhance: transfer resource group and dbname to querynode when load (#30936)

2024-03-21 11:59:12 +08:00

plan.go

enhance: retrieve output fields after local reduce (#32346)

2024-04-25 09:49:26 +08:00

pool_test.go

enhance: Execute bloom filter apply in parallel to speed up segment predict (#33793)

2024-06-13 14:14:04 +08:00

pool.go

enhance: decrease cpu overhead during filter segments on datacoord (#34231)

2024-07-01 10:20:08 +08:00

reduce_test.go

enhance: mmap load raw data if scalar index does not have raw data (#… (#33317)

2024-05-24 09:09:42 +08:00

reduce.go

enhance: add more trace for search & query (#32734)

2024-05-07 13:03:29 +08:00

reducer_test.go

fix: two-phase retrieval on lru-segment (#32945) (#33313)

2024-05-23 16:25:40 +08:00

reducer.go

fix: [2.4] Return record with largest timestamp for entires with same PK (#33936) (#34024)

2024-06-21 14:14:01 +08:00

result_sorter.go

Fix bug of missing JSON type when sorting retrieve results (#25412) (#25455)

2023-07-10 20:02:28 +08:00

result_test.go

fix: [2.4] Return record with largest timestamp for entires with same PK (#33936) (#34024)

2024-06-21 14:14:01 +08:00

result.go

enhance: [2.4] Pre-allocate space for reduce data structure (#35118) (#35137)

2024-08-01 09:59:50 +08:00

retrieve_test.go

enhance: async search and retrieve in cgo (#34200)

2024-07-04 13:02:09 +08:00

retrieve.go

fix: two-phase retrieval on lru-segment (#32945) (#33313)

2024-05-23 16:25:40 +08:00

search_test.go

enhance: mmap load raw data if scalar index does not have raw data (#… (#33317)

2024-05-24 09:09:42 +08:00

search.go

fix: add request resource timeout for lazy load, refactor context usage in cache (#32709)

2024-05-07 16:33:30 +08:00

segment_do.go

fix: two-phase retrieval on lru-segment (#32945) (#33313)

2024-05-23 16:25:40 +08:00

segment_interface.go

enhance: Use BatchPkExist to reduce bloom filter func call cost (#33752)

2024-06-12 17:45:58 +08:00

segment_l0.go

enhance: Add metautil.Channel to convert string compare to int (#32749)

2024-05-07 19:13:35 +08:00

segment_loader_test.go

fix: load operation when segment is on releasing (#33699)

2024-06-14 11:47:57 +08:00

segment_loader.go

enhance: revert remove duplicated pk function (#35102)

2024-07-30 20:03:50 +08:00

segment_test.go

enhance: [cherry-pick]growing segment support mmap (#34110)

2024-06-25 14:52:07 +08:00

segment.go

enhance: revert remove duplicated pk function (#35102)

2024-07-30 20:03:50 +08:00

statistics.go

Protect segment from being released while query/search (#26322)

2023-08-16 18:38:17 +08:00

trace.go

fix: Add Wrapper and Keepalive for CTraceContext ids (#32746)

2024-05-07 10:05:35 +08:00

utils_test.go

enhance: use different value to get related data size according to segment type (#33017)

2024-05-14 14:59:33 +08:00

utils.go

enhance: use different value to get related data size according to segment type (#33017)

2024-05-14 14:59:33 +08:00

validate.go

Format the code (#27275)

2023-09-21 09:45:27 +08:00