admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-30 23:45:28 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/util
History
yihao.dai 9fbd41a97d
fix: Adjust binlog and parquet reader buffer size for import (#43495) 
1. Modify the binlog reader to stop reading a fixed 4096 rows and
instead use the calculated bufferSize to avoid generating small binlogs.
2. Use a fixed bufferSize (32MB) for the Parquet reader to prevent OOM.

issue: https://github.com/milvus-io/milvus/issues/43387

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-07-23 21:28:54 +08:00
..
analyzecgowrapper
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
bloomfilter
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
cgo
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
cgoconverter
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
clustering
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
componentutil
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
credentials
enhance: Add search post pipeline (#43065)
2025-07-21 11:10:52 +08:00
ctokenizer
feat: support multi analyzer for bm25 function (#41351)
2025-04-23 18:22:38 +08:00
dependency
enhance: remove support of embeded nats mq (#41565)
2025-04-28 23:06:49 +08:00
exprutil
fix: OR binary expr is prunable only when both children are prunable (#42912)
2025-06-24 09:38:24 +08:00
flowgraph
fix: flow graph should free function resource after all node close (#42731)
2025-06-13 22:14:37 +08:00
function
fix: Fix weighted rerank (#43503)
2025-07-23 14:54:53 +08:00
funcutil
fix: Update logging context and upgrade dependencies (#41318)
2025-04-23 10:52:38 +08:00
grpcclient
fix: Update logging context and upgrade dependencies (#41318)
2025-04-23 10:52:38 +08:00
hookutil
enhance: Add mutex preventing concurrent plugin.Open (#41761)
2025-05-12 15:44:55 +08:00
idalloc
fix: Update logging context and upgrade dependencies (#41318)
2025-04-23 10:52:38 +08:00
importutilv2
fix: Adjust binlog and parquet reader buffer size for import (#43495)
2025-07-23 21:28:54 +08:00
indexcgowrapper
enhance: Remove not inused BuildIndexInfo (#42926)
2025-06-27 15:00:42 +08:00
indexparamcheck
fix: Add json cast type for flat index (#42970)
2025-07-03 14:14:44 +08:00
initcore
feat: Supports tracing services that require header-based authentication. (#43211)
2025-07-10 17:32:48 +08:00
metrics
fix: Fix ineffective log level setting in ThreadWatcher (#41886)
2025-05-20 21:22:24 +08:00
mock
enhance: Check loaded segments before gc (#42639)
2025-06-13 17:44:38 +08:00
nullutil
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
pipeline
fix: pipeline/delegator leak (#42582)
2025-06-06 22:00:32 +08:00
proxyutil
fix: Update logging context and upgrade dependencies (#41318)
2025-04-23 10:52:38 +08:00
quota
feat: add DDLDB rate type and related quota configurations (#40651)
2025-03-14 15:38:09 +08:00
ratelimitutil
feat: support to deny dll according to database property (#40764)
2025-03-23 11:18:28 +08:00
reduce
fix: iterator cursor progress too fast(#36179) (#36180)
2024-09-24 11:45:13 +08:00
searchutil
fix: Fix ants.Pool goroutine leak (#41892)
2025-05-19 17:56:22 +08:00
segcore
feat: make storagev1 to support eviction (#43219)
2025-07-19 02:02:52 +08:00
segmentutil
enhance: Pooling for data tasks (#41256)
2025-05-20 21:06:24 +08:00
sessionutil
enhance: use multi-process framework in integration test (#42976)
2025-06-30 14:22:43 +08:00
streamingutil
enhance: use recovery+shardmanager, remove segment assignment interceptor (#41824)
2025-05-14 23:00:23 +08:00
streamrpc
enhance: cleanup lint check exclusions (#40829)
2025-03-21 18:12:14 +08:00
testutil
enhance: bulkinsert handle nullable/defaultValue/functionOutput fields (#42956)
2025-07-04 14:20:44 +08:00
tokenizerapi
enhance: support run anayser return detaild token (#40458)
2025-03-19 15:48:15 +08:00
tsoutil
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
typeutil
feat: Storage v2 compaction (#40667)
2025-03-21 10:16:12 +08:00
vecindexmgr
enhance: Use v2 package name for pkg module (#39990)
2025-02-22 23:15:58 +08:00
wrappers
enhance: support run analyzer by loaded collection field (#42113)
2025-05-29 10:54:30 +08:00