yihao.dai
e0113b375e
fix: Fix sort stats generates large binlogs ( #42456 )
...
Remove the hardcoded batchSize of 100,000 and instead trigger a write
every 64MB based on actual data size. This prevents sort stats from
generating excessively large binlog files.
issue: https://github.com/milvus-io/milvus/issues/42400
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-06-04 09:56:39 +08:00
Ted Xu
128efaa3e3
enhance: simplify size calculation in file writers ( #40808 )
...
See: #40342
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-26 20:04:22 +08:00
sthuang
90acc8a58f
enhance: upgrade go arrow version from 12.0.1 to 17.0.0 ( #39916 )
...
related: https://github.com/milvus-io/milvus/issues/39915
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-02-25 10:30:02 +08:00
smellthemoon
8b974c5742
enhance: support compact if lack of binlog ( #40000 )
...
https://github.com/milvus-io/milvus/issues/39718
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-02-22 10:51:56 +08:00
Ted Xu
53a4207f46
enhance: improve sort performance by writing with batch record ( #39685 )
...
See #37234
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-02-12 15:08:47 +08:00
