cai.zhang b9357e4716

fix: Modify the batchsize of writer to timely flushing binlogs (#37692) ...

issue: #37579 

If the schema includes large varchar fields, a few thousand rows can
reach hundreds of MB in size. Therefore, if the batch size of the
segment writer is large, it will produce relatively large `binlogs`,
which can cause datanode to run out of memory (OOM) during compaction.

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>

2024-11-15 10:14:31 +08:00

..

chunk_mgr_factory.go

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

chunkmgr_mock.go

enhance: Avoid merging insert data when buffering insert msgs (#33562)

2024-06-13 11:15:56 +08:00

etcd_mock.go

Remove deprecated io/ioutil usage (#27747)

2023-10-17 20:32:09 +08:00

index_test.go

feat: Support stats task to sort segment by PK (#35054)

2024-09-02 14:19:03 +08:00

indexnode_component_mock.go

Decouple basetable and componentparam (#26725)

2023-09-05 10:31:48 +08:00

indexnode_service_test.go

feat: Support stats task to sort segment by PK (#35054)

2024-09-02 14:19:03 +08:00

indexnode_service.go

feat: management WebUI homepage (#36822)

2024-10-23 11:29:28 +08:00

indexnode_test.go

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

indexnode.go

feat: Support stats task to sort segment by PK (#35054)

2024-09-02 14:19:03 +08:00

metrics_info_test.go

Move some modules from internal to public package (#22572)

2023-04-06 19:14:32 +08:00

metrics_info.go

Refine state check (#27541)

2023-10-11 21:01:35 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898)

2021-11-16 15:41:11 +08:00

task_analyze.go

enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)

2024-09-30 13:23:32 +08:00

task_index.go

enhance: add unify vector index config management (#36846)

2024-11-01 06:18:21 +08:00

task_scheduler_test.go

enhance: Support analyze data (#33651)

2024-06-06 17:37:51 +08:00

task_scheduler.go

enhance: Support analyze data (#33651)

2024-06-06 17:37:51 +08:00

task_state_test.go

feat: Support stats task to sort segment by PK (#35054)

2024-09-02 14:19:03 +08:00

task_state.go

IndexCoord handle events correctly (#17878)

2022-07-07 14:44:21 +08:00

task_stats_test.go

enhance: Optimize the performance of stats task (#37374)

2024-11-08 10:08:27 +08:00

task_stats.go

fix: Modify the batchsize of writer to timely flushing binlogs (#37692)

2024-11-15 10:14:31 +08:00

task_test.go

feat: Support stats task to sort segment by PK (#35054)

2024-09-02 14:19:03 +08:00

task.go

enhance: Support analyze data (#33651)

2024-06-06 17:37:51 +08:00

taskinfo_ops_test.go

feat: support bm25 logs mixcompaction (#36072)

2024-10-14 16:57:22 +08:00

taskinfo_ops.go

feat: support bm25 logs mixcompaction (#36072)

2024-10-14 16:57:22 +08:00

util_test.go

enhance: Support analyze data (#33651)

2024-06-06 17:37:51 +08:00

util.go

enhance: Use proto for passing info in cgo (#33184)

2024-05-23 10:31:40 +08:00