congqixia 3743fc2b00

enhance: Use pool to limit kafka cgo thread number (#37744) ...

Related to #37665

Thread number went rocket high when there is lots of kafka consumers on
datanode. Since the internal implementation is CGO, using which directly
will make cgo thread leaked.

This PR add a worker pool for kafka API utilzing CGO calls to limit
thread number.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

2024-11-18 10:42:31 +08:00

..

mqwrapper

enhance: Use pool to limit kafka cgo thread number (#37744)

2024-11-18 10:42:31 +08:00

common_mq_factory.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

factory_stream_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

factory_test.go

Add timeout in dispatcher, AsConsumer and Seek (#26686)

2023-09-08 09:51:17 +08:00

mock_mq_factory.go

Add timeout in dispatcher, AsConsumer and Seek (#26686)

2023-09-08 09:51:17 +08:00

mock_msgstream_factory.go

fix: fix make generate-mockery panic with go1.22 (#36830)

2024-10-17 12:11:31 +08:00

mock_msgstream.go

fix: fix make generate-mockery panic with go1.22 (#36830)

2024-10-17 12:11:31 +08:00

mq_factory_test.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

mq_factory.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

mq_kafka_msgstream_test.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

mq_msgstream_test.go

enhance: force to stop buffer message when receiving the drop collection message (#36916)

2024-10-17 12:53:29 +08:00

mq_msgstream.go

enhance: force to stop buffer message when receiving the drop collection message (#36916)

2024-10-17 12:53:29 +08:00

mq_rocksmq_msgstream_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_collection_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_collection.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_database_test.go

feat: add the rbac msg and send them to the replicate channel (#35392)

2024-08-15 12:06:52 +08:00

msg_for_database.go

feat: add the rbac msg and send them to the replicate channel (#35392)

2024-08-15 12:06:52 +08:00

msg_for_index_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_index.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_partition_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_partition.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg_for_user_role_test.go

feat: add the rbac msg and send them to the replicate channel (#35392)

2024-08-15 12:06:52 +08:00

msg_for_user_role.go

feat: add the rbac msg and send them to the replicate channel (#35392)

2024-08-15 12:06:52 +08:00

msg_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msg.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

msgstream_util_test.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

msgstream_util.go

fix: Close leaked health check kafka producer (#37728)

2024-11-16 11:20:32 +08:00

msgstream.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

OWNERS

Move some modules from internal to public package (#22572)

2023-04-06 19:14:32 +08:00

repack_func.go

Format the code (#27275)

2023-09-21 09:45:27 +08:00

stream_bench_test.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

stream_test.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

trace.go

Format the code (#27275)

2023-09-21 09:45:27 +08:00

unmarshal_test.go

enhance: Enable linux code checker (#35084)

2024-07-30 15:53:51 +08:00

unmarshal.go

enhance: add the unmarshal method for the rbac msg (#35692)

2024-08-30 07:23:00 +08:00

wasted_mock_msgstream.go

Move some modules from internal to public package (#22572)

2023-04-06 19:14:32 +08:00