congqixia 3743fc2b00

enhance: Use pool to limit kafka cgo thread number (#37744) ...

Related to #37665

Thread number went rocket high when there is lots of kafka consumers on
datanode. Since the internal implementation is CGO, using which directly
will make cgo thread leaked.

This PR add a worker pool for kafka API utilzing CGO calls to limit
thread number.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

2024-11-18 10:42:31 +08:00

..

kafka

enhance: Use pool to limit kafka cgo thread number (#37744)

2024-11-18 10:42:31 +08:00

nmq

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

pulsar

enhance: upgrade pulsar-client-go to 0.12.1 (#36615)

2024-09-30 17:13:16 +08:00

rmq

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

client.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

consumer.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00

producer.go

enhance: move rocksmq from internal to pkg module (#33881)

2024-06-25 21:18:15 +08:00