106 Commits

Author SHA1 Message Date
yukun
080eaa9a5c
Add isClosed for rocksmq (#12267)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-26 11:27:16 +08:00
godchen
e3f49858c5
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 17:47:15 +08:00
Xiaofan
0aaa87a79a
Fix MsgStream inconsistent seek (#12042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
yukun
6a167f8579
Fix rocksmq produce hang when do search repeatedly (#12225)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-23 19:15:22 +08:00
yukun
835451e331
Update rocksmq consume slowly log (#12179)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 18:51:14 +08:00
yukun
f5bb180adb
Support multiple readers on one topic (#12155)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 10:35:14 +08:00
yukun
ac175b6f00
Add rocksmq produce slowly hint log (#12156)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-21 15:33:13 +08:00
yukun
2147507e89
Add reader implementation in rocksmq (#12137)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 20:57:13 +08:00
yukun
8c947109a9
Add log in rocksmq (#12138)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 00:11:13 +08:00
yukun
79fc84f3db
Optimize updatePageInfo in rocksmq (#11711)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 17:13:10 +08:00
yukun
da9228ab37
Add topic lock for DestroyTopic (#11786)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 17:07:10 +08:00
yukun
897d6b5fc8
Check rmq retention only by page (#11508)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 14:49:11 +08:00
Xiangyu Wang
f26ab5c29a
[skip ci]Improve import statements (#11635)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:24:52 +08:00
yukun
f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-11 17:18:43 +08:00
Xiangyu Wang
47ff1a45fe
Improve log messages in rocksmq (#11230)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-10 22:10:47 +08:00
congqixia
d50543a030
Batch consume msg in rockmq internal loop (#11373)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-08 20:56:07 +08:00
yukun
dfbb4c33b4
Rename newExpiredCleanUp to expiredCleanUp (#11433)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 19:25:00 +08:00
yukun
3a65a4517c
[skip ci]Add retention comment (#11432)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 18:45:14 +08:00
yukun
8ec040a35c
Add rocksmqPageSize to config (#11113)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 10:17:18 +08:00
yukun
425c7e09d4
[skip ci]Add rmq retention comment (#11344)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:53:22 +08:00
Xiaofan
a4715996ef
Fix Pulsar seek to latest may block forever (#11128)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:55:44 +08:00
Xiangyu Wang
60848029e1
Improve warning message in rocksmq (#11227)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-05 10:58:55 +08:00
yukun
c05ed4c365
[skip ci]Add rmq_imple seek comments (#11273)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:51:10 +08:00
yukun
82e5d21317
Fix MB const size (#11088)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 18:06:28 +08:00
yukun
ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:28:31 +08:00
yukun
a8722797fe
Add topic lock for rocksmq Seek (#11083)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:00:31 +08:00
Xiaofan
ca56290e85
Fix rocksdb retention ts not set (#11081)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-02 16:50:31 +08:00
congqixia
7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-02 14:14:40 +08:00
congqixia
be0daafdb0
Fix rocksmq SeekToLatest (#11029)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-01 19:35:51 +08:00
yukun
5f5949cf2f
[skip ci]Remove unused code (#10597)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:30:48 +08:00
edward.zeng
39b204374b
[skip ci] Fix rocksmq retention typo (#10376)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-21 19:56:10 +08:00
congqixia
c2c2036154
Stop retention gracefully (#10367)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 19:50:26 +08:00
yukun
f15dc150f1
[skip ci]Add comments for retention (#10316)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 10:59:01 +08:00
yukun
81190c573a
[skip ci]Add comments for UpdateAckedInfo (#10213)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 20:34:50 +08:00
yukun
7c7a66df6d
[skip ci]Add comments for rocksmq Notify (#10212)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 20:32:48 +08:00
yukun
401753dea0
[skip ci]Add comments for rocksmq SeekToLatest (#10120)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:52:49 +08:00
yukun
ec667846f4
[skip ci]Add comments for rocksmq Seek (#10119)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:50:59 +08:00
yukun
8dccd0ca70
[skip ci]Add comments for rocksmq Consume (#10118)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:48:40 +08:00
yukun
65a1ae0210
[skip ci]Add comments for rocksmq produce (#10030)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 22:05:04 +08:00
yukun
e8d5a1ee5f
[skip ci]Add comments for DestroyConsumerGroup (#10029)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 22:03:09 +08:00
yukun
241acadce9
Remove error return when seek invalid messages in seekToLatest (#9967)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 21:49:40 +08:00
yukun
2cfdf22897
Change retention ticker time to 10 minutes (#9933)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-15 15:44:35 +08:00
yukun
83f1b75293
[skip ci]Add comments for RegisterConsumer (#9912)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 20:02:37 +08:00
yukun
a0d9991d6f
[skip ci]Add comments for CreateConsumerGroup (#9911)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 20:00:35 +08:00
yukun
d2e2e0a63c
[skip ci]Add comments for ExistConsumerGroup (#9832)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 20:44:33 +08:00
yukun
67d38d6cf1
Fix retention datarace (#9828)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 20:38:33 +08:00
zhenshan.cao
e97b62cf67
Change RocksDBLRUCache size to 0 (#9820)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 20:28:34 +08:00
yukun
e3ce1696e7
[skip ci]Add comments for rocksmq DestroyTopic (#9735)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:37:20 +08:00
yukun
55c615b4e2
[skip ci]Add comments for rocksmq CreateTopic (#9733)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:33:24 +08:00
yukun
cdeb64d90a
Delete messages before delete meta data in rocksmq retention (#9694)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:09:22 +08:00