166 Commits

Author SHA1 Message Date
godchen
8cd1fccfb1
Return rocksdb reader timeout error (#12317)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-29 13:27:17 +08:00
yukun
080eaa9a5c
Add isClosed for rocksmq (#12267)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-26 11:27:16 +08:00
godchen
e3f49858c5
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 17:47:15 +08:00
Xiaofan
0aaa87a79a
Fix MsgStream inconsistent seek (#12042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
yukun
6a167f8579
Fix rocksmq produce hang when do search repeatedly (#12225)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-23 19:15:22 +08:00
yukun
835451e331
Update rocksmq consume slowly log (#12179)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 18:51:14 +08:00
yukun
f5bb180adb
Support multiple readers on one topic (#12155)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 10:35:14 +08:00
yukun
ac175b6f00
Add rocksmq produce slowly hint log (#12156)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-21 15:33:13 +08:00
yukun
2147507e89
Add reader implementation in rocksmq (#12137)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 20:57:13 +08:00
yukun
8c947109a9
Add log in rocksmq (#12138)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 00:11:13 +08:00
shaoyue
888aad120c
[skip ci] Fix comment typo (#12122)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 17:59:39 +08:00
yukun
d482f8aa9f
[skip ci]Add license in reader.go (#12032)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-17 21:59:38 +08:00
godchen
a1d1b3d0b6
Add reader interface (#11973)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-17 14:11:11 +08:00
yukun
79fc84f3db
Optimize updatePageInfo in rocksmq (#11711)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 17:13:10 +08:00
yukun
da9228ab37
Add topic lock for DestroyTopic (#11786)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 17:07:10 +08:00
yukun
897d6b5fc8
Check rmq retention only by page (#11508)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 14:49:11 +08:00
Xiangyu Wang
f26ab5c29a
[skip ci]Improve import statements (#11635)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:24:52 +08:00
yukun
f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-11 17:18:43 +08:00
Xiangyu Wang
47ff1a45fe
Improve log messages in rocksmq (#11230)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-10 22:10:47 +08:00
yukun
4c6d77201f
[skip ci]Add rmq consumer impl getExistedConsumer comment (#11594)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-10 21:50:45 +08:00
yukun
9bc7393913
[skip ci]Add rmq consumer impl Subscription comment (#11593)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-10 21:48:53 +08:00
yukun
1e86bd3038
[skip ci]Add rmq consumer impl topic comment (#11533)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-10 19:21:44 +08:00
yukun
5ec895fedc
[skip ci]Add rmq consumer impl MsgMutex comment (#11532)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-09 21:13:37 +08:00
yukun
2073ae497b
[skip ci]Add rmq consumer impl chan comment (#11531)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-09 21:11:41 +08:00
yukun
11e6a8ea50
[skip ci]Add rmq_client comment (#11458)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 21:09:07 +08:00
congqixia
6d3952c9bf
Fix msgs consumed before seek appear in output after seek (#11419)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-08 20:57:57 +08:00
congqixia
d50543a030
Batch consume msg in rockmq internal loop (#11373)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-08 20:56:07 +08:00
yukun
dfbb4c33b4
Rename newExpiredCleanUp to expiredCleanUp (#11433)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 19:25:00 +08:00
yukun
3a65a4517c
[skip ci]Add retention comment (#11432)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 18:45:14 +08:00
yukun
8ec040a35c
Add rocksmqPageSize to config (#11113)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 10:17:18 +08:00
yukun
425c7e09d4
[skip ci]Add rmq retention comment (#11344)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:53:22 +08:00
Xiaofan
a4715996ef
Fix Pulsar seek to latest may block forever (#11128)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:55:44 +08:00
Xiangyu Wang
60848029e1
Improve warning message in rocksmq (#11227)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-05 10:58:55 +08:00
yukun
c05ed4c365
[skip ci]Add rmq_imple seek comments (#11273)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:51:10 +08:00
Xiangyu Wang
e8c858b545
Improve error message in util (#11137)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:36:35 +08:00
Xiangyu Wang
508f560527
Improve error message in util (#11135)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:34:45 +08:00
Xiangyu Wang
cc6a08f097
Improve error message in util (#11136)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:32:46 +08:00
yukun
82e5d21317
Fix MB const size (#11088)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 18:06:28 +08:00
yukun
ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:28:31 +08:00
yukun
a8722797fe
Add topic lock for rocksmq Seek (#11083)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:00:31 +08:00
Xiaofan
ca56290e85
Fix rocksdb retention ts not set (#11081)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-02 16:50:31 +08:00
congqixia
7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-02 14:14:40 +08:00
yukun
af7a5ca50f
[skip ci]Add rocksmq client comments (#11052)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 23:02:33 +08:00
congqixia
be0daafdb0
Fix rocksmq SeekToLatest (#11029)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-01 19:35:51 +08:00
yukun
9016bd7e33
[skip ci]Add rocksmq comments (#10925)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 21:45:01 +08:00
yukun
552efd4b7b
[skip ci]Add comments for rocksmq producer_impl Send (#10696)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:40:24 +08:00
yukun
e8651a1cd9
[skip ci]Add comments for rocksmq producer_impl (#10695)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:38:29 +08:00
yukun
5f5949cf2f
[skip ci]Remove unused code (#10597)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:30:48 +08:00
congqixia
76b64a9d01
Remove not needed ctx from rocksmq client (#10416)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 17:25:12 +08:00
yukun
319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:45:22 +08:00