56 Commits

Author SHA1 Message Date
yukun
0f197dde86
Do not generate new iterator in rocksmq reader (#12342)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-10 14:33:07 +08:00
yukun
83dfbfb856
[skip ci]Add comment for rocksmq reader (#13092)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-10 10:04:33 +08:00
yukun
0f387871c1
[skip ci]Add comment for rocksmq reader (#13012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 20:41:27 +08:00
yukun
5c84992d4c
[skip ci]Add comment for rocksmq reader (#12898)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 09:18:15 +08:00
yukun
14f5348e1d
[skip ci]Add comment for rocksmq reader (#12897)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 09:16:23 +08:00
yukun
43eece5545
[skip ci]Add comment for rocksmq reader (#12895)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 09:14:32 +08:00
godchen
e3f49858c5
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 17:47:15 +08:00
Xiaofan
0aaa87a79a
Fix MsgStream inconsistent seek (#12042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
yukun
f5bb180adb
Support multiple readers on one topic (#12155)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 10:35:14 +08:00
yukun
2147507e89
Add reader implementation in rocksmq (#12137)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 20:57:13 +08:00
shaoyue
888aad120c
[skip ci] Fix comment typo (#12122)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 17:59:39 +08:00
yukun
d482f8aa9f
[skip ci]Add license in reader.go (#12032)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-17 21:59:38 +08:00
godchen
a1d1b3d0b6
Add reader interface (#11973)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-17 14:11:11 +08:00
Xiangyu Wang
f26ab5c29a
[skip ci]Improve import statements (#11635)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:24:52 +08:00
yukun
4c6d77201f
[skip ci]Add rmq consumer impl getExistedConsumer comment (#11594)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-10 21:50:45 +08:00
yukun
9bc7393913
[skip ci]Add rmq consumer impl Subscription comment (#11593)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-10 21:48:53 +08:00
yukun
1e86bd3038
[skip ci]Add rmq consumer impl topic comment (#11533)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-10 19:21:44 +08:00
yukun
5ec895fedc
[skip ci]Add rmq consumer impl MsgMutex comment (#11532)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-09 21:13:37 +08:00
yukun
2073ae497b
[skip ci]Add rmq consumer impl chan comment (#11531)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-09 21:11:41 +08:00
yukun
11e6a8ea50
[skip ci]Add rmq_client comment (#11458)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 21:09:07 +08:00
congqixia
6d3952c9bf
Fix msgs consumed before seek appear in output after seek (#11419)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-08 20:57:57 +08:00
congqixia
d50543a030
Batch consume msg in rockmq internal loop (#11373)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-08 20:56:07 +08:00
Xiangyu Wang
e8c858b545
Improve error message in util (#11137)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:36:35 +08:00
Xiangyu Wang
508f560527
Improve error message in util (#11135)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:34:45 +08:00
Xiangyu Wang
cc6a08f097
Improve error message in util (#11136)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:32:46 +08:00
yukun
af7a5ca50f
[skip ci]Add rocksmq client comments (#11052)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 23:02:33 +08:00
yukun
9016bd7e33
[skip ci]Add rocksmq comments (#10925)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 21:45:01 +08:00
yukun
552efd4b7b
[skip ci]Add comments for rocksmq producer_impl Send (#10696)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:40:24 +08:00
yukun
e8651a1cd9
[skip ci]Add comments for rocksmq producer_impl (#10695)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:38:29 +08:00
congqixia
76b64a9d01
Remove not needed ctx from rocksmq client (#10416)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 17:25:12 +08:00
yukun
319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:45:22 +08:00
yukun
4a8619619b
[skip ci]Add comments for rocksmq (#10388)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:43:21 +08:00
Xiangyu Wang
736a2cc358
[skip ci]Improve error message in rocksmq (#10196)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:54:37 +08:00
Xiangyu Wang
88a2b2b07c
[skip ci]Improve error message in rocksmq (#10195)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:52:42 +08:00
Xiangyu Wang
afa6eeecd7
[skip ci]Improve error message in rocksmq (#10194)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:50:49 +08:00
yukun
241acadce9
Remove error return when seek invalid messages in seekToLatest (#9967)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 21:49:40 +08:00
godchen
f4e0736e01
Handle util rocksmq returned error (#9169)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:07:21 +08:00
yukun
c486007796
Rocksmq support SubscriptionPositionLatest (#8947)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-30 20:51:40 +08:00
yukun
174c6275ca
golint rocksmq client (#8604)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 19:35:57 +08:00
congqixia
353eeab8b9
Add MessageID return value in producers (#8586)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 17:38:07 +08:00
yukun
a8a0ae27ae
Add rocksmq client comments (#8475)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 16:05:55 +08:00
yukun
06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 17:21:00 +08:00
yukun
fbc352263c
Improve rocksmq client code coverage (#7540)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-08 11:03:59 +08:00
yukun
847586eb95
Add rocksmq retention (#6617)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:46:10 +08:00
godchen
91ef35bad4 Change receive msg logic (#5605)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-15 16:04:48 +08:00
yukun
a3fb1356de
Fix rocksmq seek error (#5432)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to 
notify the consumer to consume.
2021-05-26 09:31:09 +00:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
Xiangyu Wang
c731e2df78 Add license header in util
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-19 13:42:47 +08:00
yukun
964e7e0a28 Add unittest for mqclient
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-04-08 20:05:33 +08:00
yukun
604f96ed2b Replace consumers map by sync.map
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-03-31 10:05:24 +08:00