neza2017
f80dbab6ec
watch proxynode ( #5424 )
...
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Resolves : #5423
2021-05-26 12:14:30 +00:00
godchen
5f0f840782
Remove datanode client code ( #5427 )
...
Remove datanode client code.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:41:37 +00:00
godchen
17cabfbed3
Add datanode client retry ( #5394 )
...
Add datanode client retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed ( #5360 )
...
master client,reconnect if grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair ( #5348 )
...
Dataservice use lastest grpc design and saves ddl/dml pos pair
* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)
See also #5220
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 11:38:58 +00:00
godchen
0eee7e5252
Change session ( #5329 )
...
Change session.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
sunby
02f2348500
Save segment allocation status to meta ( #5184 )
...
To ensure segments being flushed correctly, we need to load
the segment allocation status from meta after starting the service.
2021-05-21 10:30:41 +00:00
congqixia
7a82462da8
DataService publishes flush-completed message into its channel ( #5320 )
...
DataService publishes flush-completed message into related msgstream
See also: #5220
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:54:29 +00:00
sunby
c1efa53779
Remove redundant fields in SegmentInfo and related structure ( #5280 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00
congqixia
38f5b0826f
Add SaveBinlogPaths grpc in dataservice ( #5277 )
...
* Add SaveBinlogPaths grpc in dataservice
* fix merged compile error
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-20 11:34:45 +08:00
congqixia
d5ab8ac345
Restore flush and stats stream pos ( #5284 )
...
Restore segment flush stream & statistic stream to last success pos
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-19 06:13:53 +00:00
sunby
a00422bac2
Remove unused interfaces in dataservice ( #5157 )
...
Remove unused interfaces in dataservice
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-10 09:03:24 +00:00
XuanYang-cn
cebdfb34f7
Enable multiple datanode ( #5068 )
...
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:
While registering, dataservice need to return different insert channels for different datanode.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
Cai Yudong
74f457bd14
add more testcase to improve code coverage for data service ( #5041 )
...
* fix TestChannel run error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* comment validateAllocRequest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add test APIs
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-26 01:45:54 +00:00
Cai Yudong
5a75e23795
improve data service code coverage ( #5020 )
...
* optimize TestAssignSegmentID
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update mockMasterService to improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename client to kvClient in Server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update server.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-24 03:29:15 +00:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
sunby
fad94fb576
Remove unsed configs ( #4990 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-22 03:04:59 +00:00
sunby
0f2f46f39d
Add copyright
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-19 11:35:38 +08:00
neza2017
83647e8503
Add copyright in master service module
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-19 11:12:56 +08:00
sunby
94c3fc9321
Add unit tests in dataservice
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-16 16:30:55 +08:00
sunby
a7dac818ee
Refactor datanode register
...
Dataservice should not be stalled during registering datanode.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-13 09:47:02 +08:00
