godchen
|
b7bf26b486
|
Update grpc trace (#5817)
* Update grpc trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove useless code in mod
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-06-17 14:17:56 +08:00 |
|
Cai Yudong
|
0f4bd50ce3
|
Support ETCD endpoints array (#5755)
|
2021-06-15 16:36:36 +08:00 |
|
zhenshan.cao
|
33a43f48c8
|
[skip ci] Fix bug: Search timeout and refactor client init logic (#5735)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-06-15 16:24:48 +08:00 |
|
sunby
|
189ac881f3
|
Fix bugs (#5676)
* Remove redundant session startup
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Register datanode after start success
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix meta snap shot
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix datanode message stream channel
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix bugs when drop empty collection
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Fix bug of getting pchan statistics from task scheduler
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix i/dist/dataservice test code
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix epoch lifetime not applied
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* fix datanode flowgraph dd node
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix handle datanode timetick bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove repack function of dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Apply extended seal policy
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add check for time tick
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix check
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix the repack function of dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix the bug when send statistics of pchan
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix the repack function when craete dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix bugs
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix describe collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix bug when send timestamp statistics
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix data node
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Add length check before flush request
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add log for data node
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix SaveBinlog bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Add more log in datanode
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Put SegmentState.Flushing as the last one in enum to fit the client
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Fix params in GetInsertBinlogPaths
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Rename policy
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove unused ddl functions and fields
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Remove pchan when drop collection
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Add balanced assignment policy
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix master ut
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Add lock in session manager
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add log for debug
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix some logic bug and typo
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix recover bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Get collection scheme of a specific timestamp
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Change CheckPoint to SegmentInfo in VchannelInfo
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Recover Unflushed segment numOfRows
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix dataservice unit tests
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-06-15 16:06:11 +08:00 |
|
godchen
|
275881dbdb
|
Remove address param (#5556)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-06-15 16:04:46 +08:00 |
|
congqixia
|
62eaa0390a
|
Add dataservice metrics with grpc prometheus middleware (#5523)
* Add dataservice metrics with grpc prometheus middleware
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* register server metrics
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-06-15 15:59:04 +08:00 |
|
sunby
|
a14c35274f
|
Fix bugs in dataservice (#5457)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-06-15 15:59:04 +08:00 |
|
XuanYang-cn
|
55eac3ee7f
|
Complete Flush procedure in DataNode (#5454)
* Complete Flush proceduer in DataNode
Resolves: #5220
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix unittest
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-15 15:59:04 +08:00 |
|
sunby
|
50b3d39370
|
Add GetRecoveryInfo interface and proto (#5598)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-06-07 14:16:36 +08:00 |
|
zhenshan.cao
|
03e3b4beb4
|
Add log to startup process (#5594)
* Add log to startup process
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: avoid ctx exceed deadline
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fmt code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: wrong time unit
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: datanservice client reconnect use time ctx
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-06-04 16:29:35 +08:00 |
|
zhenshan.cao
|
b0b8f58192
|
Fix bug: search timeout (#5557)
* Fix bug: search timeout
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Add log and fix unittest bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-06-03 14:58:34 +08:00 |
|
neza2017
|
f80dbab6ec
|
watch proxynode (#5424)
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Resolves: #5423
|
2021-05-26 12:14:30 +00:00 |
|
godchen
|
bfa683ce79
|
Change dataservice grpc retry (#5411)
Change dataservice grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
|
2021-05-26 10:55:05 +00:00 |
|
neza2017
|
c28c34e852
|
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID
also see #5386
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
|
2021-05-25 07:06:05 +00:00 |
|
neza2017
|
e326eaad1e
|
master client,reconnect if grpc failed (#5360)
master client,reconnect if grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
|
2021-05-24 01:44:49 +00:00 |
|
godchen
|
0eee7e5252
|
Change session (#5329)
Change session.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-05-21 11:28:52 +00:00 |
|
congqixia
|
38f5b0826f
|
Add SaveBinlogPaths grpc in dataservice (#5277)
* Add SaveBinlogPaths grpc in dataservice
* fix merged compile error
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-05-20 11:34:45 +08:00 |
|
godchen
|
e224d1e725
|
Add SessionManager (#5288)
Add SessionManager.
Resolves: #5174
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-05-19 10:36:05 +00:00 |
|
Cai Yudong
|
5f0006d0f9
|
Improve code coverage for distributed/datanode (#5133)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-05-08 06:07:04 +00:00 |
|
Cai Yudong
|
d66a5acca3
|
improve code coverage for distributed/dataservice (#5123)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
improve code coverage for distributed/dataservice
|
2021-05-07 07:43:52 +00:00 |
|
Xiangyu Wang
|
82ccd4cec0
|
Rename module (#4988)
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
|
2021-04-22 14:45:57 +08:00 |
|
sunby
|
b79a408491
|
Remove unused config item in dataservice and datanode
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-04-19 19:28:45 +08:00 |
|
cai.zhang
|
9ccaff8005
|
Add copyright
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2021-04-19 19:28:11 +08:00 |
|
neza2017
|
eca1e25470
|
Add msg id at master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
|
2021-03-26 15:13:33 +08:00 |
|
bigsheeper
|
1634d75980
|
Release flowgraph properly
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-03-22 12:49:50 -05:00 |
|
zhenshan.cao
|
c2734fa55f
|
Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-03-22 16:36:10 +08:00 |
|
godchen
|
f3649f0419
|
Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-03-12 14:22:09 +08:00 |
|
del-zhenwu
|
b1763c3690
|
Disable xdist in test cases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
|
2021-03-10 15:27:26 +08:00 |
|
neza2017
|
55fc3f56aa
|
Set grpc max recv mag as math.MaxInt32
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
|
2021-03-08 15:49:42 +08:00 |
|
sunby
|
aeb3038545
|
Remove GetCount in data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-03-08 10:49:44 +08:00 |
|
neza2017
|
2835bcdc4e
|
Update masterservice unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
|
2021-03-05 20:41:34 +08:00 |
|
sunby
|
dec0b40a66
|
Add log panic in log module
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-03-04 16:01:30 +08:00 |
|
godchen
|
7b9fdd7f29
|
Add opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-02-26 17:44:24 +08:00 |
|
XuanYang-cn
|
fd562f9f9c
|
Update doc: add proxy graph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
|
2021-02-24 09:48:17 +08:00 |
|
zhenshan.cao
|
bbfcbbdd68
|
Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-02-23 11:40:30 +08:00 |
|
cai.zhang
|
4c5a898e9a
|
Add masterservice docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2021-02-20 11:15:19 +08:00 |
|
groot
|
dc3736281a
|
Integrate message stream
Signed-off-by: groot <yihua.mo@zilliz.com>
|
2021-02-08 14:30:54 +08:00 |
|
godchen
|
c2ca2c276f
|
Fix response check error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-02-04 19:34:35 +08:00 |
|
XuanYang-cn
|
bc7ad02df4
|
Fix datanode init bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
|
2021-02-04 10:25:01 +08:00 |
|
godchen
|
6e7e0b748a
|
Send timetick to insert channel
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-02-03 20:04:29 +08:00 |
|
sunby
|
e7588d3250
|
Implement getSegmentInfo interfaces
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-02-03 19:45:52 +08:00 |
|
zhenshan.cao
|
1b616fb874
|
Add persistent_segmentinfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-02-03 18:55:00 +08:00 |
|
sunby
|
ca9c2f5c12
|
Add GetCount and implement GetCollectionStatistics
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-02-02 14:25:58 +08:00 |
|
sunby
|
3a67dda06c
|
Add NewDataService in main
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-01-30 11:49:48 +08:00 |
|
neza2017
|
4d37a329da
|
Fix data service init
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
|
2021-01-26 19:25:17 +08:00 |
|
neza2017
|
d1b23cb8c5
|
Add debug info
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
|
2021-01-26 19:24:09 +08:00 |
|
sunby
|
f632ed0272
|
Fix data service init
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-01-26 18:45:12 +08:00 |
|
neza2017
|
8c54af292e
|
Add dd handler
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
|
2021-01-26 17:55:15 +08:00 |
|
XuanYang-cn
|
0b1c4f0420
|
Add building datanode cmd in Makefile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
|
2021-01-26 17:40:26 +08:00 |
|
sunby
|
9f72633fd9
|
Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-01-26 17:06:13 +08:00 |
|