60 Commits

Author SHA1 Message Date
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
xige-16
324f8b9b87
[skip e2e]Improve log for QueryNode spell (#14012)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-22 21:01:19 +08:00
congqixia
ef3b71f22b
Use indexInfo SerializedSize when estimating segment size (#13969)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 20:27:34 +08:00
xige-16
db0b707dd2
[skip e2e]Improve log for QueryNode spell (#13913)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 21:27:09 +08:00
xige-16
fb0426afcc
[skip e2e]Improve log for QueryNode spell (#13912)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 21:25:15 +08:00
xige-16
76c4dccf71
[skip e2e]Improve log for QueryNode spell (#13911)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 21:23:19 +08:00
congqixia
55ab425010
Use binlog size from meta when estimate SegmentSize (#13891)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-21 20:01:03 +08:00
xige-16
4e4ff54d98
Watch query channel to near the latest position (#13682)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 13:50:54 +08:00
xige-16
11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta (#13543)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 11:57:39 +08:00
XuanYang-cn
2e0f3695b2
Add more logs on failure path in load segments (#13785)
This PR added more clarified logs
- in IO failures of estimateSegmentsSize
- in esitimate goroutines

See also: #13250

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 11:13:03 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
xige-16
b7f987ef47
[skip e2e]Fix golint for loadSegments (#13674)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-17 22:32:42 +08:00
Xiaofan
b8d3808052
Fix Query Coord UT and cleanup logic (#13618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-17 21:30:42 +08:00
congqixia
835e0985fd
Reduce queryNodeCluster range prevent blocking online/offline events (#13249)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-13 21:51:10 +08:00
xige-16
6050504d43
[skip ci]Fix golint for querycoord cluster (#12918)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-07 21:47:12 +08:00
xige-16
9a208254d8
[skip ci] Fix golint of cluster (#12737)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 11:43:34 +08:00
xige-16
6d9a93ef37
[skip ci] Fix golint of reloadFromKV (#12735)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:05:41 +08:00
xige-16
567c657310
[skip ci]Fix golint for getComponentInfos (#12665)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-02 22:55:36 +08:00
xige-16
0e48ac19e9
[skip ci]Fix golint for isOnline (#12664)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-02 22:53:40 +08:00
xige-16
d237edd846
[skip ci]Fix golint for getOfflineNodes (#12663)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-02 22:51:46 +08:00
xige-16
6dd7afd1a4
[skip ci]Add comment for getOnlineNodes (#12575)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-01 22:41:33 +08:00
xige-16
e6d9be3dfa
[skip ci]Add comment for stopNode (#12574)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-01 22:01:33 +08:00
xige-16
d9af522af5
[skip ci]Add comment for removeNodeInfo (#12573)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-01 21:59:31 +08:00
xige-16
60831cae99
[skip ci]Add comment for getNodeInfoByID (#12493)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:23:34 +08:00
xige-16
0abc0ecf20
[skip ci]Add comment for registerNode (#12492)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:21:39 +08:00
xige-16
300027b0d2
[skip ci]Add comment for getNumDmChannels (#12491)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:19:43 +08:00
xige-16
b1da696767
[skip ci]Add comment for getSegmentInfoByNode (#12411)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:21:41 +08:00
xige-16
a4cfd1cb46
[skip ci]Add comment for releasePartitions (#12410)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:17:46 +08:00
xige-16
fa26804279
[skip ci]Add comment for releaseCollection (#12409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:15:49 +08:00
xige-16
d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 19:35:15 +08:00
bigsheeper
152d55dbfa
Fix the deadlock of the querycoord cluster (#11796)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 23:37:11 +08:00
XuanYang-cn
360d89d2cf
[skip ci]Update license for qc cluster (#12011)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:39:17 +08:00
xige-16
8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
xige-16
7908045a28
[skip ci] Fix golint of removeQueryChannel in queryCoord (#11941)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:53:13 +08:00
xige-16
544f1da95b
[skip ci] Fix golint of addQueryChannel in queryCoord (#11940)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:51:18 +08:00
xige-16
acd75c312a
[skip ci] Fix golint of WatchDeltaChannels in queryCoord (#11939)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:49:25 +08:00
xige-16
1278f4f356
[skip ci] Fix golint of watchDmChannels in queryCoord (#11861)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:35:14 +08:00
xige-16
354fd03729
[skip ci] Fix golint of releaseSegments in queryCoord (#11860)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:33:20 +08:00
xige-16
20a1c9774b
[skip ci] Fix golint of loadSegments in queryCoord (#11859)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:31:24 +08:00
godchen
4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
xige-16
dba0ae4421
Refactor segment allocate policy on querycoord (#11181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-11 12:56:42 +08:00
xige-16
9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster (#11247)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 16:00:55 +08:00
godchen
09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
xige-16
235d736a49
Add max number of retries for interTask in querycoord (#8215)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 09:54:37 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
xige-16
6df613f648
[skip ci] Commemt querycoord cluster interface (#8627)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-27 10:47:57 +08:00
xige-16
689e41066f
Add log for cluster reload in queryCoord (#8413)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:03:55 +08:00
xige-16
c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00