XuanYang-cn
|
4c86cc63ba
|
Fix DN flowgraph delete buffer logs (#18657)
1. Remove logs about not existing segments.
2. Group logs by timestamp.
3. Log changed segments only.
4. Pair the segments reference lock and unlock log by taskID.
Resolves: #18655
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-15 16:28:48 +08:00 |
|
aoiasd
|
8a70f2badb
|
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
|
2022-08-12 13:20:39 +08:00 |
|
jaime
|
0e95f8a690
|
Refine indexcoord logs (#18589)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-08-11 10:00:38 +08:00 |
|
jaime
|
efa5dfaa7b
|
Fix Parse binlog path failure (#18583)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-08-10 17:04:37 +08:00 |
|
Ten Thousand Leaves
|
12023e8569
|
Fix a potential nullptr issue with metric (#18540)
/kind improvement
related to: #18530
but not the root cause
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-08-09 21:12:42 +08:00 |
|
SimFG
|
ff0200210a
|
Support Role-Based Access Control (#18425)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-08-04 11:04:34 +08:00 |
|
congqixia
|
28aadc988d
|
Use vchannel name in datanode subName (#18519)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-03 17:10:36 +08:00 |
|
jaime
|
c9174d55ba
|
Refine merge operation during compacting phase (#18399)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-07-28 14:52:31 +08:00 |
|
congqixia
|
e9d777b336
|
Fix ParseSegmentIDBinlog panicks with bad input (#18413)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-26 19:32:30 +08:00 |
|
xing.zhao
|
d90313a1a8
|
Use chunkManager rather than minio.Client in datanode garbage collection (#18092)
Signed-off-by: xingzhao <xing.zhao@zilliz.com>
Co-authored-by: xingzhao <xing.zhao@zilliz.com>
|
2022-07-22 22:10:28 +08:00 |
|
Ten Thousand Leaves
|
cd2f64d30c
|
Fix a nil pointer issue (#18343)
/kind bug
issue: #18270
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-20 17:56:30 +08:00 |
|
Ten Thousand Leaves
|
0ebe407221
|
Make DataNode not panic if stale segment is not found during flush (#18322)
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-20 15:06:30 +08:00 |
|
Jeng.Gwan
|
638f6c36e9
|
Support to get real row count of segment (#18115)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
|
2022-07-18 09:58:28 +08:00 |
|
Xiaofan
|
6d82ef8c20
|
fix garbage collector err handling (#18277)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-07-15 13:54:26 +08:00 |
|
congqixia
|
e5fe46124b
|
Fix isCompacting flag lost after segment clone (#18248)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-13 10:08:28 +08:00 |
|
zhenshan.cao
|
72910d65e0
|
Fix inconsistency in DataCoord (#18170) (#18171)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-08 13:48:21 +08:00 |
|
wayblink
|
43ae6791e6
|
Make VChannelInfo read compatible with 2.0.2 (#17995)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-07-07 21:58:22 +08:00 |
|
cai.zhang
|
0ad15a22c8
|
IndexCoord handle events correctly (#17878)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-07-07 14:44:21 +08:00 |
|
Ten Thousand Leaves
|
d4a1e94f32
|
Fix flush failure caused by empty stale segments (#18097)
/bug
issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-06 18:10:21 +08:00 |
|
zhenshan.cao
|
9bd35dd84e
|
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-04 11:10:20 +08:00 |
|
zhenshan.cao
|
0baeb609dc
|
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-06-30 17:26:19 +08:00 |
|
yah01
|
ef6859a4d6
|
Refactor handoff handler (#17806)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-29 23:26:19 +08:00 |
|
XuanYang-cn
|
ff3c4ab2a8
|
Fix compaction panic (#17840)
See also: #17823
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-29 16:54:17 +08:00 |
|
Ten Thousand Leaves
|
f0b036a35a
|
Move bulk load segment lock happen early (#17612)
issue: #17600
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-27 13:56:17 +08:00 |
|
bigsheeper
|
230404499d
|
Check duplication before adding channel info in DataCoord (#17742)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-24 16:30:15 +08:00 |
|
Bingyi Sun
|
05273309e8
|
Drop empty sealed segment (#17708)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2022-06-24 15:16:14 +08:00 |
|
XuanYang-cn
|
21b52bfcf2
|
Enhance channel manager ut (#17682)
Resolves: #17676
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-23 18:08:14 +08:00 |
|
SimFG
|
50d5d04552
|
Refine some codes about the datanode (#17720)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-06-23 09:58:14 +08:00 |
|
Xiaofan
|
6fdf88f452
|
Fix compaction selection policy (#17690)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-22 19:00:14 +08:00 |
|
Enwei Jiao
|
746aeea35b
|
fix typo (#17668)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-06-21 18:54:13 +08:00 |
|
cai.zhang
|
ed94ecf847
|
Segments can't be compacted when they have reference lock (#17649)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-06-20 21:56:12 +08:00 |
|
Xiaofan
|
516d91470f
|
Fix Delta log loss after compaction (#17634)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-19 20:12:11 +08:00 |
|
Letian Jiang
|
b15c24a554
|
Acquire reference lock of compacted from segments during index building (#17619)
- Accquire reference lock during index building
- Keep dropped segment record
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-06-18 01:24:11 +08:00 |
|
wayblink
|
074ec3060a
|
Support return dropped segments info in GetSegmentInfo rpc (#17617)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-17 18:24:12 +08:00 |
|
cai.zhang
|
53a49a9255
|
GetIndexState only get the state generated call CreateIndex (#17549)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-06-16 20:12:11 +08:00 |
|
wayblink
|
eb5b0b7fc8
|
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441)
Resolves: #17233 #16047
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-16 12:00:10 +08:00 |
|
Xiaofan
|
54aeb077e9
|
Refine compaction selection poliy (#17486)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-15 23:14:10 +08:00 |
|
cai.zhang
|
ea5041aec2
|
Acquiring the segment reference lock on task level (#17544)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-06-15 21:38:10 +08:00 |
|
Ten Thousand Leaves
|
51a9e54b21
|
Fix a bug that causes infinite loop (#17550)
This will cause AddNode() to keep its lock forever so DataCoord would just hang
issue: #17366
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-15 20:50:10 +08:00 |
|
Bingyi Sun
|
d4fdfab818
|
Fix VDC-510 (#17554)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2022-06-15 19:58:10 +08:00 |
|
Ten Thousand Leaves
|
65ab847815
|
Add segment reference lock for bulk load (#17457)
So we can support DataQueryable and DataIndexed states
issue: #16607
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-15 12:20:10 +08:00 |
|
XuanYang-cn
|
e6225d923b
|
Cancel timers while adding new timer (#17511)
See also: #17335
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-13 14:46:08 +08:00 |
|
XuanYang-cn
|
2b5340581c
|
Skip remove if reassigns to the original node (#17450)
Fix ut race
See also: #15966, #17432
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-10 10:54:07 +08:00 |
|
Xiaofan
|
6426e3d037
|
Split Etcd save operation into small txns (#17386)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-08 15:08:07 +08:00 |
|
XuanYang-cn
|
1dbfebf827
|
Add debug log in removing assignment (#17427)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-08 10:44:06 +08:00 |
|
groot
|
f31be941bb
|
Fix bulkload row count bug for multi datanodes (#17384)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-06-07 16:56:07 +08:00 |
|
xige-16
|
b5c11a216d
|
Alter varChar type params's name to max_length (#17409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-07 15:58:06 +08:00 |
|
Xiaofan
|
af994b5e1c
|
Fix etcd watch error (#17364)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-06 16:26:06 +08:00 |
|
XuanYang-cn
|
c70af73005
|
Fix datacoord set wrong state for node registering (#17376)
Fix datacoord datarace
See also: #17335
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-06 15:10:05 +08:00 |
|
shaoyue
|
76eaa3fc50
|
Support access s3 through AWS IAM role (#17292)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
|
2022-06-02 19:42:03 +08:00 |
|