686 Commits

Author SHA1 Message Date
XuanYang-cn
9691315c21
Fix flush deltabuf with segmentID=0 (#23059)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-28 19:14:01 +08:00
aoiasd
5d172d0f4f
Refine errors of datanode (#22852)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-28 19:04:00 +08:00
zhenshan.cao
e3c3c949c4
Fix datarace of flow_graph_manager_test.go in package datanode (#23043)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-28 10:42:00 +08:00
yihao.dai
b21f03682a
Fix flowgraph manager test (#23009)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-27 18:00:05 +08:00
congqixia
4008ee6d60
Remove datanode ddNode forward delta logic (#23005)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-27 14:18:00 +08:00
yah01
081572d31c
Refactor QueryNode (#21625)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-27 00:42:00 +08:00
Xiaofan
5a914aedf3
Make Datacoord TT to be configurable (#22956)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-24 22:24:04 +08:00
XuanYang-cn
da58ba6a49
Fix endless appending sids (#22977)
See also: #22976

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-24 18:00:03 +08:00
congqixia
8f847884c2
Fix misc copylocks and remove exclude rule (#22962)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-24 11:17:58 +08:00
XuanYang-cn
93bc805933
Enhance ID allocator in DataNode (#22905)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-23 19:43:57 +08:00
yihao.dai
f2ffb5db26
Use buffer size at memory sync policy (#22825)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-21 21:37:56 +08:00
SimFG
4a90490a67
Fix the segment not found error (#22772)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-17 17:27:56 +08:00
smellthemoon
8799b06dbc
Fix the data is disappeared when upsert (#22762)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-14 19:11:54 +08:00
congqixia
732986aa04
Remove fmt.Print from internal package (#22722)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-14 17:36:05 +08:00
aoiasd
6959332b08
Fix unittest start channel event but not close (#22662)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-14 17:05:54 +08:00
wayblink
aa6212d5b0
[Cherry-pick] Fix channel checkpoint issues and fix GC (#22559)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Co-authored-by: Ten Thousand Leaves <69466447+soothing-rain@users.noreply.github.com>
2023-03-09 14:13:52 +08:00
jaime
d126f06946
Decouple mq module from internal proto definition (#22536)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-03-04 23:21:50 +08:00
yah01
60cd548bf5
Rename concurrency package to conc (#22453)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-28 14:19:47 +08:00
yah01
167581c08a
Refine Pool to improve the ease of use (#22412)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-27 18:07:48 +08:00
wayblink
416866e42f
Add memory usage too large sync policy (#22244)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-27 17:47:51 +08:00
yah01
b758c305a7
Make Future generic (#22411)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-27 12:07:47 +08:00
Xiaofan
3d6bded115
Fix Row Number Mismatch (#22307)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 10:41:46 +08:00
Enwei Jiao
697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
zhenshan.cao
e768437681
Correct usage of Timer and Ticker (#22228)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-02-23 18:59:45 +08:00
aoiasd
27b456dd46
Fix data race of data node test (#22221)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-22 10:28:26 +08:00
wei liu
0ce70b4f10
fix compact task data race (#22299)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-21 16:10:26 +08:00
Enwei Jiao
0a9a9058b9
Fix UT timeout (#22261)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-20 21:14:25 +08:00
aoiasd
9167773eff
Remove needless kv at dataSyncService (#22206)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-16 16:36:39 +08:00
congqixia
9346f1752a
Convert msg pchannel to vchannel before check IsCloseMsg (#22182)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-15 17:26:34 +08:00
aoiasd
148a024e05
Add tickle for datacoord watch event (#21193)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-15 16:20:34 +08:00
aoiasd
1894766235
Update datacoord compaction plan after datanode update plan to ensure consistency (#22143)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-15 16:00:33 +08:00
smellthemoon
e20d79a8a1
Fix data race (#22171)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-02-15 15:40:33 +08:00
bigsheeper
d2667064bb
Add msgDispatcher to support sharing msgs for different vChannel (#21917)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-02-13 16:38:33 +08:00
cai.zhang
511265c68c
Modify lastSyncTime in advance to prevent multiple flush binlogs (#22048) (#22088)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-12 18:56:33 +08:00
XuanYang-cn
2b982b5d8f
Fix DataNode ut never meet condition (#22093)
See also: #22079

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-02-10 11:04:32 +08:00
yah01
9b491858a5
Fix datanode unit test not stable (#21911)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-01 18:19:50 +08:00
Xiaofan
949d5d078f
Fix memory calculation in dataCodec (#21800)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-28 11:09:52 +08:00
congqixia
5986106037
Make paramtable init only once (#21782)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-19 14:53:44 +08:00
Enwei Jiao
90d9e165d4
Fix some configs not shown (#21653)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-13 15:31:41 +08:00
wayblink
6a722396bd
Integration test framework (#21283)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-01-12 19:49:40 +08:00
Enwei Jiao
fb42466c65
Use opentelemetry (#21509)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-12 16:09:39 +08:00
groot
9f8095996b
Report bulkinsert progress (#21612) (#21638)
Signed-off-by: groot <yihua.mo@zilliz.com>
2023-01-11 17:37:44 +08:00
groot
df0ffd08ce
Update segment id for import task (#21621)
Signed-off-by: groot <yihua.mo@zilliz.com>
2023-01-11 11:55:39 +08:00
Xiaofan
4b4944ecee
Support sync all segments while close (#21421)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-06 14:49:36 +08:00
cai.zhang
efefba4da4
Fix checkpoint will not update after delete and compact (#21495) (#21499)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-05 11:31:35 +08:00
yah01
7b39873ae0
limit the frequency of GetMetrics() log (#21514)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-04 17:39:35 +08:00
Jiquan Long
ff2a68e65a
Fix collection not exist when tried to do recovery (#21471)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-01-04 16:37:35 +08:00
congqixia
3a58ac9fba
Change node stop to TearDownTest (#21422)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-28 20:11:30 +08:00
Xiaofan
3667bb09b8
Avoid Sync when the segment open (#21397)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-28 10:51:34 +08:00
congqixia
3c9840d6d3
Fix some datanode instance not stopped in unit tests (#21385)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-26 16:59:30 +08:00