cai.zhang
7aab677023
Gracefully stop session ( #22386 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-27 16:05:48 +08:00
Xiaofan
63c57db28d
Fix row number mismatch ( #22306 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 10:47:47 +08:00
SimFG
8123161738
Add the retry op for all server ( #22274 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
2023-02-24 17:51:47 +08:00
aoiasd
40878a8656
Update datacoord compaction plan after datanode update plan to ensure consistency ( #22143 ) ( #22329 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-22 18:19:45 +08:00
congqixia
ca4b61f0fb
Fix 2.2.2 possible broken channel cp ( #22205 ) ( #22227 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-20 14:36:26 +08:00
jaime
dac6b7ec8b
Support rename collection function ( #22208 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-17 16:52:25 +08:00
aoiasd
fbbbd6ea2f
Add tickle for datacoord watch event ( #21193 ) ( #22209 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-17 15:52:36 +08:00
cai.zhang
dd63c71bd0
Fix ut about disconnect etcd ( #22238 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-16 23:50:37 +08:00
cai.zhang
c333ee8d17
Exit component process when session key is deleted ( #21658 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-14 11:04:35 +08:00
cai.zhang
af8f7acb7b
Remove contraint that compaction based on indexed segment ( #22145 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-14 09:56:33 +08:00
cai.zhang
31de6cfb3c
Update component state to healthy after start ( #22084 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-10 15:36:33 +08:00
cai.zhang
6313a45524
Revert #22057 ( #22115 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-10 15:24:33 +08:00
cai.zhang
dbdb7e7d92
Remove contraint that compaction based on indexed segment ( #22057 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-09 19:52:32 +08:00
yah01
ced4112ce5
Fix activate standby server ignores all errors ( #22073 ) ( #22091 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-09 17:26:32 +08:00
xige-16
50739e6c6a
Add more metrics ( #21975 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
Ten Thousand Leaves
a28b3c28d2
Fix channel checkpoint issues and fix GC ( #22027 )
...
/kind bug
issue: #21897
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-08 21:00:32 +08:00
XuanYang-cn
99e3416418
Fix ut multi-remove the timer ( #22020 )
...
See also: #22019
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-02-08 10:28:31 +08:00
congqixia
738861e807
Fix Alloc timstamp failure blocks compaction queue forever ( #22039 ) ( #22046 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-08 10:10:32 +08:00
Ten Thousand Leaves
9d3a25781d
Minor fix on segment metric ( #21977 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-07 17:01:55 +08:00
congqixia
5c5c755643
Add Rated group for checkpoint gc skip case ( #21949 ) ( #21956 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-06 16:01:54 +08:00
jaime
f16bbe711d
Add a segment seal policy by number of binlog files ( #21941 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-06 14:55:54 +08:00
Ten Thousand Leaves
51f751940c
Recalculate segment max size during compaction ( #21197 )
...
issue: #21077
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-03 17:43:53 +08:00
XuanYang-cn
f02f83da50
Remove annoying not useful logs ( #21963 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-02-03 17:23:54 +08:00
Ten Thousand Leaves
423c1c65a9
Verify and adjust segment # of rows before saving and passing SegmentInfo ( #21200 )
...
issue: #18120
/kind enhancement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-03 14:19:52 +08:00
Xiaofan
d108d91696
Fix Bulkload slow flush issue ( #21918 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-01 21:55:51 +08:00
XuanYang-cn
1ba8337d42
Fix channelmanager ut ( #21140 ) ( #21903 )
...
See also: #17199
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-02-01 16:33:52 +08:00
Xiaofan
789cf5c48b
Fix BulkInsert may seal a failed segment ( #21779 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-31 12:41:53 +08:00
congqixia
474d2e11e8
Add segment gc restraint of dml position before channel cp ( #21773 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-17 18:31:43 +08:00
Jiquan Long
a13c375c48
Remove collection meta after GC finished ( #21595 ) ( #21671 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-01-13 15:43:41 +08:00
bigsheeper
a119d4bdf7
Replace session.ServerID with config.NodeID ( #21669 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-13 14:21:41 +08:00
cai.zhang
03ce5c2656
Register after start to prevent there are tow coordinator at the same time ( #21641 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-12 12:01:39 +08:00
Jiquan Long
bd50e1e0e2
Fix collection not exist when tried to do recovery ( #21471 ) ( #21628 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-01-12 09:55:42 +08:00
Ten Thousand Leaves
04e595d61b
BulkInsert completes when segments are flushed, without checking indexes ( #21604 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-01-11 18:57:43 +08:00
jaime
c704037991
Make the subName unique for the datanode tt channel ( #21616 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
2023-01-10 17:59:39 +08:00
jaime
780fbc5ed7
Improve ListSegments performance for Datacoord catalog ( #21600 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-10 15:29:39 +08:00
yah01
989ea16a20
limit the frequency of GetMetrics() log ( #21514 ) ( #21519 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-04 20:03:35 +08:00
Xiaofan
7d1ef09344
Add some debug log for segment creating ( #21369 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-27 15:07:29 +08:00
Ten Thousand Leaves
7e85971a58
Small candidate compaction should only happen with >1 segments ( #21250 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-16 10:03:27 +08:00
congqixia
0dc9a0311c
Fill collection schema after DataCoord restarts ( #21161 ) ( #21164 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-12 20:25:22 +08:00
bigsheeper
2823d23db0
Use channel-cp as seekPosition when FromDmlCPLoadDelete ( #21150 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-12 17:47:22 +08:00
Xiaofan
f02ad7b71a
Fix flush didn't respect binaryvector and other schemas ( #21119 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-12 10:33:26 +08:00
zhenshan.cao
61592cdecc
Fix start of DataCoord ( #20581 ) ( #21079 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-08 20:03:19 +08:00
congqixia
9692f4ed0e
Fix compaction handler may double release and block forever ( #21015 ) ( #21019 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-07 14:31:26 +08:00
Ten Thousand Leaves
790d6c324d
Fix segment_num, stored_rows_num and stored_rows_count metrics ( #21028 )
...
TODO: better track segment with state other than flushed and dropped.
/kind bug
issue: #20146 , #20145
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:27:20 +08:00
Ten Thousand Leaves
6dee58685e
Increase MaxWatchDuration and make it configurable ( #21010 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:19:19 +08:00
Ten Thousand Leaves
3e62688eb6
Split small segment proportion and small segment compactable proportion ( #21012 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:15:19 +08:00
cai.zhang
8435b8b4e3
GetFlushedSegments should include flushing segment ( #20834 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-01 16:35:20 +08:00
Enwei Jiao
802f512161
Etcd config source support TLS ( #20874 ) ( #20910 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
SimFG
925fa9d41d
Make sure that the segment path matches the segment id ( #20696 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
(cherry picked from commit 764f17890072d206831ac40c12d6f51830251c90)
2022-11-24 10:51:12 +08:00
XuanYang-cn
89bdb34c98
Enable to gen compaction plan for stale segments ( #20742 )
...
See also: #20502
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-22 17:33:16 +08:00