congqixia
|
04e1333552
|
Fix insert buffer node time range uint64 conversion error (#19725)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-10-12 17:19:23 +08:00 |
|
groot
|
a561614d48
|
Fix bulkload failed bug (#19702)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-10-12 10:27:23 +08:00 |
|
jaime
|
10c03de628
|
Refine method name from BroadCastXx to BroadcastXx (#19700)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-10-11 21:07:23 +08:00 |
|
Xiaofan
|
db3f4be49d
|
Simplify flow graph node to pipeline mode (#19667)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-10 22:15:22 +08:00 |
|
jaime
|
31db01b6ae
|
Support TTL for collection level (#19383)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-10-10 20:31:22 +08:00 |
|
wayblink
|
85e04d845c
|
Move GetComponentStates to milvus.proto, make it an external interface (#19594)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-10-10 15:55:22 +08:00 |
|
XuanYang-cn
|
2c92ce0c0e
|
Prevent datacoord from syncing unflushed segments (#19659)
See also: #19653
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-10-10 11:33:21 +08:00 |
|
wayblink
|
3049dbb5a5
|
Fix exclusive consumer conflict in import (#19632)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-10-10 10:49:21 +08:00 |
|
Ten Thousand Leaves
|
b9feeab15f
|
Do not try to report task state when DataNode itself is down (#19647)
/kind bug
issue: #19502
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-10-10 09:45:21 +08:00 |
|
congqixia
|
d64f318a80
|
Add collection schema in watch channel info (#19663)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-10-10 01:37:21 +08:00 |
|
Ten Thousand Leaves
|
b24e97e6a8
|
Improve some DataNode service logs (#19648)
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-10-09 15:54:58 +08:00 |
|
Xiaofan
|
6826964e60
|
Rename some interface and files in id allocator (#19605)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-09 10:06:58 +08:00 |
|
congqixia
|
838a633584
|
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 16:18:56 +08:00 |
|
XuanYang-cn
|
a0ce533727
|
Add a SyncSegments to sync meta between DN and DC (#19298)
See also: #19072
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-09-27 16:02:53 +08:00 |
|
yah01
|
9801c6dfc9
|
Fix data race in DataNode (#19470)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-09-27 15:16:55 +08:00 |
|
XuanYang-cn
|
f6e7b92db6
|
Fix read lock to write lock (#19464)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-09-27 11:50:57 +08:00 |
|
Ten Thousand Leaves
|
b30c9d4f60
|
Support Bulk Load in Milvus 2.2 (#18982)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-09-26 18:06:54 +08:00 |
|
zhenshan.cao
|
c15b880f0e
|
Remove redundant logs (#19412)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-09-26 15:40:53 +08:00 |
|
Enwei Jiao
|
ee8896d81b
|
fix compile error (#19428)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-09-26 11:24:54 +08:00 |
|
zhagnlu
|
59f8e96522
|
Change compactor policy from loading all binlogs to loading serially (#13716) (#19280)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-09-25 20:12:52 +08:00 |
|
jaime
|
91df8f2d6a
|
Use log id instead of log path of the binlog in metastore (#19123)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-09-25 15:56:51 +08:00 |
|
Xiaofan
|
928a213e31
|
Fix Chunk Manager Path mis use (#19141)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-09-23 14:40:51 +08:00 |
|
XuanYang-cn
|
432b5ddf2e
|
Add SyncSegments into proto (#19312)
See also: #19072
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-09-23 10:22:52 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
bigsheeper
|
5cdd6ca251
|
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-09-16 09:56:47 +08:00 |
|
congqixia
|
91663a6603
|
Fix bloom filter size not match (#19140)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-13 14:12:31 +08:00 |
|
jaime
|
362c663b22
|
Remove deprecated inner compaction type (#19024)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-09-07 19:16:34 +08:00 |
|
congqixia
|
68a6587374
|
Set insert&stats binlog timestamp range (#19005)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-04 09:05:09 +08:00 |
|
congqixia
|
ff5201cbe5
|
Improve log of datanode compactor (#18981)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 14:31:06 +08:00 |
|
congqixia
|
29c72cad15
|
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 10:34:59 +08:00 |
|
congqixia
|
c91bb0b015
|
Unify rootPath in configs and ChunkManager (#18808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-25 19:32:53 +08:00 |
|
wei liu
|
9338ad45c5
|
fix insert meets vChannels reuse pChannel (#18695)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 19:12:55 +08:00 |
|
Enwei Jiao
|
d9c7519107
|
refactor compaction concurency logic (#18660)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-08-23 15:50:52 +08:00 |
|
XuanYang-cn
|
16dcd9718b
|
Fix flush panic after compaction (#18677)
See also: #18565
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-17 17:08:49 +08:00 |
|
XuanYang-cn
|
4c86cc63ba
|
Fix DN flowgraph delete buffer logs (#18657)
1. Remove logs about not existing segments.
2. Group logs by timestamp.
3. Log changed segments only.
4. Pair the segments reference lock and unlock log by taskID.
Resolves: #18655
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-15 16:28:48 +08:00 |
|
aoiasd
|
8a70f2badb
|
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
|
2022-08-12 13:20:39 +08:00 |
|
congqixia
|
28aadc988d
|
Use vchannel name in datanode subName (#18519)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-03 17:10:36 +08:00 |
|
jaime
|
c9174d55ba
|
Refine merge operation during compacting phase (#18399)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-07-28 14:52:31 +08:00 |
|
SimFG
|
74fd28df9c
|
Refine some datanode code (#18351)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-07-21 15:52:27 +08:00 |
|
Ten Thousand Leaves
|
0ebe407221
|
Make DataNode not panic if stale segment is not found during flush (#18322)
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-20 15:06:30 +08:00 |
|
congqixia
|
be6ca6358d
|
Use serialized size before compression in log meta (#18336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-19 21:30:30 +08:00 |
|
congqixia
|
f0846fb79b
|
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-15 17:12:27 +08:00 |
|
Ten Thousand Leaves
|
ecc250c20e
|
Improve logs to better cover segment flush lifecycle (#18157)
/kind improvements
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-08 14:50:21 +08:00 |
|
XuanYang-cn
|
53734bef58
|
Add seek msgID in DataNode (#17881)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-08 10:18:28 +08:00 |
|
wayblink
|
43ae6791e6
|
Make VChannelInfo read compatible with 2.0.2 (#17995)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-07-07 21:58:22 +08:00 |
|
XuanYang-cn
|
d9e8231728
|
Filter sealed segments (#18065)
- Remove FilterThreshold in DataNode
- Alter filter logic in flowgraph DDNode
See also: #17943
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-07 18:26:20 +08:00 |
|
congqixia
|
8f1ba6a0bb
|
Concurrent load segment stats log when initialize dataSyncService (#18125)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-07 14:32:21 +08:00 |
|
Ten Thousand Leaves
|
d4a1e94f32
|
Fix flush failure caused by empty stale segments (#18097)
/bug
issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-06 18:10:21 +08:00 |
|
Xiaofan
|
a9b1d71a8f
|
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-07-06 13:54:21 +08:00 |
|
zhenshan.cao
|
9bd35dd84e
|
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-04 11:10:20 +08:00 |
|