congqixia
d0e8711381
Fix watcher loop quit and channel shouldDrop logic ( #23401 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-13 19:10:29 +08:00
yihao.dai
fce815e414
Use buffer size at memory sync policy ( #22797 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-21 12:11:57 +08:00
SimFG
1e8c8f9f1c
Fix the segment not found error ( #22739 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-14 18:57:55 +08:00
SimFG
b2ece6a569
Fix the nil point about the session ( #22696 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-10 21:43:54 +08:00
cai.zhang
7aab677023
Gracefully stop session ( #22386 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-27 16:05:48 +08:00
SimFG
8123161738
Add the retry op for all server ( #22274 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
2023-02-24 17:51:47 +08:00
aoiasd
fbbbd6ea2f
Add tickle for datacoord watch event ( #21193 ) ( #22209 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-17 15:52:36 +08:00
cai.zhang
dd63c71bd0
Fix ut about disconnect etcd ( #22238 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-16 23:50:37 +08:00
xige-16
50739e6c6a
Add more metrics ( #21975 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
Xiaofan
375b2b355d
Fix Memory calculation ( #21798 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-28 11:09:51 +08:00
bigsheeper
a119d4bdf7
Replace session.ServerID with config.NodeID ( #21669 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-13 14:21:41 +08:00
groot
de318c2e7c
Report bulkinsert progress ( #21612 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2023-01-10 16:53:39 +08:00
groot
16798f4b2f
Update segment id for import task ( #21583 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2023-01-10 09:57:38 +08:00
groot
cf5c933df2
Refine bulkinsert ( #20986 ) ( #21532 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-01-05 13:29:36 +08:00
yah01
989ea16a20
limit the frequency of GetMetrics() log ( #21514 ) ( #21519 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-04 20:03:35 +08:00
groot
e7429f88af
Change import task timeout value ( #20716 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-18 18:59:09 +08:00
Bingyi Sun
c65306bc9b
Fix load uses compacted segments' binlogs ( #20655 ) ( #20695 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-11-17 22:01:09 +08:00
XuanYang-cn
2917856793
Reduce unnecessary logs of get compaction results ( #20643 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-17 10:09:12 +08:00
bigsheeper
d1ee0bb43b
Add channel level checkpoint [ #20350 ] ( #20542 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 14:07:07 +08:00
XuanYang-cn
b565145ad1
Remove too frequent logs ( #20454 ) ( #20476 )
...
Half of the log messages come from this log if DataNode in stale.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-10 21:11:03 +08:00
wayblink
7a392d6019
Pass backup flag through Import request options ( #20374 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-11-08 11:35:03 +08:00
congqixia
f557af1143
Verify target id for FlushSegments request in datanode ( #20308 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-03 22:47:35 +08:00
Xiaofan
2bfecf5b4e
Refine bloomfilter and memory usage ( #20168 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-31 17:41:34 +08:00
bigsheeper
b949fa0ea9
Increase default ttProtection max delay ( #20125 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-27 17:37:32 +08:00
groot
bee66631e3
Refine bulkload ( #19671 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-10-27 16:21:34 +08:00
bigsheeper
f0c616050a
Reduce and improve quota center log ( #20058 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-25 19:39:30 +08:00
Xiaofan
192151bc11
Refine Data Log ( #19996 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 19:31:30 +08:00
Xiaofan
1b5e765307
Block Flowgraph before handle compacted segments ( #19988 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-24 15:09:29 +08:00
smellthemoon
581e1d8c35
Fill MsgBase ALL ( #19912 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-21 15:57:28 +08:00
wayblink
dbd60757c9
Support pass start_ts and end_ts through Import API ( #19810 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-20 12:15:27 +08:00
XuanYang-cn
2785f98de6
Refactor segment replica in DN ( #19815 )
...
- Replace isNew and isFlushed with sType
- Add compacted into proto
- Rename replica to channel
- Rename segmentReplica to channelMeta
- Replace 4 maps with 1 map
- Add segment.go and segment_test.go
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-10-18 15:33:26 +08:00
SimFG
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
Ten Thousand Leaves
8b8df0a5e9
Do not use DataCoord context when DataNode is handling import task ( #19732 )
...
So that when DataCoord is done, DataNode can still proceed.
/kind bug
issue: #19730
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-14 15:15:24 +08:00
groot
a561614d48
Fix bulkload failed bug ( #19702 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-10-12 10:27:23 +08:00
wayblink
85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface ( #19594 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
wayblink
3049dbb5a5
Fix exclusive consumer conflict in import ( #19632 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 10:49:21 +08:00
Ten Thousand Leaves
b9feeab15f
Do not try to report task state when DataNode itself is down ( #19647 )
...
/kind bug
issue: #19502
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-10 09:45:21 +08:00
congqixia
d64f318a80
Add collection schema in watch channel info ( #19663 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-10 01:37:21 +08:00
Ten Thousand Leaves
b24e97e6a8
Improve some DataNode service logs ( #19648 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-09 15:54:58 +08:00
Xiaofan
6826964e60
Rename some interface and files in id allocator ( #19605 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-09 10:06:58 +08:00
congqixia
838a633584
Add ctx parameter for ChunkManager methods ( #19546 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-29 16:18:56 +08:00
XuanYang-cn
a0ce533727
Add a SyncSegments to sync meta between DN and DC ( #19298 )
...
See also: #19072
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-27 16:02:53 +08:00
Ten Thousand Leaves
b30c9d4f60
Support Bulk Load in Milvus 2.2 ( #18982 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
zhenshan.cao
c15b880f0e
Remove redundant logs ( #19412 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-09-26 15:40:53 +08:00
jaime
91df8f2d6a
Use log id instead of log path of the binlog in metastore ( #19123 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-09-25 15:56:51 +08:00
Xiaofan
928a213e31
Fix Chunk Manager Path mis use ( #19141 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-09-23 14:40:51 +08:00
XuanYang-cn
432b5ddf2e
Add SyncSegments into proto ( #19312 )
...
See also: #19072
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-23 10:22:52 +08:00
SimFG
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
bigsheeper
5cdd6ca251
Add quotaCenter, rateLimiter and rateCollector ( #18636 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-16 09:56:47 +08:00
congqixia
c91bb0b015
Unify rootPath in configs and ChunkManager ( #18808 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-25 19:32:53 +08:00