congqixia
5973f5aeb9
Use go-api/v2 for milvus-proto ( #24723 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-07 21:32:37 +08:00
yihao.dai
4434d001fd
Assign metric type in search request when user has not explicitly assigned ( #24583 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-06-01 13:44:35 +08:00
wei liu
266bf418d4
fix real time task num metrics ( #24349 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-24 14:27:26 +08:00
yah01
7524fa3919
Low the task merge cap if saw insufficient memory error ( #24233 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-05-19 13:27:24 +08:00
MrPresent-Han
0cb0fbfcf0
refine balance to replica granuity( #23454 ) ( #23629 )
...
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-25 16:52:36 +08:00
yah01
a7796e61e7
Fix the scheduler may retry a impossible task for long time ( #23649 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-25 10:22:37 +08:00
MrPresent-Han
29300106cc
support detailed querycoord task metrics( #23414 ) ( #23468 )
...
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-18 19:48:32 +08:00
wei liu
48c934a1f7
fix update next target ( #23325 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-18 10:28:32 +08:00
MrPresent-Han
f13e4efb41
enhance segment balance by considering global rowCount(##22914) ( #23307 )
...
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-09 13:28:28 +08:00
wei liu
42a90020b3
fix balance generate unexpect task ( #23217 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-07 15:58:28 +08:00
Jiquan Long
ea382f3305
Fix data race ( #23132 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-31 10:10:23 +08:00
congqixia
bca02d90c0
Reset delta position to vchannel in packSegmentLoadReq ( #22721 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-14 18:56:00 +08:00
yah01
42f4d013c0
Merge task with larger segments first ( #22474 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-28 18:09:49 +08:00
wei liu
8f1bcc3704
fix params data race ( #22402 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-24 19:43:46 +08:00
xige-16
50739e6c6a
Add more metrics ( #21975 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
wei liu
926c88ff18
resource group impl ( #21895 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-01 19:03:51 +08:00
bigsheeper
109cda6256
Return insufficient memory error when load failed ( #21592 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-10 21:25:41 +08:00
SimFG
3d0359f9a5
Support the graceful stop for the query node ( #21528 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-05 20:07:36 +08:00
Xiaofan
cfab3e4072
Add more logs for debugging load balance ( #21390 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-27 15:59:30 +08:00
wei liu
62668b891c
fix leader observer sync logic ( #20478 ) ( #21315 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-12-20 16:33:26 +08:00
Bingyi Sun
642d63c57d
update target ( #19296 ) ( #21202 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: wei liu <wei.liu@zilliz.com>
2022-12-16 15:23:25 +08:00
bigsheeper
2823d23db0
Use channel-cp as seekPosition when FromDmlCPLoadDelete ( #21150 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-12 17:47:22 +08:00
yah01
b4115c65ff
Optimize scheduler, increase merge tasks probability ( #20922 ) ( #20931 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-01 17:33:16 +08:00
Enwei Jiao
802f512161
Etcd config source support TLS ( #20874 ) ( #20910 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
yah01
c5f215da67
Refactor task scheduler and executor ( #20828 ) ( #20900 )
...
Make the performance able to scale out
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 16:37:17 +08:00
Xiaofan
61baf7dada
Remove some logs from debug to info ( #20699 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-29 21:09:15 +08:00
Jenny Li
3a42122b63
Task/Action won't finish util the RPC returned ( #20669 ) ( #20691 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
2022-11-17 20:41:09 +08:00
wei liu
8b682fdeac
fix duplicate watch channel task ( #20670 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-17 15:31:09 +08:00
yah01
a28edf9643
Add version for subscribed channel ( #20585 ) ( #20592 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:53:07 +08:00
yah01
bb19bf20d8
Scheduler should returns err if the queue is full ( #20539 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 10:27:07 +08:00
yah01
ea45a2aa4b
Refine QueryCoordV2 metrics ( #20471 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 17:09:06 +08:00
yah01
261bfeebfd
Refine task's priority ( #20364 ) ( #20370 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-07 17:23:03 +08:00
yah01
c08f11420f
Fix Release tasks may end with incorrect status ( #20263 )
...
If the resource has been removed, the release tasks should end with
Succeeded status, not stale
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 15:01:35 +08:00
Xiaofan
4f6b87311e
Refine request merger ( #20189 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-01 14:27:34 +08:00
yah01
0b939c5735
Check whether ubsubscribe/release task is stale ( #20165 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-01 12:33:35 +08:00
wei liu
4412cfcaaf
reduce querycoord unnecessary panic ( #19925 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-10-28 17:15:32 +08:00
smellthemoon
581e1d8c35
Fill MsgBase ALL ( #19912 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-21 15:57:28 +08:00
yah01
7cf26011e6
Add more logs for checkpoint of channel ( #19885 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-19 13:19:27 +08:00
yah01
c61a4d1243
Fix panic due to double stop ( #19849 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-19 12:13:28 +08:00
yah01
b0404cbbab
Remove dropped segments' info ( #19839 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-17 19:41:26 +08:00
SimFG
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
yah01
146a3342c3
Use task's ID as the MsgID instead of source ID ( #19751 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-13 15:21:23 +08:00
yah01
1c71844b8d
Add license header ( #19678 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-11 11:39:22 +08:00
yah01
e6c7286bee
Remove task timeout ( #19583 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-30 19:48:55 +08:00
yah01
2e9a08aecf
Use segment's position as the delta position ( #19577 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-30 17:20:55 +08:00
yah01
9dcee37e1c
Skip canceled tasks ( #19513 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-28 19:58:54 +08:00
yah01
377f856833
Fix balance may confuse leader observer ( #19435 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-28 12:10:54 +08:00
yah01
dff4d1042e
Fix can't release growing segment ( #19418 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-26 14:08:52 +08:00
yah01
6ba52366c5
Fix load segments can't be retried ( #19414 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-26 10:54:52 +08:00
Bingyi Sun
29d2c0bd7b
Move task merge cap to config file ( #19387 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-09-24 17:56:51 +08:00