admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
15,167 Commits 146 Branches 196 Tags
Commit Graph

1113 Commits

Author SHA1 Message Date
congqixia
bc62ca1fab
Release collection resources when all partition released (#18569) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-09 18:32:37 +08:00
congqixia
d62381afc9
Add cgo worker pool for querynode (#18542) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-09 18:30:42 +08:00
congqixia
702e3253d0
Close Node/Segment detector when close ShardCluster (#18476) (#18568) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-09 18:18:36 +08:00
Xiaofan
9899a5be98
Remove Load Delta Channel Request (#18394) 
Fix #18393

remove watch delta channel task related logic

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-04 17:50:37 +08:00
yah01
dcd6c9e5a9
Limit the concurrency level for single load request (#18410) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-07-29 11:36:32 +08:00
congqixia
1e038a75ef
Use errgroup to load DeltaData in parallel (#18384) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-23 21:36:29 +08:00
wei liu
f132197ae9
fix sync problem during reblance (#18344) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-07-20 15:58:28 +08:00
bigsheeper
8fcd6aa56b
Fix addSegment error, avoid the risk of mem leaks (#18308) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-07-19 20:16:28 +08:00
xige-16
85117efdc8
Fix query too slow when insert multi repeated pk data (#18189) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-07-11 10:26:24 +08:00
bigsheeper
507518f869
Get search field id from search plan and log if loaded index when search segments (#18184) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-07-08 21:58:21 +08:00
zhenshan.cao
997e0668c8
Fix bug in metrics (#18144) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-07-08 14:10:22 +08:00
congqixia
e02dbd5c35
Fix handoff segment unit test uses wrong node id (#18137) (#18142) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-07 17:04:21 +08:00
congqixia
2dee6534a1
Fix data race in ShardCluster.SyncReplicas (#18054) (#18059) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-05 18:30:20 +08:00
congqixia
dba779e8c5
Return NotShardLeader error code when dml channel is not watched (#18055) (#18058) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-05 18:28:26 +08:00
bigsheeper
e6cfbe8ed1
Improve flow graph node name and log msgID in QueryCoord (#18044) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-07-05 16:46:23 +08:00
xige-16
e9cf804b85
Log querynode's runtime cpu num (#18039) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-07-04 19:12:20 +08:00
zhenshan.cao
c4d3677956
Count growing segment number to estimate cpu usage (#17820) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-07-01 22:28:23 +08:00
congqixia
54c8b762da
Make querynode handle segmentChangeInfo with multiple vchannel (#18010) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-01 19:04:18 +08:00
bigsheeper
ad2526a039
Return malloc_trim result and log if malloc_trim successfully (#17960) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-07-01 10:40:19 +08:00
congqixia
49d9e5facb
Remove growing according to offline as well (#17968) (#17974) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-30 22:32:19 +08:00
zhenshan.cao
ade1f45c34
Fix bugs in monitoring metrics (#17975) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-06-30 21:32:19 +08:00
zhenshan.cao
baf1d728c5
Fix bug: get correct number of cpu (#17973) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-06-30 21:12:17 +08:00
congqixia
a875e75557
Wait last version search to release growing safely (#17713) (#17808) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-30 20:22:18 +08:00
xige-16
0318f150af
Print log after segment search done (#17877) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-06-29 20:08:18 +08:00
bigsheeper
2e63738884
Log segment type as much as possible in QueryNode (#17869) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-06-28 17:00:18 +08:00
yah01
2dd1dc092b
Fix handoff isn't processed correctly (#17738) (#17848) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-27 23:18:17 +08:00
zhagnlu
ce67ad3524
Fix: Miss channel info when load growing segment (#17789) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-06-25 11:38:15 +08:00
zhenshan.cao
1fb2b9fed8
Refine logs to reduce print (#17759) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-06-24 11:56:17 +08:00
codeman
294f7e4408
fix: log datapb.SegmentInfo is too large #17685 (#17727) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-06-23 14:36:13 +08:00
Jiquan Long
216e2f80aa
Add msg id to log in query path (#17677) 
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-06-23 10:46:13 +08:00
codeman
6cb00aa5bb
fix: log datapb.SegmentInfo is too large #17685 (#17693) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-06-22 21:46:13 +08:00
bigsheeper
8cf54137cf
Add nil check in reduce and add collection rwmutex when release segments (#17698) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-06-22 16:12:14 +08:00
Jiquan Long
0282f69eb4
Add msg id to log in search path. (#17654) 
issue: #17513
Add msg id to log in search path,
which should help us to trace a detailed request more easier.

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-06-21 13:30:12 +08:00
congqixia
aa4b42c74b
Remove wait before release collection/partition (#17623) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-17 19:00:11 +08:00
bigsheeper
92d06b2e30
Purge memory by the memory state and try to purge after each search (#17565) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-06-17 17:46:10 +08:00
congqixia
785a5a757f
Use segment version instead of ref cnt (#17609) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-17 17:38:12 +08:00
Letian Jiang
be4077421e
Filter duplicated sealed segments which are both online and offline (#17593) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-06-16 17:42:11 +08:00
wayblink
eb5b0b7fc8
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441) 
Resolves: #17233 #16047

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-06-16 12:00:10 +08:00
Jiquan Long
875b6f88b0
Add channel information to flow graph node (#17349) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-06-15 21:04:10 +08:00
xige-16
98b32f3eba
Improve time record log in search/query (#17545) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-06-15 20:48:10 +08:00
xige-16
dd483beefd
Delete the log that prints a lot of deleteMsg.timestamps (#17543) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-06-15 20:46:14 +08:00
xige-16
16f0815184
Add time record log on search/query execution path (#17497) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-06-13 11:42:09 +08:00
yah01
a38790f586
Predict the loading memory usage more accurate (#17451) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-06-09 18:16:07 +08:00
yah01
70f8bea4b4
Avoid growing slice as deserializing binlogs (#17421) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-06-08 11:46:06 +08:00
zhenshan.cao
98e95275fe
Fix several code issues caused by carelessness (#17385) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-06-06 18:58:05 +08:00
congqixia
ac6394d0fd
Fix container/list removal in iteration (#17382) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-06 16:34:05 +08:00
Xiaofan
af994b5e1c
Fix etcd watch error (#17364) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-06-06 16:26:06 +08:00
bigsheeper
45febac298
Extract lease of cProto in QueryNode (#17373) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-06-06 15:56:05 +08:00
Ten Thousand Leaves
f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324) 
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-06-02 18:54:04 +08:00
yah01
4e83f37899
Improve load performance (#17273) 
Load segment's fields concurrently

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-06-02 17:56:03 +08:00