admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2025-12-07 09:38:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
17,608 Commits 133 Branches 183 Tags
Commit Graph

153 Commits

Author SHA1 Message Date
yah01
8245e078c0
Add max segment size log (#26015) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-31 14:37:04 +08:00
zhagnlu
833674c1cb
add glog configurable function and redirect aws log to segcore log (#25664) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-07-27 19:49:02 +08:00
congqixia
5fbe6e99fd
Remove debug log from segment loader (#25937) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-26 18:51:01 +08:00
wei liu
302897f866
refine look aside balance logic (#25837) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 18:51:01 +08:00
yah01
3735a097e6
Refine the memeory usage prediction (#25889) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-25 17:41:01 +08:00
congqixia
0bc03ede0d
Add eventlog pkg and support grpc streaming event observation (#25812) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 17:23:01 +08:00
wei liu
a132122370
fix time unit in insert/delete cost metrics value (#25893) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 15:07:01 +08:00
aoiasd
b533c68632
Forbid update checkpoint without msgID (#25694) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-07-25 10:43:04 +08:00
wei liu
0e26486abc
fix segment num in log (#25876) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 09:13:00 +08:00
yah01
168f346620
Remove deprecated interface (#25864) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-07-24 17:47:00 +08:00
wei liu
fc19b85a40
fix count(*）retrieve redundant growing segment (#25825) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 14:09:00 +08:00
wei liu
32827f538a
add metrics for delegator insert/delete cost (#25733) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-21 15:30:59 +08:00
yah01
361db51337
Create dir if mmap enabled for validating path (#25750) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 18:48:58 +08:00
Cai Yudong
9a4761dcc7
Remove binary metrics TANIMOTO/SUPERSTRUCTURE/SUBSTRUCTURE (#25708) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-19 16:16:58 +08:00
yah01
079cd9dc70
Add caller skip to improve the log for segcore error (#25710) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-18 19:54:57 +08:00
congqixia
cc71e065e3
Support load index after segment loaded (#25567) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-18 10:51:19 +08:00
congqixia
c490b30db7
Fix segment loader skip wait if all segments are loading (#25643) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-17 19:51:18 +08:00
MrPresent-Han
49655d2f13
fix panic due to lack of indexInfo on querynode(#25362) (#25613) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-17 19:23:19 +08:00
yah01
948d1f1f4a
Handle errors by merr for QueryCoord (#24926) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-17 14:59:34 +08:00
Zhihong Yu
a7023ab3cc
Narrow the scope of deleteMut lock in loadStreamDelete (#25436) 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2023-07-17 09:30:34 +08:00
wei liu
b62c82af22
fix set target version in loading sealed segment (#25603) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 20:00:31 +08:00
congqixia
f2b14b43de
Add log field for local worker call (#25594) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:34:31 +08:00
congqixia
a7e6f08183
Fix DeleteCollection not protected (#25599) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:04:31 +08:00
Enwei Jiao
66fdc71479
Refactor logs in DataCoord & DataNode (#25574) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
yah01
d216f9abda
Clear collection meta after all channels/segments released (#25486) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-14 10:28:30 +08:00
yiwangdr
b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
wei liu
b72809db15
fix release sealed segment on unwatch channel (#25555) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-13 14:30:29 +08:00
yah01
205a7c430a
Fix QueryNode panic while inserting to released segment (#25495) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-12 19:48:29 +08:00
SimFG
f9e2d00f91
Prevent exclusive consumer exception in pulsar (#25376) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-07-12 17:26:30 +08:00
yihao.dai
4c93495587
Add segment size metric in querynode (#25406) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-12 14:26:28 +08:00
congqixia
bcd3abf644
Separate segments/shards reduce latency metrics (#25475) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 18:18:28 +08:00
congqixia
5aec6036dc
Add index info in GetDataDistribution response (#25444) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
cai.zhang
81278f4aea
Fix bug of missing JSON type when sorting retrieve results (#25412) (#25455) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-10 20:02:28 +08:00
congqixia
9e3a591bda
Fix segment released early in case of balancing (#25453) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-10 18:58:28 +08:00
wei liu
cc730c1ee5
fix consume growing from dml after release (#25421) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-10 17:36:28 +08:00
wei liu
d4704ab9b6
fix set shard unservicable when sync target version (#25418) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 19:32:25 +08:00
wei liu
a47fc28023
fix querynode panic in get distribution (#25405) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 18:26:25 +08:00
congqixia
f07c934558
Fix querynodev2 grace stop condition reversed (#25409) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-07 17:28:25 +08:00
wei liu
b7740835fe
fix metric label for sq count metrics (#25399) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 14:06:25 +08:00
chyezh
dc1cb54404
[Fixup] unexpected read_task_ready_len metric (#25349) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-06 20:02:29 +08:00
wei liu
d5ec7dda80
fix metric label in search/query count (#25377) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 17:48:26 +08:00
congqixia
3f9384b515
Fix exclude segment info dml position for flushed segments (#25200) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 17:30:26 +08:00
yah01
3d2283415f
Fix delegator leaked (#25347) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:18:26 +08:00
yah01
dd5f896dc8
Load batch by batch (#25212) 
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 13:58:27 +08:00
yah01
4c0e36d28c
Stop blocking until all channels & segments released (#25328) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 10:04:25 +08:00
wei liu
c84496a1ba
fix sq count metrics (#25287) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:46:26 +08:00
congqixia
efdd71c640
Make cgo pool size larger than worker pool size (#25318) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-05 16:56:26 +08:00
Enwei Jiao
816158e4af
Remove outdated searchplan (#25282) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-04 18:30:25 +08:00
Gao
4a87b9f60a
Fix queryHook ut data race (#25306) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-07-04 15:34:25 +08:00
yihao.dai
c56a26a556
Add SetMetricType and set metric only for shard leader (#25285) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00