congqixia
|
838a633584
|
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 16:18:56 +08:00 |
|
Enwei Jiao
|
fc8061bb86
|
improve logs to debug growing segment load failed (#19419)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-09-26 17:36:54 +08:00 |
|
xige-16
|
428840178c
|
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-09-21 20:16:51 +08:00 |
|
congqixia
|
3759f23f88
|
Add error log for load segment file failure (#19227)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-19 14:08:48 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
Bingyi Sun
|
626854cf0c
|
Refactor QueryCoord (#18836)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-15 18:48:32 +08:00 |
|
cai.zhang
|
e65ba6331e
|
Only store segmentID for flushed segments event (#19075)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-09-09 15:52:35 +08:00 |
|
congqixia
|
29c72cad15
|
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 10:34:59 +08:00 |
|
Xiaofan
|
56840da74f
|
Fix Segment Loader Log (#18883)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-08-29 15:30:57 +08:00 |
|
yah01
|
d76d6f42cd
|
Add unit test for case of stream closed (#18848)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-08-26 19:20:55 +08:00 |
|
yah01
|
63e08606e2
|
Fix load segment hangs forever (#18814)
Caused if the context is timeout
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-08-25 19:34:54 +08:00 |
|
wei liu
|
5c4f854271
|
fix load segment hangs (#18770)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 16:52:52 +08:00 |
|
congqixia
|
179b496824
|
Add cgo worker pool for querynode (#18461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-09 16:34:37 +08:00 |
|
Xiaofan
|
b427450593
|
Remove Load Delta Channel Request (#18497)
Fix #18393
remove watch delta channel task related logic
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-04 17:50:37 +08:00 |
|
yah01
|
9621b6615d
|
Limit the concurrency level for single load request (#18400)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-07-26 15:18:30 +08:00 |
|
zhenshan.cao
|
9bd35dd84e
|
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-04 11:10:20 +08:00 |
|
bigsheeper
|
6b79d4f7bc
|
Log segment type as possible in QueryNode (#17846)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-28 10:16:17 +08:00 |
|
congqixia
|
68d385137a
|
Fix: Miss channel info when load growing segment (#17789) (#17797)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: zhagnlu <1542303831@qq.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-06-27 12:02:16 +08:00 |
|
yah01
|
a38790f586
|
Predict the loading memory usage more accurate (#17451)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-09 18:16:07 +08:00 |
|
yah01
|
70f8bea4b4
|
Avoid growing slice as deserializing binlogs (#17421)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-08 11:46:06 +08:00 |
|
yah01
|
4e83f37899
|
Improve load performance (#17273)
Load segment's fields concurrently
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-02 17:56:03 +08:00 |
|
bigsheeper
|
f55fe6be3c
|
Merge historical replica and streaming replica in QueryNode (#17217)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-31 13:42:03 +08:00 |
|
xige-16
|
e196caf604
|
Force reclamation of memory after loading (#17244)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-27 12:50:00 +08:00 |
|
xige-16
|
56778787be
|
Reverse data from scalar index (#17145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-26 14:58:01 +08:00 |
|
zhenshan.cao
|
08a4dff41d
|
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-23 16:41:58 +08:00 |
|
Xiaofan
|
338edcd3cc
|
Load binlog for different field in parallel (#17005)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-05-15 16:11:54 +08:00 |
|
Letian Jiang
|
b3eb2b1d0d
|
Support deltaLog loading on growing segment (#16903)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
|
2022-05-12 11:59:53 +08:00 |
|
Ten Thousand Leaves
|
216c45fbd6
|
Add tests where segments load delta logs (#16825)
issue: #16821
/kind improvements
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-05-10 17:59:52 +08:00 |
|
Xiaofan
|
92b6293be4
|
Fix QueryNode log level (#16604)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-05-07 10:27:51 +08:00 |
|
xige-16
|
515d0369de
|
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
|
2022-04-29 13:35:49 +08:00 |
|
jaime
|
68b1b82faf
|
Remove DataKV interface (#16692)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-04-28 21:03:47 +08:00 |
|
yah01
|
80ae6de323
|
Add comments for concurrency package (#16654)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-04-26 11:33:45 +08:00 |
|
yah01
|
7af02fa531
|
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment (#16514)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-04-25 15:57:47 +08:00 |
|
Xiaofan
|
89b4a34892
|
Fix Data race in NodeID (#16603)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-04-24 22:03:44 +08:00 |
|
xige-16
|
99984b88e1
|
Support delete varChar value (#16229)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-04-02 17:43:29 +08:00 |
|
Jiquan Long
|
ba37531456
|
Add support for loading multiple indexes (#16138)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-03-30 21:11:28 +08:00 |
|
bigsheeper
|
7fee4743f5
|
Improve log print in OOM error info (#16170)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-03-24 20:17:25 +08:00 |
|
yah01
|
63a71e247a
|
Loading segments concurrency level fallbacks to the value that won't cause OOM (#16172)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-03-24 13:39:25 +08:00 |
|
godchen
|
78557ca6d7
|
Replace minio kv with minio chunk manager (#15936)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-03-17 18:03:23 +08:00 |
|
zhenshan.cao
|
f3eeecf146
|
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-03-15 21:51:21 +08:00 |
|
jaime
|
97b1ed7bca
|
Remove reader API from Mqstream and replace it with consumer API (#15971)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-15 14:45:22 +08:00 |
|
yah01
|
4f3d5fb6eb
|
Make load operation parallel improve performance (#15928)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-03-11 14:28:01 +08:00 |
|
顾炎
|
4f8c08f912
|
fix checkSegmentSize overflows int64 (#15858)
Signed-off-by: guyan <632722781@qq.com>
|
2022-03-09 13:29:58 +08:00 |
|
jaime
|
7a3a721380
|
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-03 21:57:56 +08:00 |
|
bigsheeper
|
12eb8c3da5
|
Add prometheus metrics for QueryNode (#15649)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-03-02 14:49:55 +08:00 |
|
bigsheeper
|
6a48071a5c
|
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-02-26 20:09:54 +08:00 |
|
xige-16
|
55cdc5aa35
|
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-02-08 21:57:46 +08:00 |
|
Cai Yudong
|
b6a48817b0
|
Add MinioConfig in GlobalParams for all components (#15099)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-01-10 17:29:34 +08:00 |
|
godchen
|
9e51591b3a
|
Fix pulsar reader not close (#14543)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-01-04 14:45:19 +08:00 |
|
XuanYang-cn
|
3d24007efa
|
Add more logs for load sealed segment (#14079)
Add logs before&after flowgraph_ddnode forwarding delete msg
See also: #13879
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-24 10:50:07 +08:00 |
|