SimFG
|
925fa9d41d
|
Make sure that the segment path matches the segment id (#20696)
Signed-off-by: SimFG <bang.fu@zilliz.com>
(cherry picked from commit 764f17890072d206831ac40c12d6f51830251c90)
|
2022-11-24 10:51:12 +08:00 |
|
yah01
|
004b443288
|
Change LRU to a generic type (#20744) (#20759)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-11-22 16:13:11 +08:00 |
|
groot
|
e1e2323fdd
|
Fix a regression of local storage (#20631)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-11-21 10:31:12 +08:00 |
|
wayblink
|
b494b564e3
|
Update datanode.segment.insertBufSize default value to 16777216 (#20714)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-11-18 18:35:10 +08:00 |
|
jaime
|
a2b383b523
|
Fix alter collection hang (#20686)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-11-17 22:07:09 +08:00 |
|
bigsheeper
|
dbcbe4d8f9
|
Disable tt delay protection (#20658)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-11-17 20:21:14 +08:00 |
|
Xiaofan
|
d01092a119
|
Fix Index Codec memory and storage usage (#20622)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-11-16 11:45:08 +08:00 |
|
jaime
|
cb294d1441
|
Add some msgstream metrics (#20601)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-11-15 19:41:16 +08:00 |
|
bigsheeper
|
6c651d25a4
|
Ensure compatibility of channel seek position and move syncPeriod to config (#20504) (#20597)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-11-15 19:39:18 +08:00 |
|
bigsheeper
|
d1ee0bb43b
|
Add channel level checkpoint [#20350] (#20542)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-11-15 14:07:07 +08:00 |
|
Xiaofan
|
037f733c28
|
Fix GCTuner Overflow (#20498)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-11-14 22:05:08 +08:00 |
|
groot
|
9aa2a0831d
|
Fix bulkinsert bug for int64 value (#20506)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-11-14 10:15:10 +08:00 |
|
MrPresent-Han
|
f857360cb4
|
enable delbuf auto flush function to avoid OOM when del msg accumulating (#20213) (#20512)
issue: #19713
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
|
2022-11-14 10:13:06 +08:00 |
|
xige-16
|
2284378f87
|
Fix spell PQ error (#20527)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-12 21:19:04 +08:00 |
|
xige-16
|
5e87eced6d
|
Limit MinDim to build disk index (#20495)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-12 21:17:09 +08:00 |
|
yah01
|
8f13fcd612
|
Only log if the refresh actually happens (#20505)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-11-11 14:37:05 +08:00 |
|
xige-16
|
0d5fbe8922
|
Fix GetDiskUsedSize not work (#20469)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-10 20:37:04 +08:00 |
|
groot
|
a1cd03ddca
|
Dont expire pending import tasks (#20432)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-11-10 10:25:08 +08:00 |
|
yah01
|
2e78872be8
|
Refresh targets if haven't make progress for 5mins (#20382)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-11-08 19:05:03 +08:00 |
|
wayblink
|
7a392d6019
|
Pass backup flag through Import request options (#20374)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-11-08 11:35:03 +08:00 |
|
groot
|
57d96a11d9
|
Fix listImportTasks bug (#20372)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-11-07 18:53:02 +08:00 |
|
Xiaofan
|
3f67fad59a
|
Fix GC Tuner when memory is too large (#20353)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-11-07 12:17:05 +08:00 |
|
xige-16
|
16c8642b18
|
Delete RAW_DATA copy when load IVF_FLAT index data (#20348)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-05 17:33:05 +08:00 |
|
Xiaofan
|
bb4777cf6e
|
Add GCTuner (#20351)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-11-05 12:07:00 +08:00 |
|
zhagnlu
|
1dac462cae
|
Change default thread core coefficient (#20120) (#20328) (#20333)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-11-04 17:49:35 +08:00 |
|
zhagnlu
|
cb2591d1fe
|
Parallel operations of disk-ann file manager (#20120) (#20122)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-11-03 14:39:40 +08:00 |
|
Ten Thousand Leaves
|
5708352a80
|
Improve DataCoord and DataNode logs (#20265)
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-11-03 12:15:35 +08:00 |
|
groot
|
cd3b3d3da6
|
Only allow one file for row-based import (#20234)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-11-02 10:23:35 +08:00 |
|
shaoyue
|
9fac1476f3
|
Add support for GCS(GoogleCloudStorage) with IAM (#20164)
go mod tidy
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
|
2022-11-01 11:07:35 +08:00 |
|
bigsheeper
|
a2d5947fe4
|
Change limiter burst type to float64 (#20215)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-10-31 20:59:34 +08:00 |
|
groot
|
c6151ad351
|
Parse utf32 string of numpy file (#20176)
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: groot <yihua.mo@zilliz.com>
|
2022-10-31 17:39:34 +08:00 |
|
Xiaofan
|
4136009a9a
|
Support load segments/channels in parallel (#20036)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-31 13:55:33 +08:00 |
|
Jiquan Long
|
8d0cc4226c
|
Fix IVF_SQ nbits check (#20183)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-10-31 10:13:34 +08:00 |
|
bigsheeper
|
bddd47c60f
|
Prevent limiter burst overflow (#20153)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-10-28 19:05:32 +08:00 |
|
bigsheeper
|
b949fa0ea9
|
Increase default ttProtection max delay (#20125)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-10-27 17:37:32 +08:00 |
|
groot
|
bee66631e3
|
Refine bulkload (#19671)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-10-27 16:21:34 +08:00 |
|
bigsheeper
|
f0c616050a
|
Reduce and improve quota center log (#20058)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-10-25 19:39:30 +08:00 |
|
Xiaofan
|
1f170ce1ba
|
Refine kafka consumer (#19846)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-25 13:23:30 +08:00 |
|
smellthemoon
|
2f19e6595a
|
Fill SourceID (#20000)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
|
2022-10-24 23:43:30 +08:00 |
|
Xiaofan
|
1b5e765307
|
Block Flowgraph before handle compacted segments (#19988)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-24 15:09:29 +08:00 |
|
Xiaofan
|
7d2ba60412
|
If autoID enabled, check to make sure user didn't specify autoID field (#19943)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-21 19:03:27 +08:00 |
|
smellthemoon
|
581e1d8c35
|
Fill MsgBase ALL (#19912)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
|
2022-10-21 15:57:28 +08:00 |
|
wayblink
|
dbd60757c9
|
Support pass start_ts and end_ts through Import API (#19810)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-10-20 12:15:27 +08:00 |
|
yah01
|
470e8ef419
|
Store index ID to filter out invalid handoff event (#19703)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-10-20 11:29:27 +08:00 |
|
jaime
|
b79687687d
|
Replace segment index file path with index file id within segment index meta (#19866)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-10-19 16:55:27 +08:00 |
|
bigsheeper
|
99df2d9b54
|
Add binlogSize and ttDelay metrics monitor (#19872)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-10-19 15:13:26 +08:00 |
|
yah01
|
7cf26011e6
|
Add more logs for checkpoint of channel (#19885)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-10-19 13:19:27 +08:00 |
|
smellthemoon
|
108e51b2f0
|
[test]Create index before load and fix error message (#19874) (#19857)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
|
2022-10-19 10:01:26 +08:00 |
|
wayblink
|
4cc57adc5d
|
Initiatively release session in etcd when service close (#19825)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-10-18 19:13:26 +08:00 |
|
jaime
|
59bcbf0cf6
|
Support check health for the service level (#19779)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-10-18 13:39:26 +08:00 |
|