1286 Commits

Author SHA1 Message Date
wayblink
3ae4e0089a
Fix bug: wrong logic on session delete (#23335)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-11 15:16:30 +08:00
yihao.dai
47e28fbe08
Add FlushAll (#23088)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-29 13:50:02 +08:00
yah01
0c729b3c50
Protect DataCoord from calculating segment lines by stale log entries num (#23069)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-28 21:30:04 +08:00
Xiaofan
4f724f1c83
Add config for disable BF load (#22998)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-28 20:06:08 +08:00
smellthemoon
ec6ed9f2b4
fix to reduce memory (#23028)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-28 19:56:02 +08:00
Xiaofan
a3e4b74fe1
Fix LRU Cache Concurrency (#23041)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-28 16:06:01 +08:00
zhenshan.cao
07090f84ee
Align the maximum dim of the diskann index and collection 's maximum dim (#23027)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-28 10:06:01 +08:00
Xiaofan
053acd39ec
Make datanode tt interval configurable (#22990)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-25 15:00:00 +08:00
Jiquan Long
9c3c29db6b
Check if all columns aligned with same num_rows (#22968) (#22981)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-24 17:32:00 +08:00
SimFG
5784943862
Check the collection num when creating the collection (#22919)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-22 20:35:57 +08:00
yihao.dai
fce815e414
Use buffer size at memory sync policy (#22797)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-21 12:11:57 +08:00
cai.zhang
cb96314fe7
Support get segment info without binlog path (#22741)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-03-14 21:47:55 +08:00
groot
3aa28506a2
Verify vector float data for bulkinsert and insert (#22729)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-03-14 14:03:58 +08:00
wei liu
336378c198
update shard leader cache (#22632)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-09 16:35:53 +08:00
aoiasd
69f4afe456
Fix data node tickle not run default (#22622)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-08 15:23:51 +08:00
xige-16
72264f656f
Fix concurrent loading diskann index timeout (#22548)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-03-03 20:15:49 +08:00
Ten Thousand Leaves
9129c11dec
Fix enableAutoCompaction default value (#22255)
/kind bug

issue: #22253

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-03-02 14:05:48 +08:00
congqixia
e27907cd29
[Cherry-Pick] Add background health check if ctx err returned (#22470)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-01 11:31:48 +08:00
MrPresent-Han
b01b467bf9
support channel balancer on datacoord (#22324) (#22377)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-02-27 18:27:48 +08:00
Xiaofan
ea039bbd37
Change the etcd session timeout to 20s (#22400)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 18:11:48 +08:00
wayblink
4cf8f2ec81
Add memory usage too large sync policy (#22241)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-27 17:47:51 +08:00
cai.zhang
7aab677023
Gracefully stop session (#22386)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-27 16:05:48 +08:00
SimFG
8123161738
Add the retry op for all server (#22274)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
2023-02-24 17:51:47 +08:00
SimFG
81f78142ee
Only print the file content when log the hook.yaml (#22340)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-02-22 20:55:46 +08:00
SimFG
876dac7545
Add the rbac for the GetLoadingProgress and GetLoadState api (#22313)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-02-21 14:20:27 +08:00
wayblink
99bf17275a
Skip file with prefix '.' may exist in filesystem (#22215)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-21 10:54:29 +08:00
wei liu
cd2e7fa535
sync resource group change (#22269)
fix load collection with rg (#22083)
	refine rg capacity behavior (#22089)
	support rg api rbac (#22097)
	Add resource group tests (#22101)
	Fix gen_vectors typo issue (#22117)
	fix transfer node (#22120)
	fix rg e2e (#22187)

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-20 19:22:26 +08:00
jaime
dac6b7ec8b
Support rename collection function (#22208)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-17 16:52:25 +08:00
aoiasd
fbbbd6ea2f
Add tickle for datacoord watch event (#21193) (#22209)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-17 15:52:36 +08:00
cai.zhang
dd63c71bd0
Fix ut about disconnect etcd (#22238)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-16 23:50:37 +08:00
cai.zhang
c333ee8d17
Exit component process when session key is deleted (#21658)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-14 11:04:35 +08:00
SimFG
bd559b3148
Add error log and metrics for the hook and privilege interceptor (#22111)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-02-10 15:52:32 +08:00
wayblink
d63bf18236
Support print log to file and console at the same time (#22080)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-10 14:16:32 +08:00
Xiaofan
d842711a8a
Setup config file for embedded etcd (#22076)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-09 22:04:33 +08:00
jaime
68754f978b
Add a segment metric for count number of binlog files (#22085)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-09 19:24:32 +08:00
yah01
ced4112ce5
Fix activate standby server ignores all errors (#22073) (#22091)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-09 17:26:32 +08:00
xige-16
50739e6c6a
Add more metrics (#21975)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
groot
1a2057b4b2
Fix datanode crash bug for bulkinsert (#22040)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-02-08 14:04:31 +08:00
Ten Thousand Leaves
d1cada2adb
Reduce maxFieldNum from 256 to 64 (#22030)
issue: #21077

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-08 10:08:32 +08:00
Jiquan Long
883a79e4b8
Change default max shards num to 64 (#22016) (#22017)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-02-07 14:43:57 +08:00
jaime
a10620c5e8
Modify default value of some configurations (#22012)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-07 10:05:56 +08:00
jaime
f16bbe711d
Add a segment seal policy by number of binlog files (#21941)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-06 14:55:54 +08:00
Ten Thousand Leaves
423c1c65a9
Verify and adjust segment # of rows before saving and passing SegmentInfo (#21200)
issue: #18120

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-03 14:19:52 +08:00
cai.zhang
85dd8912eb
Reduce scheduler duration of index task from 1s to 500ms (#21893)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-02 15:01:51 +08:00
wayblink
b68df26f73
Revoke session to only delete session key created by this node (#21908)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-02 12:03:58 +08:00
wei liu
926c88ff18
resource group impl (#21895)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-01 19:03:51 +08:00
congqixia
b7a97fe8b7
Use embed etcd for ConnectManager unit test (#21884) (#21902)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-01 15:59:51 +08:00
Xiaofan
375b2b355d
Fix Memory calculation (#21798)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-28 11:09:51 +08:00
Xiaofan
709bf35b9a
Remove frequent bulkload log (#21822)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-20 00:27:45 +08:00
Enwei Jiao
cae6d48f36
Disable time-travel by default (#21788)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-18 16:03:44 +08:00