183 Commits

Author SHA1 Message Date
congqixia
9a61c0291b
Disable error verbose for zap logger (#25688)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-18 12:53:21 +08:00
aoiasd
77a9553c3f
Add some log when node being reachable or unreachable (#25572)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-07-18 10:35:20 +08:00
yah01
948d1f1f4a
Handle errors by merr for QueryCoord (#24926)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-17 14:59:34 +08:00
wei liu
51c348158b
fix use pChannel in seek position (#25611)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-17 09:18:33 +08:00
yihao.dai
f19621fc8c
Support refund the tokens to limiter (#25598)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-07-14 15:58:32 +08:00
Bingyi Sun
c51922eb0b
Use sync.Map to reduce lock granularity to make create collection faster (#25485)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-13 21:46:31 +08:00
wayblink
50454bec4c
Allow empty minio.rootPath (#25534)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-07-13 14:46:29 +08:00
MrPresent-Han
ea3817fbbc
refinement towards sync_cp_lag_too_behind_policy to avoid submit syncTasks too frequently(#25441) (#25442) (#25500)
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-07-12 20:22:29 +08:00
yah01
205a7c430a
Fix QueryNode panic while inserting to released segment (#25495)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-12 19:48:29 +08:00
SimFG
f9e2d00f91
Prevent exclusive consumer exception in pulsar (#25376)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-07-12 17:26:30 +08:00
yihao.dai
4c93495587
Add segment size metric in querynode (#25406)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-07-12 14:26:28 +08:00
Xiaofan
dbf0130803
Faster garbage collect on compacted data (#25088)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-07-12 10:14:29 +08:00
congqixia
bcd3abf644
Separate segments/shards reduce latency metrics (#25475)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-11 18:18:28 +08:00
groot
96c987ed62
Bulkinsert supports partition keys (#25284)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-07-11 15:18:28 +08:00
yah01
8b06941da3
Reduce the load memory usage predict factor to 2 (#25469)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-11 13:06:28 +08:00
smellthemoon
d63323d117
Add rate limit and deny write in upsert (#25351)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-07-11 11:20:34 +08:00
Cai Yudong
5aad0ceec3
HNSW support binary vector (#25417)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-07-10 18:18:28 +08:00
Xiaofan
b437195e17
Set compaction default value to be true (#25424)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-07-08 11:04:25 +08:00
wei liu
342cfcad46
decrease default value of group max nq (#25380)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-07 15:40:25 +08:00
wei liu
c84496a1ba
fix sq count metrics (#25287)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 08:46:26 +08:00
wei liu
951c312ef9
refine grafana metrics for replica selection (#25319)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-05 17:00:25 +08:00
congqixia
efdd71c640
Make cgo pool size larger than worker pool size (#25318)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-05 16:56:26 +08:00
foxspy
31173727b2
growing segment index memory opt & get vector bugfix (#25272)
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2023-07-05 00:04:25 +08:00
chyezh
d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy (#24839)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-07-03 18:24:25 +08:00
Gao
de6e4817a2
Support dynamic tuning config (#25152)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-07-03 15:18:24 +08:00
smellthemoon
b30517d303
Enlarge timeout to prevent health check failure (#25173)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-06-29 17:10:23 +08:00
yihao.dai
37fe3393d1
Remove const to enable move semantics and improve schema util functions (#25193)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-06-29 11:04:22 +08:00
congqixia
1357ef7043
Merge get worker process for same nodeID (#25185)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-28 18:34:24 +08:00
wei liu
3a222e976d
fix consumer close may block forever (#25120)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-27 14:04:45 +08:00
SimFG
a1e6428bc7
Fix the kafka panic when sending the message to a closed channel (#25116) (#25117)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-06-27 10:42:44 +08:00
wei liu
17796743dd
add metrics for replica selection (#25037)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-27 09:52:44 +08:00
xige-16
33c2012675
Add more metrics (#25081)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-06-26 17:52:44 +08:00
wei liu
7b999b42bd
enable config policy on replica selection (#25067)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-25 19:46:44 +08:00
jaime
18df2ba6fd
[Cherry-Pick] Support Database (#24769)
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
2023-06-25 17:20:43 +08:00
chyezh
ccf3f0066f
[Pick] Enable max result window limit (#24986)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-06-25 14:42:43 +08:00
xige-16
04082b3de2
Migrate the ability to upload and download binlog to cpp (#22984)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-06-25 14:38:44 +08:00
congqixia
6a1eff3487
Fix kafka consumer double close (#25051)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 14:16:44 +08:00
congqixia
00f8f236d7
Revert close kafka internal producer (#25072)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 12:38:43 +08:00
congqixia
a3630e17a0
Refine grpc Status handling: retry legacy only for Unimplemented (#25041)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 10:30:43 +08:00
wei liu
0d51f55c48
enable config each collection has different rate limit (#24139)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-21 15:02:42 +08:00
PowderLi
3f4356df10
fix the spelling of field (#25008)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-06-21 14:00:42 +08:00
yihao.dai
9f5756f16e
Add cluster validation interceptor to resolve the ip-reuse issue (#25001)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-06-21 11:36:46 +08:00
congqixia
4fda4f3951
Close kafka internal consumer&producer properly (#24998)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-20 21:14:41 +08:00
Xiaofan
af1d84e5e1
Support sync when cp is lagged (#24989)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-06-20 10:00:41 +08:00
cai.zhang
c9e456c6eb
Remove metric_type check and fix some minor bugs (#24921)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-06-19 09:54:41 +08:00
cai.zhang
c81bdda55a
Hide autoindex params details (#24851) (#24935)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-06-16 14:30:40 +08:00
cqy123456
a519213316
Update knowhere version, update diskann api and generate cache nodes in build process (#24898)
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2023-06-16 14:20:39 +08:00
yihao.dai
c73219a54d
Limit the number of concurrent sync tasks and allow only one sync task for the same segment (#24881)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-06-16 14:14:39 +08:00
MrPresent-Han
ce5cb3c0c5
[skip e2e] modify default used balancer for 2.3 (#24937)
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-06-16 14:00:45 +08:00
smellthemoon
db31e88a73
Add length check when insert and upsert (#24759)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-06-15 10:24:38 +08:00