16565 Commits

Author SHA1 Message Date
MrPresent-Han
cbcdebdd8a
enable scoreBasedBalancer default(#23454) (#23805)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
v2.2.7
2023-04-28 17:58:38 +08:00
MrPresent-Han
a234e5220c
prune balance log(#23454) (#23800)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-28 16:18:36 +08:00
MrPresent-Han
2cdd09674a
Revert "fix compacted segment delete buf block channel cp update(#23621) (#23782)" (#23798)
This reverts commit aba2571feeca1dc74d9b413356bf8d5f3830fc56.

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-28 15:22:37 +08:00
MrPresent-Han
a7c44b29d3
refine balance mechanism to avoid back and forth(#23454) (#23763)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-28 00:44:36 +08:00
MrPresent-Han
aba2571fee
fix compacted segment delete buf block channel cp update(#23621) (#23782)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-28 00:24:36 +08:00
smellthemoon
c82ec0b18a
Change some configurations, include change the defaultChannelNum to 16 (#23778)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-27 22:22:37 +08:00
wei liu
56b39abfdc
add retry on get recovery info (#23766)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-27 18:42:36 +08:00
sre-ci-robot
51b86004fb
Update Pytest image changes (#23759)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-27 16:52:35 +08:00
zhenshan.cao
08045643d6
[skip e2e] [pick] Update minio&etcd version (#23488) (#23765)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: Bennu <yunmei.li@zilliz.com>
2023-04-27 16:30:35 +08:00
nico
9286d7a432
Update pymilvus version and add case (#23628)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-27 14:40:36 +08:00
wei liu
2ee23feaf7
fix node up (#23626)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-27 12:08:35 +08:00
Gao
21762d9c23
Seperate reading build and load params for diskann (#23722)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-04-27 10:54:36 +08:00
yah01
1a773b8db1
Refine the merge algorithm (#23721)
For given two search tasks t1, t2:
- same topk: merge them if nq1 + nq2 <= MaxNQ
- otherwises: merge them if the merge cost doesn't exceeded merge ratio

the merge cost is defined as:
total cost - min(cost1, cost2)

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-27 09:52:36 +08:00
zhuwenxing
bf7a2e1715
[test]Add vector to output field for query (#23708)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-04-27 09:20:43 +08:00
Xiaofan
8745ee2563
Fix Has Collection (#23709)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-26 22:42:37 +08:00
Enwei Jiao
108ce54be3
Fix aws sdk load failed (#23736)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-26 20:06:38 +08:00
congqixia
5aad58d318
Fix shard detector rewatch always returns closed channel (#23734)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-26 19:26:39 +08:00
wei liu
ffa2dc4bd3
ban balance channel (#23724)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-26 19:24:42 +08:00
SimFG
c24c3017ae
Fix superusers' password verification problem (#23729)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-04-26 19:04:36 +08:00
zhenshan.cao
05d317feb4
Change default shard number to 1 (#23593)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-26 15:40:36 +08:00
XuanYang-cn
b7cda1b2b4
Make compaction target able to exceed segment max size by a bit (#21068) (#23692)
issue: #21053

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Ten Thousand Leaves <69466447+soothing-rain@users.noreply.github.com>
Co-authored-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-04-26 12:02:35 +08:00
congqixia
75b5751117
Re-calculate segment entry num when binlog field is zero (#23696)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-26 10:24:35 +08:00
congqixia
8b34f67284
Fix global rateCollector init multiple times (#23702)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-25 19:26:35 +08:00
wei liu
7ed32dba02
fix unstable ut (#23681)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 19:24:41 +08:00
MrPresent-Han
ad8cf1f759
support score-based balance channel(#23454) (#23691)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-25 19:20:37 +08:00
congqixia
4b3a598a1e
Limit delete cgo call concurrency (#23680)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-25 19:18:34 +08:00
SimFG
3fbaf45f70
RBAC supports Database validation (#23609)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-04-25 18:06:40 +08:00
MrPresent-Han
0cb0fbfcf0
refine balance to replica granuity(#23454) (#23629)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-25 16:52:36 +08:00
congqixia
8b392e61f5
Fix test_watch_channel unit test unstable (#23507) (#23682)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-25 14:52:35 +08:00
Gao
e820479b56
Add querynode plugin (#23599)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-04-25 10:40:34 +08:00
wei liu
88bef1b1a6
fix ut timeout (#23636)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 10:24:35 +08:00
yah01
a7796e61e7
Fix the scheduler may retry a impossible task for long time (#23649)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-25 10:22:37 +08:00
wei liu
c8dd8c5c54
fix balance channel (#23632)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-24 21:20:35 +08:00
congqixia
b54afdbbe4
Fix releasing non-loaded partition blocks forever (#23612)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-23 16:12:33 +08:00
wei liu
cb82783d34
remove write handoff event (#23565)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-23 15:18:33 +08:00
aoiasd
5f96f4bbfd
remove segment from datanode meta when segment dropped (#23398) (#23564) (#23492)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-21 20:16:32 +08:00
sre-ci-robot
9e02e93224
Update Pytest image changes (#23496)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-21 15:24:33 +08:00
xige-16
f00c5d3fab
Avoid mem copy when load data (#23138)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-04-21 12:34:33 +08:00
congqixia
5555b6b91a
Fix rootcoord histgram metrics uses default buckets (#23556) (#23567)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-21 10:02:32 +08:00
congqixia
9d64f376b5
Unwatch channel in watch buffer (#23548) (#23559)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-21 10:00:39 +08:00
zhuwenxing
c983b3e104
[test]Fix log info for deploy test (#23519)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-04-20 16:44:35 +08:00
ThreadDao
210d7c47d9
Add flush all test cases (#23129) (#23514)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2023-04-20 16:37:02 +08:00
nico
bd96ae05f9
Modify test cases and add case of ignore growing (#23515)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-19 19:02:35 +08:00
MrPresent-Han
8d5852494d
refine balance mechanism by pruning code and support urgent stopping balance(#23454) (#23455)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-19 17:50:31 +08:00
Cai Yudong
6f9f4d42fa
Upgrade to knowhere-v1.3.12 (#23503)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-19 10:20:31 +08:00
MrPresent-Han
29300106cc
support detailed querycoord task metrics(#23414) (#23468)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-18 19:48:32 +08:00
MrPresent-Han
e1122c2a66
protect balance parameters by setting legal range(#23454) (#23459)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-18 18:40:33 +08:00
wayblink
abc257bec2
Add log in AddImportSegment.getChannelLatestMsgID (#23494)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-18 17:52:32 +08:00
nico
73e751ea26
Update pymilvus version (#23471)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-18 16:08:31 +08:00
zhuwenxing
052ab23786
[test]Fix get collection for chaos test (#23485)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-04-18 16:06:34 +08:00