16542 Commits

Author SHA1 Message Date
wei liu
7ed32dba02
fix unstable ut (#23681)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 19:24:41 +08:00
MrPresent-Han
ad8cf1f759
support score-based balance channel(#23454) (#23691)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-25 19:20:37 +08:00
congqixia
4b3a598a1e
Limit delete cgo call concurrency (#23680)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-25 19:18:34 +08:00
SimFG
3fbaf45f70
RBAC supports Database validation (#23609)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-04-25 18:06:40 +08:00
MrPresent-Han
0cb0fbfcf0
refine balance to replica granuity(#23454) (#23629)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-25 16:52:36 +08:00
congqixia
8b392e61f5
Fix test_watch_channel unit test unstable (#23507) (#23682)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-25 14:52:35 +08:00
Gao
e820479b56
Add querynode plugin (#23599)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-04-25 10:40:34 +08:00
wei liu
88bef1b1a6
fix ut timeout (#23636)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 10:24:35 +08:00
yah01
a7796e61e7
Fix the scheduler may retry a impossible task for long time (#23649)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-25 10:22:37 +08:00
wei liu
c8dd8c5c54
fix balance channel (#23632)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-24 21:20:35 +08:00
congqixia
b54afdbbe4
Fix releasing non-loaded partition blocks forever (#23612)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-23 16:12:33 +08:00
wei liu
cb82783d34
remove write handoff event (#23565)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-23 15:18:33 +08:00
aoiasd
5f96f4bbfd
remove segment from datanode meta when segment dropped (#23398) (#23564) (#23492)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-21 20:16:32 +08:00
sre-ci-robot
9e02e93224
Update Pytest image changes (#23496)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-21 15:24:33 +08:00
xige-16
f00c5d3fab
Avoid mem copy when load data (#23138)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-04-21 12:34:33 +08:00
congqixia
5555b6b91a
Fix rootcoord histgram metrics uses default buckets (#23556) (#23567)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-21 10:02:32 +08:00
congqixia
9d64f376b5
Unwatch channel in watch buffer (#23548) (#23559)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-21 10:00:39 +08:00
zhuwenxing
c983b3e104
[test]Fix log info for deploy test (#23519)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-04-20 16:44:35 +08:00
ThreadDao
210d7c47d9
Add flush all test cases (#23129) (#23514)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2023-04-20 16:37:02 +08:00
nico
bd96ae05f9
Modify test cases and add case of ignore growing (#23515)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-19 19:02:35 +08:00
MrPresent-Han
8d5852494d
refine balance mechanism by pruning code and support urgent stopping balance(#23454) (#23455)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-19 17:50:31 +08:00
Cai Yudong
6f9f4d42fa
Upgrade to knowhere-v1.3.12 (#23503)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-19 10:20:31 +08:00
MrPresent-Han
29300106cc
support detailed querycoord task metrics(#23414) (#23468)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-18 19:48:32 +08:00
MrPresent-Han
e1122c2a66
protect balance parameters by setting legal range(#23454) (#23459)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-18 18:40:33 +08:00
wayblink
abc257bec2
Add log in AddImportSegment.getChannelLatestMsgID (#23494)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-18 17:52:32 +08:00
nico
73e751ea26
Update pymilvus version (#23471)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-18 16:08:31 +08:00
zhuwenxing
052ab23786
[test]Fix get collection for chaos test (#23485)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-04-18 16:06:34 +08:00
wei liu
48c934a1f7
fix update next target (#23325)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-18 10:28:32 +08:00
zhenshan.cao
0141156d6b
Improve the check logic of channel remove (#23439) (#23472)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-18 10:00:31 +08:00
Xiaofan
52fb48a33c
Add more log when search result is empty (#23421)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-17 17:14:31 +08:00
yah01
aa26fce802
Protect the QueryCoord meta from stale data migrated from old version (#23412) (#23438)
Fix #23411

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-17 17:12:30 +08:00
Xiaofan
6a4c2058d9
Fix Dead lock in shard manager (#23445)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-17 16:54:31 +08:00
Jiquan Long
c810c97be6
Optimize log trace (#23431) (#23432)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-17 10:56:31 +08:00
nico
03388a8148
Update pymilvus version (#23417)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-15 08:38:29 +08:00
congqixia
a66b77e408
Fix watcher loop quit and channel shouldDrop logic (#23394)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-14 07:30:30 +08:00
XuanYang-cn
51f5a128b3
Refine codes of datanode buffer (#23168) (#23332)
This PR refines deltabuffer of datanode:
- Add last sync time for compacted segment, see also: #23210
- Ensure all deltabuffermanager handles all delete related operations
- Change usedMemory to atomic.Int64
- Remove allocator in delete buffer

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-04-12 19:02:29 +08:00
aoiasd
c64e88099b
Fix watch event timeout when IO Pool busy(#23293) (#23388)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-12 18:56:29 +08:00
XuanYang-cn
19338437d4
Add retry in recovery (#23354)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-04-12 17:12:29 +08:00
sre-ci-robot
4d48d4c37d
Update Pytest image changes (#23379)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-12 16:48:29 +08:00
congqixia
27808850f1
Check leader ready before transfer load/release (#23190)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-12 16:22:29 +08:00
zhenshan.cao
051d8027d5
Revert "Restrain gc files by collection (#22504) (#22518)" (#23382)
This reverts commit a58abe166562258051b7b987d9f897b8ee752e43.

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-12 15:52:29 +08:00
MrPresent-Han
9d5d54ff7b
fix collection_num metrics on rootCoord(#23363) (#23374)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-12 12:20:28 +08:00
nico
f935338a11
Remove lib reportportal (#23371)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-12 11:56:28 +08:00
yah01
f1c78610bf
Fix DataCoord's meta may be broken with DataNode of prior version (#23032)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-11 16:12:30 +08:00
wayblink
3fe5fdb3dd
Fix bug: wrong logic on session delete (#23344)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-11 15:54:29 +08:00
XuanYang-cn
9075cedea4
Update pymilvus version to support python3.11 (#23317)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-04-11 14:52:30 +08:00
MrPresent-Han
ec5d6e202d
/kind improvement (#23342)
[skip e2e] add parameter for new balance in milvus.yaml
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-11 14:32:30 +08:00
yihao.dai
12ed242048
Fix timetick block caused by dml task pop failed (#23290)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-11 10:58:30 +08:00
wei liu
59c8c3d95e
fix balance segment cause panic (#23334)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-11 10:24:29 +08:00
MrPresent-Han
d82ad03b19
fix false memory toleration calculation when loading segments on qnode(#23262) (#23263)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-10 17:50:30 +08:00