admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
18,508 Commits 146 Branches 196 Tags
Commit Graph

80 Commits

Author SHA1 Message Date
congqixia
14d8b1fe85
fix: [Cherry-pick] Add scope limit for querynode DeleteRequest (#29476) 
Cherry-pick from master
pr: #29474 
See also #27515

When Delegator processes delete data, it forwards delete data with only
segment id specified. When two segments has same segment id but one is
growing and the other is sealed, the delete will be applied to both
segments which causes delete data out of order when concurrent load
segment occurs.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-12-26 16:40:50 +08:00
wei liu
9092b1ae8a
feat: enable balance based on growing segment row count (#28623) (#29184) 
issue: #28622 
pr: #28623
query node with delegator will has more rows than other query node due
to delgator loads all growing rows.
This PR enable the balance segment which based on the num of growing
rows in leader view.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-12-14 15:26:37 +08:00
aoiasd
8502037cff
fix: [Cherry-pick] sync action load segment with lack collection index info list (#28956) 
relate: https://github.com/milvus-io/milvus/issues/28779
https://github.com/milvus-io/milvus/issues/28637
pr: https://github.com/milvus-io/milvus/pull/28788

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-07 14:14:42 +08:00
Gao
ccca932cc6
fix: [2.3] correct autoindex segment num (#28429) 
issue: #28386 
pr: #28387

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-11-28 19:24:26 +08:00
yihao.dai
8520ee7552
enhance: Print nq (#28507) (#28639) 
Log nq in search path.

pr: https://github.com/milvus-io/milvus/pull/28507

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-11-27 10:18:26 +08:00
congqixia
e4ea148c0f
fix: [cherry-pick] Add IndexList check for load segment request (#28601) (#28700) 
Cherry-pick from master
pr: #28601
See also #28022 #28034
The load segment may reaches before watch dml channel, so the index meta
may be empty as well

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-11-24 15:02:39 +08:00
wei liu
87e8d04ed7
fix sync distribution with wrong version (#28130) (#28170) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-11-06 11:38:18 +08:00
yah01
0ab13c935a
Fix QueryNode panic while upgrading (#28034) (#28114) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-11-03 17:24:18 +08:00
congqixia
3c716717b6
Add ctx parameter for tsafe pkg & NewDelegator method (#27877) (#28075) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-11-01 23:14:35 +08:00
yah01
be980fbc38
Refine state check (#27541) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-11 21:01:35 +08:00
wei liu
0695c88844
refine_log_of_update_target_version (#27572) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-10-11 06:51:33 +08:00
yah01
2d6a968233
Refine QueryNode errors (#27380) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-26 22:09:28 +08:00
yah01
6539a5ae2c
Refine DataCoord status (#27262) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-26 17:15:27 +08:00
jaime
7f7c71ea7d
Decoupling client and server API in types interface (#27186) 
Co-authored-by:: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-09-26 09:57:25 +08:00
SimFG
26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
yah01
168e82ee10
Fix panic while handling with the nil status (#27040) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-15 10:09:21 +08:00
congqixia
394c898b4c
Discard SyncDistribution set action from legacy querycoord (#27027) 
Since Milvus in lower version (< 2.3.0), there is no load info in set action
which may corrupt data integrity and cause panicking

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-13 09:35:18 +08:00
yah01
00c65fa0d7
Refine QueryNode errors (#27013) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 16:07:18 +08:00
aoiasd
e107d0794c
support complex delete expression (#25752) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-09-12 10:19:17 +08:00
MrPresent-Han
528948559f
fix false load failure for long unserviable period(#26813) (#26818) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-09-06 12:57:15 +08:00
yah01
3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
congqixia
e8f1b1736e
Remove log.Error(err.error())-style log (#26783) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-01 13:09:01 +08:00
MrPresent-Han
8330c18dc9
add log for loading segment(#26564) (#26640) 
/kind improvement

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-08-31 12:03:00 +08:00
wei liu
7af0f7d90c
avoid concurrent sub/unsub on same channel (#26454) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-23 10:10:22 +08:00
congqixia
123ad921e0
Fix querynodev2 search/query segments return unexpected grpc err (#26341) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-17 18:24:18 +08:00
Enwei Jiao
7d61355ab0
Refactor log for Query (#26310) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-14 18:57:32 +08:00
Gao
9ca8f28005
Fix missing totalChannelNum bug (#26295) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-08-11 18:35:29 +08:00
Enwei Jiao
ca1349708b
Remove time travel ralted testcase (#26119) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-10 18:53:17 +08:00
wei liu
302897f866
refine look aside balance logic (#25837) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 18:51:01 +08:00
wei liu
fc19b85a40
fix count(*）retrieve redundant growing segment (#25825) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 14:09:00 +08:00
congqixia
cc71e065e3
Support load index after segment loaded (#25567) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-18 10:51:19 +08:00
MrPresent-Han
49655d2f13
fix panic due to lack of indexInfo on querynode(#25362) (#25613) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-17 19:23:19 +08:00
yah01
d216f9abda
Clear collection meta after all channels/segments released (#25486) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-14 10:28:30 +08:00
wei liu
b72809db15
fix release sealed segment on unwatch channel (#25555) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-13 14:30:29 +08:00
yah01
205a7c430a
Fix QueryNode panic while inserting to released segment (#25495) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-12 19:48:29 +08:00
congqixia
bcd3abf644
Separate segments/shards reduce latency metrics (#25475) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 18:18:28 +08:00
congqixia
5aec6036dc
Add index info in GetDataDistribution response (#25444) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
wei liu
cc730c1ee5
fix consume growing from dml after release (#25421) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-10 17:36:28 +08:00
wei liu
a47fc28023
fix querynode panic in get distribution (#25405) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 18:26:25 +08:00
wei liu
d5ec7dda80
fix metric label in search/query count (#25377) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 17:48:26 +08:00
congqixia
3f9384b515
Fix exclude segment info dml position for flushed segments (#25200) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 17:30:26 +08:00
yah01
3d2283415f
Fix delegator leaked (#25347) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:18:26 +08:00
wei liu
c84496a1ba
fix sq count metrics (#25287) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:46:26 +08:00
yihao.dai
c56a26a556
Add SetMetricType and set metric only for shard leader (#25285) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00
chyezh
d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy (#24839) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-03 18:24:25 +08:00
Gao
8750be1e97
Set receive searchRequest log to debug level (#25223) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-29 14:04:22 +08:00
wei liu
9b91519c88
fix search cost metrics on replica selection (#25059) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 19:02:44 +08:00
wei liu
68ae199a9f
load segment with target version, avoid read redundant segment (#24929) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 11:48:45 +08:00
congqixia
d51e1379fe
Move loadDelta operation after needTransfer check (#24922) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-19 17:14:41 +08:00
wei liu
46f7d903a3
enable look aside balancer on replica selection (#24791) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-16 18:38:39 +08:00