admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
19,505 Commits 146 Branches 196 Tags
Commit Graph

2762 Commits

Author SHA1 Message Date
sre-ci-robot
bda2f8d1ac
[automated] Update Pytest image changes (#32278) 
Update Pytest image changes
See changes:
f6377a5018
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-16 09:47:20 +08:00
binbin
9b25ce882b
test: add test cases for code change (#32290) 
issue: #31368 
pr: #32289

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-04-16 09:45:19 +08:00
binbin
f6377a5018
test: enable bf16 and f16 test cases (#32082) (#32259) 
issue: #31625 
pr: #32082

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-04-15 19:39:31 +08:00
binbin
8894149a63
test: support enable or disable multiple vector fields in all data type tests (#31201) (#32246) 
issue: #29799
pr: #31201

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-04-15 14:25:20 +08:00
yihao.dai
b68af208bc
fix: Use pk from binlog during import (#32118) (#32194) 
During binlog import, even if the primary key's autoID is set to true,
the primary key from the binlog should be used instead of being
reassigned.

issue: https://github.com/milvus-io/milvus/discussions/31943,
https://github.com/milvus-io/milvus/issues/28521

pr: https://github.com/milvus-io/milvus/pull/32118

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-15 10:31:19 +08:00
Chun Han
5f7edc7304
fix: lack good results for insufficient ef(#29883) (#32151) 
related: #29883
pr: https://github.com/milvus-io/milvus/pull/32080
see also: #29883

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-04-13 22:13:23 +08:00
PowderLi
3946368e82
fix: restful v2 (#32160) 
issue: #31176
master pr: #32144

cannot get dbName correctly while describe alias
https://github.com/milvus-io/milvus/issues/31978
return a valid json string even if the user doesn't have the whole
privileges to describe collection
https://github.com/milvus-io/milvus/issues/31635
rename IndexParam.IndexConfig to IndexParam.Params
FieldSchema.ElementTypeParams, IndexParam.Params can not only accept
string

Signed-off-by: PowderLi <min.li@zilliz.com>
 2024-04-13 21:55:29 +08:00
nico
d9892367d3
test: update and skip some test cases (#32094) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-04-12 18:17:20 +08:00
yihao.dai
246ef454dc
enhance: Add binlog import intergration test (#32112) (#32146) 
issue: https://github.com/milvus-io/milvus/issues/28521

pr: https://github.com/milvus-io/milvus/pull/32112

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-11 15:17:20 +08:00
Buqian Zheng
c8aacc6d59
feat: [2.4] [Sparse Float Vector] added some integration tests (#32093) 
add some integration tests for sparse float vector support

#29419

pr: https://github.com/milvus-io/milvus/pull/31062

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-04-10 21:47:29 +08:00
zhuwenxing
beb3b55271
test: [cherry-pick]increase the timeout of import (#32073) 
pr: https://github.com/milvus-io/milvus/pull/32064

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-10 10:45:20 +08:00
wei liu
eefa83458a
enhance: [skip e2e]remove useless suspend/resume gc operation in integration test (#31954) (#32081) 
pr: #31954

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-04-10 10:25:18 +08:00
zhuwenxing
f0b4153513
test: [cherry-pick]fix some negative case for restful v2 (#32057) 
pr: https://github.com/milvus-io/milvus/pull/32056

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-09 18:03:23 +08:00
zhenshan.cao
4c07304790
enhance: Refactor hybrid search (#31742) 
issue: https://github.com/milvus-io/milvus/issues/25639
https://github.com/milvus-io/milvus/issues/31368
pr :https://github.com/milvus-io/milvus/pull/32020

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-04-09 10:15:18 +08:00
congqixia
176d053268
fix: [skip e2e][2.4] Dedup available ports and retry for integration setup(#31902) (#31981) 
Cherry-pick from master
pr: #31902
See also #31901

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-08 14:17:16 +08:00
nico
c18193cbbe
test: update pymilvus version and test cases (#31828) 
pr: #31827

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-04-07 17:31:23 +08:00
zhuwenxing
58d95c7a22
test: enable import job test in ci (#31538) 
pr: https://github.com/milvus-io/milvus/pull/31530

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-07 16:29:16 +08:00
Cai Yudong
3f6a7fdae8
enhance: Disable HNSW Binary (#31825) (#31883) 
Issue: #31494 #31825

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-03 17:27:14 +08:00
zhuwenxing
68a2e1b40a
test: fix bulk insert case (#31741) 
pr: https://github.com/milvus-io/milvus/pull/31738

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-01 10:49:18 +08:00
zhuwenxing
0b61f12482
enhance:[skip e2e]add some custom deploy config back (#31717) 
pr: https://github.com/milvus-io/milvus/pull/31716

This reverts commit a07abba1a04dc5ae795f4f4244e2c4e5e48aabd0.

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-03-29 18:13:11 +08:00
wei liu
3e3a92fc89
enhance: Add restful api for devops to execute rolling upgrade (#29998) (#31645) 
issue: #29261
pr: #29998
This PR Add restful api for devops to execute rolling upgrade, including
suspend/resume balance and manual transfer segments/channels.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-29 16:15:11 +08:00
binbin
6e33976665
test: modify the order function in test cases (#31680) (#31700) 
issue: #30694
pr: #31680

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-03-29 14:09:17 +08:00
binbin
a8404f77eb
test: modify the hybrid search test case (#31703) 
issue: #31339 
pr: #31702

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-03-29 10:47:17 +08:00
congqixia
97c28edb04
fix: [Cherry-pick] Verify PlaceHolderValue type before search (#31626) (#31653) 
Cherry-pick from master
pr: #31626
See also #31625

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-03-28 10:21:11 +08:00
wei liu
ad07289819
fix: Skip release duplicate l0 segment (#31540) (#31644) 
issue: #31480 #31481
pr: #31540

release duplicate l0 segment task, which execute on old delegator may
cause segment lack, and execute on new delegator may break new
delegator's leader view.

This PR skip release duplicate l0 segment by segment_checker, cause l0
segment will be released with unsub channel

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-27 20:09:09 +08:00
congqixia
34f21794df
enhance: [2.4] Save collection targets by batches (#31616) (#31632) 
Cherry-pick from master
pr: #31616
See also #28491 #31240

When colleciton number is large, querycoord saves collection target one
by one, which is slow and may block querycoord exits.

In local run, 500 collections scenario may lead to about 40 seconds
saving collection targets.

This PR changes the `SaveCollectionTarget` interface into batch one and
organizes the collection in 16 per bundle batches to accelerate this
procedure.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-03-27 17:53:09 +08:00
binbin
a441620f76
test: modify hybrid search cases (#31627) 
issue: #31339 
pr: #31624

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-03-27 16:43:11 +08:00
sre-ci-robot
8ba4677e50
[automated] Update Pytest image changes (#31638) 
Update Pytest image changes
See changes:
f953f2f70b
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-03-27 16:29:10 +08:00
cai.zhang
b8f849e98e
enhance: Support auto index for scalar index (#31593) 
issue: #29309 
master pr: #31255

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-03-27 14:57:10 +08:00
nico
f953f2f70b
enhance: update pymilvus version (#31526) 
pr: #31529

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-03-27 11:15:09 +08:00
yihao.dai
1e0bf5acd2
enhance: Remove import v1 (#31403) (#31535) 
Remove all code and logic related to import v1.

issue: https://github.com/milvus-io/milvus/issues/28521

pr: https://github.com/milvus-io/milvus/pull/31403

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-03-24 21:51:07 +08:00
yanliang567
193638a7fe
test: [cherry-pick]Add tests for more json forms support (#31503) 
related issue: #31051 
related pr: #31474

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-03-22 11:09:06 +08:00
wei liu
cac9a29eac
fix: [skip e2e] Unstable integration test TestNodeDown (#31471) 
issue: #31468 
pr: #31430 cherry-pick test part
This PR fix unstable integration test `TestNodeDown`

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-22 10:27:17 +08:00
zhuwenxing
c0f1af11d5
test: adjust index timing (#31493) 
pr: https://github.com/milvus-io/milvus/pull/31492

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-03-22 09:09:11 +08:00
sammy.huang
ad75ce043c
enhance: change config for etcd in nightly one pod (#31464) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-03-21 11:09:06 +08:00
zhuwenxing
a07abba1a0
enhance:[skip e2e]remove some custom deploy config (#31441) 
pr: https://github.com/milvus-io/milvus/pull/31440

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-03-20 20:57:06 +08:00
zhuwenxing
9d61ef56c7
test: [cherry-pick]update restful v2 testcases (#31433) 
update restful v2 test cases
pr: https://github.com/milvus-io/milvus/pull/31404

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-03-20 20:55:12 +08:00
zhuwenxing
528824f929
enhance:[skip e2e]update one pod helm values (#31425) 
pr: https://github.com/milvus-io/milvus/pull/31400

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-03-20 20:51:26 +08:00
wei liu
7abebf81a3
fix: Load segment task promote failed (#31431) 
issue: #30816
pr: #31430

pr #31319 introduce the logic that segment checker need to load level
zero segment which only exist in current target.

This PR fix load segment task promote failed when segment only belongs
to current target

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-20 15:11:05 +08:00
elstic
93bb04f884
test: add some mmap cases (#31211) 
issue : https://github.com/milvus-io/milvus/issues/30940

Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-03-15 15:25:05 +08:00
nico
9e7ce0a8f7
test: update test cases (#31266) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-03-15 15:23:10 +08:00
yanliang567
8563c4a5ee
enhance: Update groupby tests (#31297) 
related issue: #29883 
skip running for now

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-03-15 15:21:03 +08:00
yihao.dai
c408a32db6
feat: Add disk quota checks for import V2 (#31131) 
Return quota error when the files to be imported exceed the disk quota.

issue: https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-03-15 14:43:03 +08:00
wei liu
d79aa58b37
enhance: Speed up target recovery after query coord restart (#31240) 
issue: #28491

after querycoord restart, it will pull a new target, which include
channel and segment list. when segments loaded on querynode has reached
the target, the collection could provide search/query. but if segment
list changes by time, ater querycoord pull a new target, it will takes a
few minutes to catch up the target's segment distribution. and before
that, query/search will fail due to lack of segments.

This PR save the current loaded target to meta storein querycoord's stop
progress, and recover it when query coord starts, to speed up the target
recovery time.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-15 14:19:03 +08:00
wei liu
147a3b8bdc
fix: Grpcclient return unrecoverable error (#31256) 
issue: #31222

grpcclient's `call` func return a unrecoverable error, then the caller's
retry policy also breaks due to this unrecoverable error.

This PR introduce `retry.Handle`, the new func use `func() (bool,
error)` as input parameters, which return `shouldRetry` directly, to
avoid grpcclient return a unrecoverable error

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-15 10:03:05 +08:00
sre-ci-robot
126bb52f3d
[automated] Update Pytest image changes (#31236) 
Update Pytest image changes
See changes:
652b866587
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-03-14 09:59:10 +08:00
nico
652b866587
test: update test cases (#31225) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-03-13 19:05:11 +08:00
elstic
5220005a24
test: update the dim of the largest or smallest vector in case (#31223) 
issue: https://github.com/milvus-io/milvus/issues/31160

Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-03-13 16:53:04 +08:00
wei liu
06b191b164
fix: Balance channel stuck forever due to logic dead lock (#31202) 
issue: #30816

cause balance channel will stuck until leader view catch up the current
target, then start to unsub the old delegator. which make sure that the
new delegator can provide search before release old delegator. but
another logic in segment_checker skip loading segment during balance
channel. so during balance channel, if query node crash, new delegator
can't catch up target forever, then stuck forever.

This PR remove the rule that skip loading segment during balance channel
to avoid the logic dead lock here.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-03-13 15:05:04 +08:00
elstic
5b4c0bdc20
test: update the max binary vector dim in test code (#31208) 
issue: https://github.com/milvus-io/milvus/issues/31160

Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-03-13 11:23:04 +08:00