admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
18,488 Commits 137 Branches 188 Tags
Commit Graph

1241 Commits

Author SHA1 Message Date
Jiquan Long
8ef0c571b3
enhance: make consistency level used in delete configurable (#29280) (#29284) 
pr: #29280 
issue: #29279

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-12-20 14:14:34 +08:00
cai.zhang
3182b9df5b
fix: [Pick]Set the default index name to the name of the existing index (#29281) 
issue: #29269 
master pr: #29275

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2023-12-20 14:10:40 +08:00
PowderLi
9af24da65a
fix: rootCoord decide the builtin role cannot be deleted (#29248) 
issue: #29243

only rootCoord read the configuration item `builtinRoles`, so proxy
never know whether the role to be deleted is builtin.

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-12-18 14:22:42 +08:00
cai.zhang
966487962a
enhance: [Pick] Set default index name as field name (#29219) 
master pr: #29218

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2023-12-15 12:02:37 +08:00
congqixia
d8d699401b
enhance: [cherry-pick] Add http method to control datacoord garbage collection (#29212) 
Cherry-pick from master
pr: #29052
See also #29051

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi.Xia <congqi.xia@zilliz.com>
 2023-12-15 02:16:38 +08:00
congqixia
7d2fa93ee8
enhance: [cherry-pick] remove reset seed for every shuffle (#29196) 
Cherry-pick from master
pr: #29195
See also #29113
rand.Seed is deprecated and cost noticable CPU time during heavy payload

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-12-14 17:38:37 +08:00
congqixia
efef573c67
enhance: [cherry-pick] Add a config item for partition name as regexp feature (#29154) (#29183) 
Cherry pick from master
pr: #29154 
See also #29177
Add a config item for partition name as regexp feature and disable it by
default

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-12-14 14:46:37 +08:00
SimFG
c2ce7bce1a
fix: [2.3] the unstable unit test TestReplicateManager (#29147) 
/kind improvement
pr: #28718

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-12-13 10:46:44 +08:00
congqixia
78865c02e1
enhance: [cherry-pick] Use zap.Stringer for large log field (#29143) (#29153) 
Cherry pick from master
pr: #29143
See also #29113
Using zap.Stringer log field will evaluate log field value only when log
level meets the configuration, which could save some CPU time in search
route

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-12-13 09:48:38 +08:00
PowderLi
92db41518d
enhance: upgrade proto to use partition related privileges (#29100) 
issue: [milvus-proto
#212](https://github.com/milvus-io/milvus-proto/issues/212)
master pr: #28961

milvus can't use partition related privileges until upgrade
milvus-proto, even if them were added to milvus-proto

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-12-12 13:22:38 +08:00
congqixia
d36bf21f28
enhance: [cherry-pick] Avoid initializing casbin enforcer for each request (#29118) 
Cherry-pick from master
pr: #29117 
See also #29113

This patch:
- Replace plain Enforcer with `casbin.SyncedEnforcer`
- Add implementation of persist.Adapter with `MetaCacheCasbinAdapter`
- Invoke enforcer.LoadPolicy when policy updated

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-12-12 10:36:43 +08:00
PowderLi
10d3224638
enhance: add 3 builtin roles #28961 (#29010) 
issue: #28960
master pr: #28961

add new configuration: builtinRoles
user can define roles in config file: milvus.yaml

there is an example:

db_ro, only have read privileges, include load
db_rw, read and write privileges, include create/drop/rename collection
db_admin, not only read and write privileges, but also user
administration

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-12-08 10:52:36 +08:00
aoiasd
b639fd66b4
fix: [Cherry-pick] accesslog can not print search expression (#28931) 
relate: https://github.com/milvus-io/milvus/issues/28893
pr: https://github.com/milvus-io/milvus/pull/28899

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-08 02:00:36 +08:00
MrPresent-Han
5f4ac437b2
enhance: [Cherry-pick] Moving etcd client into session (#27069) (#28996) 
relate: #26694
pr: https://github.com/milvus-io/milvus/pull/27069

Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Co-authored-by: Filip Haltmayer <81822489+filip-halt@users.noreply.github.com>
 2023-12-07 16:22:34 +08:00
aoiasd
cb7b1d1d51
enhance: [Cherry-pick] pack proxy connection code and support accesslog print SDK_Version (#28844) 
relate: https://github.com/milvus-io/milvus/issues/28086
pr: https://github.com/milvus-io/milvus/pull/28835

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-07 12:06:34 +08:00
PowderLi
cdd1305f26
enhance: find collection schema from cache (#28916) 
issue: #28781 #28329
master pr: #28782

1. There is no need to call `DescribeCollection`, if the collection's
schema is found in the globalMetaCache
2. did `GetProperties` to check the access to Azure Blob Service

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-12-06 22:44:33 +08:00
jaime
275e3ea456
fix: Fix missing target db name for RenameCollection (#28911) 
issue: #28908
pr: #28909

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-12-03 08:28:31 +08:00
PowderLi
96c8e8d587
fix: azure ListObjects (#27931) (#28894) 
issue: #27932
master pr: #27931

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-12-01 18:34:31 +08:00
aoiasd
9bf33eb576
fix: [Cherry-Pick] accesslog method status not return failed when error in response (#28827) 
relate: https://github.com/milvus-io/milvus/issues/28086
pr: https://github.com/milvus-io/milvus/pull/28824

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-01 15:30:38 +08:00
aoiasd
880189e598
enhance: Delete by complex expression use partitionKey optimization (#27952) (#28128) 
relate: https://github.com/milvus-io/milvus/issues/27948
pr: https://github.com/milvus-io/milvus/pull/27952

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-11-30 17:56:31 +08:00
aoiasd
224f2755c5
enhance: [Cherry-pick]Refine accesslog to support format by yaml and support more metric (#28740) 
relate: https://github.com/milvus-io/milvus/issues/28086
pr: https://github.com/milvus-io/milvus/issues/28086

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-11-28 15:34:28 +08:00
jaime
9378f78218
enhance: Add logs for each step during service initialization (#28687) 
/kind improvement
pr: #28624

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-11-27 17:54:26 +08:00
yah01
55fda49104
enhance: validate JSON data while inserting (#28602) (#28725) 
some SDKs doesn't check the JSON data validation,
add this in server.

pr: #28602

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-11-27 16:16:26 +08:00
yah01
c4be1ddf44
enhance: improve the error messages and logs (#28684) (#28726) 
- better name for log fields
- make the error and log consistent

pr: #28684

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-11-27 15:40:26 +08:00
yihao.dai
8520ee7552
enhance: Print nq (#28507) (#28639) 
Log nq in search path.

pr: https://github.com/milvus-io/milvus/pull/28507

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-11-27 10:18:26 +08:00
yah01
5ca7851f4a
enhance: refine error messages (#28424) (#28614) 
- Split the simple reason and full detail
- Refine existing error messages related: #28422
related: https://github.com/milvus-io/milvus/issues/28422
pr: #28424

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-11-24 10:04:24 +08:00
yah01
6820124366
enhance: remove legacy error related code (#28385) (#28415) 
/kind improvement
pr: #28385

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-11-15 17:24:21 +08:00
SimFG
cb8e10b48b
[2.3]: Hide the password info when failing to authorize (#28437) 
/kind improvement
pr: #28428

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-11-15 14:40:26 +08:00
aoiasd
2d4659fe4a
Add write cache for access log (#27792) (#28142) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-11-13 15:08:18 +08:00
wei liu
26bd83f345
remove retry in getShards (#28011) (#28091) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-11-03 09:48:16 +08:00
yihao.dai
0fbfa5a9b0
Fix unstable search task ut (#28101) (#28120) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-11-03 00:34:15 +08:00
yihao.dai
0f3e83a764
Construct plan directly when search with vector output (#27963) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-10-27 10:32:13 +08:00
aoiasd
53246b1b38
Set accesslog default to close and use stdout (#27891) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-10-25 10:30:10 +08:00
aoiasd
9ba79a97e4
Add some log for delete task when it need query (#27317) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-10-24 14:54:12 +08:00
SimFG
9b0ecbdca7
Support to replicate the mq message (#27240) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-20 14:26:09 +08:00
congqixia
49516d44b4
Add ctx parameter and log tracer for watch and selectNodes (#27809) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-10-20 04:22:11 +08:00
zhenshan.cao
020ad9a6bc
Rectify wrong exception messages associated with Array datatype (#27769) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-10-19 17:24:07 +08:00
congqixia
bcbe98aba1
Add querynode client wrapper and avoid grpc in standalone mode (#27781) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-10-19 11:10:07 +08:00
yah01
9467de79c3
Use pool to block exceeded tasks (#27767) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-19 03:30:06 +08:00
SimFG
630636c4ec
Support the apikey authentication for the restful api (#27758) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-18 16:36:12 +08:00
Enwei Jiao
e98e56f75d
Fix SIGSEGV if run within gdb (#27736) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-10-18 02:16:11 +08:00
SimFG
84d05b939b
Support the apikey authentication (#27723) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-17 21:00:11 +08:00
congqixia
2f201c25e2
Remove deprecated io/ioutil usage (#27747) 
`io/ioutil` package is deprecated, use `io`,`os` package replacement
also added golangci-lint rule to block future reference

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-10-17 20:32:09 +08:00
PowderLi
09d8b76048
[restful] new context with grpc metadata (#27668) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-10-17 20:00:14 +08:00
Futao Wei
599012a340
Implement SearchByPks path for Search (#25882) 
Signed-off-by: unfode <forrest.futao.wei@gmail.com>
 2023-10-16 15:34:08 +08:00
smellthemoon
5785756d31
Add some log to print size of search result (#27601) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-10-16 10:48:08 +08:00
jaime
ec1fe3549e
Add a stop hook to clean session (#27564) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-16 10:24:10 +08:00
xige-16
6cbb67832f
Compatible with scalar index types marisa-trie and Ascending (#27638) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-10-15 13:52:06 +08:00
wei liu
310739d115
remove flush from ddl queue in proxy (#27688) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-10-13 18:33:36 +08:00
yah01
be980fbc38
Refine state check (#27541) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-11 21:01:35 +08:00