chyezh
77477d6340
fix: wrong context passing into NewClient, error handling lost in session_util ( #30817 )
...
issue: #30799
Signed-off-by: chyezh <chyezh@outlook.com>
2024-02-28 10:40:09 +08:00
zhagnlu
a0531b72aa
fix: reorder hybridsearch result for L2 metric ( #30739 )
...
#30694
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-02-26 14:18:55 +08:00
Xiaofan
d970a9fc6c
enhance: refine error log of json parse error ( #30671 )
...
add more error info when json format does not match.
relate to https://github.com/milvus-io/milvus/issues/29837
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2024-02-24 12:32:14 +08:00
zhagnlu
c5363c70db
fix: fix upsert using wrong field to compute partition key ( #30772 )
...
#30607
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-02-23 09:54:53 +08:00
aoiasd
e5353ad049
enhance: access log should get get client info by get method ( #30502 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-22 14:58:52 +08:00
MrPresent-Han
77eb6defb1
feat: support groupby on growing and non-indexed sealed egment( #30307 ) ( #30644 )
...
related: #30308
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2024-02-21 14:02:53 +08:00
smellthemoon
81d6cb1a0c
enhance: The error information is not clear ( #30658 )
...
issue:#30516
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-02-21 10:16:53 +08:00
cai.zhang
40ca98f57f
enhance: Skip timestamp allocation when search/query consistency level is eventually ( #29773 )
...
issue: #29772
1. Skip timestamp allocation when search/query consistency level is
eventually.
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-02-21 09:52:59 +08:00
aoiasd
c863b82476
enhance: Return parse expression failed error with reason ( #30548 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-20 16:02:52 +08:00
aoiasd
bbff9193d9
enhance: support clean paramtable config event in test ( #30534 )
...
relate: https://github.com/milvus-io/milvus/issues/30441
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-20 14:16:51 +08:00
chyezh
941dc755df
feat: add collection level flush rate control ( #29567 )
...
flush rate control at collection level to avoid generate too much
segment.
0.1 qps by default.
issue: #29477
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2024-02-18 15:32:50 +08:00
zhenshan.cao
bb93b22c84
fix: should return collectionName in response of ListAliases ( #30532 )
...
issue : https://github.com/milvus-io/milvus/issues/30369
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-02-12 08:30:55 +08:00
aoiasd
23aa136444
enhance: access log method support get status when method only return error instead of status ( #30409 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-04 16:35:05 +08:00
XuanYang-cn
6959630652
fix: donot set l0 segment as growing when savebinlogs ( #29194 )
...
This PR fixes negative growing L0 segments in Metrics
See also: #29204 , #30441
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-02-04 10:21:06 +08:00
xige-16
05ebe7b6ae
fix: fix hybrid search panic when has multi shard ( #30464 )
...
/kind bug
issue:#30457
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-02-02 17:25:12 +08:00
SimFG
02de84239d
fix: add more requests to the database interceptor ( #30452 )
...
issue: #30368
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-02-02 16:49:06 +08:00
xige-16
0a78b38bb8
fix: fix requery without partitionIDs in hybrid search ( #30444 )
...
issue: #30412
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-02-02 16:47:13 +08:00
Bingyi Sun
dcdf85977c
enhance: [skip e2e] add alter collection task ut ( #30447 )
...
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-02-02 15:25:04 +08:00
congqixia
1c1dd48b71
fix: Deprecated shard leader cache while deprecating collection ( #30446 )
...
Resolves : #30445
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-02-02 09:11:05 +08:00
Bingyi Sun
e22e8b30d4
enhance: check load state before altering collection ( #30399 )
...
/kind improvement
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-02-01 18:03:04 +08:00
xige-16
060c8603a3
fix: Support mvcc with hybrid serach ( #30114 )
...
issue: https://github.com/milvus-io/milvus/issues/29656
/kind bug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
---------
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-02-01 16:03:03 +08:00
cai.zhang
f619d792c0
enhance: Break down the granularity of collection info cache expired ( #29977 )
...
issue: #29772
1. `DropPartition` only invalidates the cache related to the partition.
2. `CreateAlias` does not invalidate the cache.
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-30 16:45:02 +08:00
PowderLi
6abbab12fa
feat: restful phase two ( #29728 )
...
issue: #29732
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-01-28 16:03:01 +08:00
PowderLi
8fc4ebfa11
fix: empty MetricType ( #30216 )
...
issue: #30102 #30225
we should read MetricType from SearchResult,
because query node never
1. read metricType from LoadMeta
2. store to collection
3. set SearchRequest.MetricType
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-01-28 15:33:02 +08:00
cai.zhang
d87726e4c7
enhance: Don't expire ShardLeaders cache actively ( #29879 )
...
issue: #29772
The shardLeaders cache does not actively expire, update the cache when
search/query fails.
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-26 14:13:01 +08:00
congqixia
8e8ac213aa
enhance: Utilize partition key optimization in reQuery ( #30253 )
...
See also #30250
This PR add requery flag in query task. When reQuery flag is true, query
task shall skip partition name conversion and use pre-calculated
partitionIDs passed from search task.
TODO: hybrid search does not have partition id information. we shall
apply same logic for hybrid search later.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-25 11:05:07 +08:00
xige-16
4f25066aa7
fix: Fix requery without limit during HybridSearch ( #30220 )
...
issue: #29990
/kind bug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-01-25 11:03:00 +08:00
aoiasd
38746dfc2b
fix: Remove useless lock which cause porxy meta cache recursive lock ( #30203 )
...
relate: https://github.com/milvus-io/milvus/issues/30193
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-23 23:56:55 +08:00
SimFG
463765922e
enhance: support related privilege for grant api ( #30153 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-01-23 15:56:54 +08:00
aoiasd
4142743128
enhance: fix access log can't print SDK version when client connect ( #29680 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-22 17:22:54 +08:00
aoiasd
a81d2b4780
enhance: refine proxy metacache for concurrent safe ( #29872 )
...
relate: https://github.com/milvus-io/milvus/issues/29675
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-22 14:28:55 +08:00
yihao.dai
c8a78465b4
enhance: Add a counter monitoring for the rate-limit requests ( #30109 )
...
Add a counter monitoring metric for the ratelimited rpc requests with
labels: proxy nodeID, rpc request type, and state.
issue: https://github.com/milvus-io/milvus/issues/30052
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-01-21 14:44:59 +08:00
aoiasd
4ef6217fc0
enhance: add pool for scheduler dmQueue task ( #30103 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-19 14:20:54 +08:00
SimFG
ddccccbcab
enhance: add the bytes data type for merge data and format some code ( #30105 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-01-18 22:18:55 +08:00
wei liu
fc56ed5c27
fix: Proxy restful api doesn't register ( #30072 )
...
issue: #30074
This PR fix that management restful api in proxy doesn't register to
http service
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-18 20:28:52 +08:00
PowderLi
631ebb1f07
fix: CollectionSchema.autoID is deprecated ( #30002 )
...
issue: #30000
related to: [milvus-proto
#202 ](https://github.com/milvus-io/milvus-proto/pull/202 )
1. replace collSchema.AutoID with primaryField.AutoID
2. show `enableDynamic` & `enableDynamicField` at the same time
3. avoid data race about the access to metacache
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-01-18 16:16:52 +08:00
xige-16
91aa81b4d7
fix: Add more checks to rank params ( #29950 )
...
issue: #29840 #29867
/kind bug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-01-17 20:28:58 +08:00
aoiasd
04e21564b6
enhance: delete should inc ProxyFunctionCall metric failed label when run failed instead abandon ( #29621 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-17 19:16:55 +08:00
congqixia
80465a01b5
enhance: change some important request log level to Info ( #30062 )
...
Some important request log level shall be at least Info level
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-17 17:48:53 +08:00
yah01
1c8ce33eea
fix: report error if the altering index doesn't support mmap ( #29832 )
...
this also checks the param value
fix #29909
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2024-01-17 16:40:54 +08:00
XuanYang-cn
7f059b1025
fix: record apply pk latency metric to ms ( #29987 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-01-17 10:11:03 +08:00
wei liu
fb4fbcf48c
fix: Dynamic update rate limit config with wrong value ( #29901 )
...
when apply dynamic config changes, we should format the value to proper
unit
This PR fix update rate limit config with wrong value.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-15 09:52:51 +08:00
cai.zhang
8c89ad694e
fix: Fix error message for indexing ( #29898 )
...
issue: #29897
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-12 19:44:51 +08:00
wayblink
1df3f90696
feat: Implement DescribeAlias and ListAliases interfaces ( #29641 )
...
#22882
/kind feature
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-01-11 19:12:51 +08:00
wei liu
797847904c
enhance: Change some frequency log to rated level ( #29720 )
...
This PR change some frequency log to rated level
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-11 16:30:50 +08:00
Xu Tong
e429965f32
Add float16 approve for multi-type part ( #28427 )
...
issue：https://github.com/milvus-io/milvus/issues/22837
Add bfloat16 vector, add the index part of float16 vector.
Signed-off-by: Writer-X <1256866856@qq.com>
2024-01-11 15:48:51 +08:00
aoiasd
73cfdab776
fix: Release collection delete proxy collection meta ( #29854 )
...
pr: https://github.com/milvus-io/milvus/issues/29675
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-10 21:54:49 +08:00
congqixia
8a6e1a4b27
enhance: pre-allocate result FieldData space to reduce copy & growslice ( #29726 )
...
See also: #29113
Add a new utitliy function in `pkg/util/typetuil` to pre-allocate field
data slice capacity acoording to search limit. This shall avoid copying
the data during `AppendFieldData` when previous slice is out of space.
And shall also save CPU time during high paylog.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-09 15:48:55 +08:00
yah01
f030f31d92
enhance: make the error of parsing expression to ParameterInvalid ( #29681 )
...
before this, the error is unexpected error
Signed-off-by: yah01 <yang.cen@zilliz.com>
2024-01-09 15:36:47 +08:00
zhenshan.cao
60e88fb833
fix: Restore the MVCC functionality. ( #29749 )
...
When the TimeTravel functionality was previously removed, it
inadvertently affected the MVCC functionality within the system. This PR
aims to reintroduce the internal MVCC functionality as follows:
1. Add MvccTimestamp to the requests of Search/Query and the results of
Search internally.
2. When the delegator receives a Query/Search request and there is no
MVCC timestamp set in the request, set the delegator's current tsafe as
the MVCC timestamp of the request. If the request already has an MVCC
timestamp, do not modify it.
3. When the Proxy handles Search and triggers the second phase ReQuery,
divide the ReQuery into different shards and pass the MVCC timestamp to
the corresponding Query requests.
issue: #29656
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-01-09 11:38:48 +08:00
