Zhen Ye
2ff657f2d9
fix: wal may panics when context canceled ( #40265 )
...
issue: #40264
- wal may panics when context canceled
- scanner may data race when closing
Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-28 17:41:58 +08:00
Zhen Ye
bc8e02df44
enhance: always enable streaming service ( #40253 )
...
issue: #38399
Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-28 15:38:01 +08:00
cai.zhang
dc46b08bdf
fix: Fix bug where prefix matching fails when wildcards are in prefix ( #40020 )
...
issue: #40019
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-28 10:29:59 +08:00
cai.zhang
762a644d76
enhance: Limit the speed of the generating stats task ( #39644 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-28 10:27:59 +08:00
wei liu
b0806bb900
fix: task delta cache leak due to duplicate task id ( #40183 )
...
issue: #40052
task delta cache rely on the taskID is unique, so it incDeltaCache at
AddTask, and decDeltaCache at RemoveTask, but the taskID allocator is
not atomic, which cause two task with same taskID, in such case, it will
call incDeltaCache twice, but call decDeltaCacheOnce, which cause delta
cache leak.
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-28 10:22:08 +08:00
cai.zhang
13aff35a83
enhance: Add metrics for parse expression ( #39654 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-28 10:07:58 +08:00
Micka
5cc104b412
fix: Change CMake variable for switch to knowhere-cuvs ( #40105 )
...
issue: https://github.com/milvus-io/milvus/issues/39883
Signed-off-by: Mickael Ide <mide@nvidia.com>
2025-02-27 22:05:58 +08:00
Chun Han
259f9106ad
enhance: refine variable-length-type memory usage( #38736 ) ( #39578 )
...
related: #38736
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-27 21:13:58 +08:00
wei liu
94f55df7fb
enhance: clean shard location cache after collection released ( #40088 )
...
issue: #40077
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-27 19:42:05 +08:00
cai.zhang
fc31308c5c
fix: Skip text index creation when segment is zero after sorting ( #39962 )
...
issue: #39961
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-27 17:55:58 +08:00
cai.zhang
a74580c1ca
fix: Set task version for stats task ( #40035 )
...
issue: #40034
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-27 17:49:59 +08:00
cai.zhang
eb04686348
enhance: Add metrics for proxy queue ( #40070 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-27 17:30:01 +08:00
yihao.dai
a148a78629
fix: Fix collections with duplicate names can be created ( #40143 )
...
This PR introduces two restrictions:
1. Before dropping a collection, all aliases associated with that
collection must be dropped.
2. When creating a collection, if the collection name duplicates any
alias, the collection creation will fail.
issue: https://github.com/milvus-io/milvus/issues/40142
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-27 17:27:57 +08:00
SimFG
3b7b7e7e99
fix: use the different msg type for the OperatePrivilegeV2 api ( #40192 )
...
- issue: #40178
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-27 14:43:59 +08:00
sre-ci-robot
b2769fb357
[automated] Update Knowhere Commit ( #40223 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-27 01:35:59 +08:00
wei liu
69b8b89369
enhance: Remove QueryCoord's scheduling of L0 segments ( #39552 )
...
issue: #39551
This PR remove querycoord's scheduling of l0 segments:
- only load l0 segment when watch channel
- only release l0 segment when release channel or sync data distribution
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-26 21:38:00 +08:00
Spade A
476cf61d98
fix: random sample consider empty input ( #40201 )
...
issue: #40198
Fix random sample does not consider empty input, that is no data is hit
by filter expression.
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-02-26 16:15:58 +08:00
yihao.dai
8f077089ba
enhance: Accelerate listing objects during binlog import ( #40047 )
...
issue: https://github.com/milvus-io/milvus/issues/40030
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-26 15:55:57 +08:00
Chun Han
190ac11cd1
fix: cancel sub contexts casade when http request timeout( #40030 ) ( #40059 )
...
related: #40030
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-26 11:33:57 +08:00
junjiejiangjjj
162d241063
feat: Add siliconflow text embedding ( #39867 )
...
https://github.com/milvus-io/milvus/issues/35856
Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
2025-02-26 11:01:56 +08:00
Bingyi Sun
f05e9628f6
fix: Fix search failure of null expression ( #40129 )
...
issue: #40095
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-25 20:43:55 +08:00
congqixia
e0b028ade5
enhance: Integrate holmes as pprof dumper ( #40151 )
...
Related to #40150
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-25 19:01:55 +08:00
XuanYang-cn
315cfb7f32
fix: Negative -1 executing compaction tasks ( #39954 )
...
See also: #39675
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-02-25 18:07:55 +08:00
Zhen Ye
84df80b5e4
enhance: refactor metrics of streaming ( #40031 )
...
issue: #38399
- add metrics for broadcaster component.
- add metrics for wal flusher component.
- add metrics for wal interceptors.
- add slow log for wal.
- add more label for some wal metrics. (local or remote/catcup or
tailing...)
Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-25 12:25:56 +08:00
sthuang
90acc8a58f
enhance: upgrade go arrow version from 12.0.1 to 17.0.0 ( #39916 )
...
related: https://github.com/milvus-io/milvus/issues/39915
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-02-25 10:30:02 +08:00
Bingyi Sun
db4769281c
fix: Fall back to a brute-force search if json index type unmatched ( #40076 )
...
issue: https://github.com/milvus-io/milvus/issues/35528
If the query data type does not match the index type, fall back to a
brute-force search
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-24 16:25:57 +08:00
aoiasd
38f1608910
enhance: pack analyzer code and support lindera tokenizer ( #39660 )
...
relate: https://github.com/milvus-io/milvus/issues/39659
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-02-24 12:13:55 +08:00
congqixia
dd68814c15
enhance: Remove hardcoded partition num in restful handler ( #40112 )
...
The partition num shall be determined by core logic if user did not
specifiy the partition num in request.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-23 15:33:54 +08:00
cai.zhang
9f5b488f9a
enhance: Export request timeout interval in config ( #40119 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-23 15:15:54 +08:00
congqixia
cb7f2fa6fd
enhance: Use v2 package name for pkg module ( #39990 )
...
Related to #39095
https://go.dev/doc/modules/version-numbers
Update pkg version according to golang dep version convention
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 23:15:58 +08:00
congqixia
a774f05ea7
fix: Add sub task pool for multi-stage tasks ( #40079 )
...
Related to #40078
Add a subTaskPool to execute sub task in case of logic deadlock
described in issue.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 16:37:54 +08:00
congqixia
e1b5b37195
enhance: Avoid stringtoslicebytes copy for BatchPKExists ( #40096 )
...
Using unsafe.Slice to convert string to []byte by directly using
underlying data could avoid lots of copy and cpu time
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 15:23:52 +08:00
Ted Xu
8562a102ec
enhance: API integration with storage v2 in mix-compactions ( #40008 )
...
See #39173
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-02-22 14:23:54 +08:00
SimFG
ad36347fb3
fix: add BeginTimestamp and EndTimestamp to insert and upsert messages ( #40110 )
...
- issue: #40109
- caused by: #38656
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-22 12:29:53 +08:00
smellthemoon
8b974c5742
enhance: support compact if lack of binlog ( #40000 )
...
https://github.com/milvus-io/milvus/issues/39718
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-02-22 10:51:56 +08:00
sre-ci-robot
dd1347d041
[automated] Update Knowhere Commit ( #40103 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-22 01:01:53 +08:00
sthuang
3eb3af5f08
feat: explicitly specify column groups for storage v2 api ( #39790 )
...
* use the new packed reader and writer api to be compatible with current
etcd meta
* For the new packed writer API: column groups and paths are explicitly
defined by users and won't split column groups by memory in storage v2.
Packed writer follows the user-defined column groups to split arrow
record and write into the corresponding file path.
* For the new packed reader API: read paths are explicitly defined by
users.
related: #39173
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-02-21 22:03:54 +08:00
yihao.dai
2a037a97f1
enhance: Add get vector latency metric and refine request limit error message ( #40083 )
...
issue: https://github.com/milvus-io/milvus/issues/40078
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-21 19:41:55 +08:00
Chun Han
d6699b5f50
enhance: support return configable properties when describing index( #39951 ) ( #40042 )
...
related: #39951
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-21 19:07:53 +08:00
XuanYang-cn
fb969cf636
fix: A segment may never transfer from sealed to flushing ( #39993 )
...
See also: #39717
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-02-21 16:51:54 +08:00
wei liu
7d2c948c69
fix: task delta cache leak on reduce task ( #40055 )
...
issue: #40052
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-21 16:47:54 +08:00
Spade A
d34d70582d
fix: fix misleading name *_add_multi_* ( #39997 )
...
fix : #39995
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-02-21 16:45:55 +08:00
wei liu
07578041ba
fix: querycoord panic in cornor case ( #40057 )
...
issue: #40050
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-21 11:19:58 +08:00
SimFG
b562f8e644
fix: add filter to exclude L0 import jobs in compaction trigger ( #40045 )
...
- issue: #39849
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-21 10:45:53 +08:00
sre-ci-robot
f0d3d98c3f
[automated] Update Knowhere Commit ( #40063 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-21 01:19:54 +08:00
Chun Han
1dc31619f8
enhance: support create collection with description( #40022 ) ( #40023 )
...
related: #40022
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-20 22:31:53 +08:00
SimFG
aba39ff98f
fix: enhance isBalanced function to correctly count quote pairs ( #40001 )
...
- issue: #39999
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-19 20:19:00 +08:00
Zhen Ye
fd701eca71
fix: local wal perform different with remote wal ( #39967 )
...
issue: #38399
Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-19 19:12:51 +08:00
sthuang
f47320e0e7
enhance: clean up legacy storage v2 ( #39987 )
...
related: https://github.com/milvus-io/milvus/issues/39173
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-02-19 15:42:52 +08:00
congqixia
5d83deb3f8
fix: Use start pos ts instead for sealSegmentByLifetime policy ( #39982 )
...
Related to #39981
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-19 15:41:06 +08:00
