21920 Commits

Author SHA1 Message Date
sthuang
a6396ddda5
enhance: storage v2 clang format version 12 (#40287)
change storage v2 clang-format version from 14 to 12 to match with
Milvus.
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-04 21:52:40 +08:00
congqixia
c02763d49a
fix: [GoSDK] Pass only valid data for nullable column (#40328)
Related to #40327

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-04 20:58:04 +08:00
yanliang567
7d35d023a3
test: Remove the old get index params method (#40319)
related issue: https://github.com/milvus-io/milvus/issues/40156
remove the old get index params method and update the new one

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-03-04 17:12:06 +08:00
Zhen Ye
9ca5088f62
fix: duplicate consuming from stream for invisble segment (#40316)
issue: #40207

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-04 15:54:00 +08:00
sthuang
d77756cf2d
fix: fix storage v2 cgo mem leak (#40305)
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-04 14:16:00 +08:00
XuanYang-cn
837ac295fa
enhance: Remove iterators in datanode (#40301)
Iterators are long deprecated, but sort are still using it. This PR
unifies stats task with the latest compaction common functions and
remove the usage of iterators.

1. Rename `datanode/compaction` to `datanode/compactor`
2. Add `internal/compaction` and move some compaction commons into it.
3. Replace `DeltalogIterators` with `ComposeDeleteFromDeltalogs`
4. Remove `datanode/iterators`

See also: #39242

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-03-04 12:14:00 +08:00
Bingyi Sun
7040ba1c12
enhance: make json path index support term filter (#40140)
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-04 11:56:02 +08:00
congqixia
f2ea4d6370
fix: Add duplication param check for create index (#40254)
Related to #40156

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-04 11:42:02 +08:00
zhuwenxing
45256c41d6
test: fix text match (#40295)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-03 21:26:00 +08:00
congqixia
16d468c875
fix: [GoSDK] Return role without grants (#40284)
Related to #40274

Previousy DescribeRole returns only roles with grants, this PR add
select role action to check role existence.

Also added database properties related option

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-03 18:05:59 +08:00
Chun Han
16aa123185
fix: restful drop db properties failure(#39953) (#40257)
related: #39953

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-03 15:39:59 +08:00
Zhen Ye
f47ab31f23
enhance: remove redundant resource key watch operation, just keep consistency of wal (#40235)
issue: #38399
related PR: #39522

- Just implement exclusive broadcaster between broadcast message with
same resource key to keep same order in different wal.
- After simplify the broadcast model, original watch-based broadcast is
too complicated and redundant, remove it.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-03 14:40:05 +08:00
nico
679a145e8b
test: update drop collection in teardown method (#40271)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-03 10:36:00 +08:00
sthuang
de02a3ebcc
feat: Storage v2 binlog packed record reader and writer (#40221)
related: #39173

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-03 10:24:02 +08:00
Zhen Ye
8eb662b4dc
enhance: add more metrics for async cgo component (#40136)
issue: #40014

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-03 09:56:03 +08:00
sre-ci-robot
6a57a1973f
[automated] Update Knowhere Commit (#40283)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-03 01:11:58 +08:00
cai.zhang
5a810400b5
enhance: Optimize Task Scheduling to Enable Concurrent Execution (#40251)
issue: #39101 

2.5 pr: #40104

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-02 18:38:00 +08:00
zhagnlu
7a17fb68ec
enhance: add monitor metric for retrieve raw data (#40141)
#40078

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-02 18:30:01 +08:00
Zhen Ye
944f018375
enhance: [skip e2e] only use mixcoord for scripts (#40273)
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-02 18:05:58 +08:00
zhagnlu
8c19e5c4a7
enhance: decrease delete record dump snapshot limit (#40101)
#40100

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-02 17:55:59 +08:00
yihao.dai
c368113233
fix: Fix task delta cache data race (#40259)
issue: https://github.com/milvus-io/milvus/issues/40258

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-02 16:52:09 +08:00
Zhen Ye
2ff657f2d9
fix: wal may panics when context canceled (#40265)
issue: #40264

- wal may panics when context canceled
- scanner may data race when closing

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-28 17:41:58 +08:00
nico
9a8d94998a
test: update cases for error message (#39960)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-28 17:36:02 +08:00
congqixia
0c74e409df
fix: [GoSDK] Pass base64 passwd content instead of raw data (#40268)
Related to #40261

Also add some options for create collection options and refine some
behavior

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-28 16:59:58 +08:00
Zhen Ye
bc8e02df44
enhance: always enable streaming service (#40253)
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-28 15:38:01 +08:00
Linkwei
0a4e7b5116
enhance: [skip e2e] Add configuration file detection functionality to the standalone_embed script. (#40246)
enhance: Add configuration file detection functionality to the
standalone_embed script.
issue:https://github.com/milvus-io/milvus/issues/40066

Signed-off-by: Linkwei <link.xie@zilliz.com>
2025-02-28 11:13:57 +08:00
cai.zhang
dc46b08bdf
fix: Fix bug where prefix matching fails when wildcards are in prefix (#40020)
issue: #40019

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-28 10:29:59 +08:00
cai.zhang
762a644d76
enhance: Limit the speed of the generating stats task (#39644)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-28 10:27:59 +08:00
wei liu
b0806bb900
fix: task delta cache leak due to duplicate task id (#40183)
issue: #40052

task delta cache rely on the taskID is unique, so it incDeltaCache at
AddTask, and decDeltaCache at RemoveTask, but the taskID allocator is
not atomic, which cause two task with same taskID, in such case, it will
call incDeltaCache twice, but call decDeltaCacheOnce, which cause delta
cache leak.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-28 10:22:08 +08:00
cai.zhang
13aff35a83
enhance: Add metrics for parse expression (#39654)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-28 10:07:58 +08:00
sre-ci-robot
dc43136295 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2025-02-28 00:01:26 +00:00
Micka
5cc104b412
fix: Change CMake variable for switch to knowhere-cuvs (#40105)
issue: https://github.com/milvus-io/milvus/issues/39883

Signed-off-by: Mickael Ide <mide@nvidia.com>
2025-02-27 22:05:58 +08:00
Chun Han
259f9106ad
enhance: refine variable-length-type memory usage(#38736) (#39578)
related: #38736

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-27 21:13:58 +08:00
wei liu
94f55df7fb
enhance: clean shard location cache after collection released (#40088)
issue: #40077

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-27 19:42:05 +08:00
cai.zhang
fc31308c5c
fix: Skip text index creation when segment is zero after sorting (#39962)
issue: #39961

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-27 17:55:58 +08:00
cai.zhang
a74580c1ca
fix: Set task version for stats task (#40035)
issue: #40034

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-27 17:49:59 +08:00
cai.zhang
eb04686348
enhance: Add metrics for proxy queue (#40070)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-27 17:30:01 +08:00
yihao.dai
a148a78629
fix: Fix collections with duplicate names can be created (#40143)
This PR introduces two restrictions:
1. Before dropping a collection, all aliases associated with that
collection must be dropped.
2. When creating a collection, if the collection name duplicates any
alias, the collection creation will fail.

issue: https://github.com/milvus-io/milvus/issues/40142

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-27 17:27:57 +08:00
aoiasd
d67d6b7567
fix: main dispatcher not terminate cause messsage stream leak. (#40061)
Main dispatcher will leak when we remove solo dispatcher in the end. 
https://github.com/milvus-io/milvus/issues/40046

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-02-27 16:15:58 +08:00
SimFG
3b7b7e7e99
fix: use the different msg type for the OperatePrivilegeV2 api (#40192)
- issue: #40178

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-27 14:43:59 +08:00
congqixia
35f188b329
enhance: Unify milvus version def (#40227)
Related to #40216

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-27 14:15:57 +08:00
zhikunyao
a0763b3c02
enhance: bump etcd version to 3.5.18 (#40231)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-02-27 11:53:58 +08:00
sre-ci-robot
c2b77bd24f
[automated] Bump milvus version to v2.5.5 (#40225)
Bump milvus version to v2.5.5
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-27 10:56:06 +08:00
sre-ci-robot
b2769fb357
[automated] Update Knowhere Commit (#40223)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-27 01:35:59 +08:00
wei liu
69b8b89369
enhance: Remove QueryCoord's scheduling of L0 segments (#39552)
issue: #39551
This PR remove querycoord's scheduling of l0 segments:
  - only load l0 segment when watch channel
- only release l0 segment when release channel or sync data distribution

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-26 21:38:00 +08:00
nico
75b74e9413
enhance: [skip e2e] change nightly running time (#40219)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-26 19:18:08 +08:00
ThreadDao
5f71bb2a41
test: Split gosdk cases into different packages and add rg cases (#39694)
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-02-26 16:27:59 +08:00
Spade A
476cf61d98
fix: random sample consider empty input (#40201)
issue: #40198

Fix random sample does not consider empty input, that is no data is hit
by filter expression.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-02-26 16:15:58 +08:00
yihao.dai
8f077089ba
enhance: Accelerate listing objects during binlog import (#40047)
issue: https://github.com/milvus-io/milvus/issues/40030

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-26 15:55:57 +08:00
zhuwenxing
8fd39779f7
test: add restful v2 api testcases (#39558)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-26 14:03:57 +08:00