zhagnlu
87e7d6d79f
fix:fix exception when do arith expr with using index ( #40794 )
...
#40783
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-27 11:10:21 +08:00
dependabot[bot]
b1e092673b
enhance: bump github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 ( #40923 )
...
Bumps [github.com/golang-jwt/jwt/v5](https://github.com/golang-jwt/jwt )
from 5.2.1 to 5.2.2.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/golang-jwt/jwt/releases ">github.com/golang-jwt/jwt/v5's
releases</a>.</em></p>
<blockquote>
<h2>v5.2.2</h2>
<h2>What's Changed</h2>
<ul>
<li>Fixed <a
href="https://github.com/golang-jwt/jwt/security/advisories/GHSA-mh63-6h87-95cp ">https://github.com/golang-jwt/jwt/security/advisories/GHSA-mh63-6h87-95cp </a>
by <a
href="https://github.com/mfridman "><code>@mfridman</code></a></li>
<li>Fixed some typos by <a
href="https://github.com/Ashikpaul "><code>@Ashikpaul</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/382 ">golang-jwt/jwt#382</a></li>
<li>build: add go1.22 to ci workflows by <a
href="https://github.com/mfridman "><code>@mfridman</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/383 ">golang-jwt/jwt#383</a></li>
<li>Bump golangci/golangci-lint-action from 4 to 5 by <a
href="https://github.com/dependabot "><code>@dependabot</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/387 ">golang-jwt/jwt#387</a></li>
<li>Bump golangci/golangci-lint-action from 5 to 6 by <a
href="https://github.com/dependabot "><code>@dependabot</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/389 ">golang-jwt/jwt#389</a></li>
<li>chore: bump ci tests to include go1.23 by <a
href="https://github.com/mfridman "><code>@mfridman</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/405 ">golang-jwt/jwt#405</a></li>
<li>Fix jwt -show by <a
href="https://github.com/AlexanderYastrebov "><code>@AlexanderYastrebov</code></a>
in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/406 ">golang-jwt/jwt#406</a></li>
<li>docs: typo by <a
href="https://github.com/kvii "><code>@kvii</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/407 ">golang-jwt/jwt#407</a></li>
<li>Update SECURITY.md by <a
href="https://github.com/oxisto "><code>@oxisto</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/416 ">golang-jwt/jwt#416</a></li>
<li>Update <code>jwt.Parse</code> example to use
<code>jwt.WithValidMethods</code> by <a
href="https://github.com/mattt "><code>@mattt</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/425 ">golang-jwt/jwt#425</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/Ashikpaul "><code>@Ashikpaul</code></a>
made their first contribution in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/382 ">golang-jwt/jwt#382</a></li>
<li><a href="https://github.com/kvii "><code>@kvii</code></a> made their
first contribution in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/407 ">golang-jwt/jwt#407</a></li>
<li><a href="https://github.com/mattt "><code>@mattt</code></a> made
their first contribution in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/425 ">golang-jwt/jwt#425</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a
href="https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 ">https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 </a></p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="0951d18428c035977d9ehttps://redirect.github.com/golang-jwt/jwt/issues/425 ">#425</a>)</li>
<li><a
href="bc8bdca5cchttps://redirect.github.com/golang-jwt/jwt/issues/416 ">#416</a>)</li>
<li><a
href="5ec246c074https://redirect.github.com/golang-jwt/jwt/issues/407 ">#407</a>)</li>
<li><a
href="0123f1ad66https://redirect.github.com/golang-jwt/jwt/issues/406 ">#406</a>)</li>
<li><a
href="f961c72abdhttps://redirect.github.com/golang-jwt/jwt/issues/405 ">#405</a>)</li>
<li><a
href="62e504c281https://redirect.github.com/golang-jwt/jwt/issues/389 ">#389</a>)</li>
<li><a
href="1a56dcf532https://redirect.github.com/golang-jwt/jwt/issues/387 ">#387</a>)</li>
<li><a
href="c8043eab61https://redirect.github.com/golang-jwt/jwt/issues/383 ">#383</a>)</li>
<li><a
href="7c3f6dc563https://redirect.github.com/golang-jwt/jwt/issues/382 ">#382</a>)</li>
<li>See full diff in <a
href="https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 ">compare
view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores )
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/milvus-io/milvus/network/alerts ).
</details>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-27 00:56:21 +08:00
Ted Xu
128efaa3e3
enhance: simplify size calculation in file writers ( #40808 )
...
See: #40342
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-26 20:04:22 +08:00
cai.zhang
e2e1493580
fix: exists should have a higher priority ( #40864 )
...
issue: #40837
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-26 20:02:34 +08:00
cai.zhang
4220e3355d
fix: Update milvus key words ( #40869 )
...
issue: #40290
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-26 19:44:32 +08:00
Gao
0a1c5f4460
enhance: make segment prune config refreshable ( #40539 )
...
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-03-26 18:50:25 +08:00
Zhen Ye
af80a4dac2
fix: auto flush all segment that is not created by streaming service ( #40767 )
...
issue: #40532
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-26 16:32:22 +08:00
Zhen Ye
0e83a08ffe
enhance: enable cipher for streaming message ( #40659 )
...
issue: #40321
- add cipher plugin for streaming message package.
- add more unittest for streaming message.
- remove redundant code for streaming message.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-26 16:30:20 +08:00
zhuwenxing
0d2d2c9064
test: add phrase match test in go client ( #39782 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 15:32:21 +08:00
Xiaofan
8788e591cd
enhance: add detailed stack for error message ( #40883 )
...
fix #40882
adding stacktrace will operator execute failed.
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-03-26 13:24:20 +08:00
Gao
e7050a9cef
fix: correct WithGroupSize while reducing ( #40888 )
...
issue: https://github.com/milvus-io/milvus/issues/40887
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-03-26 12:00:19 +08:00
zhuwenxing
33628c7fe5
test: update text empty percent in go client fts test ( #40009 )
...
/kind improvement
As a regression test case for the issue
https://github.com/milvus-io/milvus/issues/39583
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 11:34:22 +08:00
nico
8e5bae2f2d
test: update sdk version and test cases ( #40859 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-26 10:50:28 +08:00
zhuwenxing
a090b2ca14
test: remove xfail of test_alter_database_properties ( #40913 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 10:46:31 +08:00
congqixia
84e8e141ea
enhance: Support detailed manual compaction criterion ( #40892 )
...
Related to #40866
This PR:
- update go-api/v2 and support partition id/channel/segment level manual
compaction
- refines the compaction trigger implementation
- unify the compaction signal usage
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-25 20:06:22 +08:00
yihao.dai
f65e6b7c6e
enhance: Optimize datacoord meta mutex ( #40552 )
...
Use a separate collection mutex.
issue: https://github.com/milvus-io/milvus/issues/40551
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-25 13:46:25 +08:00
zhagnlu
7fdb2e144f
enhance:change multi or expr to in expr ( #40757 )
...
#40752
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-25 11:06:18 +08:00
wt
5203c857b1
test: test mix scenes support batch insertion ( #40872 )
...
issues: https://github.com/milvus-io/milvus/issues/40868
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2025-03-25 10:52:29 +08:00
zhuwenxing
7aee6f822e
test: using pytest_tagging to replace pytest_tags ( #40878 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-25 10:48:19 +08:00
Chun Han
eee68e9139
fix: mmap properties failed to apply when creating collection( #40511 ) ( #40512 )
...
related: #40511
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-25 10:08:19 +08:00
junjiejiangjjj
fe81c7baae
feat: Add function config ( #40534 )
...
#35856
1. Add function-related configuration in milvus.yaml
2. Add null and empty value check to TextEmbeddingFunction
Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
2025-03-25 10:06:24 +08:00
SimFG
16efcda5c4
feat: support to deny dll according to database property ( #40764 )
...
- issue: #40762
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-23 11:18:28 +08:00
congqixia
1953676ee0
fix: Set task queue time before enqueue ( #40815 )
...
Related to #40814
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-21 19:36:15 +08:00
Ted Xu
688505ab1c
enhance: cleanup lint check exclusions ( #40829 )
...
See: #40828
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-21 18:12:14 +08:00
jaime
901308df1e
fix:etcd advertise-client-urls in docker-compose ( #40804 )
...
issue #40696
Signed-off-by: jaime <yun.zhang@zilliz.com>
2025-03-21 15:52:12 +08:00
Bingyi Sun
ecea17c576
enhance: Set field name as json path if not specified ( #40419 )
...
issue: #35528
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-21 11:26:13 +08:00
cai.zhang
a41cb942f6
fix: Do not delete the centroids file when sampling fails instead wait GC ( #40701 )
...
issue: #40700
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-21 10:32:12 +08:00
congqixia
9824615efb
enhance: Close component in topological order when unsub channel ( #40796 )
...
Related to #40795
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-21 10:22:11 +08:00
sthuang
d7df78a6c9
feat: Storage v2 compaction ( #40667 )
...
- Feat: Support Mix compaction. Covering tests include compatibility and
rollback ability.
- Read v1 segments and compact with v2 format.
- Read both v1 and v2 segments and compact with v2 format.
- Read v2 segments and compact with v2 format.
- Compact with duplicate primary key test.
- Compact with bm25 segments.
- Compact with merge sort segments.
- Compact with no expiration segments.
- Compact with lack binlog segments.
- Compact with nullable field segments.
- Feat: Support Clustering compaction. Covering tests include
compatibility and rollback ability.
- Read v1 segments and compact with v2 format.
- Read both v1 and v2 segments and compact with v2 format.
- Read v2 segments and compact with v2 format.
- Compact bm25 segments with v2 format.
- Compact with memory limit.
- Enhance: Use serdeMap serialize in BuildRecord function to support all
Milvus data types.
related: #39173
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-21 10:16:12 +08:00
yihao.dai
8eb537fdd0
fix: Fix messages loss during seek ( #40735 )
...
issue: https://github.com/milvus-io/milvus/issues/40733
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-20 20:18:11 +08:00
congqixia
77515310b9
enhance: Resolve existing lint issues ( #40797 )
...
This PR
- Format import issues in datacoord & datanode
- Fix JSONPathIndex naming issue
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 19:36:11 +08:00
congqixia
e23f429299
fix: Check whether index type support mmap even param enabled ( #40614 )
...
Related to #40537
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 15:52:13 +08:00
Zhen Ye
4dc7c11bbe
fix: remove dead code at broadcaster ( #40788 )
...
issue: #38399
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-20 14:20:59 +08:00
congqixia
fd45e8bf93
enhance: [GoSDK] Support JSON Path index ( #40754 )
...
Related to #35528
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 14:18:13 +08:00
ThreadDao
24745b37b1
test: fix case code checker ( #40787 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-03-20 14:14:20 +08:00
zhuwenxing
6889b0470e
test: add text embedding function test ( #40668 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-20 11:44:12 +08:00
congqixia
096f58f314
enhance: Add an extra parameter for slow log ( #40758 )
...
Related to #40756
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 00:34:13 +08:00
ThreadDao
47f23e5a55
test: add more json expr cases ( #40775 )
...
issue: https://github.com/milvus-io/milvus/issues/33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-03-19 19:58:11 +08:00
sre-ci-robot
6ecbf88503
[automated] Bump milvus version to v2.5.7 ( #40768 )
...
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-19 18:02:18 +08:00
sre-ci-robot
5c8d13632e
[automated] Bump milvus version to v2.5.7 ( #40766 )
...
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-19 18:00:24 +08:00
Bingyi Sun
5a6b4e56d5
fix: Fix tasks will panic if one of them throw an exception. ( #40691 )
...
issue: https://github.com/milvus-io/milvus/issues/40690
the variable rcm will be dangling if a future throws an exception and
return.
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-19 16:52:09 +08:00
aoiasd
92bdf7a0c1
enhance: support run anayser return detaild token ( #40458 )
...
relate: https://github.com/milvus-io/milvus/issues/39705
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-19 15:48:15 +08:00
zhagnlu
6c55db44f1
enhance: reorder sub expr for conjunct expr ( #39872 )
...
two point:
(1) reoder conjucts expr's subexpr, postpone heavy operations
sequence: int(column) -> index(column) -> string(column) -> light
conjuct
...... -> json(column) -> heavy conjuct -> two_column_compare
(2) support pre filter for expr execute, skip scan raw data that had
been skipped
because of preceding expr result.
#39869
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-19 14:50:14 +08:00
Zhen Ye
8db708f67d
enhance: enable memory prof based on jemalloc ( #40731 )
...
issue: #40730
also see: https://github.com/milvus-io/cgosymbolizer/pull/2
After these PR, at linux:
- the milvus will always enable jemalloc by default.
- jemalloc will always compiled with --enable-prof options.
- all image will always enable the jemalloc prof by default.
- a pprof http service for jemalloc at `/debug/jemalloc/` will be
registered into restful.
- `jeprof` can remote profile the memory of milvus.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-19 14:46:18 +08:00
yanliang567
cf223bae7b
test: Split test_search and refactor on test class to share collections ( #40677 )
...
issue: #40698
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-03-19 14:20:15 +08:00
Zhen Ye
b119ac5d30
enhance: add wal access mode options ( #40617 )
...
issue: #40532
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-19 14:02:11 +08:00
Buqian Zheng
03b63bf982
fix: use NewInsertDataWithFunctionOutputField when importing binlog file ( #40741 )
...
issue: https://github.com/milvus-io/milvus/issues/40740
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-19 10:50:14 +08:00
aoiasd
e5c12421f7
enhance: remain raw token for audit log ( #40637 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-18 18:02:20 +08:00
Buqian Zheng
c12abf4e2a
enhance: improve sparse query nnz metric ( #40713 )
...
add query type and field id label; add metric for hybrid search
issue: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-18 17:20:16 +08:00
congqixia
4ca1a7a76d
fix: Protect getSegmentIndexes with rlock ( #40719 )
...
Related to #40718
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-18 16:40:14 +08:00
