jaime
651afe5058
enhance: Aligning Etcd and MinIO versions in Docker Compose ( #40857 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2025-03-31 18:08:21 +08:00
Bingyi Sun
27ff3a42e7
enhance: Record simdjson error ( #41003 )
...
issue: #35528
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-31 17:56:19 +08:00
wei liu
c02892e9fb
enhance: Balance the collection with the largest row count first ( #40297 )
...
issue: #37651
this PR enable to balance the collection with largest row count first,
to avoid temporary migration of small table data to new nodes during
their onboarding, only to be moved out again after the large table
balance, which would cause unnecessary load.
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-03-31 16:00:19 +08:00
Bingyi Sun
15ec7bae4d
fix: Fix using json index when iterative_filter is specified ( #40945 )
...
issue: #40934
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-31 15:26:19 +08:00
groot
aae3a3598e
enhance: bulkinsert supports parsing sparse vector form parquet struct ( #40927 )
...
issue: https://github.com/milvus-io/milvus/issues/40777
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-03-31 14:20:30 +08:00
yihao.dai
d8d1dcf076
fix: Fix dispatcher deregister and seek ( #40860 )
...
1. Fix deregister dispatcher concurrency. (Keep sure the same logic as
2.5 branch)
2. Fix seek if includeCurrentMsg. (This is only needed by CDC, so
there's no need to pick to 2.5 branch)
issue: issue: https://github.com/milvus-io/milvus/issues/39862
pr: https://github.com/milvus-io/milvus/pull/39863
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-31 11:38:19 +08:00
Xiaofan
3ecacc4493
Update README.md
2025-03-29 08:50:47 +08:00
Eli Boyarski
43cd9fa0f4
doc: README.md: has->have ( #40152 )
...
doc: "The vectors ... has" -> "The vectors ... have"
Signed-off-by: Eli Boyarski <eli@boyar.ski>
2025-03-29 02:12:21 +08:00
aoiasd
1cc88d7755
enhance: add utf8 check for all varchar field ( #40670 )
...
https://github.com/milvus-io/milvus/issues/40684
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-28 19:38:17 +08:00
Zhen Ye
528ce1a0fb
fix: getopts cannot find the non-args ulcgbZh ( #40984 )
...
issue: #39659
also see: #40813
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-28 15:47:29 +08:00
Buqian Zheng
7a056aff9d
enhance: avoid re-query if hybrid search requested only pk as output field ( #40842 )
...
proxy to always remove pk field from output field when forwarding
request to QN, and if user requested pk, fill it from IDs.
issue: https://github.com/milvus-io/milvus/issues/40833
---------
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-28 14:32:18 +08:00
Bingyi Sun
9676365af9
fix: Fix json index not equal filter ( #40647 )
...
issue: #35528
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-27 23:06:23 +08:00
congqixia
2e9e16d732
fix: [GoSDK] Set nullable according to fieldSchema for RowBased insert ( #40928 )
...
Related to #40737
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-27 17:50:20 +08:00
aoiasd
384d39ef5a
enhance: not build lindera features by default and support make milvus with tantivy features ( #40813 )
...
relate: https://github.com/milvus-io/milvus/issues/39659
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-27 14:08:22 +08:00
wei liu
06310a5994
fix: Fix L0 segment retention and improve delete buffer logging ( #40884 )
...
issue：#40207
related to https://github.com/milvus-io/milvus/pull/39552
- Correct comparison operator in UnRegister from > to >= to prevent
premature release of L0 segments with matching timestamps
- Add detailed logging for segment retention decisions during
unregistration
- Enhance error logging for buffer cleanup operations
- Add trace logs for segment registration/release lifecycle
- Include timestamp comparisons in debug logs for future troubleshooting
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-03-27 11:24:21 +08:00
zhagnlu
87e7d6d79f
fix:fix exception when do arith expr with using index ( #40794 )
...
#40783
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-27 11:10:21 +08:00
dependabot[bot]
b1e092673b
enhance: bump github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 ( #40923 )
...
Bumps [github.com/golang-jwt/jwt/v5](https://github.com/golang-jwt/jwt )
from 5.2.1 to 5.2.2.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/golang-jwt/jwt/releases ">github.com/golang-jwt/jwt/v5's
releases</a>.</em></p>
<blockquote>
<h2>v5.2.2</h2>
<h2>What's Changed</h2>
<ul>
<li>Fixed <a
href="https://github.com/golang-jwt/jwt/security/advisories/GHSA-mh63-6h87-95cp ">https://github.com/golang-jwt/jwt/security/advisories/GHSA-mh63-6h87-95cp </a>
by <a
href="https://github.com/mfridman "><code>@mfridman</code></a></li>
<li>Fixed some typos by <a
href="https://github.com/Ashikpaul "><code>@Ashikpaul</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/382 ">golang-jwt/jwt#382</a></li>
<li>build: add go1.22 to ci workflows by <a
href="https://github.com/mfridman "><code>@mfridman</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/383 ">golang-jwt/jwt#383</a></li>
<li>Bump golangci/golangci-lint-action from 4 to 5 by <a
href="https://github.com/dependabot "><code>@dependabot</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/387 ">golang-jwt/jwt#387</a></li>
<li>Bump golangci/golangci-lint-action from 5 to 6 by <a
href="https://github.com/dependabot "><code>@dependabot</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/389 ">golang-jwt/jwt#389</a></li>
<li>chore: bump ci tests to include go1.23 by <a
href="https://github.com/mfridman "><code>@mfridman</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/405 ">golang-jwt/jwt#405</a></li>
<li>Fix jwt -show by <a
href="https://github.com/AlexanderYastrebov "><code>@AlexanderYastrebov</code></a>
in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/406 ">golang-jwt/jwt#406</a></li>
<li>docs: typo by <a
href="https://github.com/kvii "><code>@kvii</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/407 ">golang-jwt/jwt#407</a></li>
<li>Update SECURITY.md by <a
href="https://github.com/oxisto "><code>@oxisto</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/416 ">golang-jwt/jwt#416</a></li>
<li>Update <code>jwt.Parse</code> example to use
<code>jwt.WithValidMethods</code> by <a
href="https://github.com/mattt "><code>@mattt</code></a> in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/425 ">golang-jwt/jwt#425</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/Ashikpaul "><code>@Ashikpaul</code></a>
made their first contribution in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/382 ">golang-jwt/jwt#382</a></li>
<li><a href="https://github.com/kvii "><code>@kvii</code></a> made their
first contribution in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/407 ">golang-jwt/jwt#407</a></li>
<li><a href="https://github.com/mattt "><code>@mattt</code></a> made
their first contribution in <a
href="https://redirect.github.com/golang-jwt/jwt/pull/425 ">golang-jwt/jwt#425</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a
href="https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 ">https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 </a></p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="0951d18428c035977d9ehttps://redirect.github.com/golang-jwt/jwt/issues/425 ">#425</a>)</li>
<li><a
href="bc8bdca5cchttps://redirect.github.com/golang-jwt/jwt/issues/416 ">#416</a>)</li>
<li><a
href="5ec246c074https://redirect.github.com/golang-jwt/jwt/issues/407 ">#407</a>)</li>
<li><a
href="0123f1ad66https://redirect.github.com/golang-jwt/jwt/issues/406 ">#406</a>)</li>
<li><a
href="f961c72abdhttps://redirect.github.com/golang-jwt/jwt/issues/405 ">#405</a>)</li>
<li><a
href="62e504c281https://redirect.github.com/golang-jwt/jwt/issues/389 ">#389</a>)</li>
<li><a
href="1a56dcf532https://redirect.github.com/golang-jwt/jwt/issues/387 ">#387</a>)</li>
<li><a
href="c8043eab61https://redirect.github.com/golang-jwt/jwt/issues/383 ">#383</a>)</li>
<li><a
href="7c3f6dc563https://redirect.github.com/golang-jwt/jwt/issues/382 ">#382</a>)</li>
<li>See full diff in <a
href="https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 ">compare
view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores )
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/milvus-io/milvus/network/alerts ).
</details>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-27 00:56:21 +08:00
Ted Xu
128efaa3e3
enhance: simplify size calculation in file writers ( #40808 )
...
See: #40342
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-26 20:04:22 +08:00
cai.zhang
e2e1493580
fix: exists should have a higher priority ( #40864 )
...
issue: #40837
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-26 20:02:34 +08:00
cai.zhang
4220e3355d
fix: Update milvus key words ( #40869 )
...
issue: #40290
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-26 19:44:32 +08:00
Gao
0a1c5f4460
enhance: make segment prune config refreshable ( #40539 )
...
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-03-26 18:50:25 +08:00
Zhen Ye
af80a4dac2
fix: auto flush all segment that is not created by streaming service ( #40767 )
...
issue: #40532
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-26 16:32:22 +08:00
Zhen Ye
0e83a08ffe
enhance: enable cipher for streaming message ( #40659 )
...
issue: #40321
- add cipher plugin for streaming message package.
- add more unittest for streaming message.
- remove redundant code for streaming message.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-26 16:30:20 +08:00
zhuwenxing
0d2d2c9064
test: add phrase match test in go client ( #39782 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 15:32:21 +08:00
Xiaofan
8788e591cd
enhance: add detailed stack for error message ( #40883 )
...
fix #40882
adding stacktrace will operator execute failed.
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-03-26 13:24:20 +08:00
Gao
e7050a9cef
fix: correct WithGroupSize while reducing ( #40888 )
...
issue: https://github.com/milvus-io/milvus/issues/40887
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-03-26 12:00:19 +08:00
zhuwenxing
33628c7fe5
test: update text empty percent in go client fts test ( #40009 )
...
/kind improvement
As a regression test case for the issue
https://github.com/milvus-io/milvus/issues/39583
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 11:34:22 +08:00
nico
8e5bae2f2d
test: update sdk version and test cases ( #40859 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-26 10:50:28 +08:00
zhuwenxing
a090b2ca14
test: remove xfail of test_alter_database_properties ( #40913 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-26 10:46:31 +08:00
congqixia
84e8e141ea
enhance: Support detailed manual compaction criterion ( #40892 )
...
Related to #40866
This PR:
- update go-api/v2 and support partition id/channel/segment level manual
compaction
- refines the compaction trigger implementation
- unify the compaction signal usage
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-25 20:06:22 +08:00
yihao.dai
f65e6b7c6e
enhance: Optimize datacoord meta mutex ( #40552 )
...
Use a separate collection mutex.
issue: https://github.com/milvus-io/milvus/issues/40551
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-25 13:46:25 +08:00
zhagnlu
7fdb2e144f
enhance:change multi or expr to in expr ( #40757 )
...
#40752
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-03-25 11:06:18 +08:00
wt
5203c857b1
test: test mix scenes support batch insertion ( #40872 )
...
issues: https://github.com/milvus-io/milvus/issues/40868
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2025-03-25 10:52:29 +08:00
zhuwenxing
7aee6f822e
test: using pytest_tagging to replace pytest_tags ( #40878 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-03-25 10:48:19 +08:00
Chun Han
eee68e9139
fix: mmap properties failed to apply when creating collection( #40511 ) ( #40512 )
...
related: #40511
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-25 10:08:19 +08:00
junjiejiangjjj
fe81c7baae
feat: Add function config ( #40534 )
...
#35856
1. Add function-related configuration in milvus.yaml
2. Add null and empty value check to TextEmbeddingFunction
Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
2025-03-25 10:06:24 +08:00
SimFG
16efcda5c4
feat: support to deny dll according to database property ( #40764 )
...
- issue: #40762
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-23 11:18:28 +08:00
congqixia
1953676ee0
fix: Set task queue time before enqueue ( #40815 )
...
Related to #40814
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-21 19:36:15 +08:00
Ted Xu
688505ab1c
enhance: cleanup lint check exclusions ( #40829 )
...
See: #40828
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-21 18:12:14 +08:00
jaime
901308df1e
fix:etcd advertise-client-urls in docker-compose ( #40804 )
...
issue #40696
Signed-off-by: jaime <yun.zhang@zilliz.com>
2025-03-21 15:52:12 +08:00
Bingyi Sun
ecea17c576
enhance: Set field name as json path if not specified ( #40419 )
...
issue: #35528
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-21 11:26:13 +08:00
cai.zhang
a41cb942f6
fix: Do not delete the centroids file when sampling fails instead wait GC ( #40701 )
...
issue: #40700
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-21 10:32:12 +08:00
congqixia
9824615efb
enhance: Close component in topological order when unsub channel ( #40796 )
...
Related to #40795
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-21 10:22:11 +08:00
sthuang
d7df78a6c9
feat: Storage v2 compaction ( #40667 )
...
- Feat: Support Mix compaction. Covering tests include compatibility and
rollback ability.
- Read v1 segments and compact with v2 format.
- Read both v1 and v2 segments and compact with v2 format.
- Read v2 segments and compact with v2 format.
- Compact with duplicate primary key test.
- Compact with bm25 segments.
- Compact with merge sort segments.
- Compact with no expiration segments.
- Compact with lack binlog segments.
- Compact with nullable field segments.
- Feat: Support Clustering compaction. Covering tests include
compatibility and rollback ability.
- Read v1 segments and compact with v2 format.
- Read both v1 and v2 segments and compact with v2 format.
- Read v2 segments and compact with v2 format.
- Compact bm25 segments with v2 format.
- Compact with memory limit.
- Enhance: Use serdeMap serialize in BuildRecord function to support all
Milvus data types.
related: #39173
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-03-21 10:16:12 +08:00
yihao.dai
8eb537fdd0
fix: Fix messages loss during seek ( #40735 )
...
issue: https://github.com/milvus-io/milvus/issues/40733
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-20 20:18:11 +08:00
congqixia
77515310b9
enhance: Resolve existing lint issues ( #40797 )
...
This PR
- Format import issues in datacoord & datanode
- Fix JSONPathIndex naming issue
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 19:36:11 +08:00
congqixia
e23f429299
fix: Check whether index type support mmap even param enabled ( #40614 )
...
Related to #40537
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 15:52:13 +08:00
Zhen Ye
4dc7c11bbe
fix: remove dead code at broadcaster ( #40788 )
...
issue: #38399
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-20 14:20:59 +08:00
congqixia
fd45e8bf93
enhance: [GoSDK] Support JSON Path index ( #40754 )
...
Related to #35528
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-20 14:18:13 +08:00
ThreadDao
24745b37b1
test: fix case code checker ( #40787 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-03-20 14:14:20 +08:00
