admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
23,237 Commits 137 Branches 188 Tags
Commit Graph

23237 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
congqixia
faaf215913
enhance: Bump go version & builder image tag (#44757) 
Bump go version to 1.24.6 fixing CVE-2025-47907

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-11 13:49:57 +08:00
cai.zhang
d8beafd6d0
fix: Skip running scalar index when segment was compacted (#44690) 
issue: #44689

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-10-11 12:05:56 +08:00
cai.zhang
7a93cfe890
fix: Fix bug for nullable geometry (#44732) 
issue: #44648

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-10-11 11:27:57 +08:00
congqixia
5ece760d73
fix: Pass fs via FileManagerContext when loading index (#44733) 
Related to #44615

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-11 09:55:57 +08:00
congqixia
78b266a44f
enhance: Bump builder image go version to v1.24.6 (#44739) 
Bump go version fixing CVE issues

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-11 09:53:57 +08:00
Xiaofan
af9bf80726
Update README.md 2025-10-11 09:46:12 +08:00
wei liu
33d1e7de83
fix: Replace incorrect log import with milvus v2 log package (#44731) 
issue: #44730
Fix the issue where logs were not outputting as expected due to
incorrect log package imports across multiple components.

Changes include:
- Add golangci-lint rule to forbid github.com/pingcap/log usage
- Replace github.com/pingcap/log with
github.com/milvus-io/milvus/pkg/v2/log

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-10-10 20:27:57 +08:00
sparknack
7e750190b6
enhance: add a size getter for tantivy inverted index (#44609) 
issue: #41435

---------

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
 2025-10-10 17:43:57 +08:00
Spade A
208481a070
feat: impl StructArray -- support same names in different STRUCT (#44557) 
ref: https://github.com/milvus-io/milvus/issues/42148

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-10-10 15:53:56 +08:00
nico
e5378a64bc
test: update test cases (#44651) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-10-10 11:35:56 +08:00
sre-ci-robot
80c6212c43
[automated] Bump milvus version to v2.6.3 (#44716) 
Bump milvus version to v2.6.3
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-10-10 10:45:56 +08:00
groot
81f0d498be
enhance: Support JSONL/NDJSON files for bulkinsert (#44602) 
issue: https://github.com/milvus-io/milvus/issues/44567

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2025-10-10 10:43:57 +08:00
zhenshan.cao
4279f166c6
enhance: Add refine logs for task scheduler in QueryCoord (#44577) 
issue: https://github.com/milvus-io/milvus/issues/43968

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2025-10-10 10:07:55 +08:00
congqixia
e83c7e0c92
fix: Use eventually & fix task id appear in both executing&completed (#44698) 
Related to #44620

This PR:
- Use eventually instead of `time.Sleep` in accesslog writer unit test
- Make sure compaction task results have only one state from executor
API

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-10 10:05:56 +08:00
sre-ci-robot
221e27fc02
[automated] Bump milvus version to v2.6.3 (#44655) 
Bump milvus version to v2.6.3
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-10-10 09:06:04 +08:00
Goodnight
dd9e26cad0
doc: fix typos in README (#44674) 
This PR fixes several documentation issues in README.md

Correct typo "accelaration" → "acceleration".
Minor grammar and wording cleanups for clarity.
Capitalize language and product names: "python" → "Python", "Go", and
"Youtube" → "YouTube".

No functional code changes, documentation-only.

Signed-off-by: Mohamed Arbi Nsibi <mohammedarbinsibi@gmail.com>
 2025-10-09 21:19:58 +08:00
congqixia
efbe6669ec
enhance: Make accesslog.$consistency_level represent actual value used (#44706) 
Related to #44703

This PR:
- Add `SetActualConsistencyLevel` to `info.AccessInfo` interface and
related util method processing it
- Make `$consistency_level` returning actual value if set

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-09 21:03:58 +08:00
Zhen Ye
97c987f313
fix: remove wrong start timetick to avoid filtering DML whose timetick is less than it. (#44691) 
issue: #41611

- introduced by #44532

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-10-09 20:39:58 +08:00
congqixia
e55e63288e
enhance: [GoSDK] bump pkg dep to v2.6.3 (#44619) 
See also #31293 

Bump pkg dependency version to v2.6.2

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-09 19:43:57 +08:00
yihao.dai
4ae44f1aa9
fix: Fix CDC OOM due to high buffer size (#44607) 
Fix CDC OOM by:
1. free msg buffer manually.
2. limit max msg buffer size.
3. reduce scanner msg hander buffer size.

issue: https://github.com/milvus-io/milvus/issues/44123

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-10-09 19:31:58 +08:00
liliu-z
174e1e4071
enhance: Upgrade Knohwere Version to fix GPU Compilation issue (#44704) 
Signed-off-by: Li Liu <li.liu@zilliz.com>
 2025-10-09 19:17:57 +08:00
congqixia
8a443c699e
fix: Make aws credential provider singleton (#44687) 
Related to #44647

This patch make milvus-storage using singleton credential provider in
case of data race when concurrent index build task recieved.

See also milvus-io/milvus-storage#44647

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-09 16:11:58 +08:00
Bingyi Sun
c25166a202
fix: Fix bulk import with autoid (#44604) 
issue: #44424

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-10-09 12:09:56 +08:00
Zhen Ye
30091a3bb7
enhance: remove redundant channel manager from datacoord (#44532) 
issue: #41611

- After enabling streaming arch, channel manager of data coord is a
redundant component.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-10-09 11:01:57 +08:00
congqixia
1d85b83215
enhance: [backlog] Fix unittest and remove fs fallback logic (#44615) 
Related to #44535

This PR:
- Fix the unittest creating `DiskFileManagerImpl` without `filesystem`
- Add comments for methods need `fs_`
- Remove fallback creation and add assertion for nullptr fs

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-10-09 10:41:57 +08:00
PjJinchen
d8efe8a6fb
feat: support ali qwen rerank (#44363) (#44364) 
issue: #44363

---------

Signed-off-by: PjJinchen <6268414+pj1987111@users.noreply.github.com>
 2025-09-30 23:19:52 +08:00
congqixia
d76d92d33f
enhance: Use relative path in proto following convention (#44650) 
Previous pr #44163

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-09-30 18:43:52 +08:00
congqixia
1185fbec0a
enhance: Bump milvus & proto version to v2.6.3 (#44633) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
pkg/v2.6.3 v2.6.3 		2025-09-30 17:33:49 +08:00
Xiaofan
7c00f292bc
enhance: add config for meta batch(#44569) (#44645) 
fix: https://github.com/milvus-io/milvus/issues/44569
add a new config to control meta batch to avoid too large

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2025-09-30 17:31:02 +08:00
yanliang567
c9f01a73cc
test:Skip unstable test (#44649) 
related issue: #44620

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-09-30 16:47:52 +08:00
Agnes George
aea0418713
fix: resolve CVE-2020-25576, WS-2023-0223 (#44163) 
fix: issue https://github.com/milvus-io/milvus/issues/44160

WS-2023-0223 reported for
[atty-0.2.14.crate](https://ibmets.whitesourcesoftware.com/Wss/WSS.html#!libraryDetails;uuid=9c622063-376a-446b-bece-d7f6fd096758;project=7300448;orgToken=79623fcf-07fe-42b8-90bf-513fafeb41be)
CVE-2020-25576 reported for
[rand_core-0.3.1.crate](https://ibmets.whitesourcesoftware.com/Wss/WSS.html#!libraryDetails;uuid=20e2ad1b-c84c-4f18-98a9-4f27643b29ff;project=7300448;orgToken=79623fcf-07fe-42b8-90bf-513fafeb41be)

[atty-0.2.14.crate](https://ibmets.whitesourcesoftware.com/Wss/WSS.html#!libraryDetails;uuid=9c622063-376a-446b-bece-d7f6fd096758;project=7300448;orgToken=79623fcf-07fe-42b8-90bf-513fafeb41be)
is a transitive dependency coming from the root libraries
'cbindgen-0.26.0.crate' and 'criterion-0.4.0.crate'

[rand_core-0.3.1.crate](https://ibmets.whitesourcesoftware.com/Wss/WSS.html#!libraryDetails;uuid=20e2ad1b-c84c-4f18-98a9-4f27643b29ff;project=7300448;orgToken=79623fcf-07fe-42b8-90bf-513fafeb41be)
is also a transitive dependency coming from 'rand-0.3.23.crate' library
Path to dependency file:
/workspace/app/milvus/internal/core/thirdparty/tantivy/tantivy-binding/Cargo.toml
For Remediation, since these vulnerabilities are transitive one, the
root libraries should be updated to the latest non-vulnerable version

---------

Co-authored-by: Agnes-George1 <agnes.george1@ibm.com>
Co-authored-by: Abita Ann Augustine <abitaaugustine@gmail.com>
Co-authored-by: gifi-siby <gifi.s@ibm.com>
 2025-09-30 16:25:53 +08:00
congqixia
bd6eb43617
fix: [GoSDK] Handle row->column input dynamic column (#44626) 
Related to #44161

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-09-30 16:23:52 +08:00
Gao
d3dfb90587
enhance: move tracer test to milvus-common (#44605) 
#43931

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2025-09-30 15:07:06 +08:00
congqixia
31670c5489
enhance: Use dbName in error message (#44618) 
The collection not found err could contains db id in err message, which
is not meaningful to users.

This patch make error message wrapping dbname instead of db id.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-09-30 12:25:05 +08:00
zhagnlu
4c49295c3d
Revert "enhance: enable default json stats (#44559)" (#44644) 
This reverts commit 1b5191974c71eee342e4f7a8c804e1d95cfd094b.
 #44132

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-09-30 12:11:53 +08:00
congqixia
079cd97c0a
fix: [skip e2e] Wait eventch in TestUpdateSessions (#44640) 
Related to #44620

Make unittest stable by waiting eventch instead of async read
len(eventCh), which is unstable

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-09-30 09:53:05 +08:00
Gao
3cc59a0d69
enhance: add storage usage for delete/upsert/restful (#44512) 
#44212 

Also, record metrics only when storageUsageTracking is enabled.
Use MB for scanned_remote counter and scanned_total counter metrics to
avoid overflow.

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2025-09-30 00:31:06 +08:00
sparknack
c8eae818e0
fix: milvus-common update (#44637) 
issue: #41435

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
 2025-09-29 22:37:45 +08:00
cai.zhang
9d1bb8497c
fix: Get R-Tree index correct for growing segment (#44612) 
issue： #43427 

R-Tree index is the entire segment, not the chunk.

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-09-29 21:34:54 +08:00
Zhen Ye
a110d8cc49
fix: don't use logical resource for metrics of quota center on streaming node (#44613) 
issue: #44599

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-09-29 21:34:13 +08:00
congqixia
e6640594fd
fix: Set mixcoord in activateFunc when enabled standby (#44621) 
Related to #44620

Fix unstable "internal/coordinator TestMixcoord_EnableActiveStandby"

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-09-29 21:30:59 +08:00
cai.zhang
aecb46a08b
fix: Skip empty loop for process growing segment (#44606) 
issue: #43427 

The GISFunction asserts that the segment_offsets cannot be nullptr. When
size is 0, the segment_offsets is nullptr, so the loop is skiped.

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-09-29 21:15:05 +08:00
yanliang567
7438b00108
test:Fix a space issue for config update (#44630) 
related issue: https://github.com/milvus-io/milvus/issues/44623

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-09-29 20:51:06 +08:00
yanliang567
424075d26f
test: Update querynode.segcore.exprEvalBatchSize to 512 to cover multiple batches in segcore (#44624) 
related issue: #44623

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-09-29 18:01:05 +08:00
aoiasd
78ee76f018
enhance: support preload sealed segment bm25 stats and optimize bm25 stats serialize (#44279) 
relate: https://github.com/milvus-io/milvus/issues/41424

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-09-29 16:35:05 +08:00
zhikunyao
ca1cc7c9f3
test: mergify support ci-v2/code-check (#44603) 
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
 2025-09-29 11:53:04 +08:00
XuanYang-cn
e9aa270713
test: Increase PyMilvus version to 2.7.0rc38 for master branch (#44579) 
Automated daily bump from pymilvus master branch. Updates
tests/python_client/requirements.txt.

Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2025-09-29 11:15:06 +08:00
aoiasd
294282f1d2
enhance: support use nullable field as bm25 function input field (#44586) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-09-29 10:25:05 +08:00
Zhen Ye
b6b59bd222
fix: remove redundant initialization of storage v2 (#44597) 
issue: #44596

- querynode already init the storage v2 and segcore, so streamingnode
should not do this again.
- It also fix the gcp object storage access denied.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-09-29 10:17:04 +08:00
tinswzy
f342f49b32
enhance: add support for Azure Blob Storage in wp (#44592) 
#44485 
add support for blob in woodpecker

#43638 
upgrade wp v0.1.6

related wp [issue#11](https://github.com/zilliztech/woodpecker/issues/11
)

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
 2025-09-29 09:51:44 +08:00