22313 Commits

Author SHA1 Message Date
congqixia
d251e102b6
enhance: [2.5] Add param item for hybrid search requery policy (#44467)
Cherry-pick from master
pr: #44466
related to #39757

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-24 17:52:07 +08:00
XuanYang-cn
cdcad7b1c7
test: Increase PyMilvus version to 2.5.17rc1 for 2.5 branch (#44552)
Automated daily bump from pymilvus 2.5 branch. Updates
tests/python_client/requirements.txt.

Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-09-24 17:16:10 +08:00
congqixia
aadb99c716
fix: [2.5] Cleanup collection metrics after dropped on rootcoord (#44511) (#44525)
Cherry-pick from master
pr: #44511
Related to #44509

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-24 09:56:06 +08:00
Bingyi Sun
c5a7845531
enhance: optimize the performance of binary_search_string (#44470)
pr: #44469

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-23 14:28:05 +08:00
Bingyi Sun
8b0bfe4cd8
feat: encode cluster id in auto id (#44471) (#44500)
pr: #44471 
https://github.com/milvus-io/milvus/issues/44326
prev:
[physical_ts][logical_ts]
after
[sign_bit][cluster_id][physical_ts][logical_ts]

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-22 20:30:10 +08:00
aoiasd
d19d65fb46
fix: [2.5] idf oracle use wrong local path (#44328)
relate: https://github.com/milvus-io/milvus/issues/44264
pr: https://github.com/milvus-io/milvus/pull/44266

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-22 15:44:18 +08:00
XuanYang-cn
83e162bf66
test: Increase PyMilvus version to 2.5.16 for 2.5 branch (#44493)
Automated daily bump from pymilvus 2.5 branch. Updates
tests/python_client/requirements.txt.

Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-09-22 11:24:08 +08:00
congqixia
1b0bf82b22
enhance: Bump milvus & proto version to v2.5.18 (#44468)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
v2.5.18 pkg/v2.5.18
2025-09-19 17:20:02 +08:00
cai.zhang
fa54cdadac
fix: Fix inserting geometry data bug by restful (#44479)
issue: #43427

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-19 17:18:02 +08:00
cai.zhang
5b8288a0ef
enhance: Refine geometry cache with offsets (#44432)
issue: #43427

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-18 20:24:02 +08:00
zhikunyao
94b1d66535
enhance: base images use https to install apt package 2.5 (#44420)
pr: #44382

Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-09-18 10:58:01 +08:00
cai.zhang
124a1b3ce4
fix: Fix geometry bugs and add cache for create Geometry (#44376)
issue: #44102, #44079, #44075

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-17 15:24:03 +08:00
presburger
d44bdcd76c
enhance: compaction task metric bug (#44280)
issue: #44281

Signed-off-by: yusheng.ma <yushengma@bytedance.com>
Co-authored-by: yusheng.ma <yushengma@bytedance.com>
2025-09-17 10:06:01 +08:00
cai.zhang
7ef76058d5
enhance: Support gis filter operator st_dwithin (#44392)
issue: #43427

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-16 22:44:03 +08:00
sre-ci-robot
570ae44f6a
enhance: 2.5 update builder env rust (#44368)
pr: #44366

---------

Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
Co-authored-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-09-16 13:34:01 +08:00
cai.zhang
a2bb36a6dc
enhance: [2.5] Remove timeout for compaction task (#44278)
issue: #44272 
master pr: #44277

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-15 21:24:01 +08:00
yihao.dai
9e96cab7c0
fix: [2.5] Fix invalid pre-allocated segment IDs (#44351)
Mark the task as failed when PreAllocatedSegmentIDs is nil.

issue: https://github.com/milvus-io/milvus/issues/44349

pr: https://github.com/milvus-io/milvus/pull/44350

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-09-15 20:32:00 +08:00
sre-ci-robot
ecb73108e4
test: 2.5 Mac OS code checker uses cmake-3.31 (#44375)
pr: #44348

Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
Co-authored-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-09-15 17:32:00 +08:00
congqixia
02d12619e2
fix: [2.5] Update 2.5 branch format (#44096)
Cherry-pick from master
pr: #44077
Related to #44076

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-15 11:16:00 +08:00
cai.zhang
8e8bb8604a
fix: [2.5] Fix GetCompactionTo return empty results when segment was GCed (#44271)
issue: #44269 
master pr: #44270

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-15 10:53:59 +08:00
aoiasd
cb0bb7b31f
enhance: [2.5] forbid panic when tantivy index path not exist (#44136)
pr: https://github.com/milvus-io/milvus/pull/44135

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-15 10:30:00 +08:00
congqixia
5d54d84438
enhance: [2.5] Add param item forcing all indices ready for segment (#44329)
Cherry-pick from master
pr: #44313
Related to #44312

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 19:29:58 +08:00
cai.zhang
4c0249ba20
fix: [2.5] Check if ArrayData is nil to prevent panic (#44333)
issue: #44331 
master pr: #44332

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-12 14:47:59 +08:00
cqy123456
ec4442d39b
enhance: update knowhere version (#44292)
issue: https://github.com/milvus-io/milvus/issues/42937 
master pr:https://github.com/milvus-io/milvus/pull/44294

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-09-11 15:05:58 +08:00
cai.zhang
877e68f851
enhance: Support R-Tree index for geometry datatype (#44069)
issue: #43427
pr: #37417

Support R-Tree index for geometry datatype.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: ZhuXi <150327960+Yinwei-Yu@users.noreply.github.com>
2025-09-11 14:19:58 +08:00
aoiasd
adbfa3f0fa
fix: [2.5] add utf8 check for bm25 functoin run (#44221)
relate: https://github.com/milvus-io/milvus/issues/44219
pr: https://github.com/milvus-io/milvus/pull/44220

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-09 19:27:58 +08:00
zhagnlu
802026569d
enhance:add param to modify delete snapshot size (#44213)
pr: #44215

Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-05 14:31:56 +08:00
congqixia
7514eece4c
enhance: [2.5] Add mutex and range check preventing concurrent del (#44128) (#44202)
Cherry-pick from master
pr: #44128
This PR adds a mutex prevent concurrent applying delete on same segment
and check latestDeltaTimestamp to skip overlapping delete range

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-04 10:35:54 +08:00
cqy123456
c17ce3cf90
enhance:[2.5]minhash support and add autoindex config (#44015)
master pr: https://github.com/milvus-io/milvus/pull/44186

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-09-03 17:39:54 +08:00
Bingyi Sun
d658b6f50a
enhance: remove name check for alter index task (#42953) (#44056)
pr: #42953 
issue: https://github.com/milvus-io/milvus/issues/42952

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-02 10:23:54 +08:00
zhagnlu
4ff9e49a99
fix:expand lock range for dump_snapshot (#44131)
cherry-pick from pr: #44130

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-01 16:25:54 +08:00
XuanYang-cn
6f9e42fbe4
test: Increase PyMilvus version to 2.5.16rc3 for 2.5 branch (#44125)
Automated daily bump from pymilvus 2.5 branch. Updates
tests/python_client/requirements.txt.

Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-08-29 15:09:51 +08:00
XuanYang-cn
0cac47c02c
test: Increase PyMilvus version to 2.5.16rc2 for 2.5 branch (#44101)
Automated daily bump from pymilvus 2.5 branch. Updates
tests/python_client/requirements.txt.

Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-08-28 18:07:52 +08:00
congqixia
94acb811bb
fix: [2.5] Invalidate proxy cache for create alias op (#43854) (#44073)
Cherry-pick from master
pr: #43854
Related to #43853

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-27 16:19:51 +08:00
ZhuXi
cd931a0388
feat:Geospatial Data Type and GIS Function support for milvus (#43661)
issue: #43427
pr: #37417

This pr's main goal is merge #37417 to milvus 2.5 without conflicts.

# Main Goals

1. Create and describe collections with geospatial type
2. Insert geospatial data into the insert binlog
3. Load segments containing geospatial data into memory
4. Enable query and search can display  geospatial data
5. Support using GIS funtions like ST_EQUALS in query

# Solution

1. **Add Type**: Modify the Milvus core by adding a Geospatial type in
both the C++ and Go code layers, defining the Geospatial data structure
and the corresponding interfaces.
2. **Dependency Libraries**: Introduce necessary geospatial data
processing libraries. In the C++ source code, use Conan package
management to include the GDAL library. In the Go source code, add the
go-geom library to the go.mod file.
3. **Protocol Interface**: Revise the Milvus protocol to provide
mechanisms for Geospatial message serialization and deserialization.
4. **Data Pipeline**: Facilitate interaction between the client and
proxy using the WKT format for geospatial data. The proxy will convert
all data into WKB format for downstream processing, providing column
data interfaces, segment encapsulation, segment loading, payload
writing, and cache block management.
5. **Query Operators**: Implement simple display and support for filter
queries. Initially, focus on filtering based on spatial relationships
for a single column of geospatial literal values, providing parsing and
execution for query expressions.Now only support brutal search
6. **Client Modification**: Enable the client to handle user input for
geospatial data and facilitate end-to-end testing.Check the modification
in pymilvus.

---------

Signed-off-by: Yinwei Li <yinwei.li@zilliz.com>
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
2025-08-26 19:11:55 +08:00
Ted Xu
8821743c17
enhance: returning collection metadata from cache (#42823) (#43911)
See #43187
pr: #42823

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-08-26 14:23:54 +08:00
zhagnlu
6c29689ca2
enhance: support expr result cache (#43882)
cherry-pick from pr: #43923

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-08-26 11:19:57 +08:00
cqy123456
a1ff6c89be
enhance:[2.5] Make build ratio of interim index configurable (#43938)
issue: https://github.com/milvus-io/milvus/issues/43993
master pr: https://github.com/milvus-io/milvus/pull/43939

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-08-25 16:01:52 +08:00
congqixia
95f6b1ff89
enhance: [2.5] Use function def determine field IsFunctionOutput only (#43979) (#44009)
Cherry-pick from master
pr: #43979
Related to #35853

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-22 16:55:48 +08:00
congqixia
0fceece818
enhance: [2.5] Use RLock for ListPrivilegeGroups (#43998) (#44006)
Cherry-pick from master
pr: #43998
Related to #43901

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-22 10:31:47 +08:00
XuanYang-cn
199002f9e3
test: Increase PyMilvus version to 2.5.15rc4 (#43991)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-08-21 19:29:47 +08:00
sre-ci-robot
9aab728657
[automated] Bump milvus version to v2.5.17 (#43971)
Bump milvus version to v2.5.17
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-20 19:17:47 +08:00
Alexander Guzhva
5903f049fb
enhance: Fix ArithHelperI64 for SVE in bitset (#43953)
pr: #43952

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
v2.5.17
2025-08-19 22:49:43 +08:00
Alexander Guzhva
84b7ec880d
enhance: remove duplicate code in ArithHelperF32 in SVE for bitset (#43951)
pr: #43950

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
2025-08-19 22:38:44 +08:00
liliu-z
bd9fd42310
enhance: Fix template declaration order for ArithHelperF32 in SVE implemementation (#43948)
pr: #43949

Signed-off-by: Li Liu <li.liu@zilliz.com>
2025-08-19 22:00:39 +08:00
congqixia
8748a59a62
enhance: Bump milvus & proto version to v2.5.17 (#43906)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
pkg/v2.5.17
2025-08-19 16:37:47 +08:00
wei liu
39754af727
fix: Fix L0 segment loading delegator selection in QueryCoord (#43795)
issue: #43794
Fix the issue where L0 segments were not correctly selecting appropriate
delegators during loading, which could cause load failures or incorrect
delegator assignments.

Changes include:
- Add special handling for L0 segments in delegator selection logic
- Find delegators that are missing the L0 segment for direct loading
- Fallback to existing serviceable delegator selection when no suitable
delegator is found for L0 segments
- Add comprehensive test coverage for L0 segment loading scenarios
- Test delegator selection when some delegators are missing segments
- Test fallback behavior when all delegators already have the segment
- Test error handling when no delegators are available

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-08-19 16:35:47 +08:00
liliu-z
a6bfa25054
enhance: Cp sve support for bitset (#43928)
pr: #43833

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: Alexander Guzhva <alexanderguzhva@gmail.com>
2025-08-19 16:33:47 +08:00
sthuang
c6e6bcece4
enhance: [2.5] avoid frequent LoadWithPrefix etcd calls in ShowCollections and DescribeCollections (#43903)
pr: #43902
related: https://github.com/milvus-io/milvus/issues/43901

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-08-19 12:29:46 +08:00
sparknack
b57d104742
enhance: [2.5] add write rate limit for disk file writer (#43856)
issue: https://github.com/milvus-io/milvus/issues/43040
pr: #43912

---------

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-08-18 23:33:46 +08:00