XuanYang-cn
16cbd26154
test: Increase PyMilvus version to 2.7.0rc24 for master branch ( #44126 )
...
Automated daily bump from pymilvus master branch. Updates
tests/python_client/requirements.txt.
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-08-29 15:05:51 +08:00
cai.zhang
c16296a53f
fix: Handle compaction retry state ( #44119 )
...
issue: #43776
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-08-29 13:31:51 +08:00
wei liu
d84c4c580a
enhance: [DataCoord] Remove full-collection index work from metrics ( #43859 )
...
issue: #43858
- Remove full-collection index handling in getCollectionMetrics
- Avoid heavy metadata scans and RPC calls during metrics
- Reduce latency and CPU/memory usage on large datasets
- No functional change to metrics semantics
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-08-29 12:05:50 +08:00
sparknack
70c8114e85
enhance: cachinglayer: resource management for segment loading ( #43846 )
...
issue: #41435
---------
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-08-29 11:37:50 +08:00
Zhen Ye
7b04107863
fix: unrecoverable if lease expire when standby mode ( #44112 )
...
issue: #44111
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-29 10:47:51 +08:00
Zhen Ye
23085ae437
fix: use query node label check if streamingnode ( #44099 )
...
issue: #44014
- Because the session of querynode and streamingnode is different.
- So when streamingnode session down first, a streaming query node will
be treated as querynode.
- Use label but not streaming node session to fix it.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-29 10:45:59 +08:00
Buqian Zheng
6b22661c06
fix: use tbb::concurrent_unordered_map for ChunkedSegmentSealedImpl::fields_ ( #44084 )
...
issue: https://github.com/milvus-io/milvus/issues/44078
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-08-29 10:01:51 +08:00
cqy123456
844caf5cfe
enhance: estimate the size of interim index ( #44104 )
...
issue: #41435
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-08-28 19:37:51 +08:00
XuanYang-cn
4bc86cb335
test: Increase PyMilvus version to 2.7.0rc21 for master branch ( #44100 )
...
Automated daily bump from pymilvus master branch. Updates
tests/python_client/requirements.txt.
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-08-28 18:05:51 +08:00
congqixia
ba88cfa7a9
enhance: Add unified GRPC latency metrics in inteceptor ( #44089 )
...
Related to #43966
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-28 09:53:51 +08:00
9Eurydice9
d70607c342
test: migrate test_query V2 cases for milvus client ( #44091 )
...
issue: #44090
Migrate test_query cases from TestcaseBase to TestMilvusClientV2Base
Signed-off-by: Orpheus Wang <orpheus.wang@zilliz.com>
2025-08-28 09:13:50 +08:00
cai.zhang
eddf188452
fix: Using bucket name in storage config for bulk writer v2 ( #44083 )
...
issue: #44082
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-08-27 23:47:51 +08:00
congqixia
e3b3502287
fix: Use correct regex for cppcheck ( #44077 )
...
Related to #44076
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-27 20:57:50 +08:00
Buqian Zheng
6420d72391
enhance: print as storage size unit MB with 2 digits only, so the log is easier to read ( #44085 )
...
issue: https://github.com/milvus-io/milvus/issues/41435
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-08-27 19:47:50 +08:00
cai.zhang
7f470e6bd3
fix: Fix retry state with palyload is not nil ( #44068 )
...
issue: #43776
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-08-27 18:11:49 +08:00
marcelo-cjl
e13e19cd2c
enhance: add sparse_u32_f32 data type for sparse vertor ( #43974 )
...
issue: #43973
Signed-off-by: marcelo.chen <marcelo.chen@zilliz.com>
2025-08-27 16:47:50 +08:00
Chun Han
da156981c6
feat: milvus support posix-compatible mode(milvus-io#43942) ( #43944 )
...
related: #43942
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-08-27 16:29:50 +08:00
XuanYang-cn
09b29a88aa
enhance: Remove not inused allocator ( #43821 )
...
See also: #44039
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-08-27 14:31:50 +08:00
congqixia
d3fa305785
enhance: Add grpc metadata header for client request time ( #44059 )
...
Related to #44058
This PR:
- Add common grpc metadata key for client request time
- Add gosdk & milvus inteceptor related logic for this attribute
- Bump go sdk version
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-27 14:27:49 +08:00
XuanYang-cn
37a447d166
feat: Add CMEK cipher plugin ( #43722 )
...
1. Enable Milvus to read cipher configs
2. Enable cipher plugin in binlog reader and writer
3. Add a testCipher for unittests
4. Support pooling for datanode
5. Add encryption in storagev2
See also: #40321
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-08-27 11:15:52 +08:00
groot
55b24b7a78
fix: Hide sensitive items for restful get configs ( #44057 )
...
issue:https://github.com/milvus-io/milvus/issues/44065
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-08-27 11:09:52 +08:00
aoiasd
208a345a3d
enhance: package analyzer code in Go and fix named analyzer as tokenizer ( #43694 )
...
relate: https://github.com/milvus-io/milvus/issues/43687
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-08-27 10:59:52 +08:00
Spade A
90a7e63665
enhance: collect doc_id from posting list directly for text match ( #43899 )
...
issue: https://github.com/milvus-io/milvus/issues/43898
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-08-27 10:39:52 +08:00
aoiasd
e205c30f7d
fix: boost panic if search return empty result ( #44042 )
...
relate: https://github.com/milvus-io/milvus/issues/44041
Skip rescore node if no valid offsets.
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-08-27 05:01:52 +08:00
Spade A
8456f824be
feat: impl StructArray -- miscellaneous staffs for struct array ( #43960 )
...
Ref https://github.com/milvus-io/milvus/issues/42148
1. enable storage v2
2. implement some missing staffs
3. fix some bugs and add tests
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-08-26 21:35:53 +08:00
Zhen Ye
5bdc593b8a
enhance: use v0.15.1 official pulsar client and add logging for pulsar client ( #43913 )
...
issue: #43785
- pulsar client will print log into milvus logger now.
- pulsar client open the metric by default.
- upgrade the pulsar client to v0.15.1, and use offical repo.
- the fixing of milvus-io/pulsar-client-go is already covered by
official v0.15.1.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-26 16:45:53 +08:00
Tianx
c0d62268ac
feat: add timesatmptz data type ( #44005 )
...
issue: https://github.com/milvus-io/milvus/issues/27467
>
https://github.com/milvus-io/milvus/issues/27467#issuecomment-3092211420
> * [x] M1 Create collection with timestamptz field
> * [x] M2 Insert timestamptz field data
> * [x] M3 Retrieve timestamptz field data
> * [x] M4 Implement handoff[ ]
The second PR of issue:
https://github.com/milvus-io/milvus/issues/27467 , which completes M1-M4
described above.
---------
Signed-off-by: xtx <xtianx@smail.nju.edu.cn>
2025-08-26 15:59:53 +08:00
yanliang567
f301692900
test: Add ngram tests and expression tests ( #44029 )
...
related issue: https://github.com/milvus-io/milvus/issues/43989
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-08-26 14:51:51 +08:00
groot
ccb0db92e7
fix: Not allow to import null element of array field from parquet ( #43964 )
...
issue: https://github.com/milvus-io/milvus/issues/43819
Before this fix: null elements are converted to zero or empty strings
After this fix: import job will return error "array element is not
allowed to be null value for field xxx"
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-08-26 14:45:51 +08:00
Zhen Ye
575345ae7b
fix: get streamingnodes from service discovery without channel assign ( #44033 )
...
issue: #43767
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-26 14:29:51 +08:00
WAR10CK
2ad41872da
enhance: support enable asan for docker image builder ( #44047 )
...
#44045
Signed-off-by: YangYanbin <warlock.yyb@alibaba-inc.com>
2025-08-26 11:39:14 +08:00
Gao
e97a618630
enhance: support readAt interface for remote input stream ( #43997 )
...
#42032
Also, fix the cacheoptfield method to work in storagev2.
Also, change the sparse related interface for knowhere version bump
#43974 .
Also, includes https://github.com/milvus-io/milvus/pull/44046 for metric
lost.
---------
Signed-off-by: chasingegg <chao.gao@zilliz.com>
Signed-off-by: marcelo.chen <marcelo.chen@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: marcelo.chen <marcelo.chen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-26 11:19:58 +08:00
zhagnlu
8934c18792
enhance: support cache result cache for expr ( #43923 )
...
issue: #43878
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-08-26 10:55:52 +08:00
junjiejiangjjj
f1ce84996d
enhance: refactor model service configuration and environment variables ( #44036 )
...
- Add enable configuration for all model service providers
- Migrate environment variables from MILVUSAI_* to MILVUS_* prefix with
backward compatibility
- Unify model service enable/disable logic using configuration
- Add tests for environment variable parsing with fallback support
#35856
Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
2025-08-26 10:49:52 +08:00
zhuwenxing
a2ac49f867
test: fix dependabot alerts ( #44037 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-08-26 09:05:51 +08:00
zhagnlu
1a30012014
enhance: support trace log level for segcore ( #44003 )
...
#43230
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-08-25 17:55:52 +08:00
ZhuXi
d079947bdf
doc: [skip e2e] Add research reports on geographic systems ( #43737 )
...
issue: #43427
Upload research reports on geographic information systems.
Signed-off-by: Yinwei Li <yinwei.li@zilliz.com>
2025-08-25 15:29:51 +08:00
cqy123456
d987dd7103
enhance: Make build ratio of interim index configurable ( #43939 )
...
issue: https://github.com/milvus-io/milvus/issues/43993
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-08-25 14:43:51 +08:00
sparknack
4fae074d56
enhance: add write rate limit for disk file writer ( #43912 )
...
issue: #43040
---------
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-08-25 10:27:47 +08:00
Zhen Ye
d0e3a33c37
enhance: add IsRebalanceSuspended interface for wal balancer ( #44026 )
...
issue: #43968
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-24 09:19:47 +08:00
9Eurydice9
d6b78193cb
test: add collection V2 cases for milvus client ( #44021 )
...
issue: #43590
Migrate collection test cases from TestcaseBase to
TestMilvusClientV2Base
Signed-off-by: Orpheus Wang <orpheus.wang@zilliz.com>
2025-08-23 21:35:47 +08:00
Zhen Ye
cbb9392564
fix: filter the streaming node from resource group ( #43984 )
...
issue: #43981
Signed-off-by: chyezh <chyezh@outlook.com>
2025-08-22 19:21:47 +08:00
junjiejiangjjj
f3d7e47227
feat: Supports more rerankers ( #43270 )
...
https://github.com/milvus-io/milvus/issues/35856
Signed-off-by: junjiejiangjjj <junjie.jiang@zilliz.com>
2025-08-22 17:29:47 +08:00
9Eurydice9
59d333819c
test: add collection V2 cases for milvus client ( #44008 )
...
issue: #43590
Migrate collection test cases from TestcaseBase to
TestMilvusClientV2Base
---------
Signed-off-by: Orpheus Wang <orpheus.wang@zilliz.com>
2025-08-22 13:13:47 +08:00
congqixia
d5ecf49319
enhance: Add request stats interceptor collecting req metrics ( #43967 )
...
Related to #43966 #43809
This PR:
- Replace distributed request metrics collection into one interceptor
- Add `Retry` and `Reject` label represents auth rejection and
retry-able error cases
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-22 13:09:47 +08:00
congqixia
56e40f7993
enhance: [GoSDK] Support IvfRabitQ & MinHashLSH index ( #43975 )
...
Related to #41746
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-22 04:55:47 +08:00
congqixia
606d4c24cd
enhance: Use function def determine field IsFunctionOutput only ( #43979 )
...
Related to #35853
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-22 04:49:46 +08:00
congqixia
847b79e197
enhance: Use RLock for ListPrivilegeGroups ( #43998 )
...
Related to #43901
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-21 23:45:46 +08:00
yanliang567
ec6681b018
test: add tests for ngram and fix invalid collection name mag ( #43990 )
...
related issue: #43989
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-08-21 18:45:47 +08:00
nico
551a4a400b
test: update sdk version ( #43929 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-08-21 16:47:47 +08:00
