admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,014 Commits 146 Branches 196 Tags
Commit Graph

83 Commits

Author SHA1 Message Date
shaoyue
973f6d80a1
enhance: update go version to fix cve (#41697) 
master pr: #41696
/cc @congqixia @czs007

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
 2025-05-09 11:22:55 +08:00
congqixia
ecf3841ae9
enhance: [GoSDK] cherry pick patches for 2.5.3 (#41631) 
pr: #41498 #41576 #41606 #39973

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Co-authored-by: aoiasd <45024769+aoiasd@users.noreply.github.com>
 2025-04-30 15:10:53 +08:00
congqixia
41d910451f
enhance: Bump milvus & proto version to v2.5.11 (#41541) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-27 19:56:39 +08:00
SimFG
18eb627533
fix: [2.5] Update logging context and upgrade dependencies (#41319) 
- issue: #41291
- pr: #41318

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-04-24 23:50:40 +08:00
congqixia
55b37c3bb6
enhance: Bump milvus & proto version to v2.5.10 (#41328) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-15 19:50:32 +08:00
congqixia
d679195a5a
enhance: Bump milvus & proto version to v2.5.9 (#41144) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-04-07 20:37:35 +08:00
congqixia
e0f274a1b8
enhance: Bump milvus & proto version to v2.5.8 (#41019) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-31 22:27:12 +08:00
congqixia
2411c184a8
enhance: [2.5] Support detailed manual compaction criterion (#40892) (#40924) 
Cherry-pick from master
pr: #40892
Related to #40866

This PR:
- update go-api/v2 and support partition id/channel/segment level manual
compaction
- refines the compaction trigger implementation
- unify the compaction signal usage

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-27 10:36:22 +08:00
zhuwenxing
99670db5e9
test: update text empty percent in go client fts test (#40010) 
pr: https://github.com/milvus-io/milvus/pull/40009

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-25 17:28:23 +08:00
yihao.dai
b534c9d804
enhance: [2.5] Introduce batch subscription in msgdispatcher (#40596) 
Introduce a batch subscription mechanism in msgdispatcher: the
msgdispatcher now includes a vchannel watch task queue, where all
vchannels in the queue will subscribe to the MQ only once and pull
messages from the oldest vchannel checkpoint to the latest.

issue: https://github.com/milvus-io/milvus/issues/39862

pr: https://github.com/milvus-io/milvus/pull/39863

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-24 10:18:17 +08:00
ThreadDao
635f6c5300
[GoSDK][2.5] test: Cherry-pick gosdk test commits from master branch (#40778) 
pr: #39694 #40352 #40775 #40787

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-03-21 14:30:14 +08:00
congqixia
50241e4cf9
enhance: [2.5][GoSDK] Support JSON Path index (#40754) (#40791) 
Cherry-pick from master
pr: #40754 
Related to #35528

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 10:28:13 +08:00
congqixia
6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 (#40728) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 19:58:15 +08:00
Bingyi Sun
683b26ffb7
feat: cherry pick json path index (#40313) 
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-10 22:14:05 +08:00
congqixia
4272703de4
enhance: Bump milvus & proto version to v2.5.6 (#40293) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-03 16:52:00 +08:00
SimFG
a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api (#40193) 
- issue: #40178
- pr: #40192

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-03 10:20:01 +08:00
congqixia
3f76e1c6d1
enhance: [GoSDK][2.5] Use pkg v2 module path (#40134) (#40269) 
Cherry-pick from master
pr: #40134
Related to #39095
Previous PR #39990 update pkg module path using "/v2" package name, this
PR update milvusclient go sdk dependency for this update

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-01 11:00:01 +08:00
ThreadDao
7fb69960d1
test: [GoSDK][2.5] Sync gosdk test commits from master branch (#39838) 
Cherry-pick from master
pr: #39484 #39570 #39537 #39824 #39579

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wxzhuyeah@gmail.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-02-18 11:11:08 +08:00
Xianhui Lin
f0964f769d
enhance: [2.5]Add json key inverted index in stats for optimization (#39876) 
Add json key inverted index in stats for optimization
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-02-16 20:12:15 +08:00
Zhen Ye
f85bf59921
fix: rootcoord graceful stop failed and limit resource of ci (#39793) 
issue: #38399
pr: #39781

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-02-13 19:34:13 +08:00
congqixia
7ca5e8309b
enhance: [GoSDK][2.5] Sync gosdk commits from master branch (#39823) 
Cherry-pick from master
pr: #38791 #38812 #38940 #39515 #39580 #39662 #39665 #39751

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-12 18:46:47 +08:00
congqixia
6f7b2b4e75
enhance: [2.5] Refine error msg for schema & index checking (#39533) (#39565) 
Cherry-pick from master
pr: #39533

The error message was malformated or missing some meta info, say field
name. This PR recitfies some message format and add field name in error
message when type param check fails.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-24 13:43:06 +08:00
ThreadDao
c1c1f2df4e
test: [2.5] add test cases for template param (#39475) 
issue: #33419
pr: #38867

- add case for Get
- add case for TemplateParam

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-01-22 09:55:24 +08:00
Xianhui Lin
20c6de156e
feat: update milvusproto version to 2.5.5 (#39478) 
feat: update milvusproto version to 2.5
issue: https://github.com/milvus-io/milvus/issues/39093

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-01-21 15:11:05 +08:00
congqixia
e68d161e60
enhance: Bump milvus & proto version to v2.5.4 (#39330) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-16 15:39:03 +08:00
zhenshan.cao
99a8274326
enhance: Add primary field name in SearchResult and QueryResults (#39222) 
pr: https://github.com/milvus-io/milvus/pull/39220
issue: https://github.com/milvus-io/milvus/issues/39219

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2025-01-14 16:10:58 +08:00
congqixia
ac730be5aa
enhance: Bump milvus & proto version to v2.5.3 (#39198) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-13 12:56:57 +08:00
ThreadDao
c2532def02
test: update cases for search params support and groupby issue fix (#38876) 
pr: #38852
- update cases for WithSearchParam
- remove skip for groupby search issue
- update output query dynamic case for server changes

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-01-09 19:12:56 +08:00
cai.zhang
e6dd3e5a57
fix: [2.5]Remove valid expressions from invalid expressions (#38999) 
issue: #39014 

master pr: #38957 
master pr: #39012

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-01-06 18:02:55 +08:00
congqixia
6433f76c61
enhance: [2.5] Bump golang/x/net to v0.33 fixing security alarm (#38850) (#38932) 
Cherry-pick from master
pr: #38850
Related to https://github.com/milvus-io/milvus/security/dependabot/106

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-03 14:50:54 +08:00
Patrick Weizhi Xu
1d55ad6a1d
enhance: [2.5] add param for tuning max VARCHAR length and restore limit to 65535 (#38883) 
issue: #38882
pr: https://github.com/milvus-io/milvus/pull/38884

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit a64a7377ea8258efe36c74bd1cf9db556726ba2d)
 2025-01-02 13:56:54 +08:00
foxspy
3d723676ac
enhance: [2.5]update knowhere version (#38785) 
/kind branch-feature
release note: https://github.com/zilliztech/knowhere/releases/tag/v2.5.1

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-12-27 10:24:50 +08:00
congqixia
a67b57275c
enhance: Bump milvus & proto version to v2.5.1 (#38774) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-26 16:36:50 +08:00
Xianhui Lin
3cf9b6bae5
enhance: [2.5]field stringtype maxlength raise to 1M (#38614) 
enhance: field stringtype maxlength raise to 1M
issue: https://github.com/milvus-io/milvus/issues/37436
master pr: https://github.com/milvus-io/milvus/pull/38592

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2024-12-20 17:08:45 +08:00
congqixia
b132438c03
enhance: Bump milvus & proto verison to v2.5.0 (#38610) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-20 14:30:46 +08:00
congqixia
c39db11509
enhance: [GoSDK] Sync API names and add missing APIs (#38603) 
Related to #31293

- Rename `UsingDatabase` to `UseDatabase`
- Uncomment default value methods
- Add missing RBAC APIs
- Add some resource group APIs

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-20 11:52:46 +08:00
XuanYang-cn
ca7ec23198
enhance: Use partitionID when delete by partitionKey (#38231) 
When delete by partition_key, Milvus will generates L0 segments
globally. During L0 Compaction, those L0 segments will touch all
partitions collection wise. Due to the false-positive rate of segment
bloomfilters, L0 compactions will append false deltalogs to completed
irrelevant partitions, which causes *partition deletion amplification.

This PR uses partition_key to set targeted partitionID when producing
deleteMsgs into MsgStreams. This'll narrow down L0 segments scope to
partition level, and remove the false-positive influence
collection-wise.

However, due to DeleteMsg structure, we can only label one partition to
one deleteMsg, so this enhancement fails if user wants to delete over 2
partition_keys in one deletion.

See also: #34665

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-12-20 11:18:46 +08:00
Bingyi Sun
894c203f27
enhance: allow hyphen in partition name (#38494) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-12-18 15:04:45 +08:00
ThreadDao
8794ec966e
test: add go case for groupby search (#38411) 
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-12-16 10:44:43 +08:00
congqixia
fe79babdb3
enhance: Bump golang/x/crypto for all packages (#38445) 
Related to #38446
See also https://github.com/milvus-io/milvus/security/dependabot/103

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-13 19:12:42 +08:00
ThreadDao
59234a3350
test: add log level for go sdk test and update part cases (#38385) 
- add log level for go sdk cases
- update cases for issue #33460 & #37853

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-12-12 16:58:43 +08:00
Yinzuo Jiang
1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion (#37978) 
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion

fp32 <-> fp16/bf16 vector conversion:

- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`

`columnBasedDataOption`:

- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`

`ColumnFloat16Vector`/`ColumnBFloat16Vector`:

- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`

issue: #37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-11-29 08:00:37 +08:00
ThreadDao
c5327ff150
test: add cases for gosdk v2 partial load (#37924) 
issue: #33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-26 15:08:34 +08:00
congqixia
6b23e668b0
test: Update go_client version & update latest changes (#37793) 
Related to #37768

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-26 10:26:40 +08:00
ThreadDao
bc131a911c
test: add cases for gosdk v2 load release (#37831) 
issue: #33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-22 10:54:32 +08:00
smellthemoon
a654487995
fix: some error in restful (#37487) 
#37370

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-11-13 17:12:39 +08:00
congqixia
83d2729f94
enhance: Generate milvusclient mockery with latest proto (#37567) 
Related to #37558

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-11 14:28:30 +08:00
ThreadDao
f42869c0ce
test: remove case skip label (#37539) 
[test] remove case skip label
issue: #33952

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-10 16:14:27 +08:00
congqixia
11f4fe0177
enhance: [GoSDK] move client pkg go files to sub one (#37492) 
Related to #31293

Client source files under client pkg cannot be evaluate correctly by
codecov. This PR moves them to `milvusclient` sub-package to fix this
issue and follow go major version best practice.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-08 07:32:26 +08:00
congqixia
c83b93946e
enhance: [GoSDK] Add alter collection API & expose options (#37365) 
Related to #31293

This PR:

- Add `AlterCollection` API for collection property modification
- Expose hidden or missing option methods

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-06 14:36:25 +08:00