admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-03 09:22:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,737 Commits 138 Branches 188 Tags
Commit Graph

60 Commits

Author SHA1 Message Date
Cai Yudong
f32830e016
feat: Support restful & go sdk for Int8Vector (#39278) 
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2025-01-24 17:07:07 +08:00
congqixia
05b6ea1351
enhance: Refine error msg for schema & index checking (#39533) 
The error message was malformated or missing some meta info, say field
name. This PR recitfies some message format and add field name in error
message when type param check fails.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-24 09:57:06 +08:00
ThreadDao
e02fb41db8
test: add go-sdk cases for database properties (#39484) 
issue: #33419 
- Add test cases for database properties
- Fixed typo AlterDatabaseProperies to AlterDatabaseProperties
- Rename UsingDatabase to UseDatabase
- Rename ListDatabases to ListDatabase

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-01-23 14:29:16 +08:00
ThreadDao
461c376b46
test: add test cases for template param (#38867) 
issue: #33419
- add case for Get
- add case for TemplateParam

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-01-10 09:38:58 +08:00
cai.zhang
ee9a2793da
fix: [skip-e2e] Remove valid expressions from invalid expressions (#39012) 
issue: #39014

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-01-06 18:06:54 +08:00
foxspy
af08b5b311
enhance: Update Knowhere version (#38942) 
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-01-03 14:28:53 +08:00
Zhen Ye
80fefadf27
enhance: TestDeleteComplexExpr may failure because of timeout (#38935) 
issue: #33419

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-01-03 12:25:26 +08:00
Patrick Weizhi Xu
d3a5282eaa
enhance: add param for tuning max VARCHAR length and restore limit to 65535 (#38884) 
issue: #38882 

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 8e740e004151dd2c11918aad2857c1c8d1bd98f5)
 2025-01-02 14:42:53 +08:00
congqixia
19a5c31907
enhance: Bump golang/x/net to v0.33 fixing security alarm (#38850) 
Related to https://github.com/milvus-io/milvus/security/dependabot/106

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-01-02 10:50:55 +08:00
ThreadDao
ba0c7b8fff
test: update cases for search params support and groupby issue fix (#38852) 
issue: #38343 #33419
- update cases for WithSearchParam
- remove skip for groupby search issue
- update output query dynamic case for server changes

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-12-31 14:14:52 +08:00
congqixia
a882f341f4
enhance: [GoSDK] Add APIs for backup tool (#38791) 
Related to #31291

This PR:

- Add Backup&Restore RBAC APIs
- Add GetPersistentSegmentInfo API
- Add GetServerVersion API
- Add flush task stats

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-27 14:20:51 +08:00
Xianhui Lin
90de37e60a
enhance: field stringtype maxlength raise to 1M (#38592) 
enhance: field stringtype maxlength raise to 1M
issue: https://github.com/milvus-io/milvus/issues/37436

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2024-12-20 14:32:45 +08:00
congqixia
c39db11509
enhance: [GoSDK] Sync API names and add missing APIs (#38603) 
Related to #31293

- Rename `UsingDatabase` to `UseDatabase`
- Uncomment default value methods
- Add missing RBAC APIs
- Add some resource group APIs

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-20 11:52:46 +08:00
XuanYang-cn
ca7ec23198
enhance: Use partitionID when delete by partitionKey (#38231) 
When delete by partition_key, Milvus will generates L0 segments
globally. During L0 Compaction, those L0 segments will touch all
partitions collection wise. Due to the false-positive rate of segment
bloomfilters, L0 compactions will append false deltalogs to completed
irrelevant partitions, which causes *partition deletion amplification.

This PR uses partition_key to set targeted partitionID when producing
deleteMsgs into MsgStreams. This'll narrow down L0 segments scope to
partition level, and remove the false-positive influence
collection-wise.

However, due to DeleteMsg structure, we can only label one partition to
one deleteMsg, so this enhancement fails if user wants to delete over 2
partition_keys in one deletion.

See also: #34665

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-12-20 11:18:46 +08:00
Bingyi Sun
894c203f27
enhance: allow hyphen in partition name (#38494) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-12-18 15:04:45 +08:00
ThreadDao
8794ec966e
test: add go case for groupby search (#38411) 
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-12-16 10:44:43 +08:00
congqixia
fe79babdb3
enhance: Bump golang/x/crypto for all packages (#38445) 
Related to #38446
See also https://github.com/milvus-io/milvus/security/dependabot/103

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-13 19:12:42 +08:00
ThreadDao
59234a3350
test: add log level for go sdk test and update part cases (#38385) 
- add log level for go sdk cases
- update cases for issue #33460 & #37853

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-12-12 16:58:43 +08:00
Yinzuo Jiang
1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion (#37978) 
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion

fp32 <-> fp16/bf16 vector conversion:

- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`

`columnBasedDataOption`:

- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`

`ColumnFloat16Vector`/`ColumnBFloat16Vector`:

- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`

issue: #37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-11-29 08:00:37 +08:00
ThreadDao
c5327ff150
test: add cases for gosdk v2 partial load (#37924) 
issue: #33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-26 15:08:34 +08:00
congqixia
6b23e668b0
test: Update go_client version & update latest changes (#37793) 
Related to #37768

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-26 10:26:40 +08:00
ThreadDao
bc131a911c
test: add cases for gosdk v2 load release (#37831) 
issue: #33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-22 10:54:32 +08:00
smellthemoon
a654487995
fix: some error in restful (#37487) 
#37370

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-11-13 17:12:39 +08:00
congqixia
83d2729f94
enhance: Generate milvusclient mockery with latest proto (#37567) 
Related to #37558

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-11 14:28:30 +08:00
ThreadDao
f42869c0ce
test: remove case skip label (#37539) 
[test] remove case skip label
issue: #33952

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-10 16:14:27 +08:00
congqixia
11f4fe0177
enhance: [GoSDK] move client pkg go files to sub one (#37492) 
Related to #31293

Client source files under client pkg cannot be evaluate correctly by
codecov. This PR moves them to `milvusclient` sub-package to fix this
issue and follow go major version best practice.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-08 07:32:26 +08:00
congqixia
c83b93946e
enhance: [GoSDK] Add alter collection API & expose options (#37365) 
Related to #31293

This PR:

- Add `AlterCollection` API for collection property modification
- Expose hidden or missing option methods

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-06 14:36:25 +08:00
foxspy
eaf86f7649
fix: optimize invalid datatype error msg (#37376) 
issue: #37151

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-11-04 11:46:28 +08:00
congqixia
be71b98146
enhance: Fix case error msg after knowhere upgrade (#37339) 
Previous PR: #37315

Error message updated after knowhere behavior change, this PR update
corresponding test error message.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-01 14:00:22 +08:00
cai.zhang
2ef6cbbf59
feat: The expression supports filling elements through templates (#37033) 
issue: #36672

The expression supports filling elements through templates, which helps
to reduce the overhead of parsing the elements.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-10-31 14:20:22 +08:00
foxspy
d7b2ffe5aa
enhance: add an unify vector index config checker (#36844) 
issue: #34298

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-10-28 10:11:37 +08:00
Yinzuo Jiang
3628593d20
feat: Implement custom function module in milvus expr (#36560) 
OSPP 2024 project:
https://summer-ospp.ac.cn/org/prodetail/247410235?list=org&navpage=org

Solutions:

- parser (planparserv2)
    - add CallExpr in planparserv2/Plan.g4
    - update parser_visitor and show_visitor
- grpc protobuf
    - add CallExpr in plan.proto
- execution (`core/src/exec`)
- add `CallExpr` `ValueExpr` and `ColumnExpr` (both logical and
physical) for function call and function parameters
- function factory (`core/src/exec/expression/function`)
    - create a global hashmap when starting milvus (see server.go)
- the global hashmap stores function signatures and their function
pointers, the CallExpr in execution engine can get the function pointer
by function signature.
- custom functions
    - empty(string)
    - starts_with(string, string)
- add cpp/go unittests and E2E tests

closes: #36559

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-10-25 15:25:30 +08:00
congqixia
e5948bd039
enhance: [GoSDK] Use variadic params for options (#36912) 
Use variadic parameter function for options make client options easier
to use.

Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-16 19:33:23 +08:00
aoiasd
db34572c56
feat: support load and query with bm25 metric (#36071) 
relate: https://github.com/milvus-io/milvus/issues/35853

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-10-11 10:23:20 +08:00
ThreadDao
f068729a26
test: fix repeated random partition name (#35805) 
/kind improvement

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-09-03 17:13:12 +08:00
ThreadDao
a90133cdf5
test: Optimize sparse vector case (#35661) 
/kind improvement

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-26 14:54:57 +08:00
ThreadDao
570a8879e7
test: update gosdk case for valid empty sparse vector (#35621) 
/kind improvement

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-22 10:54:56 +08:00
yellow-shine
6e29d713b3
enhance: [skip e2e]dockerfile for milvus-sdk-go test (#35426) 
https://github.com/milvus-io/milvus/issues/35567

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-20 09:48:55 +08:00
congqixia
b4743b4ca8
enhance: [GoSDK] Sync latest milvus proto and mockery (#35511) 
Related to #35443

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-19 16:22:55 +08:00
ThreadDao
635e9ddb0e
test: fix go sdk cases parallel context deadline (#35519) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-16 20:32:53 +08:00
ThreadDao
a62118ca33
test: update cases for index describe and upsert with autoID (#35191) 
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-05 18:00:16 +08:00
sthuang
d8668fe405
enhance: upgrade go version to 1.21.11 (#35257) 
issue: #35142

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-08-05 16:12:15 +08:00
congqixia
db06b86594
enhance: Sync otlp dependency version to fix security issue (#35192) 
Related to #34434

otelgrpc DoS vulnerability due to unbound cardinality metrics

https://github.com/milvus-io/milvus/security/dependabot/91

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-02 16:22:20 +08:00
congqixia
de8a266d8a
enhance: Enable linux code checker (#35084) 
See also #34483

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-30 15:53:51 +08:00
wei liu
c45f38aa61
enhance: Update protobuf-go to protobuf-go v2 (#34394) 
issue: #34252

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-07-29 11:31:51 +08:00
congqixia
4ee6c69217
enhance: Add Segment Level in milvus segment info APIs (#34763) 
See also #34746

This PR add segment level field in response of
`GetPersistentSegmentInfo` and `GetQuerySegmentInfo`

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-26 10:01:46 +08:00
congqixia
482373b3d3
enhance: Sync go e2e package proto dependency (#34913) 
Go e2e package point to a lower verion of milvus-proto and may cause
compile error locally.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-23 16:09:43 +08:00
ThreadDao
e4115485b6
test: add cases for gosdk v2 partitions (#34593) 
issue: #33419 #34426

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-07-11 16:49:36 +08:00
congqixia
3333160b8d
enhance: Fix lint issues from recent PRs (#34482) 
See also #34483
Some lint issues are introduced due to lack of static check run. This PR
fixes these problems.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-09 10:06:24 +08:00
ThreadDao
67747245f4
test: add test cases for gosdk v2 index (#34431) 
issue: #33419 
- Add test cases for gosdk v2 index
- Add sparse index for go client

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-07-05 09:10:09 +08:00