admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,893 Commits 137 Branches 188 Tags
Commit Graph

21893 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cai.zhang
762a644d76
enhance: Limit the speed of the generating stats task (#39644) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-28 10:27:59 +08:00
wei liu
b0806bb900
fix: task delta cache leak due to duplicate task id (#40183) 
issue: #40052

task delta cache rely on the taskID is unique, so it incDeltaCache at
AddTask, and decDeltaCache at RemoveTask, but the taskID allocator is
not atomic, which cause two task with same taskID, in such case, it will
call incDeltaCache twice, but call decDeltaCacheOnce, which cause delta
cache leak.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-02-28 10:22:08 +08:00
cai.zhang
13aff35a83
enhance: Add metrics for parse expression (#39654) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-28 10:07:58 +08:00
sre-ci-robot
dc43136295 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2025-02-28 00:01:26 +00:00
Micka
5cc104b412
fix: Change CMake variable for switch to knowhere-cuvs (#40105) 
issue: https://github.com/milvus-io/milvus/issues/39883

Signed-off-by: Mickael Ide <mide@nvidia.com>
 2025-02-27 22:05:58 +08:00
Chun Han
259f9106ad
enhance: refine variable-length-type memory usage(#38736) (#39578) 
related: #38736

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-02-27 21:13:58 +08:00
wei liu
94f55df7fb
enhance: clean shard location cache after collection released (#40088) 
issue: #40077

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-02-27 19:42:05 +08:00
cai.zhang
fc31308c5c
fix: Skip text index creation when segment is zero after sorting (#39962) 
issue: #39961

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-27 17:55:58 +08:00
cai.zhang
a74580c1ca
fix: Set task version for stats task (#40035) 
issue: #40034

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-27 17:49:59 +08:00
cai.zhang
eb04686348
enhance: Add metrics for proxy queue (#40070) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-27 17:30:01 +08:00
yihao.dai
a148a78629
fix: Fix collections with duplicate names can be created (#40143) 
This PR introduces two restrictions:
1. Before dropping a collection, all aliases associated with that
collection must be dropped.
2. When creating a collection, if the collection name duplicates any
alias, the collection creation will fail.

issue: https://github.com/milvus-io/milvus/issues/40142

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-02-27 17:27:57 +08:00
aoiasd
d67d6b7567
fix: main dispatcher not terminate cause messsage stream leak. (#40061) 
Main dispatcher will leak when we remove solo dispatcher in the end. 
https://github.com/milvus-io/milvus/issues/40046

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-02-27 16:15:58 +08:00
SimFG
3b7b7e7e99
fix: use the different msg type for the OperatePrivilegeV2 api (#40192) 
- issue: #40178

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-02-27 14:43:59 +08:00
congqixia
35f188b329
enhance: Unify milvus version def (#40227) 
Related to #40216

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-27 14:15:57 +08:00
zhikunyao
a0763b3c02
enhance: bump etcd version to 3.5.18 (#40231) 
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
 2025-02-27 11:53:58 +08:00
sre-ci-robot
c2b77bd24f
[automated] Bump milvus version to v2.5.5 (#40225) 
Bump milvus version to v2.5.5
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-02-27 10:56:06 +08:00
sre-ci-robot
b2769fb357
[automated] Update Knowhere Commit (#40223) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-02-27 01:35:59 +08:00
wei liu
69b8b89369
enhance: Remove QueryCoord's scheduling of L0 segments (#39552) 
issue: #39551
This PR remove querycoord's scheduling of l0 segments:
  - only load l0 segment when watch channel
- only release l0 segment when release channel or sync data distribution

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2025-02-26 21:38:00 +08:00
nico
75b74e9413
enhance: [skip e2e] change nightly running time (#40219) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-02-26 19:18:08 +08:00
ThreadDao
5f71bb2a41
test: Split gosdk cases into different packages and add rg cases (#39694) 
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-02-26 16:27:59 +08:00
Spade A
476cf61d98
fix: random sample consider empty input (#40201) 
issue: #40198

Fix random sample does not consider empty input, that is no data is hit
by filter expression.

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
 2025-02-26 16:15:58 +08:00
yihao.dai
8f077089ba
enhance: Accelerate listing objects during binlog import (#40047) 
issue: https://github.com/milvus-io/milvus/issues/40030

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-02-26 15:55:57 +08:00
zhuwenxing
8fd39779f7
test: add restful v2 api testcases (#39558) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-02-26 14:03:57 +08:00
zhuwenxing
ac7550da82
test: fix duplicate import file names in tests (#40181) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-02-26 14:02:05 +08:00
Chun Han
190ac11cd1
fix: cancel sub contexts casade when http request timeout(#40030) (#40059) 
related: #40030

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-02-26 11:33:57 +08:00
junjiejiangjjj
162d241063
feat: Add siliconflow text embedding (#39867) 
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-02-26 11:01:56 +08:00
zhuwenxing
01966280da
test: add run_analyzer api test and lindera tokenizer test (#40160) 
/kind improvement


/hold

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-02-26 10:29:55 +08:00
zhuwenxing
828ecacadc
test: fix checker function name, release mistake and add nullable (#40135) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-02-26 10:27:56 +08:00
Bingyi Sun
f05e9628f6
fix: Fix search failure of null expression (#40129) 
issue: #40095

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-02-25 20:43:55 +08:00
congqixia
e0b028ade5
enhance: Integrate holmes as pprof dumper (#40151) 
Related to #40150

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-25 19:01:55 +08:00
XuanYang-cn
315cfb7f32
fix: Negative -1 executing compaction tasks (#39954) 
See also: #39675

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-02-25 18:07:55 +08:00
Zhen Ye
84df80b5e4
enhance: refactor metrics of streaming (#40031) 
issue: #38399

- add metrics for broadcaster component.
- add metrics for wal flusher component.
- add metrics for wal interceptors.
- add slow log for wal.
- add more label for some wal metrics. (local or remote/catcup or
tailing...)

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-02-25 12:25:56 +08:00
congqixia
ce480c3f57
enhance: [GoSDK] Use pkg v2 module path (#40134) 
Related to #39095
Previous PR #39990 update pkg module path using "/v2" package name, this
PR update milvusclient go sdk dependency for this update

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-25 10:33:56 +08:00
sthuang
90acc8a58f
enhance: upgrade go arrow version from 12.0.1 to 17.0.0 (#39916) 
related: https://github.com/milvus-io/milvus/issues/39915

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-02-25 10:30:02 +08:00
congqixia
36a4fada02
enhance: Sync proxy.maxTaskNum defaual value to 1024 (#40072) 
Sync milvus.yaml value to default value for maxTaskNum

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-24 16:28:06 +08:00
Bingyi Sun
db4769281c
fix: Fall back to a brute-force search if json index type unmatched (#40076) 
issue: https://github.com/milvus-io/milvus/issues/35528
If the query data type does not match the index type, fall back to a
brute-force search

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-02-24 16:25:57 +08:00
aoiasd
38f1608910
enhance: pack analyzer code and support lindera tokenizer (#39660) 
relate: https://github.com/milvus-io/milvus/issues/39659

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-02-24 12:13:55 +08:00
congqixia
dd68814c15
enhance: Remove hardcoded partition num in restful handler (#40112) 
The partition num shall be determined by core logic if user did not
specifiy the partition num in request.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-23 15:33:54 +08:00
cai.zhang
9f5b488f9a
enhance: Export request timeout interval in config (#40119) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-02-23 15:15:54 +08:00
congqixia
cb7f2fa6fd
enhance: Use v2 package name for pkg module (#39990) 
Related to #39095

https://go.dev/doc/modules/version-numbers

Update pkg version according to golang dep version convention

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-22 23:15:58 +08:00
congqixia
a774f05ea7
fix: Add sub task pool for multi-stage tasks (#40079) 
Related to #40078

Add a subTaskPool to execute sub task in case of logic deadlock
described in issue.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-22 16:37:54 +08:00
congqixia
e1b5b37195
enhance: Avoid stringtoslicebytes copy for BatchPKExists (#40096) 
Using unsafe.Slice to convert string to []byte by directly using
underlying data could avoid lots of copy and cpu time

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-02-22 15:23:52 +08:00
Ted Xu
8562a102ec
enhance: API integration with storage v2 in mix-compactions (#40008) 
See #39173

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2025-02-22 14:23:54 +08:00
SimFG
ad36347fb3
fix: add BeginTimestamp and EndTimestamp to insert and upsert messages (#40110) 
- issue: #40109
- caused by: #38656

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-02-22 12:29:53 +08:00
smellthemoon
8b974c5742
enhance: support compact if lack of binlog (#40000) 
https://github.com/milvus-io/milvus/issues/39718

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2025-02-22 10:51:56 +08:00
yihao.dai
d72d2281ca
fix: Fix concurrent map (#39775) 
issue: https://github.com/milvus-io/milvus/issues/39778

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-02-22 09:51:54 +08:00
sre-ci-robot
dd1347d041
[automated] Update Knowhere Commit (#40103) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-02-22 01:01:53 +08:00
sthuang
3eb3af5f08
feat: explicitly specify column groups for storage v2 api (#39790) 
* use the new packed reader and writer api to be compatible with current
etcd meta
* For the new packed writer API: column groups and paths are explicitly
defined by users and won't split column groups by memory in storage v2.
Packed writer follows the user-defined column groups to split arrow
record and write into the corresponding file path.
* For the new packed reader API: read paths are explicitly defined by
users.
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-02-21 22:03:54 +08:00
yihao.dai
2a037a97f1
enhance: Add get vector latency metric and refine request limit error message (#40083) 
issue: https://github.com/milvus-io/milvus/issues/40078

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-02-21 19:41:55 +08:00
Chun Han
d6699b5f50
enhance: support return configable properties when describing index(#39951) (#40042) 
related: #39951

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-02-21 19:07:53 +08:00