admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-04 01:42:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
22,046 Commits 138 Branches 188 Tags
Commit Graph

22046 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
nico
8e5bae2f2d
test: update sdk version and test cases (#40859) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-03-26 10:50:28 +08:00
zhuwenxing
a090b2ca14
test: remove xfail of test_alter_database_properties (#40913) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-26 10:46:31 +08:00
congqixia
84e8e141ea
enhance: Support detailed manual compaction criterion (#40892) 
Related to #40866

This PR:
- update go-api/v2 and support partition id/channel/segment level manual
compaction
- refines the compaction trigger implementation
- unify the compaction signal usage

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-25 20:06:22 +08:00
yihao.dai
f65e6b7c6e
enhance: Optimize datacoord meta mutex (#40552) 
Use a separate collection mutex.

issue: https://github.com/milvus-io/milvus/issues/40551

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-25 13:46:25 +08:00
zhagnlu
7fdb2e144f
enhance:change multi or expr to in expr (#40757) 
#40752

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-25 11:06:18 +08:00
wt
5203c857b1
test: test mix scenes support batch insertion (#40872) 
issues: https://github.com/milvus-io/milvus/issues/40868

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2025-03-25 10:52:29 +08:00
zhuwenxing
7aee6f822e
test: using pytest_tagging to replace pytest_tags (#40878) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-25 10:48:19 +08:00
Chun Han
eee68e9139
fix: mmap properties failed to apply when creating collection(#40511) (#40512) 
related: #40511

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2025-03-25 10:08:19 +08:00
junjiejiangjjj
fe81c7baae
feat: Add function config (#40534) 
#35856 
1. Add function-related configuration in milvus.yaml
2. Add null and empty value check to TextEmbeddingFunction

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-03-25 10:06:24 +08:00
SimFG
16efcda5c4
feat: support to deny dll according to database property (#40764) 
- issue: #40762

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-23 11:18:28 +08:00
congqixia
1953676ee0
fix: Set task queue time before enqueue (#40815) 
Related to #40814

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 19:36:15 +08:00
Ted Xu
688505ab1c
enhance: cleanup lint check exclusions (#40829) 
See: #40828

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2025-03-21 18:12:14 +08:00
jaime
901308df1e
fix:etcd advertise-client-urls in docker-compose (#40804) 
issue #40696

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2025-03-21 15:52:12 +08:00
Bingyi Sun
ecea17c576
enhance: Set field name as json path if not specified (#40419) 
issue: #35528

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-21 11:26:13 +08:00
cai.zhang
a41cb942f6
fix: Do not delete the centroids file when sampling fails instead wait GC (#40701) 
issue: #40700

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-21 10:32:12 +08:00
congqixia
9824615efb
enhance: Close component in topological order when unsub channel (#40796) 
Related to #40795

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-21 10:22:11 +08:00
sthuang
d7df78a6c9
feat: Storage v2 compaction (#40667) 
- Feat: Support Mix compaction. Covering tests include compatibility and
rollback ability.
  - Read v1 segments and compact with v2 format.
  - Read both v1 and v2 segments and compact with v2 format.
  - Read v2 segments and compact with v2 format.
  - Compact with duplicate primary key test.
  - Compact with bm25 segments.
  - Compact with merge sort segments.
  - Compact with no expiration segments.
  - Compact with lack binlog segments.
  - Compact with nullable field segments.
- Feat: Support Clustering compaction. Covering tests include
compatibility and rollback ability.
  - Read v1 segments and compact with v2 format.
  - Read both v1 and v2 segments and compact with v2 format.
  - Read v2 segments and compact with v2 format.
  - Compact bm25 segments with v2 format.
  - Compact with memory limit.
- Enhance: Use serdeMap serialize in BuildRecord function to support all
Milvus data types.
related: #39173

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2025-03-21 10:16:12 +08:00
yihao.dai
8eb537fdd0
fix: Fix messages loss during seek (#40735) 
issue: https://github.com/milvus-io/milvus/issues/40733

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-03-20 20:18:11 +08:00
congqixia
77515310b9
enhance: Resolve existing lint issues (#40797) 
This PR
- Format import issues in datacoord & datanode
- Fix JSONPathIndex naming issue

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-20 19:36:11 +08:00
congqixia
e23f429299
fix: Check whether index type support mmap even param enabled (#40614) 
Related to #40537

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-20 15:52:13 +08:00
Zhen Ye
4dc7c11bbe
fix: remove dead code at broadcaster (#40788) 
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-20 14:20:59 +08:00
congqixia
fd45e8bf93
enhance: [GoSDK] Support JSON Path index (#40754) 
Related to #35528

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-20 14:18:13 +08:00
ThreadDao
24745b37b1
test: fix case code checker (#40787) 
issue: #33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-03-20 14:14:20 +08:00
zhuwenxing
6889b0470e
test: add text embedding function test (#40668) 
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-20 11:44:12 +08:00
congqixia
096f58f314
enhance: Add an extra parameter for slow log (#40758) 
Related to #40756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-20 00:34:13 +08:00
ThreadDao
47f23e5a55
test: add more json expr cases (#40775) 
issue: https://github.com/milvus-io/milvus/issues/33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-03-19 19:58:11 +08:00
sre-ci-robot
6ecbf88503
[automated] Bump milvus version to v2.5.7 (#40768) 
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-19 18:02:18 +08:00
sre-ci-robot
5c8d13632e
[automated] Bump milvus version to v2.5.7 (#40766) 
Bump milvus version to v2.5.7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-03-19 18:00:24 +08:00
Bingyi Sun
5a6b4e56d5
fix: Fix tasks will panic if one of them throw an exception. (#40691) 
issue: https://github.com/milvus-io/milvus/issues/40690

the variable rcm will be dangling if a future throws an exception and
return.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-03-19 16:52:09 +08:00
aoiasd
92bdf7a0c1
enhance: support run anayser return detaild token (#40458) 
relate: https://github.com/milvus-io/milvus/issues/39705

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-19 15:48:15 +08:00
zhagnlu
6c55db44f1
enhance: reorder sub expr for conjunct expr (#39872) 
two point:
 (1) reoder conjucts expr's subexpr, postpone heavy operations
sequence: int(column) -> index(column) -> string(column) -> light
conjuct
...... -> json(column) -> heavy conjuct -> two_column_compare
(2) support pre filter for expr execute, skip scan raw data that had
been skipped
     because of preceding expr result.

#39869

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-19 14:50:14 +08:00
Zhen Ye
8db708f67d
enhance: enable memory prof based on jemalloc (#40731) 
issue: #40730

also see: https://github.com/milvus-io/cgosymbolizer/pull/2

After these PR, at linux:

- the milvus will always enable jemalloc by default.
- jemalloc will always compiled with --enable-prof options.
- all image will always enable the jemalloc prof by default.
- a pprof http service for jemalloc at `/debug/jemalloc/` will be
registered into restful.
- `jeprof` can remote profile the memory of milvus.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-19 14:46:18 +08:00
yanliang567
cf223bae7b
test: Split test_search and refactor on test class to share collections (#40677) 
issue: #40698

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-03-19 14:20:15 +08:00
Zhen Ye
b119ac5d30
enhance: add wal access mode options (#40617) 
issue: #40532

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-03-19 14:02:11 +08:00
Buqian Zheng
03b63bf982
fix: use NewInsertDataWithFunctionOutputField when importing binlog file (#40741) 
issue: https://github.com/milvus-io/milvus/issues/40740

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-19 10:50:14 +08:00
aoiasd
e5c12421f7
enhance: remain raw token for audit log (#40637) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-18 18:02:20 +08:00
Buqian Zheng
c12abf4e2a
enhance: improve sparse query nnz metric (#40713) 
add query type and field id label; add metric for hybrid search

issue: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-03-18 17:20:16 +08:00
congqixia
4ca1a7a76d
fix: Protect getSegmentIndexes with rlock (#40719) 
Related to #40718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-18 16:40:14 +08:00
XuanYang-cn
015a8f7631
fix: L0 brings its own start pos when syncing (#40663) 
See also: #40388, #40207

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2025-03-18 15:56:16 +08:00
zhikunyao
4f93694404
enhance: mergify to check correct ut code (#40723) 
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
 2025-03-18 15:46:25 +08:00
zhuwenxing
69fc9aa271
test: add empty sparse in import test (#40682) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-03-18 15:16:12 +08:00
Ted Xu
be86d31ea3
feat: compaction to support add field (#40415) 
See: #39718

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2025-03-18 11:32:12 +08:00
congqixia
f4f81b7d0c
enhance: [skip e2e][mergify rule] Resolve go tests rule conflict (#40697) 
This PR:
- Add macro for only go test file changed
- Resolve conflict for only go test file changed and remove ci-passed
rule

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-17 19:28:11 +08:00
aoiasd
f943a8c78b
enhance: accesslog support fetch hybrid search expr and field (#40167) 
relate: https://github.com/milvus-io/milvus/issues/40166

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-03-17 18:08:10 +08:00
Ted Xu
d903b943c6
enhance: improve documentation on large page size support (#40695) 
See: #30843

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2025-03-17 17:14:13 +08:00
congqixia
94a859c028
enhance: Add buffer forwarder for stream delta loading (#40559) 
See also #40558
Related to #35303 & #38066 as well

This PR:
- Add `BufferedForward` to limit memory usage forwarding stream delete
- Add `UseLoad` flag to determine `Delete` shall use `segment.Delete` or
`segment.LoadDelta`
- Fix delegator accidentally use always true candidate while load
streaming delta

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-17 15:24:10 +08:00
congqixia
b3edb76516
enhance: [skip e2e][GoSDK] Add client example for common usage (#40643) 
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-03-17 14:16:10 +08:00
zhagnlu
7ebe3d7038
enhance: refine chunk access logic and add some comment on data (#40618) 
#40367

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-03-16 22:20:08 +08:00
cai.zhang
123b6588b6
feat: Support get segment binlogs info with new interface GetSegmentsInfo (#40464) 
issue: #40341

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-03-16 21:04:07 +08:00
SimFG
5a87eb40ee
enhance: add GetService method to retrieve MilvusServiceClient (#40658) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-03-14 18:44:10 +08:00