admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
23,273 Commits 137 Branches 188 Tags
Commit Graph

23273 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yihao.dai
1f5f8a4843
fix: Disable block and mutex profiling on arm to prevent SIGSEGV (#41822) 
issue: https://github.com/milvus-io/milvus/issues/41821

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-14 10:56:29 +08:00
foxspy
358bc150df
enhance: add force rebuild index configuration (#41473) 
issue: #41431

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-14 10:52:21 +08:00
congqixia
fb612c765c
enhance: [Restful] Add consistency level for query/get API (#41825) 
Related to #41805

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-14 10:48:21 +08:00
Zhen Ye
21d6d1669e
fix: wal should be reopen if wal append receive the fence error (#41807) 
issue: #41544

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-14 01:02:56 +08:00
Zhen Ye
7beafe99a7
enhance: implement wal garbage collector with truncate api (#41770) 
issue: #41544

- add a truncator implementation into wal recovery storage.
- add metrics for recovery storage.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-13 22:08:56 +08:00
congqixia
8bc9ae9a9e
doc: Update go client golang version requirement (#41815) 
Related to #41749

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-13 19:00:56 +08:00
congqixia
186a01eef4
fix: [AddField] Broadcast update schema even there is no segment (#41780) 
Related to #41744

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-13 16:02:55 +08:00
zhuwenxing
eb1eab8914
test: [skip e2e]fix nightly e2e scripts (#41782) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-05-13 15:20:56 +08:00
zhagnlu
f094d026f8
fix: add params to ignore config type exception (#41776) 
#41707

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-13 13:48:56 +08:00
Zhen Ye
61b6ca5b73
enhance: add in mem shard manager (#41749) 
issue: #41544

- Implement in-memory shard manager to maintain the shard state at write
ahead.
- Remove all rpc and meta operation at write ahead, make the segment
assignment logic only use wal and memory.
- Refactor global stats management, add node-level flush policy.
- Fix the recovery storage inconsistency bug when graceful close.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-13 12:04:56 +08:00
shaoyue
5e8966ec32
enhance: update golang-jwt to v4.5.2 to fix cve (#41734) 
/cc @congqixia

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
 2025-05-13 10:58:56 +08:00
aoiasd
9166c77a72
fix: bulk insert should use function runner's input field list instead schema's (#41560) 
relate: https://github.com/milvus-io/milvus/issues/41213

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2025-05-12 19:14:56 +08:00
congqixia
476984c53e
fix: [AddField] Use latest schema instead of cached one (#41757) 
Related to #41713 #41710

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-12 16:24:56 +08:00
congqixia
1d76afad7c
enhance: Add mutex preventing concurrent plugin.Open (#41761) 
Concurrent calling plugin.Open might cause empty pluginpath issue

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-12 15:44:55 +08:00
groot
1574673a8c
enhance: Alter collection description (#41558) 
issue: https://github.com/milvus-io/milvus/issues/41557

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2025-05-12 14:16:55 +08:00
Zhen Ye
52950ce392
enhance: add pulsar truncate api to protect pulsar unconsumed message (#41724) 
issue: #41465

- implement truncate api for pulsar based on durable subscription.
- truncate api can only be called if wal is read-write.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-11 20:50:55 +08:00
Zhen Ye
e675da76e4
enhance: simplify the proto message, make segment assignment code more clean (#41671) 
issue: #41544

- simplify the proto message for flush and create segment.
- simplify the msg handler for flowgraph.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-11 20:49:00 +08:00
Zhen Ye
452d6fb709
fix: write buffer leak if the wal flusher is cancelled when recovery (#41719) 
issue: #41715

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-10 09:32:56 +08:00
Buqian Zheng
ff5c2770e5
feat: cachinglayer: various improvements (#41546) 
issue: https://github.com/milvus-io/milvus/issues/41435

this PR is based on https://github.com/milvus-io/milvus/pull/41436. 

Improvements include:

- Lazy Load support for Storage v1
- Use Low/High watermark to control eviction
- Caching Layer related config changes
- Removed ChunkCache related configs and code in golang
- Add `PinAllCells` helper method to CacheSlot class
- Modified ValueAt, RawAt, PrimitiveRawAt to Bulk version, to reduce
caching layer overhead
- Removed some unclear templated bulk_subscript methods
- CachedSearchIterator to store PinWrapper when searching on
ChunkedColumn, and removed unused contrustor.

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2025-05-10 09:19:16 +08:00
yanliang567
ee659d50db
test: [E2e Refactor] update search basic tests and add a pk_name instead of hard code (#41669) 
related issue: https://github.com/milvus-io/milvus/issues/40698

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2025-05-09 21:58:54 +08:00
Zhen Ye
d32b802752
fix: remove the max_row_num for segment meta (#41680) 
issue: #41544

- remove the estimate logic, so the create segment operation will not
check the collection meta anymore

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-09 20:46:53 +08:00
cai.zhang
15ffd28643
fix: Set worker totalSlot in standalone mode is half of cluster mode (#41730) 
issue: #41616, #41732

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-05-09 18:30:58 +08:00
sre-ci-robot
3a69fcb26b
[automated] Update gpu Builder image changes (#41740) 
Update gpu Builder image changes
See changes:
3a7b2fef57
Signed-off-by: zhikunyao zhikunyao@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-05-09 18:22:53 +08:00
zhikunyao
3a7b2fef57
enhance: update builder to use dedicated self-hosted runner (#41735) 
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
 2025-05-09 16:52:10 +08:00
congqixia
d791cb0979
enhance: [AddField] Support explicit dynamic output fields (#41717) 
Related to #39718

After support add field with dynamic fields enabled, the masked dynamic
field shall be able to return with `$meta["name"]`

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-09 16:46:54 +08:00
Xianhui Lin
2278e9e03f
fix: set quota center metrics configuration before watch (#41706) 
fix: set quota center metrics configuration before watch
issue: https://github.com/milvus-io/milvus/issues/35177

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-09 14:32:54 +08:00
congqixia
bcf94a0754
fix: Remove noexcept from CacheIndexToDiskInternal (#41725) 
Related to #41219

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-09 14:16:53 +08:00
sre-ci-robot
d09763b73f
[automated] Update cpu Builder image changes (#41712) 
Update cpu Builder image changes
See changes:
f0451d2f3a
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2025-05-09 11:58:53 +08:00
zhagnlu
f674e232b9
fix: GetValueFromConfig return nullopt instead of exception for null value (#41709) 
#41707

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-09 11:18:53 +08:00
Zhen Ye
16d6af85c3
fix: panic when use kafka/pulsar/wp for standalone (#41683) 
issue: #41682

- There's a bug in rocksmq cleanup, #41565 remove the support of nats.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-09 11:16:54 +08:00
Zhen Ye
3dd9a1147b
enhance: add lock interceptor and recoverable txn manager (#41640) 
issue: #41544

- add a lock interceptor at vchannel granularity.
- make txn manager recoverable and add FailTxnAtVChannel operation.

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-09 11:14:53 +08:00
Zhen Ye
44c0799331
fix: ignore operation when node or cluster not match (#41718) 
issue: #41715

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-09 10:48:53 +08:00
Xianhui Lin
26cbc74478
fix: support infix and suffix match types in JsonStats (#41720) 
fix: support infix and suffix match types in JsonStats
issue:https://github.com/milvus-io/milvus/issues/41386

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-09 10:42:53 +08:00
zhagnlu
e3c81ba1cc
enhance: use scan mode for like although inverted index exists (#41325) 
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-09 10:36:54 +08:00
ThreadDao
caaf9b1ea4
test: fix property case and remove load default replicaNum value (#41674) 
issue: #41673

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2025-05-09 10:14:54 +08:00
SimFG
dfd2548c1b
enhance: support more ddl apis to replicate according to cdc (#41678) 
- issue: #41677

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2025-05-08 20:02:58 +08:00
junjiejiangjjj
f337d2989b
enhance : New decay function (#41634) 
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
 2025-05-08 17:24:54 +08:00
shaoyue
f0451d2f3a
enhance: update go version to fix cve (#41696) 
/cc @congqixia @czs007

Signed-off-by: haorenfsa <haorenfsa@gmail.com>
 2025-05-08 16:04:54 +08:00
Zhen Ye
7dca7ef4d0
fix: empty growing segment cannot be recovered by streamingnode (#41666) 
issue: #41665

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-08 14:50:53 +08:00
zhagnlu
39e7ad33d7
enhance: add optimize for like expr (#41066) 
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2025-05-08 14:28:52 +08:00
foxspy
e2ddbe4962
feat: add cachinglayer to index (#41653) 
issue: #41435

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2025-05-08 10:12:54 +08:00
nico
5c11c4add1
enhance: update pymilvus version (#41695) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2025-05-08 10:04:54 +08:00
congqixia
b1f3fe1f07
fix: Use sum of num_rows instead of last one (#41685) 
Related to #41656

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-07 19:40:53 +08:00
Divya
3e67024d94
fix: Security Fixes for RESTful APIs (#41136) 
Fix for Issue :- #41128

---------

Signed-off-by: Divya <divyaruhil999@gmail.com>
 2025-05-07 18:08:54 +08:00
Zhen Ye
00cf93c043
fix: tombstone channel cp should be set as a metric (#41687) 
issue: #41686

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-07 15:34:53 +08:00
Zhen Ye
05eb17aebc
fix: wrong error handling when call importv2 (#41664) 
issue: #41654

Signed-off-by: chyezh <chyezh@outlook.com>
 2025-05-07 15:18:52 +08:00
Bingyi Sun
0dee3ccfd7
enhance: Make user specified doc id selectable for tantivy index writer (#41528) 
issue: https://github.com/milvus-io/milvus/issues/41527

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2025-05-07 10:48:53 +08:00
congqixia
18625d7d20
enhance: [AddField] Remove restriction that cannot add field dynamic field enabled (#41642) 
Related to #39718

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2025-05-07 09:58:52 +08:00
Xianhui Lin
3124d6f599
feat: add string ts type in describecollection (#41612) 
feat: add string  ts type in describecollection
issue:https://github.com/milvus-io/milvus/issues/39093

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2025-05-06 14:28:52 +08:00
zhuwenxing
1e65e3232f
test: add csv import testcase and adjust import testcase tag (#41638) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2025-05-06 11:52:53 +08:00