admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 03:13:22 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,537 Commits 137 Branches 188 Tags
Commit Graph

9258 Commits

Author SHA1 Message Date
congqixia
3491608256
fix: Match int8_t and int16_t in Array::get_data (#35579) 
Related to #35578

Previously int16/int8 bitmap index may read int32 array as int16, which
may cause build index with half of the data(if array is full) and half
zeros. This causes BITMAP index lost information.

This PR matches int8_t & int16_t while `get_data` when building index.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-20 16:10:56 +08:00
wei liu
e09dc3be58
enhance: Mark query node as read only after suspend (#35492) 
issue: #34985 #35493
after querynode has been suspended, it's not allow to load
segment/channel on it, which means the node is read only. to be
compatible with resource group design, after query node has been
suspend, we remove it from it's original resource group, make it a read
only query node in replica. then two things will happens:
1. it's original resource group will be lacking of query nodes, query
coord will assign new node to it.
2. querycoord will try to move out all segments/channels after querynode
has been suspended

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-20 14:02:54 +08:00
nish112022
3948bd4e79
fix: Added check for validating varchar,array max length (#35499) 
issue : https://github.com/milvus-io/milvus/issues/34150

This is for numpy,parquet,json readers.

---------

Signed-off-by: Nischay Yadav <nischay.yadav@ibm.com>
 2024-08-20 11:42:55 +08:00
wei liu
22ced010cd
enhance: make configure load param feature be compatible with old sdk (#35520) 
issue: #31570 #35521

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-20 10:30:55 +08:00
Zhen Ye
4d69898cb2
enhance: support single pchannel level transaction (#35289) 
issue: #33285

- support transaction on single wal.
- last confirmed message id can still be used when enable transaction.
- add fence operation for segment allocation interceptor.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-19 21:22:56 +08:00
yihao.dai
227ecd3901
enhance: Remove the check for channel cp lag when generating compaction plan (#35383) 
issue: https://github.com/milvus-io/milvus/issues/35382

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-19 19:40:55 +08:00
Chun Han
337e065902
fix: querynode hang when failing to allocate disk space for mmap(#35184) (#35187) 
related: #35184

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-08-19 15:30:55 +08:00
wei liu
14ef88f423
fix: Fix proxy panic after Import related api failed (#35540) 
issue: #35539

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-19 15:22:55 +08:00
XuanYang-cn
967f38672a
enhance: Add integration tests for l0 (#35429) 
See also: #34796

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-19 10:56:54 +08:00
smellthemoon
80dbe87759
enhance: support null value in index (#35238) 
#31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-08-16 15:30:54 +08:00
congqixia
f87af9bc54
enhance: Exclude L0 segment from readable snapshot (#35507) 
L0 segments now do not contain insert data and may cause confusion for
query hook optimizer if counted as sealed segment number.

This PR add segment level flag in segment entry and exclude L0 segments
while get readable segment snaphsot

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-16 15:28:53 +08:00
CharlesFeng
5e9097c2dd
fix: err degenerated to a new variable (#35413) 
https://github.com/milvus-io/milvus/issues/35412

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-16 14:24:54 +08:00
wei liu
a570567644
enhance: Enable ReadOnly/ReadWrite/Admin Privilege Group to simplify RBAC grant progress (#35472) 
issue: #35471

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-16 14:18:54 +08:00
Buqian Zheng
f4a91e135b
enhance: Allow empty sparse row (#34700) 
issue: #29419

* If a sparse vector with 0 non-zero value is inserted, no ANN search on
this sparse vector field will return it as a result. User may retrieve
this row via scalar query or ANN search on another vector field though.
* If the user uses an empty sparse vector as the query vector for a ANN
search, no neighbor will be returned.

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-08-16 14:14:54 +08:00
wei liu
1d49358f82
enhance: Add BackupRBAC/RestoreRBAC API to enable rbac backup (#35444) 
issue: #35443

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-16 10:10:53 +08:00
Alexander Guzhva
b896143965
enhance: Improve bitset performance for AVX512 (#35479) 
see #35478

optimized functions take 20%+ less time to run

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
 2024-08-16 07:44:53 +08:00
cai.zhang
1bbf7a3c0e
enhance: Optimize the use of locks and avoid double flush clustering buffer writer (#35486) 
issue: #35436

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-08-16 02:24:58 +08:00
congqixia
fe20366b5c
enhance: Remove duplicated schema helper creation in proxy (#35489) 
Related to PRs of #35415

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-15 19:18:53 +08:00
wei liu
c0200eec39
enhance: limit getSegmentInfo batch size to avoid excced grpc message limit (#35394) 
issue: #35395

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-15 19:17:00 +08:00
wei liu
f6aaf3fef2
fix: force update next target if target can't be loaded (#35365) 
issue: #35361

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-15 19:15:00 +08:00
CharlesFeng
b4b1ed6910
fix: before exiting, make sure the goroutine has exited (#35411) 
https://github.com/milvus-io/milvus/issues/35409

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-15 18:16:53 +08:00
Abdullah Ahmed
d20d6ea551
fix: Functional-notation casting vulnerability fix (#35252) 
Fix for issue: https://github.com/milvus-io/milvus/issues/35200
 2024-08-15 16:20:53 +08:00
SimFG
b2cc4b0776
feat: add the rbac msg and send them to the replicate channel (#35392) 
- issue: #35391

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-15 12:06:52 +08:00
sre-ci-robot
b1ea645390
[automated] Update Knowhere Commit (#35474) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-15 01:14:53 +08:00
congqixia
f99a761d87
enhance: Support dynamic field in SchemaHelper (#35461) 
Related to #35415

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-14 18:04:59 +08:00
SimFG
0400eb91c1
enhance: remove the invalid log (#35465) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-14 18:00:53 +08:00
chyezh
0868a978d1
fix: streaming service stat manager crash when pv stat is empty (#35439) 
issue: #33285

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-14 12:04:52 +08:00
CharlesFeng
36d59867f3
fix: err cannot be captured in defer in data_sync_service (#35448) 
https://github.com/milvus-io/milvus/issues/35447

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-14 10:26:52 +08:00
XuanYang-cn
c42976ee6f
enhance: Init ChannelCP when creating a channel (#35387) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-14 10:16:58 +08:00
CharlesFeng
a690e6e004
fix: panic in timetick_sender (#35451) 
https://github.com/milvus-io/milvus/issues/35450

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-14 10:10:53 +08:00
CharlesFeng
f5b4a972a0
fix: checkResultTicker leak (#35377) 
https://github.com/milvus-io/milvus/issues/35376

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-13 21:36:52 +08:00
jaime
1b0ea49d25
fix: incorrect memory size and delta count in SegmentInfo (#35369) 
issue: #35368

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-08-13 17:20:19 +08:00
cai.zhang
196b343a94
fix: Fix data race for clustering compaction (#35435) 
issue: #35436

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-08-13 17:10:20 +08:00
yihao.dai
e58d656e65
fix: Fix compile error (#35442) 
issue: https://github.com/milvus-io/milvus/issues/33285

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-13 15:46:19 +08:00
yihao.dai
efadf22802
enhance: Append create partition msg to wal (#35398) 
issue: https://github.com/milvus-io/milvus/issues/33285

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-13 14:28:20 +08:00
chyezh
16b0aee97f
enhance: timetick interceptor optimization (#35287) 
issue: #33285

- remove redundant goroutine by using insepctor.
- remove the coutinous non-message timetick persistence
- periodically push the time tick forward without persistent timetick
message.
- add 'message type filter' deliver filter.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-12 18:58:25 +08:00
XuanYang-cn
06f9ba294e
enhance: Add more ut for l0CompactionTask (#35100) 
See also: #34796

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-09 14:24:18 +08:00
Patrick Weizhi Xu
e1d725b938
fix: rollback grpc to 1.50.1 (#35385) 
issue: #35298

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-08-09 14:08:17 +08:00
XuanYang-cn
61a426bc6f
enhance: Init channel cp metric when DataCoord recover (#35353) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-09 10:08:18 +08:00
congqixia
c0ee25afd8
fix: Use k locations only for basic BF test location (#35380) 
Related to #35379

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-09 07:52:22 +08:00
congqixia
143502e708
enhance: Fix progress always zero due to integer divide (#35374) 
See also #35183

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-08 22:26:16 +08:00
cai.zhang
aaab827a16
fix: Fix the issue of missing stats log after clustering compaction (#35266) 
issue: #35265

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-08-08 14:24:17 +08:00
zhagnlu
626b1b2f5e
fix:redefine hybrid internal index type (#35314) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-08-08 10:32:16 +08:00
yellow-shine
7420115b5e
enhance: pinpoint revision of 3thirdparty package (#35325) 
issue: https://github.com/milvus-io/milvus/issues/35340

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-08 09:46:22 +08:00
Bingyi Sun
ae1b81ac1a
fix: fix panic when generating plans (#35309) 
issue: https://github.com/milvus-io/milvus/issues/35335

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-08-07 18:14:16 +08:00
yihao.dai
72a175478f
enhance: Append drop partition msg to wal (#35326) 
issue: https://github.com/milvus-io/milvus/issues/33285

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-07 17:28:16 +08:00
wei liu
838f06323f
fix: datacoord binlog size metrics include dropped segment (#35338) 
issue: #35337

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-07 16:24:16 +08:00
wayblink
c6253f9c9b
enhance: improve ut cov of clustering compaction task (#35242) 
#34792

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-08-07 14:44:21 +08:00
wayblink
bb15ecdc13
enhance: improve ut for compaction_policy_clustering (#35205) 
#34792

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-08-07 14:42:17 +08:00
Patrick Weizhi Xu
1d5bf34e38
fix: init telemetry fails when set otlp as trace exporter (#35301) 
issue: #35298

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-08-07 14:20:21 +08:00