16100 Commits

Author SHA1 Message Date
Ten Thousand Leaves
6dee58685e
Increase MaxWatchDuration and make it configurable (#21010)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:19:19 +08:00
Ten Thousand Leaves
3e62688eb6
Split small segment proportion and small segment compactable proportion (#21012)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:15:19 +08:00
Xiaofan
b8be79fe27
Limit the rpc to 64M (#20844)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-07 10:09:19 +08:00
XuanYang-cn
7ea86ed3a3
Add ut for rootcoord/kv/kv_catalog.go (#20909) (#20974)
Add ut for CreateCredential, GetCredential, Dropcredential,
ListCredentials, CreateRole, DropRole AlterUserRole, ListRole,
ListUser, ListUserRole, DeleteGrant, AlterGrant, ListGrant, and, ListPolicy

Fixes: #20833

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-05 15:39:22 +08:00
congqixia
0769e00e70
Fix BufferData limit calculation for BinaryVector (#20963) (#20971)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-05 15:31:19 +08:00
yah01
d14271f30c
Check target node ID for query/search (#20976)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 15:09:20 +08:00
yah01
90ca7e1e2d
Add time records for search path (#20924) (#20950)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-02 14:51:16 +08:00
Jiquan Long
5bf76a8fef
Refine log level (#20896) (#20902)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-02 10:11:16 +08:00
sre-ci-robot
11e37c176e
Update Pytest image changes (#20939)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-12-02 08:57:16 +08:00
binbin
735f853e65
Update test cases (#20940)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-12-02 08:55:17 +08:00
liliu-z
b46601fd74
[Cherry Pick]Upgrade knowhere to 1.3.4 (#20943)
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
2022-12-02 00:33:22 +08:00
congqixia
8ed33d0b66
Generate unique id with ts for sync task (#20928) (#20942)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-01 23:19:16 +08:00
congqixia
fd1a67ef64
Fix compaction target segment rowNum is always 0 (#20937) (#20941)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-01 22:11:17 +08:00
jingkl
a3e181898f
[test]add the scalar field testcase (#20930)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-12-01 20:15:16 +08:00
binbin
5cd33cb5cb
Update pymilvus version (#20814)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-12-01 20:13:19 +08:00
yah01
b4115c65ff
Optimize scheduler, increase merge tasks probability (#20922) (#20931)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-01 17:33:16 +08:00
xige-16
42172a4b33
Delete logs that print sensitive information (#20890)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-12-01 16:37:18 +08:00
cai.zhang
8435b8b4e3
GetFlushedSegments should include flushing segment (#20834)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-01 16:35:20 +08:00
congqixia
2a655c32b9
Setup lastSyncTs when add segment to avoid sync next timetick (#20920) (#20923)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-01 14:57:16 +08:00
Enwei Jiao
802f512161
Etcd config source support TLS (#20874) (#20910)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
yah01
c5f215da67
Refactor task scheduler and executor (#20828) (#20900)
Make the performance able to scale out

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 16:37:17 +08:00
Cai Yudong
225ced2183
Add param check for BruteForceSearch in segcore (#20903)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-11-30 16:15:15 +08:00
yah01
7d426ca744
Refine TimeRecorder output (#20897) (#20899)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 15:35:16 +08:00
cai.zhang
b81cd10dc3
Reduce some logs level which is frequent (#20901)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-30 15:27:16 +08:00
Jiquan Long
2bc5b61f62
Fix metric ProxyApplyPrimaryKeyLatency (#20499)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-30 14:21:16 +08:00
congqixia
3d7b83d4e5
Fix delete operation scope to vchannel (#20866) (#20881)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-30 09:55:16 +08:00
Xiaofan
61baf7dada
Remove some logs from debug to info (#20699)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-29 21:09:15 +08:00
NicoYuan1986
e2dd7a41ad
Modify test cases by making create index after insert (#20778)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-11-29 20:09:14 +08:00
yah01
8c353bf099
Fix asserting PK slice equal fails due to the same distances (#20858) (#20887)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-29 19:01:17 +08:00
yah01
84f88dd16c
Fix IndexNode panic while failed to create index (#20861) (#20883)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-29 16:53:15 +08:00
Jiquan Long
770918eaff
Fix term filtering failed on indexed scalar field (#20840)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-29 15:25:15 +08:00
congqixia
5c81fca3d1
Fix LRU cache may panic on double close (#20854) (#20872)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 14:15:14 +08:00
congqixia
711c91eb9a
Add log for transfer segment operation (#20829) (#20847)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:53:15 +08:00
congqixia
ae42fd5a6e
Add collection delta channel in mutex protection (#20736) (#20770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:51:14 +08:00
yah01
dd10e571cf
Avoid allocating and coping when fill column with default values (#20721) (#20788)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-26 18:59:13 +08:00
wei liu
5e63b84ff1
support pulsar tenant and auth (#19727) (#20762)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-25 17:11:12 +08:00
yah01
f19740fdac
Check whether CodecIndex is nil to avoid panic (#20816) (#20826)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-25 14:55:12 +08:00
shaoyue
0c49a1fe87
[restapi] Fix insert request lost precision for int64 fields (#20827)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-11-25 13:57:12 +08:00
XuanYang-cn
f85c7eb02e
Remove mockTestKv in metatable test (#20690)
See also: #19289

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-25 11:09:13 +08:00
jingkl
d2d72c1642
[test]modify the diskann testcase (#20782)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-11-24 16:55:14 +08:00
SimFG
925fa9d41d
Make sure that the segment path matches the segment id (#20696)
Signed-off-by: SimFG <bang.fu@zilliz.com>
(cherry picked from commit 764f17890072d206831ac40c12d6f51830251c90)
2022-11-24 10:51:12 +08:00
Bennu
a69425c2b8
[skip e2e] Delete windows code-checker (#20783) (#20785)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-11-23 16:49:12 +08:00
jingkl
2966710b9f
[test]modify the diskann testcase (#20728)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-11-23 09:53:21 +08:00
XuanYang-cn
89bdb34c98
Enable to gen compaction plan for stale segments (#20742)
See also: #20502

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-22 17:33:16 +08:00
yah01
004b443288
Change LRU to a generic type (#20744) (#20759)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-22 16:13:11 +08:00
congqixia
5594d754f1
Use embed etcd for allocator ut (#20749) (#20754)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-22 11:53:11 +08:00
Jenny Li
15c096b3b2
Make docker base separate from milvus image (#20473) (#20737)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-22 10:11:11 +08:00
smellthemoon
64e9cb3061
Only balance segement in targets (#20709) (#20750)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-22 09:49:11 +08:00
wei liu
efa1cf7f23
fix mannual balance with empty segment list (#20739)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-21 19:31:12 +08:00
Jenny Li
94407a9d2a
Show milvus config after install milvus (#20712) (#20722)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-21 14:31:11 +08:00