1226 Commits

Author SHA1 Message Date
Enwei Jiao
802f512161
Etcd config source support TLS (#20874) (#20910)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
cai.zhang
b81cd10dc3
Reduce some logs level which is frequent (#20901)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-30 15:27:16 +08:00
congqixia
3d7b83d4e5
Fix delete operation scope to vchannel (#20866) (#20881)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-30 09:55:16 +08:00
Xiaofan
61baf7dada
Remove some logs from debug to info (#20699)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-29 21:09:15 +08:00
congqixia
711c91eb9a
Add log for transfer segment operation (#20829) (#20847)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:53:15 +08:00
congqixia
ae42fd5a6e
Add collection delta channel in mutex protection (#20736) (#20770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:51:14 +08:00
groot
e1e2323fdd
Fix a regression of local storage (#20631)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-21 10:31:12 +08:00
congqixia
31ee7098b5
Limit concurrency of decoded index file and do force gc (#20624)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 23:55:09 +08:00
congqixia
2880a75dfc
Fix querynode panics when watch/unsub runs concurrently (#20606) (#20619)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 20:03:06 +08:00
jaime
cb294d1441
Add some msgstream metrics (#20601)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-15 19:41:16 +08:00
congqixia
d3dedfc933
Remove not needed RLock for getVersion (#20596) (#20613)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:27:12 +08:00
yah01
a28edf9643
Add version for subscribed channel (#20585) (#20592)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:53:07 +08:00
XuanYang-cn
663d4259d9
Refine query logs (#20559) (#20583)
See also: #20406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 12:25:07 +08:00
xige-16
5cfff621ac
Avoid delete segment which has been loaded (#20530)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-15 11:25:07 +08:00
wgcn
a0b697d3ff
improve search latency (#20472)
Signed-off-by: wgcn <1026688210@qq.com>
2022-11-14 17:05:07 +08:00
xige-16
5e87eced6d
Limit MinDim to build disk index (#20495)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:17:09 +08:00
xige-16
0d5fbe8922
Fix GetDiskUsedSize not work (#20469)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-10 20:37:04 +08:00
congqixia
7f574bff58
Filter segments when doing FromDmlCPLoadDelete (#20388) (#20392)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-08 14:21:03 +08:00
congqixia
9523a778c1
Fix version not deleted if expired by loadSegment (#20361) (#20377)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 19:51:06 +08:00
congqixia
a4b3a53123
Remove KeyLock from querynode task (#20344) (#20349)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 09:45:01 +08:00
Xiaofan
bb4777cf6e
Add GCTuner (#20351)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-05 12:07:00 +08:00
SimFG
deb9963d0e
Delete unused messages for the mq (#20295)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-03 21:41:35 +08:00
yah01
e0506352a4
Fix search failed with nil result (#20304)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 21:15:35 +08:00
zhagnlu
39212bc04c
Fix get cpu num for segcore (#20120) (#20307)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 19:29:36 +08:00
bigsheeper
d528aa3d90
Print seek postion time and seek elapse (#20271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-03 15:03:35 +08:00
zhagnlu
cb2591d1fe
Parallel operations of disk-ann file manager (#20120) (#20122)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 14:39:40 +08:00
jaime
b7ee057d6b
Fix querynode panic during stop (#20242)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-02 14:59:34 +08:00
bigsheeper
29f2ed67a9
Release delta flowgraph if loadSegment failed (#20238)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-01 21:31:35 +08:00
Xiaofan
d17f9de343
revert concurrent segment load (#20244)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-01 20:33:35 +08:00
Xiaofan
ded919a7a3
Refine Concurrent Load (#20220)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-01 19:25:37 +08:00
Xiaofan
99b958e360
Fix BF Concurrency issue (#20211)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-31 19:27:35 +08:00
Xiaofan
2bfecf5b4e
Refine bloomfilter and memory usage (#20168)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-31 17:41:34 +08:00
xige-16
05a966afbe
Delete row num check before load (#20205)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-31 17:17:34 +08:00
jaime
48f5c60070
Refine msgstream close (#20194)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-31 15:13:33 +08:00
Xiaofan
4136009a9a
Support load segments/channels in parallel (#20036)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-31 13:55:33 +08:00
congqixia
19300bd36f
Remove delta vchannel when clean up empty flowgraph (#20182)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-29 18:31:33 +08:00
congqixia
6224b3c44c
Fix lastVersion not expire when there is only loadSegmentsTask (#20156)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-28 13:05:31 +08:00
yah01
404fc68afa
Fix dead locks (#20121)
the collection's lock and meta replica's lock

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-27 20:53:32 +08:00
congqixia
1e590d787f
Release last version after expiration (#20137)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-27 19:15:32 +08:00
bigsheeper
51e50bba73
Use Wlock when release segment (#20092)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-26 18:59:32 +08:00
congqixia
d525cacb8d
Remove empty delta flow graph (#20076)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-26 17:17:31 +08:00
bigsheeper
f0c616050a
Reduce and improve quota center log (#20058)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-25 19:39:30 +08:00
Xiaofan
3d316fc052
Fix Query Log Level (#19995)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 19:29:36 +08:00
XuanYang-cn
0a2436fbe7
Remove meaningless logs (#20051)
Fixes: #20050

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-10-25 17:53:32 +08:00
Xiaofan
1f170ce1ba
Refine kafka consumer (#19846)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 13:23:30 +08:00
congqixia
454ff2f1df
Fix ctx confusion caused goroutine leakage (#20017)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-24 14:31:29 +08:00
smellthemoon
581e1d8c35
Fill MsgBase ALL (#19912)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-21 15:57:28 +08:00
yah01
a4fb3cc3e2
Fix panic while applying deletions (#19956)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-21 14:25:29 +08:00
congqixia
3de74165ac
Fix SyncSegment generate source (#19929)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-20 16:35:28 +08:00
yah01
5dcff9ab72
Fix QueryNode panic when meta changed (#19902)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-20 10:07:30 +08:00