1265 Commits

Author SHA1 Message Date
xige-16
faf62cfa55
Fix metric of querynode's channel num (#22252)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-20 19:08:26 +08:00
yah01
787322f50c
Improve search task merge policy (#22006) (#22287)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-20 13:56:26 +08:00
congqixia
bc531b9e7a
Fix offline calculation not correct (#22225)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-20 10:08:26 +08:00
cai.zhang
dd63c71bd0
Fix ut about disconnect etcd (#22238)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-16 23:50:37 +08:00
congqixia
f63a00af6f
Fix concurrent segment alloc changes caused LeaderView error (#22154)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-15 14:08:34 +08:00
xige-16
590498d531
Fix metrics not registered (#22098)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 21:18:32 +08:00
xige-16
50739e6c6a
Add more metrics (#21975)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
wei liu
2e4d64eca5
fix search failed msg (#22071)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-08 21:02:34 +08:00
congqixia
8ed2784212
Remove redundant optimization code (#22044) (#22053)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-08 19:02:32 +08:00
congqixia
5c5c755643
Add Rated group for checkpoint gc skip case (#21949) (#21956)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-06 16:01:54 +08:00
Ten Thousand Leaves
f7645d28b6
Guard bad distance/score from knowhere (#21198)
/kind bug

issue: #21138

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-03 17:29:54 +08:00
yah01
ebf7455e54
Fix lag behind error with 0 servicetime (#21637) (#21899)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-01 14:25:51 +08:00
Bingyi Sun
02cfcbbd2f
Add unsubscribe dmchannel task (#21513) (#21794)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-01-31 14:23:50 +08:00
yah01
cd664adb50
Fix fill the string field twice when string index exists (#21852) (#21865)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-30 14:05:54 +08:00
Xiaofan
375b2b355d
Fix Memory calculation (#21798)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-28 11:09:51 +08:00
smellthemoon
8f8f104979
timestamp decided if the pks were the same (#20166) (#21764)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-01-17 18:01:44 +08:00
bigsheeper
a119d4bdf7
Replace session.ServerID with config.NodeID (#21669)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-13 14:21:41 +08:00
liliu-z
e68374b6bf
Skip search GRPC call for standalon (#21630)
Signed-off-by: Li Liu <li.liu@zilliz.com>
2023-01-10 23:07:40 +08:00
bigsheeper
109cda6256
Return insufficient memory error when load failed (#21592)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-10 21:25:41 +08:00
MrPresent-Han
27f7708d46
fix flaws found in the process of ideal benchmark(#21504) (#21505)
1. enable paramter autoBalance
2. adjust inappropriate log info when searching in shardcluster

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-01-10 10:25:38 +08:00
SimFG
7b12865c73
Support sync all segments while close (#21576)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: Xiaofan <83447078+xiaofan-luan@users.noreply.github.com>
2023-01-09 16:51:43 +08:00
SimFG
f6eb2926a2
Fix some errors of querynode and query coord (#21565)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-06 16:57:36 +08:00
congqixia
c21cdb5d2c
Setup first tsafe to avoid false maxLag error (#21490) (#21497)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-06 13:19:36 +08:00
SimFG
3d0359f9a5
Support the graceful stop for the query node (#21528)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-05 20:07:36 +08:00
congqixia
fbeec8c487
Add guarantee and serviceable lag too large check (#21441) (#21467)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-05 16:53:36 +08:00
yah01
989ea16a20
limit the frequency of GetMetrics() log (#21514) (#21519)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-04 20:03:35 +08:00
cai.zhang
f93ba3e37c
Use tt msg stream for consume delete msg (#21478)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-04 10:57:34 +08:00
Jiquan Long
9beffd328b
Try using ASAN in ci ut (#21089) (#21448)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-30 14:43:32 +08:00
congqixia
ea89a5d8b2
Fix QueryNode may panics when stopped (#21406) (#21419)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-29 15:49:31 +08:00
Bingyi Sun
642d63c57d
update target (#19296) (#21202)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: wei liu <wei.liu@zilliz.com>
2022-12-16 15:23:25 +08:00
zhenshan.cao
1c309a74ee
Fix metric with wrong label (#21127) (#21174)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-13 11:47:22 +08:00
XuanYang-cn
cc8cc985e6
Refine search logs in querynode (#21136)
- Make sure all logs logging with ctx
- Add an info log for searching on not-indexed segments
- Separate log prefix of shardleader and non-shardleaders

See also: #20975

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-12 15:23:22 +08:00
zhenshan.cao
8d55a2cefa
Add indexCountLabel for metric QueryNodeNumEntities (#21081) (#21121)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-11 01:01:20 +08:00
Jiquan Long
41f7b10abb
Fix empty retrieve result (#21032) (#21066)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-09 16:37:20 +08:00
yah01
2f16432eea
Improve error message when target id not match (#21043) (#21048)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-07 18:27:21 +08:00
Ten Thousand Leaves
35173aa35c
Refine segment stat metrics on QueryNode (#21029)
issue: #20760

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:29:26 +08:00
yah01
d14271f30c
Check target node ID for query/search (#20976)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 15:09:20 +08:00
yah01
90ca7e1e2d
Add time records for search path (#20924) (#20950)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-02 14:51:16 +08:00
liliu-z
b46601fd74
[Cherry Pick]Upgrade knowhere to 1.3.4 (#20943)
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
2022-12-02 00:33:22 +08:00
Enwei Jiao
802f512161
Etcd config source support TLS (#20874) (#20910)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
cai.zhang
b81cd10dc3
Reduce some logs level which is frequent (#20901)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-30 15:27:16 +08:00
congqixia
3d7b83d4e5
Fix delete operation scope to vchannel (#20866) (#20881)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-30 09:55:16 +08:00
Xiaofan
61baf7dada
Remove some logs from debug to info (#20699)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-29 21:09:15 +08:00
congqixia
711c91eb9a
Add log for transfer segment operation (#20829) (#20847)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:53:15 +08:00
congqixia
ae42fd5a6e
Add collection delta channel in mutex protection (#20736) (#20770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:51:14 +08:00
groot
e1e2323fdd
Fix a regression of local storage (#20631)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-21 10:31:12 +08:00
congqixia
31ee7098b5
Limit concurrency of decoded index file and do force gc (#20624)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 23:55:09 +08:00
congqixia
2880a75dfc
Fix querynode panics when watch/unsub runs concurrently (#20606) (#20619)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 20:03:06 +08:00
jaime
cb294d1441
Add some msgstream metrics (#20601)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-15 19:41:16 +08:00
congqixia
d3dedfc933
Remove not needed RLock for getVersion (#20596) (#20613)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:27:12 +08:00