1250 Commits

Author SHA1 Message Date
smellthemoon
8f8f104979
timestamp decided if the pks were the same (#20166) (#21764)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-01-17 18:01:44 +08:00
bigsheeper
a119d4bdf7
Replace session.ServerID with config.NodeID (#21669)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-13 14:21:41 +08:00
liliu-z
e68374b6bf
Skip search GRPC call for standalon (#21630)
Signed-off-by: Li Liu <li.liu@zilliz.com>
2023-01-10 23:07:40 +08:00
bigsheeper
109cda6256
Return insufficient memory error when load failed (#21592)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-01-10 21:25:41 +08:00
MrPresent-Han
27f7708d46
fix flaws found in the process of ideal benchmark(#21504) (#21505)
1. enable paramter autoBalance
2. adjust inappropriate log info when searching in shardcluster

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-01-10 10:25:38 +08:00
SimFG
7b12865c73
Support sync all segments while close (#21576)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: Xiaofan <83447078+xiaofan-luan@users.noreply.github.com>
2023-01-09 16:51:43 +08:00
SimFG
f6eb2926a2
Fix some errors of querynode and query coord (#21565)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-06 16:57:36 +08:00
congqixia
c21cdb5d2c
Setup first tsafe to avoid false maxLag error (#21490) (#21497)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-06 13:19:36 +08:00
SimFG
3d0359f9a5
Support the graceful stop for the query node (#21528)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-05 20:07:36 +08:00
congqixia
fbeec8c487
Add guarantee and serviceable lag too large check (#21441) (#21467)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-05 16:53:36 +08:00
yah01
989ea16a20
limit the frequency of GetMetrics() log (#21514) (#21519)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-04 20:03:35 +08:00
cai.zhang
f93ba3e37c
Use tt msg stream for consume delete msg (#21478)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-04 10:57:34 +08:00
Jiquan Long
9beffd328b
Try using ASAN in ci ut (#21089) (#21448)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-30 14:43:32 +08:00
congqixia
ea89a5d8b2
Fix QueryNode may panics when stopped (#21406) (#21419)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-29 15:49:31 +08:00
Bingyi Sun
642d63c57d
update target (#19296) (#21202)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: wei liu <wei.liu@zilliz.com>
2022-12-16 15:23:25 +08:00
zhenshan.cao
1c309a74ee
Fix metric with wrong label (#21127) (#21174)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-13 11:47:22 +08:00
XuanYang-cn
cc8cc985e6
Refine search logs in querynode (#21136)
- Make sure all logs logging with ctx
- Add an info log for searching on not-indexed segments
- Separate log prefix of shardleader and non-shardleaders

See also: #20975

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-12 15:23:22 +08:00
zhenshan.cao
8d55a2cefa
Add indexCountLabel for metric QueryNodeNumEntities (#21081) (#21121)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-11 01:01:20 +08:00
Jiquan Long
41f7b10abb
Fix empty retrieve result (#21032) (#21066)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-09 16:37:20 +08:00
yah01
2f16432eea
Improve error message when target id not match (#21043) (#21048)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-07 18:27:21 +08:00
Ten Thousand Leaves
35173aa35c
Refine segment stat metrics on QueryNode (#21029)
issue: #20760

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:29:26 +08:00
yah01
d14271f30c
Check target node ID for query/search (#20976)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 15:09:20 +08:00
yah01
90ca7e1e2d
Add time records for search path (#20924) (#20950)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-02 14:51:16 +08:00
liliu-z
b46601fd74
[Cherry Pick]Upgrade knowhere to 1.3.4 (#20943)
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
2022-12-02 00:33:22 +08:00
Enwei Jiao
802f512161
Etcd config source support TLS (#20874) (#20910)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
cai.zhang
b81cd10dc3
Reduce some logs level which is frequent (#20901)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-30 15:27:16 +08:00
congqixia
3d7b83d4e5
Fix delete operation scope to vchannel (#20866) (#20881)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-30 09:55:16 +08:00
Xiaofan
61baf7dada
Remove some logs from debug to info (#20699)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-29 21:09:15 +08:00
congqixia
711c91eb9a
Add log for transfer segment operation (#20829) (#20847)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:53:15 +08:00
congqixia
ae42fd5a6e
Add collection delta channel in mutex protection (#20736) (#20770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 11:51:14 +08:00
groot
e1e2323fdd
Fix a regression of local storage (#20631)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-21 10:31:12 +08:00
congqixia
31ee7098b5
Limit concurrency of decoded index file and do force gc (#20624)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 23:55:09 +08:00
congqixia
2880a75dfc
Fix querynode panics when watch/unsub runs concurrently (#20606) (#20619)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 20:03:06 +08:00
jaime
cb294d1441
Add some msgstream metrics (#20601)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-15 19:41:16 +08:00
congqixia
d3dedfc933
Remove not needed RLock for getVersion (#20596) (#20613)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:27:12 +08:00
yah01
a28edf9643
Add version for subscribed channel (#20585) (#20592)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:53:07 +08:00
XuanYang-cn
663d4259d9
Refine query logs (#20559) (#20583)
See also: #20406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 12:25:07 +08:00
xige-16
5cfff621ac
Avoid delete segment which has been loaded (#20530)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-15 11:25:07 +08:00
wgcn
a0b697d3ff
improve search latency (#20472)
Signed-off-by: wgcn <1026688210@qq.com>
2022-11-14 17:05:07 +08:00
xige-16
5e87eced6d
Limit MinDim to build disk index (#20495)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:17:09 +08:00
xige-16
0d5fbe8922
Fix GetDiskUsedSize not work (#20469)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-10 20:37:04 +08:00
congqixia
7f574bff58
Filter segments when doing FromDmlCPLoadDelete (#20388) (#20392)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-08 14:21:03 +08:00
congqixia
9523a778c1
Fix version not deleted if expired by loadSegment (#20361) (#20377)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 19:51:06 +08:00
congqixia
a4b3a53123
Remove KeyLock from querynode task (#20344) (#20349)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 09:45:01 +08:00
Xiaofan
bb4777cf6e
Add GCTuner (#20351)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-05 12:07:00 +08:00
SimFG
deb9963d0e
Delete unused messages for the mq (#20295)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-03 21:41:35 +08:00
yah01
e0506352a4
Fix search failed with nil result (#20304)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 21:15:35 +08:00
zhagnlu
39212bc04c
Fix get cpu num for segcore (#20120) (#20307)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 19:29:36 +08:00
bigsheeper
d528aa3d90
Print seek postion time and seek elapse (#20271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-03 15:03:35 +08:00
zhagnlu
cb2591d1fe
Parallel operations of disk-ann file manager (#20120) (#20122)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 14:39:40 +08:00