congqixia
94f0951f0d
Fix query lock logic in query shard ( #17034 )
...
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock
This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-16 18:23:55 +08:00
Xiaofan
92b6293be4
Fix QueryNode log level ( #16604 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-07 10:27:51 +08:00
bigsheeper
f18b3c44ee
Print msgID instead of msg ( #16268 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-29 19:11:47 +08:00
xige-16
515d0369de
Support string type in segcore ( #16546 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
zhenshan.cao
0a953948af
Simplify monitoring metrics ( #16687 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-27 23:03:47 +08:00
Xiaofan
89b4a34892
Fix Data race in NodeID ( #16603 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
xige-16
27b4cbc098
Cherry pick remove translateHits commit to mater ( #16436 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-08 20:27:31 +08:00
godchen
bb7a0766fe
Add dependency factory ( #16204 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
Letian Jiang
09b90fd8bf
Fix QueryCollection retrieve unit test ( #16376 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-04 21:07:30 +08:00
godchen
478f6ca11e
Add cache for vector chunk ( #15912 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-26 22:05:26 +08:00
zhenshan.cao
f3eeecf146
Reduce the number of metrics ( #16030 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
jaime
29975a7a26
Remove Consume() API from mqstream interface ( #15886 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
jaime
7a3a721380
Reconstruct mqstream module ( #15784 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
cai.zhang
88527fc0a9
Fix metrics label conflict ( #15839 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-03 16:05:57 +08:00
bigsheeper
12eb8c3da5
Add prometheus metrics for QueryNode ( #15649 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-02 14:49:55 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. ( #15541 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-24 23:53:53 +08:00
zhenshan.cao
5bc6ec7250
Fixbug: QueryNode search exceptions will cause memory leak ( #15305 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-24 21:19:39 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc ( #15223 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
bigsheeper
0c98f21d4d
Remove global sealed segments in historical ( #15177 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-12 17:01:38 +08:00
bigsheeper
12f37ffb57
Improve timeout log when query in QueryNode ( #14766 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-05 10:35:31 +08:00
godchen
eb7dcf9ed3
Fix do unsolved msg goroutine not release ( #14536 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-29 21:06:03 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
cai.zhang
3418c17d90
[skip e2e]Add log for reducing results in querynode ( #13972 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-22 20:47:08 +08:00
bigsheeper
1ca08d9138
Simplify flow graph in QueryNode ( #13613 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
xige-16
97d5231a0a
Reorganize querycoord proto ( #13181 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
xige-16
8b2cd271c7
Improve querynode log ( #13158 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 18:51:08 +08:00
XuanYang-cn
0262942a14
[skip ci]Update license for qn query collection ( #13009 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 14:35:32 +08:00
bigsheeper
57707e0d11
Close tSafe update log print ( #12992 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:33:44 +08:00
bigsheeper
214f40b209
Add timeout ts for search and query ( #12890 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 14:15:03 +08:00
cai.zhang
ed58c277e3
Add log for search ( #12625 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 09:54:01 +08:00
bigsheeper
58964621a5
Remove tSafeWatcher and vChannel when release ( #12264 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 01:33:16 +08:00
zhenshan.cao
f95ef2260b
Add GetFlushState grpc method ( #12220 )
...
Update sdk version
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-23 22:57:17 +08:00
Xiaofan
f654621650
Remove the etcd deletion of segment data path on querynode ( #11863 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
zhenshan.cao
8c6c031e80
FixBug:update serviceableTime incorrectly ( #11769 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-15 10:31:09 +08:00
godchen
5357e301f4
Fix retrieve search error ( #11501 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
godchen
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
Cai Yudong
021f4c0f8a
Update query reduce log ( #11401 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 16:05:51 +08:00
yukun
4e5c8811da
Add flow_graph for delta channel in querynode ( #11293 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-06 11:02:58 +08:00
Cai Yudong
0fac38000c
Correct empty retrieve result handling ( #11219 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-04 18:08:32 +08:00
godchen
a0a3a889e7
Add common endian for global use ( #11092 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
Cai Yudong
7763615780
Remove primary key duplicated query result on query node ( #10834 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-30 15:12:41 +08:00
bigsheeper
6053d693df
Add query mutex to fix crashed with panic ( #10832 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-29 17:12:43 +08:00
zhenshan.cao
c0ea7ee780
Remove unused code in querynode ( #10859 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-28 23:58:52 +08:00
congqixia
5317c8abab
Fix waitNewTSafe not waiting ( #10724 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-27 14:22:22 +08:00
xige-16
0cedd9d47e
Compaction multiSegmentChangeInfo to a single info ( #10587 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 15:18:22 +08:00
xige-16
a414d16c06
Fix remove segment when querynode receive segmentChangeInfo ( #10619 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 13:04:18 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel ( #10084 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
bigsheeper
132f57f5b7
Set gracefulTime to 0 ( #10114 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 10:55:12 +08:00
godchen
24a6fc096b
Update query node bloom filter ( #10109 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-18 20:08:42 +08:00