124 Commits

Author SHA1 Message Date
bigsheeper
26fe0d850e
[skip ci] Add comment for removeSegmentPrivate (#10203)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-19 20:30:56 +08:00
bigsheeper
dc42fdb2f0
[skip ci] Add comment for removeSegment (#10202)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-19 20:28:59 +08:00
bigsheeper
24f6834192
[skip ci] Add comment for setSegment (#10201)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-19 20:27:09 +08:00
bigsheeper
f8e7f3f549
[skip ci] Add comment for addSegmentPrivate (#10112)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-18 20:26:59 +08:00
bigsheeper
93ec046ef2
[skip ci] Add comment for addSegment (#10111)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-18 20:24:55 +08:00
bigsheeper
9ec4105a85
[skip ci] Add comment for getSegmentIDsPrivate (#10110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-18 20:22:56 +08:00
bigsheeper
a4a66341da
[skip ci] Add comment for getSegmentIDsByVChannel (#10022)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 21:51:32 +08:00
bigsheeper
db534419f9
[skip ci] Add comment for getPartitionNum (#10021)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 21:47:44 +08:00
bigsheeper
9f958f4b00
[skip ci] Add comment for getSegmentIDs (#10020)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 21:45:40 +08:00
bigsheeper
4c420dac21
Update excluded segments info when receive changeInfo (#10011)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 17:00:33 +08:00
bigsheeper
14b77405f4
[skip ci] Add comment for collectionReplica (#9980)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 18:38:36 +08:00
bigsheeper
0f1de9757b
[skip ci] Add comment for hasPartition (#9979)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 18:36:42 +08:00
bigsheeper
3cff929be3
[skip ci] Add comment for getPartitionByIDPrivate (#9978)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 18:34:51 +08:00
bigsheeper
c92706c75d
[skip ci] Add comment for getPartitionByID (#9892)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-14 18:54:34 +08:00
bigsheeper
d59bb7dd29
[skip ci] Add comment for removePartitionPrivate (#9891)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-14 18:52:41 +08:00
bigsheeper
5ffe605865
[skip ci] Add comment for removePartition (#9890)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-14 18:50:51 +08:00
bigsheeper
4b77e6e047
[skip ci] Add comment for addPartitionPrivate (#9808)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 19:14:33 +08:00
bigsheeper
1a72d05a1b
[skip ci] Add comment for addPartition (#9807)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 19:12:39 +08:00
bigsheeper
71a6c5a7e6
[skip ci] Add comment for getFieldsByCollectionIDPrivate (#9806)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 19:10:46 +08:00
bigsheeper
55193ec75a
[skip ci] Add comment for getVecFieldIDsByCollectionID (#9721)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-12 19:11:04 +08:00
bigsheeper
de14446286
[skip ci] Add comment for getPartitionIDs (#9720)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-12 19:07:12 +08:00
bigsheeper
8a4a232eff
[skip ci] Add comment for getCollectionNum (#9719)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-12 19:05:17 +08:00
bigsheeper
dd77e08b9e
[skip ci] Add comment for hasCollection (#9660)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 19:04:37 +08:00
bigsheeper
1b128c3fbf
[skip ci] Add comment for getCollectionByIDPrivate (#9659)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 19:02:45 +08:00
bigsheeper
ba998b1673
[skip ci] Add comment for hasCollectionPrivate (#9661)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 18:56:37 +08:00
bigsheeper
cc1801fa98
Add comment for removeCollectionPrivate (#9584)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 18:41:32 +08:00
bigsheeper
1b3a7b129b
Add comment for removeCollection (#9583)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 18:39:48 +08:00
bigsheeper
5865ead978
[skip ci] Add comment for getCollectionByID (#9585)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 18:33:32 +08:00
bigsheeper
edea91ae6e
[skip ci] Add comment for addColllection (#9523)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-08 23:53:25 +08:00
bigsheeper
d7b29c059c
[skip ci] Add comment for getCollectionIDs (#9435)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-08 06:47:15 +08:00
bigsheeper
8696a37fe6
[skip ci] Add comment for printReplica (#9434)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-08 06:45:25 +08:00
bigsheeper
44622622f6
[skip ci] Add comment for getSegmentsMemSize (#9433)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-08 06:43:26 +08:00
bigsheeper
9d6c95bf25
Add cacheSize to prevent OOM in query node (#8765)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-28 22:24:03 +08:00
bigsheeper
11c65dc2b3
Add comment for collection replica (#8147)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:15:51 +08:00
bigsheeper
bc1f39bb55
Remove deprecated replica interface in query node (#7908)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:09:53 +08:00
bigsheeper
691e4c5bc9
Use definitional type instead of raw type (#7797)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:25:26 +08:00
bigsheeper
4123deef9e
Return error message in grpc.LoadSegment in query node (#6908)
* return load error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* init streaming meta in loadSegment

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix excluded init

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* improve impl

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:01:27 +08:00
bigsheeper
e8ea8b51d5
improve query node log (#6897)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-31 10:47:22 +08:00
Cai Yudong
a992dcf6a8
Support query return vector output field (#6570)
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
xige-16
7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error (#5960)
* delete nodeInfo after nodeDown

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load balance can's stop

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load field data error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* contiue task loop after error in queryService

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 14:10:09 +08:00
bigsheeper
bbd8a7e13a
Add released partitions and fix search error in empty partition (#5893)
* rename flowgraphType to loadType

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* add load type and released partitions

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* filter released partition

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-19 18:38:07 +08:00
xige-16
e4c51aae36
Add recovery logic for querynode and queryservice (#5843)
* merge milvus/recovery2

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add recovery logic in queryservice

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* debug smoke case

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add etcd to querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix release partition error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load balance error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* debug querynode down and recovery

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add log

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix showCollection

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* skip smoke test search without insert

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
xige-16
97049ce293
use dataservice's getRecoveryInfo to get load and watch info (#5790)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-16 11:09:56 +08:00
bigsheeper
58bf92a407
Add vChannel,pChannel in query node and get vChannel from master in query service (#5784)
* add vChannel,pChannel in query node and get vChannel from master in query service

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-15 20:06:10 +08:00
bigsheeper
cdbc6d2c94
Refactor query node and query service (#5751)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
bigsheeper
8aae0f7cc9
Refactor flow graph and load/watchDML in query node (#5682)
* Refactor flow graph and load/watchDML in query node

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-09 11:37:55 +08:00
bigsheeper
03f90ff28c
refactor collection replica and add tsafe replica in querynode (#5475)
* refactor collection replica and add tsafe replica in querynode

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check2

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* code format

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
xige-16
fce792b8bf
Add historical and streaming module in querynode (#5469)
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
bigsheeper
71b8f309b2 Add licence to query node and query service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-19 13:47:10 +08:00