xige-16
2b720fd2f7
Fix load hang when restart querynode many time in short time ( #6351 )
...
* fix load hang when restart querynode many time in short time
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add multi queryNode ut
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add ut for restart querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set queryCoord contex to load collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
dragondriver
bd317a5461
Check if field data is empty ( #6404 )
...
* Check if field data is empty
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* FixBug: fast fail when output_fields contain fields that are not in schema
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-11 19:39:52 +08:00
neza2017
8b89744c6b
search with exp ( #6409 )
...
* process float vector and binary vector field
on the search result
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add more debug info on etcd
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add debug info when grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
Cai Yudong
21a9bcd844
Create default partition when receive CreateCollectionMsg ( #6305 )
...
* create default partition when create collection
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* adjust sleep time for unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-06 09:16:03 +08:00
FluorineDog
bf8b2be4a7
Deprecate num_groups to simplify search API ( #6230 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-01 10:32:15 +08:00
zhenshan.cao
ff4c6c7ff4
Fix travel timestamp and guarantee timestamp ( #6234 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-30 21:02:13 +08:00
Cai Yudong
a7a9eeeffe
Add time record for build index and search process ( #6231 )
...
* add timerecord for build index process
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add timerecord for query process
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-30 19:46:14 +08:00
xige-16
ff93d1611f
merge retrive and search code in query node ( #6227 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-30 17:50:15 +08:00
xige-16
f146d3825f
Fix search hang after querynode restart ( #6212 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-30 17:48:19 +08:00
Cai Yudong
95135c1681
fix blob file sort error ( #6184 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-29 13:24:15 +08:00
xige-16
6b65529086
Fix search error after releasePartition ( #6135 )
...
* fix search error after releasePartition
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-26 16:08:11 +08:00
xige-16
8db95a63f6
Return error when search limit equal 0 or grater than 16384 ( #6115 )
...
* return error when search limit equal 0 or grater than 16384
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-26 11:44:11 +08:00
bigsheeper
0d0c1901dd
Fix service time check of search in streaming ( #6068 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-25 20:18:09 +08:00
yukun
39614aa8eb
Add rocksmq_path in config and paramtable ( #6099 )
...
* Add rocksmq_path in config and paramtable
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add rocksdbPath in NewRmsFactory
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change rdb default path to /vat/lib/milvus/rdb_data
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-25 19:44:11 +08:00
yukun
eb818d05ab
Remove vector fields from output fields ( #6112 )
...
* Remove vector fields from output fields
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add empty_collection error_code
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-25 16:52:11 +08:00
bigsheeper
e87372761a
Remove tSafe in release partition task and return max timestamp ( #6078 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-24 19:06:34 +08:00
congqixia
10e5fc3382
Fix query node crash when retrieved 0 result ( #6087 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-24 19:04:34 +08:00
yukun
c8bf9078ae
Change pchannels to vchannel in retrieveResults ( #6054 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-24 13:40:03 +08:00
yukun
b72e4c6372
Merge search_collection and retrieve_colletion into query_collection ( #6037 )
...
* Merge search_collection and retrieve_colletion into query_collection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix static-check
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-23 20:26:10 +08:00
bigsheeper
dca24f313a
fix search timeout error ( #6027 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-23 18:04:22 +08:00
bigsheeper
0f89f40488
Use virtual channel in search result and retrieve result ( #6030 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-23 18:00:37 +08:00
xige-16
5417fee45f
fix releasePartition not work after loadCollection ( #6025 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-23 17:44:12 +08:00
bigsheeper
47d89abaa0
get channels by static converting ( #6015 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-23 17:26:09 +08:00
Cai Yudong
a09a3a1905
rename service to coord ( #6020 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
godchen
fd07a44dba
Fix error in retry refactor ( #6000 )
...
* Fix error in retry refactor
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 11:48:06 +08:00
godchen
99be4c09a5
change retry ( #5996 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
bigsheeper
b31bae351d
fix empty search result ( #5979 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-22 16:52:08 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator ( #5931 )
...
* Rename queryservice to querycoordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix param table
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix unittest
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* service to coordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set querycoord in ci
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
xige-16
7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error ( #5960 )
...
* delete nodeInfo after nodeDown
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance can's stop
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load field data error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* contiue task loop after error in queryService
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 14:10:09 +08:00
yukun
b2eb596c23
Change search result to columnBased and return target_entry ( #5896 )
...
* Change search result to columnBased and return target_entry
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: fluorinedog <fluorinedog@gmail.com>
* synchronize the latest pymilvus-orm version
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change pymilvus-orm version to 40
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: fluorinedog <fluorinedog@gmail.com>
2021-06-21 20:18:13 +08:00
bigsheeper
2e615907ca
fix test_search_after_index_different_metric_type ( #5921 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-21 18:46:15 +08:00
sunby
7f2d7c1da3
Rename dataservice to datacoordinator ( #5912 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
Cai Yudong
92e429d812
Rename IndexService to IndexCoord ( #5932 )
...
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
zhenshan.cao
958280ebb8
Add support for time travel ( #5897 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-21 10:42:10 +08:00
bigsheeper
bbd8a7e13a
Add released partitions and fix search error in empty partition ( #5893 )
...
* rename flowgraphType to loadType
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* add load type and released partitions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* filter released partition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-19 18:38:07 +08:00
FluorineDog
255e3959af
support time travel ( #5894 )
...
* support time travel
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* lint
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-19 17:38:11 +08:00
XuanYang-cn
ab7f642740
Add alias in paramtable ( #5878 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-19 12:38:06 +08:00
xige-16
e4c51aae36
Add recovery logic for querynode and queryservice ( #5843 )
...
* merge milvus/recovery2
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add recovery logic in queryservice
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug smoke case
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add etcd to querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix release partition error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug querynode down and recovery
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add log
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix showCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* skip smoke test search without insert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
sunby
33f5225968
Use physical channel to init msg stream ( #5815 )
...
* Use physical channel to init msg stream
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix search collection error check (#1 )
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: bigsheeper <954206947@qq.com>
2021-06-18 16:02:05 +08:00
bigsheeper
46151d203f
Fix tSafe cannot update correctly ( #5820 )
...
* Fix tSafe cannot update correctly
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* skip test_load_partitions_release_collection
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* skip test_release_collection_during_searching
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-17 16:56:04 +08:00
yukun
e9a8d1c404
Add vChannels in proxy for query results ( #5802 )
...
* Fix proxynode for new retrieve logic
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove querynodenum from proxynode and querynode
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove QueryNodeIDList from proxy
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-16 20:15:59 +08:00
bigsheeper
d6f7fbf19f
release collection synchronously ( #5798 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-16 15:31:57 +08:00
bigsheeper
bf39644457
Fix channels in query node and fix search ( #5795 )
...
* fix add channel error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix tSafe vChannel key
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-16 12:05:56 +08:00
xige-16
97049ce293
use dataservice's getRecoveryInfo to get load and watch info ( #5790 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-16 11:09:56 +08:00
yukun
5c18138a6b
Fix retrieve_collection return nil vchannel ( #5787 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-15 20:07:30 +08:00
bigsheeper
58bf92a407
Add vChannel,pChannel in query node and get vChannel from master in query service ( #5784 )
...
* add vChannel,pChannel in query node and get vChannel from master in query service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-15 20:06:10 +08:00
yukun
fceba63a33
Add segment and channel msgs in retrieve results ( #5750 )
...
* Fix query hang bug (#5709 )
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add segment and channel msgs in retrieve results
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-15 16:38:59 +08:00
zhenshan.cao
5c69c6902d
Refactor proxy channelTimeTick and fix search timeout ( #5760 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:36 +08:00
Cai Yudong
0f4bd50ce3
Support ETCD endpoints array ( #5755 )
2021-06-15 16:36:36 +08:00
zhenshan.cao
33a43f48c8
[skip ci] Fix bug: Search timeout and refactor client init logic ( #5735 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:24:48 +08:00
