58 Commits

Author SHA1 Message Date
Cai Yudong
829077ad0c
Optimize reSentDdMsg logic (#13378)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-15 08:59:08 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
JackLCL
3ddcec79b4
[skip ci]Fix error log output format in root_coord_test.go (#13130)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:17:30 +08:00
cai.zhang
342200ce13
Estimate the memory size of the index before building the index (#12973)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
Bingyi Sun
a05a74fca2
Improve proxy manager in rootcoord (#12303)
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-29 17:33:41 +08:00
Cai Yudong
cbbeb2a383
Add debug log when proxy idle for a long time (#12319)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-27 13:57:16 +08:00
Cai Yudong
858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 10:07:15 +08:00
Cai Yudong
d4c297b1a8
Enhance dml channel operations (#12143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-21 21:33:13 +08:00
dragondriver
ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
Cai Yudong
173e7b3808
Fix golint warnings for rootcoord/root_coord.go (#11871)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:25:17 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Cai Yudong
a2ad88237d
Add deltaChannels in rootcoord core (#11097)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 21:04:14 +08:00
Cai Yudong
66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels (#11007)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 15:50:30 +08:00
congqixia
ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 14:04:36 +08:00
Cai Yudong
c7566345eb
Simplify meta_snapshot interface (#9778)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 15:54:33 +08:00
Yusup
49198dbce1
Disable dropping collection via alias (#8850)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-10-08 17:37:53 +08:00
congqixia
88e319acda
Save start position in collection meta (#8682)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 18:10:00 +08:00
Cai Yudong
177a465913
Clean golint warnings for rootcoord (#8383)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 15:10:00 +08:00
Cai Yudong
a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 10:37:54 +08:00
Yusup
bdfb78e936
Add aliases to DescribeCollection (#8268)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-22 16:20:48 +08:00
Yusup
ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
godchen
b3f965c7d4
Add unrecoverable error for retry. (#7828)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:49:51 +08:00
Cai Yudong
d10c6abc9e
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
congqixia
675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 22:05:49 +08:00
zhenshan.cao
e5e4b24954
Fix bug: describe collection return wrong shard number (#7841)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-14 11:59:47 +08:00
Cai Yudong
4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-10 13:00:00 +08:00
zhenshan.cao
29e5138274
Fix unittest: timeout caused by excessive use of resources (#7653)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-09 17:39:30 +08:00
zhenshan.cao
b0524adbd8
Support specified shard number when create collection (#7482)
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-08 15:00:00 +08:00
Cai Yudong
d15d3fa0ac
Improve rootcoord codecov (#7518)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-07 11:16:37 +08:00
zhenshan.cao
86afde4598
Fix unittest for rootcoord, should filter out timetick msg first (#7490)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-06 11:52:41 +08:00
Cai Yudong
3b9609692b
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 18:35:58 +08:00
dragondriver
f0dbdd7f13
Expose metrics of root coordinator (#7228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 11:45:59 +08:00
Cai Yudong
f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376)
This reverts commit e6de86a4336e623861fd476afa458383b9883662.
2021-08-31 11:07:58 +08:00
Cai Yudong
e6de86a433
Apply for msgstream from pool when creating collection (#7323)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 09:47:58 +08:00
congqixia
4d9f89df09
Add unit test for 7150 fix (#7276)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-25 14:41:52 +08:00
Xiaofan
58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-08-24 09:45:51 +08:00
XuanYang-cn
47df4a2e57
Fix DataNode BackGroudGC problem (#6551)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-03 09:59:24 +08:00
Cai Yudong
21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305)
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-06 09:16:03 +08:00
Cai Yudong
bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo (#6289)
* add collectionID and partitionID into SegmentIndexInfo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add partID2SegID into meta table

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DropIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-03 20:00:40 +08:00
neza2017
111a24a49f
remove msgstream of segment info (#6280)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 14:36:18 +08:00
sunby
07b0989628
Add GetFlushedSegments in data coordinator (#6253)
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
godchen
49a0528d53
Fix trace (#6218)
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00
neza2017
95ad498822
check proxy if exist before connect to it (#6165)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-28 15:08:12 +08:00
neza2017
6d7edc6015
fix typo (#6142)
* fix typo

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add log

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-26 18:04:12 +08:00
neza2017
a1d0e5c980
remove task scheduler (#6123)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-26 09:22:11 +08:00
neza2017
da12e55c6c
rootcoord connect to other components in go routines (#6117)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-25 16:48:10 +08:00
Cai Yudong
64d1fa2de2
Banner use UTC time (#6102)
* banner use UTC time

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-25 10:24:11 +08:00
Cai Yudong
f633d48ccc
fix rootcoord unittest (#6090)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-24 19:44:08 +08:00
Cai Yudong
a09a3a1905
rename service to coord (#6020)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
Cai Yudong
ba5aacd3f2
Remove GetChanNameByVirtualChan (#5999)
* remove redundant ctx

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove GetChanNameByVirtualChan

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 11:18:05 +08:00