admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-02 00:45:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
14,121 Commits 138 Branches 188 Tags
Commit Graph

4878 Commits

Author SHA1 Message Date
Ji Bin
d83f69bb21
Support windows compliation (#15448) 
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-02-07 23:43:46 +08:00
JunSung Park
f6873d3dc1
Implement automatic item expiration on compaction (#14418) 
* Implement automatic item expiration on compaction

Signed-off-by: JunSung Park <writtic@gmail.com>

* Change entityExpiration value comparison logic

Signed-off-by: JunSung Park <writtic@gmail.com>

* Add logging for the number of expired entity

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default value of CompactionEntityExpiration to off

Signed-off-by: JunSung Park <writtic@gmail.com>

* Fix errors for code checker

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default entityExpiration to max value

Signed-off-by: JunSung Park <writtic@gmail.com>
 2022-02-07 22:45:46 +08:00
XuanYang-cn
5eef9886b3
Add more specific log when exiting BackGroundGC goroutine (#15273) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-02-07 16:55:44 +08:00
congqixia
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo (#15455) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-02-07 15:35:44 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-02 00:35:43 +08:00
congqixia
b4bfe58fd9
[skip e2e] Fix component name for IndexCoordComponent comment (#15138) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-29 22:39:44 +08:00
XuanYang-cn
eef295465a
Fix timetick inconsistency in drop collection (#15408) 
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.

Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.

Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.

This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs

Fixes: #15406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-28 20:49:41 +08:00
Filipe Caixeta
dee1961b4d
Make SearchResults and QueryResults return collectionID (#15377) 
* Make SearchResults and QueryResults return collectionID

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* add return collection name from QueryRequest and SearchRequest

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* remove comment

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
 2022-01-27 22:55:41 +08:00
Xiaofan
885ecaf222
Refine time sync logic log (#15251) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-27 11:25:41 +08:00
congqixia
273890a91e
Fix datanode flush manager injection unit test (#15358) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-27 10:23:40 +08:00
xige-16
b9d1396258
Delete ut's useless param for genCollectionSchema (#15119) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-26 14:21:40 +08:00
xige-16
6336e2326c
Set triggerCondition when queryCoord reload loadbalanceTask meta (#15380) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-25 17:26:13 +08:00
XuanYang-cn
8ab9d769de
Fix logs of compaction_executor (#15365) 
- Remove not useful log in `stopExecutingtaskByVChannelName`
- Add planID info in `mergeFlushedSegments`

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-25 13:29:40 +08:00
zhenshan.cao
3f48a40ab0
Load index meta in every retry (#15376) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-25 13:28:05 +08:00
Bingyi Sun
515fe962d5
Fix subscription path (#15373) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-25 13:27:44 +08:00
xige-16
3a024307f4
Release collection first when drop collection (#15370) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-24 21:51:22 +08:00
zhenshan.cao
5bc6ec7250
Fixbug: QueryNode search exceptions will cause memory leak (#15305) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-24 21:19:39 +08:00
Bingyi Sun
3987574448
Unsubscribe topic in DataCoord (#15353) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-24 19:47:38 +08:00
zhenshan.cao
6bc2efe429
Fixbug: IndexNode should panic when save meta failed to MetaKV (#15347) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-24 17:18:46 +08:00
bigsheeper
390cdd2515
Remove tmporary debug log in core (#15330) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-24 10:03:41 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 21:43:40 +08:00
xige-16
57383c9f76
Delete Useless timetick channel (#15296) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 14:31:39 +08:00
Bingyi Sun
c877f33084
Downgrade pulsar client (#15325) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-20 22:25:38 +08:00
xige-16
c132302129
Clean flowGraph if watchChannel failed (#15303) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-20 10:01:38 +08:00
congqixia
1e61112b5a
Add retry logic in pulsar consumer unsubscribe (#15284) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-20 01:23:37 +08:00
xige-16
bbb672cb00
Remove state service in querynode (#15281) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-18 18:43:37 +08:00
XuanYang-cn
87394e29b6
Fix compaction ut datarace (#15267) 
Fixes: #15241

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-18 17:49:39 +08:00
Cai Yudong
356efee492
Rename timetickSync APIs and variables for better readability (#15264) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-18 14:47:36 +08:00
cai.zhang
f564ea7fc7
RootCoord set healthy state after registered service (#15261) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-01-18 12:09:37 +08:00
Cai Yudong
1b1d4e502b
Remove session from timetickSync (#15255) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-18 00:07:37 +08:00
bigsheeper
7f775096c5
Unsubscribe when close pulsar consumer (#15221) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-17 18:53:36 +08:00
xige-16
408a6e9e58
Fix collectResultLoop hang after search timeout (#15250) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-17 18:11:36 +08:00
xige-16
dfc6670f0f
Unsubscribe channel after query node down (#15230) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-17 17:37:37 +08:00
zhenshan.cao
871e093dc8
Call release memory in case error occured (#15237) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-17 14:43:38 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc (#15223) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-17 14:41:35 +08:00
yah01
fd8d452cfd
remove unused fieldIDs and fieldTypes (#15229) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2022-01-16 17:37:35 +08:00
Xiaofan
f36e02dfbb
Add more log when tt failed (#15227) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-15 18:53:34 +08:00
Xiaofan
f617c8887b
Time Tick Failed need log (#15225) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-14 23:55:34 +08:00
zhenshan.cao
1601a61b78
Move logic of checking available port to service (#15222) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-14 21:17:34 +08:00
zhenshan.cao
f14df1d2db
Initilize listener in service instead of ParamTable (#15220) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-14 18:29:34 +08:00
xige-16
cc5bee4684
Stop handoff if segment has been compacted (#15181) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-13 21:49:35 +08:00
Jiquan Long
2819f6cc6f
Release memory to OS after index is built (#15196) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-13 20:27:34 +08:00
congqixia
2528b6850d
Refactor flush manager injection to reduce goroutine number (#15180) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-13 18:49:34 +08:00
xige-16
384d3169d3
Don't remove nodeInfo when querycoord panic at loadBalanceTask (#15189) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-13 17:59:34 +08:00
XuanYang-cn
008e08a996
Add flowgraph manager and event manager (#15102) 
1. Add flowgraph manager to manager start and release of dataSyncService
2. Add event manager to manager etcd watchInfo event
  - Make put event able to retry
  - Make delete event able to terminate the retry loop

See also: #14604, #14300

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-13 14:21:34 +08:00
xige-16
4e956ee10c
Panic when recover querynode failed (#15161) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-12 17:43:37 +08:00
bigsheeper
0c98f21d4d
Remove global sealed segments in historical (#15177) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-12 17:01:38 +08:00
cai.zhang
3254d36609
[skip e2e]Add comment for msgIndexCoordIsUnhealthy (#15146) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-01-12 11:15:36 +08:00
cai.zhang
745d5f5a8a
[skip e2e]Add comment for newGrpcClient (#15144) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-01-12 11:13:37 +08:00