5560 Commits

Author SHA1 Message Date
Jeng.Gwan
db71c74cc7
Fix leak of memory in ParseMallocInfo while assert false (#18311)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-19 14:26:33 +08:00
cai.zhang
315df1ff15
Reduce the timer time of assigning index task scheduler (#18319)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-19 14:24:29 +08:00
Jiquan Long
70246f82fd
Reduce chunk row size (#18320)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-19 13:50:28 +08:00
congqixia
f7bd054adb
Set EnableGarbageCollection to true by default (#18305)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-18 16:34:28 +08:00
Xiaofan
c97563590c
fix missing handling channels while a node down (#18250)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-18 13:06:28 +08:00
Jeng.Gwan
638f6c36e9
Support to get real row count of segment (#18115)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-18 09:58:28 +08:00
congqixia
f0846fb79b
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-15 17:12:27 +08:00
Xiaofan
6d82ef8c20
fix garbage collector err handling (#18277)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-15 13:54:26 +08:00
bigsheeper
d278213e4f
Check load request both in impl and task (#18276)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-15 10:24:28 +08:00
bigsheeper
73aef14820
Improve check of purge memory and change purge place (#18271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-15 10:22:27 +08:00
yah01
bb2ad23e55
GetQuerySegmentInfo returns sealed loaded segments (#18255)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-14 16:44:27 +08:00
cai.zhang
93d9dfad1a
Ignore task when IndexNode load empty index meta (#18266)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-14 15:08:28 +08:00
cai.zhang
a47a414dce
Fix bug for IndexNode pod kill test (#18177)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-13 16:16:25 +08:00
xige-16
54d17bc5da
Fix query too slow when insert multi repeated pk data (#18231)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-13 10:22:26 +08:00
congqixia
e5fe46124b
Fix isCompacting flag lost after segment clone (#18248)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-13 10:08:28 +08:00
Zach
84d73bd618
add package name in log contents (#18251)
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-12 23:02:26 +08:00
Jeng.Gwan
a926a9eb66
Fix redundant string copy of PlaceholderGroup (#18236)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-12 15:48:25 +08:00
Cai Yudong
015a2f0866
Let growing segment call knowhere brute search API (#18227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-07-12 11:58:25 +08:00
bigsheeper
1da970af18
Remove useless statsService in QueryNode (#17395)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-11 15:12:25 +08:00
congqixia
a9aff3a678
Allocate ID for each insertMsg (#18217)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-11 14:38:24 +08:00
yah01
08612ac56c
Fix QueryCoord unit test stucks (#18197)
Signed-off-by: yah <yang.cen@zilliz.com>
2022-07-11 12:44:25 +08:00
Xiaofan
653dce4948
Fix pulsar error check (#18207)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-11 10:56:25 +08:00
congqixia
e61f61a9bd
Dedup insert msgs by MsgID in mqtt MsgPack (#18180)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-08 20:42:22 +08:00
bigsheeper
22508f36d3
Get search field id from search plan and log if loaded index when search segments (#18183)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-08 20:18:22 +08:00
cai.zhang
90faf4a212
Fix bug for IndexCoord recycles index files (#18168)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-08 16:54:22 +08:00
bigsheeper
0fb5e9c1a9
Remove load collection check in Proxy (#18166)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-08 16:12:25 +08:00
Ten Thousand Leaves
ecc250c20e
Improve logs to better cover segment flush lifecycle (#18157)
/kind improvements

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-07-08 14:50:21 +08:00
zhenshan.cao
72910d65e0
Fix inconsistency in DataCoord (#18170) (#18171)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-08 13:48:21 +08:00
XuanYang-cn
53734bef58
Add seek msgID in DataNode (#17881)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-07-08 10:18:28 +08:00
wayblink
43ae6791e6
Make VChannelInfo read compatible with 2.0.2 (#17995)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-07-07 21:58:22 +08:00
codeman
5fda8261d0
Fix: Unable to list newly created credential users (#18117) (#18153)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-07-07 21:16:22 +08:00
cai.zhang
0c883b215b
Fix bug for IndexCoord ut (#18148)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 18:52:21 +08:00
cai.zhang
44e59d6318
Fix bug for clean etcd in QueryNCoord (#18145)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 18:32:21 +08:00
XuanYang-cn
d9e8231728
Filter sealed segments (#18065)
- Remove FilterThreshold in DataNode
- Alter filter logic in flowgraph DDNode

See also: #17943

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-07-07 18:26:20 +08:00
cai.zhang
58a9a0b79a
Add license for new files (#18138)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 17:44:21 +08:00
cai.zhang
c1a47c8941
Use struct channel instead of bool chan (#18140)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 16:20:22 +08:00
congqixia
543197c2be
Fix handoff segment unit test uses wrong node id (#18137)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-07 15:22:21 +08:00
cai.zhang
0ad15a22c8
IndexCoord handle events correctly (#17878)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 14:44:21 +08:00
congqixia
8f1ba6a0bb
Concurrent load segment stats log when initialize dataSyncService (#18125)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-07 14:32:21 +08:00
Jiquan Long
6df47c7faf
Change pulsar compression type to zstd-faster (#18121)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-07 11:16:22 +08:00
Enwei Jiao
ca88e37c98
fix receive messages before waitToFinish (#18101)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-07-07 10:00:21 +08:00
Ten Thousand Leaves
d4a1e94f32
Fix flush failure caused by empty stale segments (#18097)
/bug

issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-07-06 18:10:21 +08:00
SimFG
79523ff8d4
Fix the wrong log tag in the test case (#18103)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-07-06 15:38:20 +08:00
Zach
1c9647ff31
Merging multiple shard query/search requests into one rpc request if QueryNode is the leader of multiple shards of Collection (#17588)
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-06 15:06:21 +08:00
Xiaofan
a9b1d71a8f
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-06 13:54:21 +08:00
Jiquan Long
44024c1b1d
Replace pulsar compression type zstd with lz4 (#18085)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-05 22:06:21 +08:00
bigsheeper
696d747afa
Check if loaded in Proxy when LoadCollection (#18074)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 21:16:20 +08:00
zhagnlu
257da153ce
Fix core dump when nq has no topk result (#17923) (#18051)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-07-05 19:48:20 +08:00
Cai Yudong
5edeeb5fcd
Define new SubSearchResult constructor to avoid memory copy for growing (#18000)
segment search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-07-05 17:14:20 +08:00
bigsheeper
7d6624fcad
Improve flow graph node name and log msgID in QueryCoord (#18043)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 16:46:23 +08:00