64 Commits

Author SHA1 Message Date
bigsheeper
8aae0f7cc9
Refactor flow graph and load/watchDML in query node (#5682)
* Refactor flow graph and load/watchDML in query node

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-09 11:37:55 +08:00
zhenshan.cao
7dac20c35c
Add log for poxynode transform data and querynode segment insert (#5627)
* Add log for poxynode transform data and querynode segment insert

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Decrease print times

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-05 16:21:36 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
bigsheeper
71b8f309b2 Add licence to query node and query service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-19 13:47:10 +08:00
xige-16
332b14c915 Delete querynode’s redundant load IO
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-07 18:29:19 +08:00
xige-16
c10b36f188 fix getting wrong offset when segment preinsert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-31 16:16:58 +08:00
xige-16
a6f1de036b Optimize search performance in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-30 22:16:58 +08:00
bigsheeper
dfb68a7e46 Remove unused segment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-25 16:08:08 -05:00
zhenshan.cao
c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
xige-16
8a5c039137 Fix search error when running single node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
xige-16
09ae985daa Fix wrong error code in master_service_test.go
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
XuanYang-cn
8567679888 Check enableIndex before load index
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-10 14:51:00 +08:00
quicksilver
455cc59dbb Update publish-test-images.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
sunby
ddddd65d10 Delete internal/errors package
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
bigsheeper
447a15207e Add zap log to query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-05 09:21:35 +08:00
xige-16
f62078c027 Fix crash error when search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 10:14:03 +08:00
xige-16
a6442cb600 Fix querynode memory leak
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 09:20:51 +08:00
sunby
5769c000a1 Find failed python tests and add skip mark "r0.3-test"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper
d8f41db823 Fix search crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
bigsheeper
12b2eaf196 Rename apis
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 21:26:03 +08:00
zhenshan.cao
1ba8e2448f Add tsLoop for indexservice
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-07 18:38:58 +08:00
bigsheeper
a64c831ed9 Fix segment replacement bug
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 18:37:18 +08:00
bigsheeper
c6c99ef32b Implement getSegmengInfo function
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-04 11:40:14 +08:00
bigsheeper
f12a0490bb Do not drop collections or partitions in flow graph
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 18:12:48 +08:00
Xiangyu Wang
fd9e42d3ed Update msgstream/unmarshal interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-03 17:30:10 +08:00
bigsheeper
abffdbff62 Remove partition tag
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 16:44:38 +08:00
godchen
66d5189601 Add get collection statistics implemetation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-02 19:54:31 +08:00
dragondriver
e4e3ec88d1 Add usage count of insert channels
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-02 15:49:13 +08:00
bigsheeper
09bdbee944 Refactor load service, remove seg manager
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-02 15:13:08 +08:00
bigsheeper
3573e01093 Check index periodically and load index, add indexing segment type
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-30 16:02:10 +08:00
bigsheeper
73d2b6a101 Get index param from minio and filter by vector fields
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
cai.zhang
83c60fd84f Update proto about index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-21 15:20:23 +08:00
zhenshan.cao
2ec573d2f9 Recover delete docs
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-20 09:36:50 +08:00
cai.zhang
fb493cc235 Update interface name of GetIndexStates
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-19 18:32:57 +08:00
neza2017
918e279869 Set msg stream
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 16:14:13 +08:00
neza2017
d5e53aa28a Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 14:13:49 +08:00
bigsheeper
2064b014a1 Add loadFieldData, use partition id instead of tag
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-19 14:44:03 +08:00
XuanYang-cn
6a13386393 Add DataNode package
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-19 11:37:16 +08:00
neza2017
1ce32d8775 Add master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 09:45:42 +08:00
bigsheeper
aaf8b0ad40 Add sealed segment, segment type and manager, send loadIndexReq to service's buffer
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-19 10:29:16 +08:00
bigsheeper
f02bd8c8f5 Rename query node package, implement watchDmChannel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-16 10:12:14 +08:00
bigsheeper
b98b226d8c Refactor query node and implement channelRemove, channelAdd
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-15 15:28:54 +08:00
quicksilver
8e9d8e36e1 Update run_go_unittest.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-13 10:40:46 +08:00
FluorineDog
4cd42c553f Rename field_name, make field_id strongly typed, skip multithread test
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-12 18:31:52 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
xige-16
004d0027b3 Fix error that different loadIndex messages have same indexParam
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-09 15:57:55 +08:00