193 Commits

Author SHA1 Message Date
dragondriver
78fe530d87
Initialize the simd type when initialize an indexnode (#8276)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:05:59 +08:00
Cai Yudong
c1e229cb7e
Add segcore logger (#8262)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 10:11:52 +08:00
zhenshan.cao
4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
zhenshan.cao
5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
yukun
8b3893e030
Add more error messages in segcore (#8012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-16 10:23:53 +08:00
yukun
9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 22:04:39 +08:00
Cai Yudong
14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong
a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
Cai Yudong
e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
Cai Yudong
c16ab5b35c
Use better segcoe variable name (#7869)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:06:00 +08:00
yukun
80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 18:43:48 +08:00
Cai Yudong
4dc9a64f01
Improve segcore code readability (#7868)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 16:07:48 +08:00
Cai Yudong
74ac528095
Improve segcore (#7851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 10:53:04 +08:00
yukun
5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 10:06:40 +08:00
Cai Yudong
27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
yukun
94272bba87
Support query by expression (#7386)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-03 17:12:55 +08:00
Cai Yudong
e771bda92f
optimize retrieve output vector code structure (#7102)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
Cai Yudong
6c75301c70
optimize search reduce logic (#7066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 18:00:11 +08:00
Cai Yudong
85ea051ddc
change growing segment default value to -1 (#7054)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 12:32:07 +08:00
FluorineDog
aba21baf82
refactor expr executor to use single bitset (#6667)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-23 15:30:12 +08:00
Cai Yudong
744f2c7f51
optimize test_c_api.cpp (#6637)
* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean redundant file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change DIM to const

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update reduce testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-20 17:13:21 +08:00
FluorineDog
234954931f
remove deprecated (#6623)
* remove deprecated

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix timeout

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-20 15:18:08 +08:00
dragondriver
99249a0224
Fix bug: override the compare function of SearchResultPair (#6628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-20 14:38:11 +08:00
Cai Yudong
a992dcf6a8
Support query return vector output field (#6570)
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
dragondriver
7f99d9d714
Loose the limit of dimension when searching on a binary vector field (#6503)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-14 14:33:54 +08:00
Cai Yudong
724f10b9a0
Unify the usage of query and search (#6467)
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-13 22:20:33 +08:00
quicksilver
7d920e9c9c
Fix compile error on CentOS (#6359)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
FluorineDog
bf8b2be4a7
Deprecate num_groups to simplify search API (#6230)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-01 10:32:15 +08:00
FluorineDog
255e3959af
support time travel (#5894)
* support time travel

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-19 17:38:11 +08:00
FluorineDog
bec9f2c182
Split segcore and plan proto for future feature (#5767)
* Split segcore and plan proto for future feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-15 14:43:57 +08:00
FluorineDog
006dae35c3
fix retrieve bug (#5727)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-11 00:06:55 +08:00
FluorineDog
1ff4764ba6
Fix wrong primary key (#5604)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 18:35:36 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
dragondriver
b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
dragondriver
e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
FluorineDog
396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096)
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-04-30 07:19:52 +00:00
xige-16
1165db75f6 Optimize search performance
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-19 19:30:36 +08:00
FluorineDog
6059558698 Add license files
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 11:16:16 +08:00
FluorineDog
ce7a5ea699 Support segcoreinit
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
xige-16
22eda19bc4 Fix mem leak when load index
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-10 10:10:53 +08:00
xige-16
a6f1de036b Optimize search performance in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-30 22:16:58 +08:00
FluorineDog
f39dcdb8f3 Support error code in segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-26 16:18:30 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
FluorineDog
2cec04ed90 Fix empty schema proto hack
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-17 11:35:28 +08:00
xige-16
8a5c039137 Fix search error when running single node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
FluorineDog
e33d0a797c Migrate knowhere to segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-12 15:54:59 +08:00
bigsheeper
447a15207e Add zap log to query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-05 09:21:35 +08:00
dragondriver
801396e3ef Disable register link logic, use proxy node directly
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
FluorineDog
ef98dab2a9 Support segcore config
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-04 17:09:48 +08:00