admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-07 19:31:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,128 Commits 137 Branches 188 Tags
Commit Graph

6128 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yukun
2b3ce3777e
Terms of must and must_not together are not working (#4624) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-01-19 10:24:19 +08:00
groot
412f7052f9
fix cache wrong size issue (#4597) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-01-11 11:33:40 +00:00
yukun
0b9ae4e872
[skip ci]Fix C++ sdk ConstructTopkQueryResult (#4580) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-01-06 16:52:59 +08:00
XuPeng-SH
ec4ecdcd7a
optimization for read node sync metadata (#4556) 
* optimize read-write mode sync logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

update 2

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

optimize read node sync logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for optimization

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-31 11:04:05 +00:00
BossZou
56d557e929
Meta filter 0111 (#4538) 
* Use reference pass

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add Meta Filter

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Meta Combination & Mock Filter

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* mock

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* meta filter test chcek collection

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove surplus return

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Fix meta filter ut fail

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* format query

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-30 08:07:41 +00:00
XuPeng-SH
34c6b71ba3
enable config reader/writer interval by env variable (#4529) 
* support change reader/writer interval by env variable

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* optimize db query

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-30 06:32:12 +00:00
del-zhenwu
0961c046f5
add cluster test (#4426) 
* add cluster test

Signed-off-by: zw <zw@milvus.io>

* add cluster test

Signed-off-by: zw <zw@milvus.io>

* update helm install

Signed-off-by: zw <zw@milvus.io>

* update log name

Signed-off-by: zw <zw@milvus.io>

* remove cluster helm release

Signed-off-by: zw <zw@milvus.io>

* add delay in nginx

Signed-off-by: zw <zw@milvus.io>

* add delay in nginx

Signed-off-by: zw <zw@milvus.io>

* fix delay in nginx

Signed-off-by: zw <zw@milvus.io>

* remove resources limits

Signed-off-by: zw <zw@milvus.io>

* remove resources limits

Signed-off-by: zw <zw@milvus.io>

* fix case

Signed-off-by: zw <zw@milvus.io>

* remove collections after test executed

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-12-30 10:28:22 +08:00
yukun
debc22a676
restful api /collections/{collection_name}/partitions (DELETE) didn't work (#4539) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-12-30 02:04:40 +00:00
XuPeng-SH
1cc9631da3
fix write node snapshot eject logic bug (#4523) 
* fix snapshot eject logic error for write node

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* fix code static check

Signed-off-by: XuPeng-SH <xupeng3112@163.com>
 2020-12-26 07:05:10 +00:00
shengjun.li
2955181d9e
fix hnsw load (#4521) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-26 03:54:08 +00:00
XuPeng-SH
48878a75e9
add some debug info for readonly node (#4514) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-26 02:15:10 +00:00
groot
ecb0aff9aa
#4511 Insert should be failed if field type not matched (#4517) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-12-25 13:58:27 +00:00
XuPeng-SH
56b4e40c73
fix table not exist issue (#4502) 
* fix table not exist issue

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* fix snapshot policy issue

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* format

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-24 02:47:53 +00:00
groot
7b5d9630b2
#4488 get_entity_by_id() performance is poor in 0.11.0 (#4489) 
* #4488 get_entity_by_id() performance is poor in 0.11.0

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* add changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-12-22 02:06:22 +00:00
XuPeng-SH
a2cad4604e
modificate name to id data structure in Snapshots (#4483) 
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
 2020-12-21 03:11:05 +00:00
XuPeng-SH
9d76f3a640
add more check during build snapshot (#4434) (#4478) 
* add more check during build snapshot

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* fix format

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* fix format

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-18 18:43:07 +08:00
XuPeng-SH
ce60e7e10e
add mutex in OnReaderTimer (#4411) (#4433) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-10 18:06:33 +08:00
yukun
cd6a910d0a
Fix search when there are multiple vector fields (#4420) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-12-10 10:56:48 +08:00
XuPeng-SH
cf7ce28921
fix readonly mode crash issue (#4396) (#4400) 
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
 2020-12-10 10:19:48 +08:00
del-zhenwu
176ffdb0f5
fix insert case (#4311) 
Co-authored-by: zw <zw@milvus.io>
 2020-12-07 12:04:30 +08:00
XuPeng-SH
d0ff3906b7
Cherry pick master 20201204 (#4370) 
* Phase 1 of implementation of read-write seperation (#4214)

* (db/snapshot): add SnapshotPolicy

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* (db/snapshot): add some snapshot policy

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* (db/snapshot): add policy factory

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add ut

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* implement ut for snapshot policy

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* fix clang format

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add some comments

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* Phase 2 of implementation of read-write seperation (#4299)

* ro mode impl 1

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* ro mode impl 2

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add TimerContext.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Add Timer in Server

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 2

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 3

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 4

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 5

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 6

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 7

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 8

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 9

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 10

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 11

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 12

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 13

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 14

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 15

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 16

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* fix compile error from latest compiler version (#4359)

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* fix format

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-07 11:19:52 +08:00
BossZou
67fa089df0
Add new method called EntireRowCount to get count of uid (#4365) 
* Fix may logout memory leak

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add new method called EntireRowCount to get count of uid

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-04 02:03:52 +00:00
ThreadDao
ffd3187784
add case for server crash when cycle delete entities across segments (#4355) 2020-12-03 10:33:22 +08:00
BossZou
1a206d24aa
Fix deleted docs blacklist size setting error (#4341) 
* Fix deleted docs blacklist size setting error

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Remove clear resource operation when unref snapshot

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix error when get delete docs count during generating blacklist

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add comments for modification

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-02 14:26:50 +08:00
BossZou
e1c955b532
Remove log src in index module unittest CMakeLists.txt (#4339) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-01 11:51:16 +00:00
ThreadDao
082fb744b4
[skip ci] update search case for the change of query param in http-api (#4320) 
* [skip ci] update http search case for field

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] update http search case for field

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-12-01 08:59:38 +00:00
yukun
fbf5972ffb
C++ sdk sdk_binary needs to update (#4330) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-12-01 13:05:44 +08:00
yukun
2909677dda
[skip ci]Delete removed api doc in webserver readme.md (#4319) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-30 20:20:21 +08:00
shengjun.li
2a21d2cb7c
fix leak (#4324) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-30 11:55:20 +00:00
yukun
b6dbbccd11
Setting DSL fields is invalid in restful api, fields are not returned (#4312) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-28 09:35:27 +00:00
XuPeng-SH
b58a7b9bb0
fix memcheck leak issue (#4308) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-11-27 12:15:19 +00:00
FluorineDog
b01d8f8f74
fix virtual (#4304) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2020-11-27 09:49:04 +00:00
BossZou
855f871a39
Fix 'Illegal instruction' when running index tests at GitHub action (#4294) 
* Fix 'Illegal instruction' when running index tests at GitHub action

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* index module ignore ccache

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* add ill signal

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-11-26 02:11:11 +00:00
quicksilver
56131626cd
Reduce the size of docker images (#4260) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-25 16:30:33 +08:00
del-zhenwu
e9f802c435
[skip ci] update milvus_benchmark (#4288) 
Co-authored-by: zw <zw@milvus.io>
 2020-11-25 16:29:43 +08:00
ThreadDao
2e7c7a1c54
fix multi thread case by override join method (#4281) 
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-11-25 11:55:38 +08:00
yukun
7d393ce3e9
Program exit abnormally (#4275) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-25 02:22:19 +00:00
del-zhenwu
add0c706fe
add case: delete & flush during searching (#4261) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-11-21 10:48:21 +08:00
ThreadDao
38c96cca67
[skip ci] fix search case in java-sdk (#4253) 
* get entity with fields

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* dsl search

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* service search case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* optmize binary search case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] search

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] delete unused code

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] optmize

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] fix search case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-11-20 21:33:07 +08:00
yukun
aff6c44823
It should raise InvalidDsl exception when search with multi vectors (#4255) 
* It should raise InvalidDsl exception when search with multi vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* change stat_optimizer_enable to true

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-20 19:42:11 +08:00
yukun
70ab7e3229
improve QueryUtil code (#4247) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-19 10:07:17 +08:00
BossZou
0071905d5f
Remove blacklist index from VecIndex (#4239) 
* Remove blacklist from VecIndex

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add blacklist in DeletedDoc

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Remove blacklist from VecIndex and add to DeletedDOc

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify cmakelist

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add default value in strcut VectorsData (fix #4242)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add more default value

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* skip file which is not executable

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* codacy

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-11-18 02:55:10 +00:00
shengjun.li
62ec0a9381
remove setting omp thread num (#4244) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-18 09:50:43 +08:00
BossZou
b3b9523420
Opt some code (#4238) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-11-16 15:28:40 +08:00
ThreadDao
8c563f1de0
[skip ci] update benchamrk version to 0.11.1 (#4236) 
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-11-16 07:28:26 +00:00
yukun
2c16a839ad
Fix metrics (#4237) 
* Add CollectQueryMetrics

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* The Prometheus performance metrics sent by Milvus 0.11.0 is not right

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-16 15:27:56 +08:00
ThreadDao
fb7bfaf722
add case for search with partition and binary collection (#4235) 
* [skip ci] binary insert and search

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] change num to nq

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] search with empty partition

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] update values to query

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] gitignore

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-11-16 07:25:51 +00:00
BossZou
5b93b892c4
The scalar field value of search result is wrong after deleted (#4209) 
* The scalar field information of search result is wrong after some entities deleted

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix bitset count passing error

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add more db del test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] add ()

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-11-14 10:42:35 +08:00
ThreadDao
e7c6f52e25
add service search case in java-sdk and add case of get entity with field in go-sdk (#4216) 
* get entity with fields

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* dsl search

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* service search case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* optmize binary search case

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] search

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] delete unused code

Signed-off-by: ThreadDao <zongyufen@foxmail.com>

* [skip ci] optmize

Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-11-13 04:00:16 +00:00
ThreadDao
af59d1efff
[skip ci] add case for client in go-sdk (#4230) 
Signed-off-by: ThreadDao <zongyufen@foxmail.com>
 2020-11-12 18:19:01 +08:00