admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-02-02 01:06:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,669 Commits 146 Branches 196 Tags
Commit Graph

5669 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
groot
96054dfafa
Fix the crash in BaseRequest (#5762) 
Fix #5398

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-06-15 12:14:14 +08:00
groot
a2ff18c40d
Search with big nq and big topk (#5748) 
* fix #5747 #5115

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-06-15 09:53:12 +08:00
shengjun.li
73190282bd
Fix apply deletes (#5752) 
(1) Even if the bloom filter is destroyed, it can delete entity by ID
(2) No duplicate deletion

Resolves: #5537

Signed-off-by: shengjun.li shengjun.li@zilliz.com
 2021-06-11 20:20:12 +08:00
del-zhenwu
cbba9c4517
add case for max length search result (#5737) 
* add case

Signed-off-by: zw <zw@milvus.io>

* add case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2021-06-11 16:00:55 +08:00
shengjun.li
f6f57c203a
Even if the bloom filter is destroyed, it can get entity by ID (#5724) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-10 18:55:32 +08:00
del-zhenwu
69638abf20
add test cases for index_file_size (#5708) 
* add test cases for index_file_size

Signed-off-by: zw <zw@milvus.io>
 2021-06-10 16:57:14 +08:00
groot
84318f251b
clean code (#5707) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-06-10 13:54:03 +08:00
shengjun.li
2214397646
update the bloom filter by renaming a temporary file (#5683) 
MemTable::ApplyDeletes() may update the bloom filter file.
If it is written in place, a damaged file will be left in case of
power failure. To update the bloom filter by renaming a temporary
file can avoid it.

Resolves: #5537

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-10 10:46:19 +08:00
groot
98fd6fa69a
modify error/warning message (#5695) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-06-09 19:10:36 +08:00
groot
5386d7ddb7
loose limitation of index_file_size (#5669) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-06-09 14:26:46 +08:00
shengjun.li
11a426c304
[skip ci] modify branch name in install.md (#5658) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-08 10:43:37 +08:00
shengjun.li
71c6eaeddb
index created by std::make_shared (#5628) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-05 16:34:51 +08:00
shengjun.li
9e7e1dcba4
modify the version to 1.1.1 (#5615) 
* modify the version to 1.1.1

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-05 10:06:55 +08:00
del-zhenwu
534c729933
enable test case (#5608) 
Signed-off-by: zw <zw@milvus.io>
 2021-06-04 17:36:57 +08:00
shengjun.li
2b82120c01
IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs (#5584) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-04 11:24:34 +08:00
groot
4193e18bb5
loose limitation of index_file_size (#5568) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-06-03 18:50:33 +08:00
Ji Bin
c753c7b0c3
storage: enableing compile with aws sdk by default. (#5485) 
* enabling compile with AWS by default
* add s3 related configure item's description in servier_config

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-05-31 16:07:34 +08:00
groot
ce0e75e6a4
Fix #5191 (#5459) 
* Fix #5191

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-05-28 11:34:00 +08:00
Xiangyu Wang
3099039eef Add OWNERS file 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-28 10:54:52 +08:00
Ji Bin
930600371d
storage: s3_address support domain/hostname. (#5413) 
In most cases, it is more appropriate to use the hostname or domain name
as the address of the S3 server.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-05-27 16:32:32 +08:00
groot
cc066e5f5c
Fix grpcio version unmatch error (#5403) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-05-26 11:11:43 +08:00
Ji Bin
e213e5b321
Bugfix: increase offset after read in s3 IO reader. (#5393) 
Signed-off-by: Ji Bin <matrixji@live.com>
 2021-05-25 15:07:46 +08:00
shengjun.li
d1413e47c6
Partition existence check (#5326) 
(1) Exception should be raised if insert or delete entity on the none-existed partition
(2) Creating duplicate collections may result in insert or delete operation loss

Resolves: #5164

Signed-off-by: shengjun1985 shengjun.li@zilliz.com
 2021-05-20 19:18:03 +08:00
groot
90d5ee90df
Fix issue #5191 (#5314) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-05-20 15:36:50 +08:00
Ji Bin
b9e9bb22d0
Bugfix: fix local directory creating while using s3 storage (#5306) 
- remove unneeded CachePut for bloom filter in s3 storage
- using create_directories instead of create_directory
Resolves: #5287
Signed-off-by: Ji Bin <matrixji@live.com>
 2021-05-20 10:23:51 +08:00
shengjun.li
28cabb2a4e
Add a timestamp to the blacklist and cache it (#5297) 
(1) Add a timestamp to the blacklist and cache it.
(2) If timestamp mismatches, it will load DeleteDocs to regenerate it.
(3) Only SearchTask will load blacklist.
(4) Fix BloomFilter cache cleaning.

Resolves: #4897, #4625

Signed-off-by: shengjun.li shengjun.li@zilliz.com
 2021-05-19 19:53:11 +08:00
shengjun.li
53cacf60b2
Dirty blacklist is left in the cache (#5272) 
Multi threads accessing will leave dirty blacklist in the cache.
To fix it, we let knowhere::index not hold the blacklist.
And each query will regenerate it by DeleteDoc.
Later, we will add blacklist to the cache to improve performance.

Resolves: #4897

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-18 17:49:54 +08:00
cqy123456
dce238e939
Dirty BloomFilter is left in the cache (#5252) 
Multi threads accessing will leave dirty BloomFilter in the cache.
Now, reading threads will not overwrite the cache. And it should be solved.
Issue 4897 involves BloomFilter and Blacklist.
This commit try to fix BloomFilter firstly.

Resolves: #4897

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2021-05-18 11:02:10 +08:00
del-zhenwu
0497fe46ae
Disable cron testing (#5194) 
* disable cron testing

Signed-off-by: zhenwu <zhenwu@milvus.io>
 2021-05-14 17:12:38 +08:00
shengjun.li
623ae55ff5
Improve IVF query on GPU when no entity deleted (#5204) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-14 11:29:57 +08:00
shengjun.li
2e4aaff531
Remove daemonize code (#5181) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-13 09:19:06 +08:00
ophunter233
0ec2a6d33a
Enable gpu cache (#5161) 
* enable gpu cache

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-05-12 09:51:28 +08:00
del-zhenwu
9bf3cc74a3
Add partition tag in new cases (#5140) 
* add partition tag in new cases

Signed-off-by: zw <zw@milvus.io>
 2021-05-08 14:25:44 +08:00
XuanYang-cn
e6955208ff
upgrading shards (#5098) 
* upgrading shards

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* update shards

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
v1.1.0 		2021-05-07 14:49:26 +08:00
del-zhenwu
5e559cd791
[Test CI] Add dim test on GPU (#5102) 
Signed-off-by: zhenwu <zhenwu@milvus.io>
 2021-04-30 15:04:34 +08:00
yukun
fe55f5353f
[skip ci]Fix webserver readme (#5099) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-04-30 11:17:13 +08:00
shengjun.li
c19290b1ba
fix crash when creating a GPU IVF index (#5097) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-30 11:01:18 +08:00
groot
638da8594f
modify changlog (#5095) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-29 19:15:53 +08:00
groot
747e218378
[skip ci] modify changelog (#5077) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-28 11:48:14 +08:00
groot
6a9990168a
Fix #5063 (#5071) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-28 10:00:48 +08:00
del-zhenwu
1e97d22a12
update test connect case (#5039) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2021-04-27 10:01:44 +08:00
groot
5667d00344
Index type returned by get_collection_stats() is incorrect (#5052) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-26 14:17:57 +08:00
groot
3d3799967c
Failed to set timezone like "UTC + 5:30" (#5042) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-26 09:24:21 +08:00
XuanYang-cn
97e0d1f8f3
Updaing APIs in mishards (#5036) 
* Updaing APIs in mishards

This PR implements issue#4968, including API changes:
  - get_entity_by_id
  - delete_entity_by_id
  - release_collection

See also: https://github.com/milvus-io/pymilvus/issues/476

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* remove comments

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* remove no codecy unittest

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* remove comment

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix codecy

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-04-25 18:47:28 +08:00
ophunter233
5e5067f1ae
add validation of parameter nbits for IndexIVFPQ on Gpu version (#5011) 
* add validate of parameter nbits for IndexIVFPQ on Gpu version

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-04-23 17:31:49 +08:00
groot
6fb9a82974
Fix #5008 (#5009) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-04-23 17:19:50 +08:00
shengjun.li
3451fa642a
fix nlist adapter (#5000) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-23 11:33:01 +08:00
del-zhenwu
afd15b6971
enable cron test (#5004) 
* update sdk-python source

Signed-off-by: zhenwu <zhenwu@milvus.io>
 2021-04-23 11:05:04 +08:00
ophunter233
0ede2fcf1c
fix the wrong size of new operate (#4999) 
* fix the wrong size of new operate

Signed-off-by: cmli <chengming.li@zilliz.com>
 2021-04-22 20:21:19 +08:00
shengjun.li
26d84621aa
improve parallel (#4993) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-22 17:41:31 +08:00