15 Commits

Author SHA1 Message Date
Rayn Wei
375fd709a9
. (#1972)
Signed-off-by: RyanWei <rainmanwy@gmail.com>
2020-04-18 13:22:47 +08:00
Wang XiangYu
890fe08e7c
Refactor LOG macro and improve log format (#1927)
* update log format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add new log macro

Signed-off-by: wxyu <xy.wang@zilliz.com>

* use new log macro instead

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* add SetThreadName function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* set thread name

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* add changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add git ignore .swp file

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update log level in LogUtil.cpp

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-15 14:44:00 +08:00
Cai Yudong
66e38d20cd
Caiyd 1881 bad alloc (#1892)
* #1881 update storage APIs, use int64_t for size

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-09 17:13:15 +08:00
Cai Yudong
7ccfa5b9f0
Caiyd 1627 move rw index (#1833)
* #1627 move read/write index into codec

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update WriteVectorIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-02 22:44:45 +08:00
yudong.cai
817ea8b9e1 #1548 add FSHandler
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 11:40:12 +08:00
yudong.cai
28a0f1de01 #1548 move store/Directory.cpp to storage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 11:38:17 +08:00
yudong.cai
67fad34065 Merge remote-tracking branch 'main/master' into caiyd_1547_rename_storage_file 2020-03-11 18:43:02 +08:00
yudong.cai
ea63f65ceb #1537 add interface open()/close() for IOReader/IOWriter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-09 15:11:55 +08:00
yudong.cai
1d18c0a938 #1547 rename storage/file to storage/disk
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-09 13:08:17 +08:00
yudong.cai
6b81dd55df #1536 move Config.cpp to config directory
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 17:02:21 +08:00
Cai Yudong
636f5c9cb6
#1234 do service check when Milvus startup (#1404)
* #1234 do service check when Milvus startup

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1234 update error log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-02-28 10:05:30 +08:00
Jin Hai
e1027e9e65
#1240 Update license declaration of each file (#1241)
* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-02-17 23:40:58 +08:00
Cai Yudong
364fc25766 rename 'minio' to 's3' in Storage Config section (#1088)
* #1002 rename 'minio' to 's3' in Storage Config section

* #1002 clang format
2020-01-18 10:07:46 +08:00
Cai Yudong
3c02b4b581 add s3 mock for unittest (#937)
* #815 change S3 client_ptr_ to shared_ptr

* #815 install test_storage to unittest

* #815 add MockS3Client.h for unittest

* #815 optimize MockS3Client.h

* #815 update unittest

* #815 update unittest

* #815 fix clang-format

* #815 use FIU for unittest

* #815 enable FIU in jenkins

* #815 update unittest

* #815 enable FIU in docker build
2020-01-08 10:39:05 +08:00
Cai Yudong
b9d9b8ecc2 support minio storage (#895)
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
2020-01-04 10:39:52 +08:00