admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-04 18:02:08 +08:00
Code Issues Packages Projects Releases Wiki Activity
17,567 Commits 136 Branches 188 Tags
Commit Graph

47 Commits

Author SHA1 Message Date
shaoyue
7bf39aed08
chunk manager supports using gcs & oss with accessKey (#25233) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2023-07-20 15:38:58 +08:00
yah01
227d2c8b3a
Reduce loading index memory usage (#25698) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 14:02:57 +08:00
xige-16
94d6cbb238
Fix querynode panic when binlog ts wrong (#25635) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-07-18 10:41:20 +08:00
yah01
dd5f896dc8
Load batch by batch (#25212) 
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 13:58:27 +08:00
cai.zhang
7f3f18e71f
Fix program crash caused by incorrect use of noexcept modifier (#25194) (#25214) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-30 15:08:22 +08:00
xige-16
04082b3de2
Migrate the ability to upload and download binlog to cpp (#22984) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-25 14:38:44 +08:00
zhagnlu
a79fd1c5a2
Fix GetObject return null value bug in MacOs (#24959) (#25002) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-21 13:40:42 +08:00
yah01
247f117096
Refine segcore code style (#24999) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 14:16:46 +08:00
Bingyi Sun
cc56efb134
Fix build index performance downgrade (#24651) (#24708) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-19 10:50:47 +08:00
congqixia
cbfbc4e63a
Memset sigaction before using it (#24933) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-16 14:08:40 +08:00
congqixia
561021ec5a
Refine sigpipe handling (#24872) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-14 10:10:38 +08:00
congqixia
e729b504ab
Use SA_ONSTACK flag for SIGPIPE handler (#24688) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 15:50:35 +08:00
zhagnlu
0fe8342648
Support google cloud for C++ chunk manager (#21100) (#24418) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-29 01:05:28 +08:00
cai.zhang
c80d8f82ce
Reduce memory usage for diskann index (#23600) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-06 10:32:39 +08:00
Enwei Jiao
66a5efeb3d
Fix load failed with DiskANN (#23760) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-27 16:56:35 +08:00
Enwei Jiao
967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
Enwei Jiao
ef57ba3bac
Remove easylogging and replace by GLog (#22979) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-27 18:22:02 +08:00
zhagnlu
7c633e9b9d
Support aliyun OSS for chunk manager (#22663) (#22842) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-03-20 14:45:57 +08:00
xige-16
9aa99aedbb
[Cherry-Pick] Remove arrow uasge in FieldData (#22726) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-03-20 10:41:56 +08:00
yah01
a4031da634
Refine string parameters, avoid coping or deref (#22708) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 17:53:53 +08:00
yah01
7bc3309918
Replace NULL with nullptr (#22701) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 10:35:52 +08:00
yah01
bdd6bc7695
Re-format cpp code (#22513) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 15:55:49 +08:00
yah01
4d4bf99098
Fix DiskANN can't recovery after querynode reboots (#22488) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 10:17:48 +08:00
cai.zhang
5cae49e28d
Store index files in slices to reduce memory peaks (#22369) (#22455) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-03-01 19:43:47 +08:00
presburger
9950cacd10
support knowhere 2.0 (#21857) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-02-10 14:24:32 +08:00
yah01
61c2f29ab3
Fix miss to throw exception when failed to create dir (#21886) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-01-31 13:49:50 +08:00
yah01
cc56d58052
Fix panic while concurrent releasing payload writer/reader (#21218) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-14 16:23:22 +08:00
Xiaofan
e131915207
Support 64M Rpc Limit (#20845) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-07 10:07:18 +08:00
xige-16
a20770c172
Delete logs that print sensitive information (#20889) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-12-01 10:35:16 +08:00
Enwei Jiao
958e94f6f0
Use Conan as c++ package manager (#19920) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-23 10:39:11 +08:00
xige-16
34c88cea32
Fix GetDiskUsedSize not work (#20474) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-11-21 17:47:17 +08:00
xige-16
15badd0263
Fix cache disk index error (#20419) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-11-21 17:45:23 +08:00
zhagnlu
39212bc04c
Fix get cpu num for segcore (#20120) (#20307) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-11-03 19:29:36 +08:00
zhagnlu
cb2591d1fe
Parallel operations of disk-ann file manager (#20120) (#20122) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-11-03 14:39:40 +08:00
bigsheeper
37dce8a660
Make s3 client creation thread safe, prevent crashing (#20200) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-10-31 17:09:33 +08:00
xige-16
89a9b6fda0
Init storage config's SSL and IAM config (#20082) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-26 16:07:30 +08:00
xige-16
32ba4fafb8
Delete Creating bucket when create core/minioChunkManager (#20049) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-25 14:15:30 +08:00
zhagnlu
02a8a07322
Fix BucketExists bug in minio chunk manager (#19548) (#19854) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-10-20 10:23:27 +08:00
xige-16
158787811e
Move assemble/disassemble func to core (#19420) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-16 21:17:25 +08:00
xige-16
8c9c1672ae
Assign different storage config for indexes (#19517) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-14 14:45:23 +08:00
xige-16
49daee2e17
Fix lost disk index data (#19636) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-09 14:36:58 +08:00
xige-16
428840178c
Support diskann index for vector field (#19093) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-21 20:16:51 +08:00
xige-16
4de1bfe5bc
Add cpp data codec (#18538) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: zhagnlu lu.zhang@zilliz.com

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-09 22:12:34 +08:00
Letian Jiang
4ae1ca2cac
Fix arrow builder nullptr check in FinishPayloadWriter (#17873) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-06-28 20:04:17 +08:00
Enwei Jiao
16c3aedc15
refine complie configuration (#17502) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-06-24 21:12:15 +08:00
groot
73c9ab43e0
Simplify cpp (#10413) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-22 14:33:11 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-28 10:39:30 +08:00