admin/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2026-01-01 00:15:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/core/src/storage
History
yah01 dd5f896dc8
Load batch by batch (#25212) 
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-06 13:58:27 +08:00
..
AliyunCredentialsProvider.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
AliyunCredentialsProvider.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
AliyunSTSClient.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
AliyunSTSClient.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
BinlogReader.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
BinlogReader.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
ChunkManager.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
CMakeLists.txt
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
DataCodec.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
DataCodec.h
Refine segcore code style (#24999)
2023-06-20 14:16:46 +08:00
DiskFileManagerImpl.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
DiskFileManagerImpl.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
Event.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
Event.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
Exception.h
[Cherry-Pick] Remove arrow uasge in FieldData (#22726)
2023-03-20 10:41:56 +08:00
FieldData.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
FieldData.h
Load batch by batch (#25212)
2023-07-06 13:58:27 +08:00
FieldDataInterface.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
FileManager.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
IndexData.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
IndexData.h
[Cherry-Pick] Remove arrow uasge in FieldData (#22726)
2023-03-20 10:41:56 +08:00
InsertData.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
InsertData.h
[Cherry-Pick] Remove arrow uasge in FieldData (#22726)
2023-03-20 10:41:56 +08:00
LocalChunkManager.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
LocalChunkManager.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
LocalChunkManagerSingleton.h
Load batch by batch (#25212)
2023-07-06 13:58:27 +08:00
MemFileManagerImpl.cpp
Fix program crash caused by incorrect use of noexcept modifier (#25194) (#25214)
2023-06-30 15:08:22 +08:00
MemFileManagerImpl.h
Fix program crash caused by incorrect use of noexcept modifier (#25194) (#25214)
2023-06-30 15:08:22 +08:00
milvus_storage.pc.in
refine complie configuration (#17502)
2022-06-24 21:12:15 +08:00
MinioChunkManager.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
MinioChunkManager.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
parquet_c.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
parquet_c.h
Support json & array types (#23408)
2023-04-20 11:32:31 +08:00
PayloadReader.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
PayloadReader.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
PayloadStream.cpp
Add cpp data codec (#18538)
2022-09-09 22:12:34 +08:00
PayloadStream.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
PayloadWriter.cpp
Support json & array types (#23408)
2023-04-20 11:32:31 +08:00
PayloadWriter.h
Support json & array types (#23408)
2023-04-20 11:32:31 +08:00
RemoteChunkManagerSingleton.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
SafeQueue.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
storage_c.cpp
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
storage_c.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
ThreadPool.cpp
Parallel operations of disk-ann file manager (#20120) (#20122)
2022-11-03 14:39:40 +08:00
ThreadPool.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
Types.h
Migrate the ability to upload and download binlog to cpp (#22984)
2023-06-25 14:38:44 +08:00
Util.cpp
Load batch by batch (#25212)
2023-07-06 13:58:27 +08:00
Util.h
Load batch by batch (#25212)
2023-07-06 13:58:27 +08:00