272 Commits

Author SHA1 Message Date
groot
0ce9502a3e fix bug
Former-commit-id: daf197368b50cd764df893949abb5f2956c9c560
2019-05-06 11:24:36 +08:00
xj.lin
2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin
56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
jinhai
675777d072 Add libzstd-dev to solve the linking error
Former-commit-id: 993f2b5e526a3d073820f80b8ce473842ab937b5
2019-05-05 20:42:33 +08:00
groot
faa2c4b4b1 support empty id
Former-commit-id: 1a5303b58f3f3b0154f1609ff1acc0d00007c569
2019-05-05 20:13:34 +08:00
Xu Peng
496989bbe4 refactor(db): add more debug log
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
2019-05-05 18:02:11 +08:00
Xu Peng
d3cbc1ccad fix(db): db desctruction bug fix
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
2019-05-05 17:26:50 +08:00
Xu Peng
8a029c9b0d refactor(db): add copyright header
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
2019-05-05 13:10:04 +08:00
Xu Peng
72f096bfca refactor(db): typedef ptr for memvectors
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
2019-05-05 12:55:42 +08:00
Xu Peng
c64e8c9621 refactor(db): typdef meta ptr
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
2019-05-05 10:28:40 +08:00
Xu Peng
f5b0ec50cf refactor(db): typedef engine ptr
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
2019-05-05 10:21:26 +08:00
Xu Peng
85707aa3e9 refactor(db): impl template for engine type part 2
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
2019-05-05 09:38:37 +08:00
Xu Peng
166289cafa refactor(db): impl template for engine type
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
2019-04-30 21:02:13 +08:00
Xu Peng
0e37089c6a refactor(db): refactor all for crtp replacement
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
2019-04-30 20:23:11 +08:00
Xu Peng
67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng
8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng
ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng
62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng
94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng
473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng
95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng
4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
groot
a724141e73 use multithreads to do id mapping
Former-commit-id: 10b201d3801b146fa6335e4dfd20c877cfb2e948
2019-04-30 17:37:50 +08:00
groot
b67c731b90 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 730d1e5d7acd6ff2250ea1a453c2d4127f081356
2019-04-30 17:00:05 +08:00
groot
2e76522151 refine code
Former-commit-id: f81a57c8340d7cfcea9db3d8219612f6108eeda6
2019-04-30 17:00:00 +08:00
Xu Peng
7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng
204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng
713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng
052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng
cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng
39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
groot
74eee9dc77 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 00d18f20fb408445831a00a5385a244c49786910
2019-04-30 14:47:46 +08:00
groot
905722bd0e add python sample
Former-commit-id: 2c0825ad6ed774eb5ad1999b1439f840dc602bf1
2019-04-30 14:47:36 +08:00
Xu Peng
3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng
9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
groot
aa591114c4 time range search
Former-commit-id: 182c5c9db2d3aeaafc4d4878f060435c442b366c
2019-04-30 11:18:08 +08:00
Xu Peng
7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng
0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
groot
363de87bdb gen python api
Former-commit-id: 1c9b4a1fea7c450b55e8d683085d8779460ea3c4
2019-04-29 17:58:08 +08:00
groot
231b216963 add namespace for thrift api
Former-commit-id: 92f9e0a0f7d2e301120573976984f99062b8f44e
2019-04-29 17:55:50 +08:00
groot
e1efe942da fix test load config failure
Former-commit-id: 7781b6ff8a4c1d72dfe4f872a7765424af40286e
2019-04-29 16:34:43 +08:00
groot
16df78caee add attribute for vector
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
2019-04-29 16:14:21 +08:00
groot
fe5909a597 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 69eee8018a8a7d7478181c11fef7ef4206ee0784
2019-04-29 16:12:40 +08:00
groot
592dde4dd7 add attribute for vector
Former-commit-id: c2a1a5cd917abe1cf3e8ef327bba5c2ed1cf8008
2019-04-29 16:12:35 +08:00
Xu Peng
f096e0a109 feat(db): add meta impl factory
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
2019-04-29 15:06:35 +08:00
Xu Peng
c1d40bfb3d feat(db): add db factories
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
2019-04-29 14:06:40 +08:00
groot
b8148d8e13 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: bd511cfab2d3813dee05c34dcf068622da2fef94
2019-04-29 12:31:56 +08:00
groot
1aefac8ae0 fix unitest load config error
Former-commit-id: 8bf7417881a421bf5c28a31474743484e8fea155
2019-04-29 12:31:48 +08:00
Xu Peng
5d5bbe842d feat(db): add dates filter for search
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
2019-04-29 12:05:03 +08:00
groot
688a9992be fix make error
Former-commit-id: 7a5d078a48a92b0595e67bf8fe9891a075044bf4
2019-04-29 12:04:56 +08:00