110 Commits

Author SHA1 Message Date
Xu Peng
67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng
8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng
ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng
62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng
94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng
473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng
95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng
4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
Xu Peng
7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng
204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng
713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng
052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng
cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng
39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
Xu Peng
3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng
9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
Xu Peng
7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng
0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
Xu Peng
f096e0a109 feat(db): add meta impl factory
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
2019-04-29 15:06:35 +08:00
Xu Peng
c1d40bfb3d feat(db): add db factories
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
2019-04-29 14:06:40 +08:00
Xu Peng
5d5bbe842d feat(db): add dates filter for search
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
2019-04-29 12:05:03 +08:00
Xu Peng
5569f22de2 fix(db): no transaction for update_group_file
Former-commit-id: 22b364f8f07cd009391952ba66478879f6b86b6d
2019-04-28 21:01:30 +08:00
Xu Peng
57dfdae3e3 feat(db): fix bug and add exception catch in meta operation
Former-commit-id: 6d33945997e7a528bc729efdad6076d6532f79b3
2019-04-28 18:44:25 +08:00
Xu Peng
486c175b4e feat(db): add serialization mutex
Former-commit-id: f8a3b14c0209a9e36b0510ce48754deefc4ee442
2019-04-28 18:44:25 +08:00
Xu Peng
32b64ab724 feat(db): add more print
Former-commit-id: 42486eb1e1c804e7b5120dc1f0dd12d2f7bd6a96
2019-04-28 18:44:25 +08:00
Xu Peng
5fbe3d9641 feat(db): remove limit for id generator
Former-commit-id: a110cfa01b6207cd76fd1ee000945c04c48b0d88
2019-04-26 17:59:14 +08:00
Xu Peng
062c3aad91 feat(db): merge file optimize
Former-commit-id: fea0d7970fab88f995d9d16d7dfea84dd4fbacb7
2019-04-26 17:18:27 +08:00
Xu Peng
1d9946ff87 feat(db): change sqlite_orm header dependency
Former-commit-id: d682b364b1b27a2af27f0246460bb9bbb6370fd0
2019-04-26 15:37:54 +08:00
xj.lin
ce7bc10f8c fix search
Former-commit-id: 14a6408d66811f1d1a1d5bb1cbbddbecb5dd4d51
2019-04-24 18:19:29 +08:00
Xu Peng
d402dd9dce fix(db): code fix
Former-commit-id: fbb9040ada2c355dad1e13526f8f16c36e155716
2019-04-24 16:25:50 +08:00
Xu Peng
a6369c7a4e feat(db): cache for search
Former-commit-id: 8e13efdaa593b4ebb83b06d33d5127180d756597
2019-04-24 16:20:36 +08:00
Xu Peng
4e59f966c3 feat(db): cache for mem merge
Former-commit-id: bff342710683954dcd4b72b890fff483708ceba0
2019-04-24 16:04:14 +08:00
Xu Peng
22281e8ea5 feat(db): cache for mem serialization
Former-commit-id: 9d3211b9c4bfa6132cd52822e19c1ae5d287d9a2
2019-04-24 15:47:34 +08:00
Xu Peng
7150d3c5aa feat(db): cache for index
Former-commit-id: e33cb100824e8714e539bec4f6622753001a9606
2019-04-24 15:42:08 +08:00
Xu Peng
2e8d45aad3 feat(db): cache merged file
Former-commit-id: d236a8dbfcb01d07b6b544aa98a7e1dd179fc477
2019-04-24 15:16:38 +08:00
Xu Peng
918c113727 fix(db): fix memory leak
Former-commit-id: 1c5b7e0ab18f9508aa5aeecfc7caecf5ac74fd45
2019-04-24 11:53:26 +08:00
Xu Peng
06ab815c7b feat(db): add count api
Former-commit-id: 9fb2b765a48d1753ba31a68e7b9b207273adb199
2019-04-24 10:28:05 +08:00
Xu Peng
7509e28d91 feat(db): try build index every interval
Former-commit-id: 15571dc68be30524189c73800ce8050ed8a2f9aa
2019-04-23 20:57:00 +08:00
Xu Peng
d6344006e5 feat(db): add drop_all
Former-commit-id: 70720144d39f5ca18d349e475e66fb6ccca7bacf
2019-04-23 20:03:55 +08:00
Xu Peng
d7a87d14b1 feat(db): try build index every merege interval
Former-commit-id: ee639ab9b93b0a3bd5950276749f0dad3dc53227
2019-04-23 16:48:24 +08:00
xj.lin
db32c300e8 feat: add search support
Former-commit-id: 0bb20ad7b80ca432b83154efd59cb89e7cc2867c
2019-04-23 11:58:43 +08:00
Xu Peng
d8f40536c5 feat(db): add easylogging for debug log
Former-commit-id: 85e3e48f3b917d7ecf716805fa8d19af349bc35f
2019-04-22 17:00:39 +08:00
Xu Peng
2943126bda feat(db): add ttl files cleanup api
Former-commit-id: bb84f6f2baa8c20c9f0e745c67213af236609507
2019-04-22 15:08:26 +08:00
Xu Peng
abacf3e234 feat(db): change updated_time type of long
Former-commit-id: e58de06418bdb6b4f40f646ff5dc3d6a0efb12c0
2019-04-22 14:50:47 +08:00
Xu Peng
216aeb6bd0 feat(db): add updated_time in group_file meta
Former-commit-id: 0a2c3549b8b82267db3facc9606d8f8f90b02de2
2019-04-22 14:15:58 +08:00
Xu Peng
b377266934 feat(db): add some print
Former-commit-id: 200b365c40532a13d777457bd53e6788fd613559
2019-04-22 14:15:58 +08:00
Xu Peng
cb82771ef4 feat(db): change open db api
Former-commit-id: f9c5b0714096075d7a869b248a8b44201b41d0e0
2019-04-19 21:39:59 +08:00
xj.lin
457688d787 add search support
Former-commit-id: 4aae0710844eff71fb83f3d73f3fa7463b00e99b
2019-04-19 21:39:39 +08:00
Xu Peng
8e1e03b2ba feat(db): cleanup pre db destruction
Former-commit-id: 98270b53f6bafcde31d44039bb224d547ce71b07
2019-04-19 16:08:12 +08:00
Xu Peng
2de4f04771 fix(db): no default sqlite dumped
Former-commit-id: d5b6964706cbb0870e5cc9c8fab048a849dd3fa1
2019-04-19 16:08:12 +08:00