132 Commits

Author SHA1 Message Date
Xu Peng
59544b0341 fix(db): fix cache error after load file from disk
Former-commit-id: 23dd81d168caa49451634ef7a97c6fa618c92957
2019-05-15 11:47:21 +08:00
xj.lin
70dda63820 fix topk_2
Former-commit-id: 573d80b6d51407cc80e92989c11e3d74f2531d66
2019-05-14 10:26:46 +08:00
xj.lin
354f68a96f fix TopK bug
Former-commit-id: 76e24617b83d49b2a4808a0cd7406edb849e767e
2019-05-11 18:49:30 +08:00
xj.lin
c4244fdc6d fix search stack overflow
Former-commit-id: 39801544686f061a63f4c3f1dec11565164a928d
2019-05-11 16:52:16 +08:00
xj.lin
364af3b1a8 redefine default index build type
Former-commit-id: 1f10a7774b80b596323882bb74a46484a917344f
2019-05-11 11:27:06 +08:00
xj.lin
876f6a4c66 1 Support Cpu-version
2 Update build.sh support both cpu-build and gpu-build


Former-commit-id: 3c0ddd7fb2f93ab45b6f9878b71b6541617f92c4
2019-05-11 11:27:06 +08:00
Xu Peng
ac7092f556 fix(db): bug fix for add vectors
Former-commit-id: 84cfcf89843bfd79e226ef3fd8c6d9a273a1f4dc
2019-05-11 11:17:07 +08:00
Xu Peng
56ffd6bad3 fix(db): db destruction bug fix
Former-commit-id: d77e18e428bc43b2cc1316f0d77b6807192f6662
2019-05-08 13:58:16 +08:00
Xu Peng
4428d56670 refactor(db): trait for engine and dbimpl
Former-commit-id: c42d9f4d7168b4d8e374ddb5ed0499ea1394a306
2019-05-08 12:13:01 +08:00
Xu Peng
b36a524739 refactor(db): using traits
Former-commit-id: 6496aa13a3ba40d4bec2e32a1ad6f10377055775
2019-05-08 12:13:01 +08:00
Xu Peng
9e43c45de4 feat(db): support trait for engine
Former-commit-id: cfb90e35386177032fa0c4ac7b8c81f29a536571
2019-05-08 12:13:01 +08:00
groot
5897f415ad addd log
Former-commit-id: e950e203afc9c259a4530fd8c9b6ce95da4cb4bc
2019-05-07 12:11:39 +08:00
xj.lin
2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
Xu Peng
496989bbe4 refactor(db): add more debug log
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
2019-05-05 18:02:11 +08:00
Xu Peng
d3cbc1ccad fix(db): db desctruction bug fix
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
2019-05-05 17:26:50 +08:00
Xu Peng
8a029c9b0d refactor(db): add copyright header
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
2019-05-05 13:10:04 +08:00
Xu Peng
72f096bfca refactor(db): typedef ptr for memvectors
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
2019-05-05 12:55:42 +08:00
Xu Peng
c64e8c9621 refactor(db): typdef meta ptr
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
2019-05-05 10:28:40 +08:00
Xu Peng
f5b0ec50cf refactor(db): typedef engine ptr
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
2019-05-05 10:21:26 +08:00
Xu Peng
85707aa3e9 refactor(db): impl template for engine type part 2
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
2019-05-05 09:38:37 +08:00
Xu Peng
166289cafa refactor(db): impl template for engine type
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
2019-04-30 21:02:13 +08:00
Xu Peng
0e37089c6a refactor(db): refactor all for crtp replacement
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
2019-04-30 20:23:11 +08:00
Xu Peng
67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng
8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng
ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng
62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng
94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng
473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng
95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng
4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
Xu Peng
7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng
204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng
713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng
052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng
cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng
39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
Xu Peng
3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng
9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
Xu Peng
7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng
0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
Xu Peng
f096e0a109 feat(db): add meta impl factory
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
2019-04-29 15:06:35 +08:00
Xu Peng
c1d40bfb3d feat(db): add db factories
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
2019-04-29 14:06:40 +08:00
Xu Peng
5d5bbe842d feat(db): add dates filter for search
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
2019-04-29 12:05:03 +08:00
Xu Peng
5569f22de2 fix(db): no transaction for update_group_file
Former-commit-id: 22b364f8f07cd009391952ba66478879f6b86b6d
2019-04-28 21:01:30 +08:00
Xu Peng
57dfdae3e3 feat(db): fix bug and add exception catch in meta operation
Former-commit-id: 6d33945997e7a528bc729efdad6076d6532f79b3
2019-04-28 18:44:25 +08:00
Xu Peng
486c175b4e feat(db): add serialization mutex
Former-commit-id: f8a3b14c0209a9e36b0510ce48754deefc4ee442
2019-04-28 18:44:25 +08:00
Xu Peng
32b64ab724 feat(db): add more print
Former-commit-id: 42486eb1e1c804e7b5120dc1f0dd12d2f7bd6a96
2019-04-28 18:44:25 +08:00
Xu Peng
5fbe3d9641 feat(db): remove limit for id generator
Former-commit-id: a110cfa01b6207cd76fd1ee000945c04c48b0d88
2019-04-26 17:59:14 +08:00
Xu Peng
062c3aad91 feat(db): merge file optimize
Former-commit-id: fea0d7970fab88f995d9d16d7dfea84dd4fbacb7
2019-04-26 17:18:27 +08:00
Xu Peng
1d9946ff87 feat(db): change sqlite_orm header dependency
Former-commit-id: d682b364b1b27a2af27f0246460bb9bbb6370fd0
2019-04-26 15:37:54 +08:00