nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
27676 commits 1 branch 0 tags 363 MiB
Commit graph

630 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
8ac3c65b00 Add version check to open binary dictionary. 
Bug: 11073222
Change-Id: Iabae12b8f14a9da3cdc804dcc6af443cedeb3f99
 2013-11-28 20:40:26 +09:00
Keisuke Kuroyanagi
8d1daac5a9 Refactoring to extend probability field. 
Bug: 11073222
Change-Id: I147c3ea32834c3c5b9709df502a7dcb5b0180fef
 2013-11-28 18:00:32 +09:00
Keisuke Kuroyanagi
24af6ed692 Have ver4 support decaying dictionary 
Bug: 11073222

Change-Id: I7f0002c4743ab3bb1ebaac1bca6e367e6b220010
 2013-11-27 12:14:00 +09:00
Keisuke Kuroyanagi
0058ae8449 Fix build. 
Change-Id: I28bd3d737def01e62100b86d8c837853da696aef
 2013-11-26 13:00:34 +09:00
Keisuke Kuroyanagi
99ddbe717c Fix offdevice build. 
Bug: 11859139
Change-Id: I2fdad2d1166fba0141db3377c247e1c548c956d3
 2013-11-26 12:31:05 +09:00
Keisuke Kuroyanagi
007672f285 Implement Ver4PatriciaTriePolicy::getProperty. 
Bug: 11073222

Change-Id: I49ecb406113e9ce09550056cdcbed51729531f23
 2013-11-25 14:57:41 +09:00
Keisuke Kuroyanagi
065a427f5d Implement GC for ver4 dict contents. 
Bug: 11073222
Change-Id: Ia4dff07c7f4576897e0d3fc4840aed0ccb535299
 2013-11-25 11:59:43 +09:00
Keisuke Kuroyanagi
4095177c4f Implement GC for terminal Id lookup table. 
Bug: 11073222
Change-Id: I8889ba808755ac39ae0abcfe2f6f0c4ee3a01a03
 2013-11-22 20:27:44 +09:00
Keisuke Kuroyanagi
f65dbee3b6 Implement ver4 dict shortcut writing. 
Bug: 11073222
Change-Id: I74247c104bdc2e26c77dd75bc28d2aa209296f63
 2013-11-22 19:37:35 +09:00
Keisuke Kuroyanagi
bcde771489 Implement ver4 dictionary GC. 
Bug: 11391130
Change-Id: I8a8c5b24b5922df49f27341a2f94d85513bb7166
 2013-11-22 19:37:33 +09:00
Keisuke Kuroyanagi
1b0e574830 Refactoring: Make GC listeners version independent. 
Bug: 11073222
Change-Id: I831517045edf934e09e9441deb9b57dbc78ff2ee
 2013-11-21 21:07:57 +09:00
Keisuke Kuroyanagi
9882fbb2ee Merge "Implement Ver4PatriciaTriePolicy::needsToRunGC()." 2013-11-21 08:40:26 +00:00
Keisuke Kuroyanagi
4af48b1a7a Implement Ver4PatriciaTriePolicy::needsToRunGC(). 
Bug: 11073222
Change-Id: Ia3fd1be94addb2ba76579e27763f84c5e5156643
 2013-11-21 16:12:09 +09:00
Keisuke Kuroyanagi
15c8b84af8 Merge "Implement Ver4PatriciaTriePolicy::flush()." 2013-11-20 05:35:16 +00:00
Keisuke Kuroyanagi
dc14d5fbba Implement Ver4PatriciaTriePolicy::flush(). 
Bug: 11073222
Change-Id: I7da5f7f8b7918ce6cc35d36e1ce993840cad797c
 2013-11-20 14:12:04 +09:00
Keisuke Kuroyanagi
36c3075c7d Reduce MAX_DICT_EXTENDED_REGION_SIZE to 32K. 
Bug: 11740462
Change-Id: I21cb956c692a1bcc5515f47b904f0c9b3dfdc3fd
 2013-11-18 23:45:45 +09:00
Keisuke Kuroyanagi
80bd4a7585 Implement writing empty ver4 dictionary to file. 
Bug: 11073222
Change-Id: Ic1a9295953d091c8e8982264ffff15669c30544c
 2013-11-18 14:57:53 +09:00
Keisuke Kuroyanagi
2687484585 Create empty ver4 dictionary buffer on memory. 
Bug: 11073222
Change-Id: Ia1f4d7782e019fdc6a4162f942f433d8b150b49d
 2013-11-13 16:40:04 +09:00
Keisuke Kuroyanagi
ff4b1d1fd0 Implement ver4 dictionary bigram removing methods. 
Bug: 11073222
Change-Id: I0c42e283d1ff983dc2c51e91b167bc39cdfd3da8
 2013-11-13 16:40:01 +09:00
Keisuke Kuroyanagi
fe05173198 Merge "Implement ver4 dictionary bigram writing methods." 2013-11-13 05:23:57 +00:00
Keisuke Kuroyanagi
99808b7b0d Implement ver4 dictionary bigram writing methods. 
Bug: 11073222
Change-Id: Ibb0e697fe14dac1edb1f3074fb59e2cdc91039d4
 2013-11-12 21:10:01 +09:00
Keisuke Kuroyanagi
180419b20c Merge "Implement ver4 dictionary unigram writing methods." 2013-11-07 09:42:40 +00:00
Keisuke Kuroyanagi
3fe9458b6d Implement ver4 dictionary unigram writing methods. 
Bug: 11073222
Change-Id: Ibdb6846fee98919bb5f845170c19d7d571fcb88d
 2013-11-07 17:58:27 +09:00
Keisuke Kuroyanagi
fc1824ea55 Merge "Use sysconf(_SC_PAGESIZE) instead of getpagesize()." 2013-11-07 06:19:48 +00:00
Keisuke Kuroyanagi
75534b98ca Use sysconf(_SC_PAGESIZE) instead of getpagesize(). 
Bug: 11563061
Change-Id: I1350f0b1cb8e2bf17cdce34b7429763bbb6b2856
 2013-11-07 14:53:20 +09:00
Keisuke Kuroyanagi
956ca35157 Refactoring: Separate updating methods from writing methods. 
Bug: 11073222

Change-Id: I5e9df7276a8c167f31423bebf30bd26bde74fc92
 2013-11-06 19:22:37 +09:00
Keisuke Kuroyanagi
0be85cfdf7 Refactoring: PtNodeWriter to separate version specific writing methods. 
Bug: 11073222

Change-Id: Id2ade16316f33e17ead5faf45404a2054c303d74
 2013-11-06 19:22:34 +09:00
Keisuke Kuroyanagi
b460c85589 Implement ver4 shortcut reading method. 
Bug: 11073222
Change-Id: I3738c7ce07f500920bde8d3f985cf6e8ecb40b6a
 2013-11-06 18:09:35 +09:00
Keisuke Kuroyanagi
9b3e59d644 Implement ver4 bigram reading method. 
Bug: 11073222
Change-Id: I7b3408938f304da361201892e0a1342fdf92e62e
 2013-11-05 16:00:26 +09:00
Keisuke Kuroyanagi
6e15f8a17f Implement TerminalPositionLookupTable. 
Bug: 11073222
Change-Id: I2ffe8ffc290fb69afc0eca35b5fed7157f5108fd
 2013-11-01 17:54:23 -07:00
Keisuke Kuroyanagi
1c62341de6 Implement SparseTable in native code. 
Bug: 11073222
Change-Id: Ia2cbb2fecfae0c9f621600483d96a55aef75c1b8
 2013-11-01 11:03:41 -07:00
Keisuke Kuroyanagi
b3691b5642 Implement ver4 dict PtNode reading methods. 
Bug: 11073222
Change-Id: I03af717ff02a621d9be8eb554d8f1438a500339b
 2013-10-31 11:01:41 -07:00
Keisuke Kuroyanagi
ecbd8af169 Implement ProbabilityDictContent. 
Bug: 11073222
Change-Id: Ia57c940fe3507a53b9d32aa6b9ebc5581c08d11f
 2013-10-28 21:41:41 -07:00
Keisuke Kuroyanagi
b8a1e8fa33 Add uint reading method to BufferWithExtendableBuffer. 
Bug: 11073222
Change-Id: Iff503cba883dd6f4ce9079783ad6a2edf464ffba
 2013-10-28 15:32:57 -07:00
Keisuke Kuroyanagi
41b77116d3 Merge "Refactoring: Move some methods to the reading helper." 2013-10-28 22:12:06 +00:00
Keisuke Kuroyanagi
2271c23dc6 Open dictionary files always using O_RDONLY. 
We never directly write to opened and mmapped files.

Bug: 11391620

Change-Id: Ic52fbe6018b8b3c1b6ca687461f29185809217c2
 2013-10-25 17:35:37 -07:00
Keisuke Kuroyanagi
3f0a8e3fb0 Refactoring: Move some methods to the reading helper. 
To handle multiple dictionary formats in helpers.

Bug: 11073222
Change-Id: I376bbdea934e13588feca02b9865105742f1a058
 2013-10-25 12:32:36 -07:00
Keisuke Kuroyanagi
c481d0556f Refactoring: Introduce PtNode and PtNodeReader. 
To handle multiple dictionary formats in helpers.

Bug: 11073222

Change-Id: Iaef7be08534f9010e837ffcf8c8292b174b64d2b
 2013-10-25 11:18:55 -07:00
Keisuke Kuroyanagi
75d7f0fbf5 Introduce Ver4DictBuffers to handle multiple buffers. 
Bug: 11073222
Change-Id: Icacca8133c0030b19ca826fbf9525f41a1ac6cc8
 2013-10-24 23:45:01 -07:00
Keisuke Kuroyanagi
1e34cc1698 Introduce DictContent for ver4 dict. 
Bug: 11073222
Change-Id: I88ab3948a98388931d81c97825c9d2c76e15a44b
 2013-10-24 17:42:56 -07:00
Keisuke Kuroyanagi
e5cfb77694 Introduce ExclusiveOwnershipPointer. 
Bug: 11073222
Change-Id: I841527f0247f2ade07796406729b3a4a8958aa57
 2013-10-24 17:28:30 -07:00
Keisuke Kuroyanagi
4fd413b7e4 Merge "Tracking minor errors to categorize exact match." 2013-10-21 12:32:03 +00:00
Keisuke Kuroyanagi
eb5049b28d Tracking minor errors to categorize exact match. 
Bug: 8844931

Change-Id: I012529f5fc0d094ef64a41c075fe548b6b439265
 2013-10-21 21:01:59 +09:00
Keisuke Kuroyanagi
0913aaa56f Merge "Add utility methods related to buffers for ver4 dict." 2013-10-21 11:03:08 +00:00
Keisuke Kuroyanagi
72877b15ea Add utility methods related to buffers for ver4 dict. 
Bug: 11073222
Change-Id: Ieca15ffa09fd36c6602f6d2afab5779800c5a422
 2013-10-21 19:56:50 +09:00
Keisuke Kuroyanagi
53686e0f5f Fix: Suggested words from user history are invalid. 
- Suggestions form user history can contain invalid words.
- isValidWord always returns false.

Bug: 11139426
Change-Id: I6075b275603332ddb00f4a9284afcaa82d824270
 2013-10-18 19:53:57 +09:00
Keisuke Kuroyanagi
2628268ef4 Add ver4 dictionary structure policy file. 
Bug: 11073222
Change-Id: Ia9e1a4842d42a581812a8c3dd4a85e7ee86dd529
 2013-10-16 18:46:32 +09:00
Keisuke Kuroyanagi
427d69e218 Moving files for dictionary structure policies. 
Bug: 11073222
Change-Id: Ic40f6258e2b0c2790d526aff31312c112760839d
 2013-10-16 18:46:32 +09:00
Keisuke Kuroyanagi
c1fce1a720 Make "node"s clear by renaming to PtNode or DicNode. 
Bug: 10233675
Change-Id: I248b927c724253f593e3806e82b4e1fed2c025fb
 2013-10-16 18:46:28 +09:00
Keisuke Kuroyanagi
e1bd7d5d39 Initial step to support version 4 format in native code. 
Bug: 11073222
Change-Id: I633229381b28cef23edef2b37e5b0bf6e15af468
 2013-10-09 12:54:33 +09:00