nyancrimew
/
LatinIME
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
27,693 Commits
1 Branch
0 Tags
363 MiB
Commit Graph

727 Commits (ab18fb1289e6e9df1e2d0a9d53fda6aa8800eb66)

Author SHA1 Message Date
Keisuke Kuroyanagi 9d4f433e49 Fix bugs of GC. 
- All PtNodes were treated as terminal during GC.
- Cannot delete Ver4 PtNode.

Bug: 11073222
Change-Id: I26e012cc7154b6267e3499559b457dfee601748f
 2013-11-29 20:35:00 +09:00
Keisuke Kuroyanagi 5c48f1970a Merge "Extend unigram probability field to support historical info." 2013-11-29 07:29:54 +00:00
Keisuke Kuroyanagi 16412cca66 Extend unigram probability field to support historical info. 
Bug: 11073222
Change-Id: I9668db89ae5e90271f3d70c86cea458832275bff
 2013-11-29 16:07:29 +09:00
Keisuke Kuroyanagi ebd5541edf Merge "Add timestamp as an argument to updating methods." 2013-11-28 12:02:22 +00:00
Keisuke Kuroyanagi 4fa5588d1b Add timestamp as an argument to updating methods. 
Bug: 11073222
Change-Id: I791787a6af3c920996920cad4e302ac50cf7b568
 2013-11-28 20:43:15 +09:00
Keisuke Kuroyanagi 8ac3c65b00 Add version check to open binary dictionary. 
Bug: 11073222
Change-Id: Iabae12b8f14a9da3cdc804dcc6af443cedeb3f99
 2013-11-28 20:40:26 +09:00
Keisuke Kuroyanagi 8d1daac5a9 Refactoring to extend probability field. 
Bug: 11073222
Change-Id: I147c3ea32834c3c5b9709df502a7dcb5b0180fef
 2013-11-28 18:00:32 +09:00
Keisuke Kuroyanagi 63b7392b8d Merge "Have ver4 support decaying dictionary" 2013-11-27 03:38:21 +00:00
Keisuke Kuroyanagi 24af6ed692 Have ver4 support decaying dictionary 
Bug: 11073222

Change-Id: I7f0002c4743ab3bb1ebaac1bca6e367e6b220010
 2013-11-27 12:14:00 +09:00
Keisuke Kuroyanagi 9cdca3255b Extend jni interface to support time stamp and shortcut. 
Bug: 11073222

Change-Id: I19e0501850917a13ddc756d3e78fc6f6cf3f33c4
 2013-11-26 21:31:26 +09:00
Keisuke Kuroyanagi ca16be7552 Implement addMultipleDictionaryEntries as a jni method. 
Bug: 11757169

Change-Id: Ie1569e0b3c0503588ebfe5d09c7ca06116f54485
 2013-11-26 16:03:10 +09:00
Keisuke Kuroyanagi 0058ae8449 Fix build. 
Change-Id: I28bd3d737def01e62100b86d8c837853da696aef
 2013-11-26 13:00:34 +09:00
Keisuke Kuroyanagi 99ddbe717c Fix offdevice build. 
Bug: 11859139
Change-Id: I2fdad2d1166fba0141db3377c247e1c548c956d3
 2013-11-26 12:31:05 +09:00
Keisuke Kuroyanagi 007672f285 Implement Ver4PatriciaTriePolicy::getProperty. 
Bug: 11073222

Change-Id: I49ecb406113e9ce09550056cdcbed51729531f23
 2013-11-25 14:57:41 +09:00
Keisuke Kuroyanagi 065a427f5d Implement GC for ver4 dict contents. 
Bug: 11073222
Change-Id: Ia4dff07c7f4576897e0d3fc4840aed0ccb535299
 2013-11-25 11:59:43 +09:00
Keisuke Kuroyanagi 4095177c4f Implement GC for terminal Id lookup table. 
Bug: 11073222
Change-Id: I8889ba808755ac39ae0abcfe2f6f0c4ee3a01a03
 2013-11-22 20:27:44 +09:00
Keisuke Kuroyanagi f65dbee3b6 Implement ver4 dict shortcut writing. 
Bug: 11073222
Change-Id: I74247c104bdc2e26c77dd75bc28d2aa209296f63
 2013-11-22 19:37:35 +09:00
Keisuke Kuroyanagi bcde771489 Implement ver4 dictionary GC. 
Bug: 11391130
Change-Id: I8a8c5b24b5922df49f27341a2f94d85513bb7166
 2013-11-22 19:37:33 +09:00
Keisuke Kuroyanagi 1b0e574830 Refactoring: Make GC listeners version independent. 
Bug: 11073222
Change-Id: I831517045edf934e09e9441deb9b57dbc78ff2ee
 2013-11-21 21:07:57 +09:00
Keisuke Kuroyanagi 9882fbb2ee Merge "Implement Ver4PatriciaTriePolicy::needsToRunGC()." 2013-11-21 08:40:26 +00:00
Keisuke Kuroyanagi 4af48b1a7a Implement Ver4PatriciaTriePolicy::needsToRunGC(). 
Bug: 11073222
Change-Id: Ia3fd1be94addb2ba76579e27763f84c5e5156643
 2013-11-21 16:12:09 +09:00
Keisuke Kuroyanagi 15c8b84af8 Merge "Implement Ver4PatriciaTriePolicy::flush()." 2013-11-20 05:35:16 +00:00
Keisuke Kuroyanagi dc14d5fbba Implement Ver4PatriciaTriePolicy::flush(). 
Bug: 11073222
Change-Id: I7da5f7f8b7918ce6cc35d36e1ce993840cad797c
 2013-11-20 14:12:04 +09:00
Keisuke Kuroyanagi 36c3075c7d Reduce MAX_DICT_EXTENDED_REGION_SIZE to 32K. 
Bug: 11740462
Change-Id: I21cb956c692a1bcc5515f47b904f0c9b3dfdc3fd
 2013-11-18 23:45:45 +09:00
Keisuke Kuroyanagi 80bd4a7585 Implement writing empty ver4 dictionary to file. 
Bug: 11073222
Change-Id: Ic1a9295953d091c8e8982264ffff15669c30544c
 2013-11-18 14:57:53 +09:00
Keisuke Kuroyanagi 2687484585 Create empty ver4 dictionary buffer on memory. 
Bug: 11073222
Change-Id: Ia1f4d7782e019fdc6a4162f942f433d8b150b49d
 2013-11-13 16:40:04 +09:00
Keisuke Kuroyanagi ff4b1d1fd0 Implement ver4 dictionary bigram removing methods. 
Bug: 11073222
Change-Id: I0c42e283d1ff983dc2c51e91b167bc39cdfd3da8
 2013-11-13 16:40:01 +09:00
Keisuke Kuroyanagi fe05173198 Merge "Implement ver4 dictionary bigram writing methods." 2013-11-13 05:23:57 +00:00
Keisuke Kuroyanagi 99808b7b0d Implement ver4 dictionary bigram writing methods. 
Bug: 11073222
Change-Id: Ibb0e697fe14dac1edb1f3074fb59e2cdc91039d4
 2013-11-12 21:10:01 +09:00
Keisuke Kuroyanagi 180419b20c Merge "Implement ver4 dictionary unigram writing methods." 2013-11-07 09:42:40 +00:00
Keisuke Kuroyanagi 3fe9458b6d Implement ver4 dictionary unigram writing methods. 
Bug: 11073222
Change-Id: Ibdb6846fee98919bb5f845170c19d7d571fcb88d
 2013-11-07 17:58:27 +09:00
Keisuke Kuroyanagi fc1824ea55 Merge "Use sysconf(_SC_PAGESIZE) instead of getpagesize()." 2013-11-07 06:19:48 +00:00
Keisuke Kuroyanagi 75534b98ca Use sysconf(_SC_PAGESIZE) instead of getpagesize(). 
Bug: 11563061
Change-Id: I1350f0b1cb8e2bf17cdce34b7429763bbb6b2856
 2013-11-07 14:53:20 +09:00
Keisuke Kuroyanagi 956ca35157 Refactoring: Separate updating methods from writing methods. 
Bug: 11073222

Change-Id: I5e9df7276a8c167f31423bebf30bd26bde74fc92
 2013-11-06 19:22:37 +09:00
Keisuke Kuroyanagi 0be85cfdf7 Refactoring: PtNodeWriter to separate version specific writing methods. 
Bug: 11073222

Change-Id: Id2ade16316f33e17ead5faf45404a2054c303d74
 2013-11-06 19:22:34 +09:00
Keisuke Kuroyanagi b460c85589 Implement ver4 shortcut reading method. 
Bug: 11073222
Change-Id: I3738c7ce07f500920bde8d3f985cf6e8ecb40b6a
 2013-11-06 18:09:35 +09:00
Keisuke Kuroyanagi 9b3e59d644 Implement ver4 bigram reading method. 
Bug: 11073222
Change-Id: I7b3408938f304da361201892e0a1342fdf92e62e
 2013-11-05 16:00:26 +09:00
Keisuke Kuroyanagi 6e15f8a17f Implement TerminalPositionLookupTable. 
Bug: 11073222
Change-Id: I2ffe8ffc290fb69afc0eca35b5fed7157f5108fd
 2013-11-01 17:54:23 -07:00
Keisuke Kuroyanagi 1c62341de6 Implement SparseTable in native code. 
Bug: 11073222
Change-Id: Ia2cbb2fecfae0c9f621600483d96a55aef75c1b8
 2013-11-01 11:03:41 -07:00
Keisuke Kuroyanagi b3691b5642 Implement ver4 dict PtNode reading methods. 
Bug: 11073222
Change-Id: I03af717ff02a621d9be8eb554d8f1438a500339b
 2013-10-31 11:01:41 -07:00
Keisuke Kuroyanagi ecbd8af169 Implement ProbabilityDictContent. 
Bug: 11073222
Change-Id: Ia57c940fe3507a53b9d32aa6b9ebc5581c08d11f
 2013-10-28 21:41:41 -07:00
Keisuke Kuroyanagi b8a1e8fa33 Add uint reading method to BufferWithExtendableBuffer. 
Bug: 11073222
Change-Id: Iff503cba883dd6f4ce9079783ad6a2edf464ffba
 2013-10-28 15:32:57 -07:00
Keisuke Kuroyanagi 41b77116d3 Merge "Refactoring: Move some methods to the reading helper." 2013-10-28 22:12:06 +00:00
Keisuke Kuroyanagi 2271c23dc6 Open dictionary files always using O_RDONLY. 
We never directly write to opened and mmapped files.

Bug: 11391620

Change-Id: Ic52fbe6018b8b3c1b6ca687461f29185809217c2
 2013-10-25 17:35:37 -07:00
Keisuke Kuroyanagi 3f0a8e3fb0 Refactoring: Move some methods to the reading helper. 
To handle multiple dictionary formats in helpers.

Bug: 11073222
Change-Id: I376bbdea934e13588feca02b9865105742f1a058
 2013-10-25 12:32:36 -07:00
Keisuke Kuroyanagi c481d0556f Refactoring: Introduce PtNode and PtNodeReader. 
To handle multiple dictionary formats in helpers.

Bug: 11073222

Change-Id: Iaef7be08534f9010e837ffcf8c8292b174b64d2b
 2013-10-25 11:18:55 -07:00
Keisuke Kuroyanagi 75d7f0fbf5 Introduce Ver4DictBuffers to handle multiple buffers. 
Bug: 11073222
Change-Id: Icacca8133c0030b19ca826fbf9525f41a1ac6cc8
 2013-10-24 23:45:01 -07:00
Keisuke Kuroyanagi 1e34cc1698 Introduce DictContent for ver4 dict. 
Bug: 11073222
Change-Id: I88ab3948a98388931d81c97825c9d2c76e15a44b
 2013-10-24 17:42:56 -07:00
Keisuke Kuroyanagi e5cfb77694 Introduce ExclusiveOwnershipPointer. 
Bug: 11073222
Change-Id: I841527f0247f2ade07796406729b3a4a8958aa57
 2013-10-24 17:28:30 -07:00
Keisuke Kuroyanagi 4fd413b7e4 Merge "Tracking minor errors to categorize exact match." 2013-10-21 12:32:03 +00:00