647ea07eb1
Purge ver3 dictionary reading in native code.
...
Bug: 11073222
Change-Id: I52892516fc9b8f1efdddb175da1bc87cbc0c66f0
2013-12-02 21:59:56 +09:00
e717f64659
Purge Ver3 dictionary writing in native code.
...
Bug: 11073222
Change-Id: Iccedd618970b270a1e4178cfb178cd87c8208f3d
2013-12-02 21:59:56 +09:00
99ddbe717c
Fix offdevice build.
...
Bug: 11859139
Change-Id: I2fdad2d1166fba0141db3377c247e1c548c956d3
2013-11-26 12:31:05 +09:00
4095177c4f
Implement GC for terminal Id lookup table.
...
Bug: 11073222
Change-Id: I8889ba808755ac39ae0abcfe2f6f0c4ee3a01a03
2013-11-22 20:27:44 +09:00
f65dbee3b6
Implement ver4 dict shortcut writing.
...
Bug: 11073222
Change-Id: I74247c104bdc2e26c77dd75bc28d2aa209296f63
2013-11-22 19:37:35 +09:00
dc14d5fbba
Implement Ver4PatriciaTriePolicy::flush().
...
Bug: 11073222
Change-Id: I7da5f7f8b7918ce6cc35d36e1ce993840cad797c
2013-11-20 14:12:04 +09:00
80bd4a7585
Implement writing empty ver4 dictionary to file.
...
Bug: 11073222
Change-Id: Ic1a9295953d091c8e8982264ffff15669c30544c
2013-11-18 14:57:53 +09:00
99808b7b0d
Implement ver4 dictionary bigram writing methods.
...
Bug: 11073222
Change-Id: Ibb0e697fe14dac1edb1f3074fb59e2cdc91039d4
2013-11-12 21:10:01 +09:00
3fe9458b6d
Implement ver4 dictionary unigram writing methods.
...
Bug: 11073222
Change-Id: Ibdb6846fee98919bb5f845170c19d7d571fcb88d
2013-11-07 17:58:27 +09:00
956ca35157
Refactoring: Separate updating methods from writing methods.
...
Bug: 11073222
Change-Id: I5e9df7276a8c167f31423bebf30bd26bde74fc92
2013-11-06 19:22:37 +09:00
0be85cfdf7
Refactoring: PtNodeWriter to separate version specific writing methods.
...
Bug: 11073222
Change-Id: Id2ade16316f33e17ead5faf45404a2054c303d74
2013-11-06 19:22:34 +09:00
1c62341de6
Implement SparseTable in native code.
...
Bug: 11073222
Change-Id: Ia2cbb2fecfae0c9f621600483d96a55aef75c1b8
2013-11-01 11:03:41 -07:00
b3691b5642
Implement ver4 dict PtNode reading methods.
...
Bug: 11073222
Change-Id: I03af717ff02a621d9be8eb554d8f1438a500339b
2013-10-31 11:01:41 -07:00
ecbd8af169
Implement ProbabilityDictContent.
...
Bug: 11073222
Change-Id: Ia57c940fe3507a53b9d32aa6b9ebc5581c08d11f
2013-10-28 21:41:41 -07:00
75d7f0fbf5
Introduce Ver4DictBuffers to handle multiple buffers.
...
Bug: 11073222
Change-Id: Icacca8133c0030b19ca826fbf9525f41a1ac6cc8
2013-10-24 23:45:01 -07:00
e5cfb77694
Introduce ExclusiveOwnershipPointer.
...
Bug: 11073222
Change-Id: I841527f0247f2ade07796406729b3a4a8958aa57
2013-10-24 17:28:30 -07:00
4fd413b7e4
Merge "Tracking minor errors to categorize exact match."
2013-10-21 12:32:03 +00:00
eb5049b28d
Tracking minor errors to categorize exact match.
...
Bug: 8844931
Change-Id: I012529f5fc0d094ef64a41c075fe548b6b439265
2013-10-21 21:01:59 +09:00
2628268ef4
Add ver4 dictionary structure policy file.
...
Bug: 11073222
Change-Id: Ia9e1a4842d42a581812a8c3dd4a85e7ee86dd529
2013-10-16 18:46:32 +09:00
427d69e218
Moving files for dictionary structure policies.
...
Bug: 11073222
Change-Id: Ic40f6258e2b0c2790d526aff31312c112760839d
2013-10-16 18:46:32 +09:00
13d5dc914a
Change name of DecayingUtils.
...
Bug: 6669677
Change-Id: I97839b2184b95ae1659c55a9b31d22e2d601cba1
2013-10-02 16:23:44 +09:00
fd02b2d6ee
Implement simple dictionary decay.
...
Groundwork and implement simple decay.
Increment probability when typed and decrement probability
at GC.
Bug: 6669677
Change-Id: Ib12caead0cbeef4ce7808fe8ac0b00ee331523fe
2013-09-30 20:53:35 +09:00
1592eb8a3a
Prepare dictionary file creating in native code.
...
Bug: 6669677
Change-Id: I7c476a6e99ec7ac883f05d84ef306265255154da
2013-09-26 10:48:43 +09:00
2a64726a16
Step 1 to implement GC. Finding garbage PtNodes.
...
Bug: 6669677
Change-Id: I3551fe2f16a09d2bf7761f4e1d73ebd4a03380e7
2013-09-20 15:37:14 +09:00
e28927dfb6
Change name of header_reading_utlis.*
...
Bug: 6669677
Change-Id: I91389050148237580ef640d3a58b935ea752954e
2013-09-18 18:27:01 +09:00
96a0631664
DynamicPatriciaTrieWritingUtils to write PtNodes.
...
Bug: 6669677
Change-Id: I67cce3c1d338cf747ed2204c96768907d990d269
2013-09-05 20:12:56 +09:00
5d8fd5457d
Change name of bigram_list_reading_utils.* .
...
Bug: 6669677
Change-Id: Ifd2baa11fb4ee083be1d23e8235f6f903c1b5747
2013-09-03 20:44:58 +09:00
202e416b51
Add bigram writing methods.
...
Bug: 6669677
Change-Id: Ib62f6c31c4bcbb41ac200dccccb13e366b3c2173
2013-09-03 20:44:51 +09:00
f1cd7a081c
Implement reading side of updating methods of dpt.
...
Reading methods are used to determine the position to
be updated in dynamic patricia trie.
Bug: 6669677
Change-Id: Ie9acdcdbc73aa3fd4294c97aa39451a96b165ed9
2013-09-03 14:47:30 +09:00
2660f83a12
Change name of extendable_buffer.h to buffer_with_... .
...
Bug: 6669677
Change-Id: Id2bd79d8f86c690d5c16d1ab726c5f6fa28ba5e3
2013-09-02 17:18:41 +09:00
4d814bfcb7
Introduce DynamicPatriciaTrieReadingHelper.
...
It supports iterating nodes and dealing with additional
buffer. It counts nodes and node arrays to avoid infinite
loop.
Bug: 6669677
Change-Id: I322e7263c0535e098635a1e5de098838de09467d
2013-08-30 19:41:58 +09:00
941811cbd6
Introduce ExtendableBuffer for dynamic update.
...
Bug: 6669677
Change-Id: I6343c348334c0dace8b12a71eb992d6f040e8c95
2013-08-22 18:05:15 +09:00
112257e40f
Rename BinaryDictDecoder to Ver3DictDecoder.
...
Change-Id: Ibf9b95b658df6e2c2218bdb62e2380f326a03832
2013-08-20 17:11:51 +09:00
94460eba11
[Refactor] Divide BinaryDictInputOutput into BinaryDictEncoder and BinaryDictDecoder.
...
Change-Id: I7c3269d77e3e3b567e459dcaa1bc029903941744
2013-08-15 20:23:07 +09:00
e7870a2c0d
Add an initial JNI interface to dicttool.
...
Bug: 10100269
Change-Id: I883992c2033e7d9e7c754c0bf653767728b221b6
2013-08-15 17:58:55 +09:00
90619ae02b
Move utils for reading dict to policyimpl.
...
Bug: 6669677
Change-Id: Ia1da3cb84b457665cf26172d3810e1d28329bca4
2013-08-14 15:50:42 +09:00
23d3ed962f
Move files for headerPolicy to policyimpl.
...
Bug: 6669677
Change-Id: Ic90feb9c3a9a7b698e588c8ad25c765a246706a8
2013-08-13 20:35:16 +09:00
f1e383ed45
Change name of shortcut reading util class.
...
Bug: 6669677
Change-Id: If93916f4c3d568119ff6b83e22e95c7086423d2f
2013-08-12 17:37:59 +09:00
7c48352af8
Move methods for Shortcut reading to policyimpl.
...
Bug: 6669677
Change-Id: If0a565de015564f803429f4fbf21b05687f80553
2013-08-12 17:18:28 +09:00
277053af7c
Move bigram reading methods to BigramListReadingUtils.
...
Bug: 6669677
Change-Id: Icb024a8af577323b4dcf74f4c4054cfb8b57a943
2013-08-12 11:54:31 +09:00
e1ebef6124
Make DictionaryStructurePolicy have buffer info.
...
To support various format dictionary, extendable
buffers or multiple files.
Bug: 6669677
Change-Id: I203a5a4adc049a6322cfba4eacb4cb6715f8dfc2
2013-08-09 05:27:22 +00:00
2b1dd6e253
Implement a part of ver 3 dictionary reading methods.
...
Bug: 6669677
Change-Id: I83c159838ad99b2093907b9de7df6cb7a97b4165
2013-08-06 10:18:20 +09:00
647c000707
Give PatriciaTrieReadingUtils methods for reading nodes.
...
The remaining methods in BinaryFormat will be removed.
Bug: 6669677
Change-Id: I866f828d69a600c0ac03b68d71b1f6ee2ce4dd36
2013-08-01 16:15:35 +09:00
26de7079b6
Introduce DynamicPatriciaTriePolicy for ver 3 dictionary.
...
Bug: 6669677
Change-Id: Idd3189558aa6fbbd6b2fd007c5721bf39dde9f48
2013-07-30 17:41:13 +09:00
b6f5d3e39d
Fix offdevice compilation
...
Change-Id: I8bccccbc51b308fddfbbc990f7bfe1c490259372
2013-07-02 15:19:16 +09:00
c5e6efafff
Introduce patriciaTrie to abstract traversing version 2 dictionary.
...
Bug: 6669677
Change-Id: Ifef72f3d7a7ba67c5232b98c7835485d72d7322d
2013-06-28 19:47:00 +09:00
af9d92f590
Rename BinaryDictionaryBigramsReadingUtils to BinaryDictionaryTerminalAttributesReadingUtils and remanme the class methods
...
Bug: 6669677
Change-Id: I960dcf51a950ead2c3d7b9dedcde0a450569cbe9
2013-06-24 09:42:37 +09:00
1ff81e8890
Use bloom filter in multi bigram map.
...
Evaluated with previous word "this".
without bloom filter (use only hash_map):
Total 147792.34 (sum of others 147771.57)
with bloom filter:
Total 145900.64 (sum of others 145874.30)
always read binary dictionary:
Total 148603.14 (sum of others 148579.90)
Bug: 8592527
Change-Id: I821dc39454543826adb73b9eeeef6408fad8ae28
2013-06-14 20:35:41 +09:00
a71ed8caa2
Introduce BinaryDictionaryBigramsIterator to access bigrams attributes in binary dictionaries.
...
Bug: 6669677
Change-Id: Ifb1adebc5305a930c80396f6b4ec31d84400a9dc
2013-06-14 18:12:56 +09:00
0b7cd6a0b2
Fix: Android.mk for autocorrection_threshold_utils.
...
Change-Id: I3ea0811ca7c2c1a88351ee2ba5cc13d7096865ba
2013-06-11 18:05:04 +09:00
Keisuke Kuroyanagi
Yuichiro Hanada
Jean Chalard