Yuichiro Hanada
|
94460eba11
|
[Refactor] Divide BinaryDictInputOutput into BinaryDictEncoder and BinaryDictDecoder.
Change-Id: I7c3269d77e3e3b567e459dcaa1bc029903941744
|
2013-08-15 20:23:07 +09:00 |
|
Keisuke Kuroyanagi
|
d14ffcfcbc
|
Remove BinaryDictionaryInfo and introduce MmapedBuffer.
Bug: 6669677
Change-Id: I1459bb53a9761d920427e4b5d925a2844955c88c
|
2013-08-15 18:17:44 +09:00 |
|
Keisuke Kuroyanagi
|
08ce337d3f
|
Fix: BinaryDictionaryInfo.isDynamicallyUpdatable().
Change-Id: Ifb3acded5e19f1302c7fcc8881b74addd20c1571
|
2013-08-15 13:39:32 +09:00 |
|
Keisuke Kuroyanagi
|
6ec3f63d59
|
Merge "Make dictionary structure policy have updating methods."
|
2013-08-15 03:15:43 +00:00 |
|
Yuichiro Hanada
|
46ebaa49e9
|
Fix a comment.
Change-Id: I5d09fd2474c7a0e6f42b6c7c6e717692636fbc6d
|
2013-08-15 11:57:58 +09:00 |
|
Keisuke Kuroyanagi
|
7fd9667d76
|
Remove NodeFilter.
Change-Id: I27d905dd3581cbb0e67d071dba04066aaa2ba22e
|
2013-08-14 18:20:15 +09:00 |
|
Keisuke Kuroyanagi
|
dfecc86f25
|
Fix ShortcutListPolicy::getStartPos().
Bug: 6669677
Change-Id: I1fa9967fc6aa0956986954c8ea1f990a47c15764
|
2013-08-14 17:23:57 +09:00 |
|
Keisuke Kuroyanagi
|
90619ae02b
|
Move utils for reading dict to policyimpl.
Bug: 6669677
Change-Id: Ia1da3cb84b457665cf26172d3810e1d28329bca4
|
2013-08-14 15:50:42 +09:00 |
|
Keisuke Kuroyanagi
|
66facd37dd
|
Make dictionary structure policy have updating methods.
Bug: 6669677
Change-Id: I6aa8e377c6347e0db4b7a82293b316ec64d87bec
|
2013-08-14 11:34:42 +09:00 |
|
Keisuke Kuroyanagi
|
23d3ed962f
|
Move files for headerPolicy to policyimpl.
Bug: 6669677
Change-Id: Ic90feb9c3a9a7b698e588c8ad25c765a246706a8
|
2013-08-13 20:35:16 +09:00 |
|
Keisuke Kuroyanagi
|
76e579c7ca
|
Move header reading methods to policyimpl.
Bug: 6669677
Change-Id: I24cb32f28cf355485b431cc56d877000e3f946d4
|
2013-08-13 20:22:40 +09:00 |
|
Keisuke Kuroyanagi
|
d81654cd61
|
Use DictionaryStructureWithBufferPolicy for traversing.
Bug: 6669677
Change-Id: If7bc038278b7217ed5ba4cb77b1238b2dad0001b
|
2013-08-13 19:38:20 +09:00 |
|
Keisuke Kuroyanagi
|
e607e0722a
|
Merge "Remove TerminalAttributes."
|
2013-08-13 05:58:35 +00:00 |
|
Keisuke Kuroyanagi
|
b40d14226b
|
Merge "Quit using BinaryDictionaryInfo in header reading methods."
|
2013-08-13 05:49:49 +00:00 |
|
Keisuke Kuroyanagi
|
99007de979
|
Quit using BinaryDictionaryInfo in header reading methods.
Bug: 6669677
Change-Id: I5198ae28fcc271dd6ab3c33df940a2d15513a8c8
|
2013-08-13 12:26:01 +09:00 |
|
Keisuke Kuroyanagi
|
6abdafc671
|
Remove TerminalAttributes.
Use BinaryDictionaryShortcutIterator instead of
TerminalAttributes.
Bug: 6669677
Change-Id: Ib7176e3b302ba383344cc6fcc037e23568c702a8
|
2013-08-12 17:46:13 +09:00 |
|
Keisuke Kuroyanagi
|
f4688f8df0
|
Cleanup ShortcutListReadingUtils.
Bug: 6669677
Change-Id: Ifd61022665c89f492933dde9811ec644f7e1f5c4
|
2013-08-12 17:46:13 +09:00 |
|
Keisuke Kuroyanagi
|
f1e383ed45
|
Change name of shortcut reading util class.
Bug: 6669677
Change-Id: If93916f4c3d568119ff6b83e22e95c7086423d2f
|
2013-08-12 17:37:59 +09:00 |
|
Keisuke Kuroyanagi
|
7c48352af8
|
Move methods for Shortcut reading to policyimpl.
Bug: 6669677
Change-Id: If0a565de015564f803429f4fbf21b05687f80553
|
2013-08-12 17:18:28 +09:00 |
|
Keisuke Kuroyanagi
|
fd10db04e0
|
Move shortcut iteration methods to poilcy.
Bug: 6669677
Change-Id: I6e535ce7962de8e153a52fd1085fe961649ffe16
|
2013-08-12 15:53:09 +09:00 |
|
Keisuke Kuroyanagi
|
277053af7c
|
Move bigram reading methods to BigramListReadingUtils.
Bug: 6669677
Change-Id: Icb024a8af577323b4dcf74f4c4054cfb8b57a943
|
2013-08-12 11:54:31 +09:00 |
|
Keisuke Kuroyanagi
|
668870be43
|
Move bigrams iteration methods to policy.
To support various bigram format.
Bug: 6669677
Change-Id: Ifc8c1a855b03cd5a39d97a6e10872ef8ef76475b
|
2013-08-09 20:20:34 +09:00 |
|
Keisuke Kuroyanagi
|
e1ebef6124
|
Make DictionaryStructurePolicy have buffer info.
To support various format dictionary, extendable
buffers or multiple files.
Bug: 6669677
Change-Id: I203a5a4adc049a6322cfba4eacb4cb6715f8dfc2
|
2013-08-09 05:27:22 +00:00 |
|
Keisuke Kuroyanagi
|
b2408c7f71
|
Fix parent position reading for ver3 dict.
Bug: 6669677
Change-Id: Ia55d4ecb43c7d37b9bc466b848d5142bc13cd823
|
2013-08-08 16:31:17 +09:00 |
|
Keisuke Kuroyanagi
|
60eb250194
|
Support ver3 dict in native code.
Bug: 6669677
Change-Id: Iafc3287f1f87588a6296593d6b43ea4464c8f553
|
2013-08-08 14:53:05 +09:00 |
|
Keisuke Kuroynagi
|
744084defb
|
Implement getTerminalNodePositionOfWord for ver3 dict.
Bug: 6669677
Change-Id: Ib9f88d23e6502b8281921ae2f1e47f930b16972f
|
2013-08-07 17:59:52 +09:00 |
|
Keisuke Kuroynagi
|
9601df5aac
|
Implement getCodePointsAndProbabilityAnd... for ver3 dicts.
Bug: 6669677
Change-Id: I5c3b53d015496e11cb6c1f19938b8ee8a4c0f983
|
2013-08-07 11:53:34 +09:00 |
|
Keisuke Kuroynagi
|
2b1dd6e253
|
Implement a part of ver 3 dictionary reading methods.
Bug: 6669677
Change-Id: I83c159838ad99b2093907b9de7df6cb7a97b4165
|
2013-08-06 10:18:20 +09:00 |
|
Keisuke Kuroynagi
|
22f951c881
|
Merge "Remove checkFirstCharacter from BigramDictionary."
|
2013-08-05 04:56:23 +00:00 |
|
Keisuke Kuroynagi
|
cf1f7675ea
|
DynamicPatriciaTrieReadingUtils for version 3 dictionary.
Bug: 6669677
Change-Id: I7105258a00159a5ddda7ff520c490c4ac9fa7902
|
2013-08-01 16:15:49 +09:00 |
|
Keisuke Kuroynagi
|
647c000707
|
Give PatriciaTrieReadingUtils methods for reading nodes.
The remaining methods in BinaryFormat will be removed.
Bug: 6669677
Change-Id: I866f828d69a600c0ac03b68d71b1f6ee2ce4dd36
|
2013-08-01 16:15:35 +09:00 |
|
Keisuke Kuroynagi
|
f0a7f70cf6
|
Fix: Include wrong file in dynamic_patricia_trie_policy.cpp.
Change-Id: If994f17e41c7d07e979fa6b0aa4661da0523eb0a
|
2013-08-01 14:48:20 +09:00 |
|
Keisuke Kuroynagi
|
8045b7cd24
|
Merge "Introduce DynamicPatriciaTriePolicy for ver 3 dictionary."
|
2013-08-01 05:39:07 +00:00 |
|
Keisuke Kuroynagi
|
2401f7c62d
|
Move binary_format.h to policyimpl.
Bug: 6669677
Change-Id: I3712f60528c7fcf364746f792cec6e180ab2dbef
|
2013-07-31 21:07:32 +09:00 |
|
Keisuke Kuroynagi
|
11a431fca6
|
Fix: appendTwoWords cannot handle MAX_WORD_LENGTH-chars word.
Bug: 9892258
Change-Id: Ib4ef7850c8fc8b1d99d594bb7ef68ce645f0f1f3
|
2013-07-31 16:58:09 +09:00 |
|
Keisuke Kuroynagi
|
2a2aac2568
|
Remove checkFirstCharacter from BigramDictionary.
Bug: 10028452
Change-Id: I27b147e83b312d73e975a0b2bc8074b33906e56e
|
2013-07-31 13:47:23 +09:00 |
|
Keisuke Kuroynagi
|
26de7079b6
|
Introduce DynamicPatriciaTriePolicy for ver 3 dictionary.
Bug: 6669677
Change-Id: Idd3189558aa6fbbd6b2fd007c5721bf39dde9f48
|
2013-07-30 17:41:13 +09:00 |
|
Keisuke Kuroynagi
|
1fb11da36a
|
Move creating children methods to structurePolicy.
Bug: 6669677
Change-Id: I20760f8ab95b18d21383960f6466db0d79429200
|
2013-07-29 19:31:27 +09:00 |
|
Keisuke Kuroynagi
|
9d618d1431
|
Move files only used in dicNode to "internal".
Change-Id: Ib31ddeff99b480d9b1f33a5b5b207a8acce22858
|
2013-07-29 17:03:21 +09:00 |
|
Keisuke Kuroynagi
|
4447b14b78
|
"much" in suggestions of "m" after "very"
Make cache size larger for single point input.
Bug: 9823678
Change-Id: Ic6bbcebd18eccaf9f9ac07d9c0d456a62f6c5287
|
2013-07-26 18:35:42 +09:00 |
|
Satoshi Kataoka
|
75322cecb9
|
Support terminal insertion error correction
Bug: 9421356
Change-Id: I19685763ca487b5636019d62e150708c63ce6fc2
|
2013-07-25 22:07:38 +09:00 |
|
Keisuke Kuroynagi
|
cb4a7c1d87
|
Fix: "saomething" -> "something".
Fixed by making MAX_CACHE_DIC_NODE_SIZE larger.
Bug: 9682742
Change-Id: I0312952c90b0820bed37df99c223921c68450570
|
2013-07-24 17:55:25 +09:00 |
|
Keisuke Kuroynagi
|
62f3b4e9c9
|
Merge "Fix: huge bigram costs for blacklisted words."
|
2013-07-23 05:32:09 +00:00 |
|
Keisuke Kuroynagi
|
5b7688bbb5
|
Fix: native crash while iterating bigramslist.
Bug: 9964153
Change-Id: Ia2eb922b61300a7c0e34122cd6c18358f1ee7ba9
|
2013-07-23 13:13:12 +09:00 |
|
Keisuke Kuroynagi
|
b179199830
|
Fix: huge bigram costs for blacklisted words.
Bug: 8844931
Change-Id: I523005c5ed9a3d401a67b0e4e1c3ff2e4574e6df
|
2013-07-22 22:05:16 +09:00 |
|
Keisuke Kuroynagi
|
c38ec47596
|
Get BigramsPos and ShortcutPos via structure policy.
Bug: 6669677
Change-Id: I924d5512377cfcfe72d3470006b81a36db3865b6
|
2013-07-17 20:13:04 +09:00 |
|
Keisuke Kuroynagi
|
8a7129530b
|
Replace NOT_VALID_WORD with NOT_A_VALID_WORD_POS
Bug: 6669677
Change-Id: If5fb58e8a98b04b767eaaf624cb6a40841b64f54
|
2013-07-16 15:53:03 +09:00 |
|
Keisuke Kuroynagi
|
b6f286bfa5
|
Merge "Make bigram dictionary and traverse session use structure policy."
|
2013-07-16 02:45:36 +00:00 |
|
Keisuke Kuroynagi
|
34047d8905
|
Quit ignoring language cost of exact matches.
Handle exact matches in DicNode::compare() and calculateFinalScore().
Bug: 8844931
Change-Id: I17c78d4e352b0a4308727229b02a8004b38468bf
|
2013-07-11 08:25:17 +00:00 |
|
Keisuke Kuroynagi
|
1311cdcb62
|
Make bigram dictionary and traverse session use structure policy.
Bug: 6669677
Change-Id: I5a13290366afbb788da997b98d1c593963e92f3e
|
2013-07-08 14:25:50 +09:00 |
|