bd1f59bda5
Remove PrevWordsInfo.getBigramsIteratorForPrediction().
...
This changes the behavior of predictions for some rare cases.
For example, let's consider the case of the prev word is
"ABC", "ABC" and "abc" is in the dict, "ABC" doesn't have
any bigrams, and "abc" has bigrams.
Without this change, "abc"'s bigrams are used for
prediction. But, with this change, "abc"'s bigrams are not
used for prediction. This strategy is the same as the the
current way of bigram probability computation during
traversal (for suggestion).
Bug: 14425059
Change-Id: I857ff39aa70aea265efa651451a63b759bb47d48
2014-07-30 17:26:26 +09:00
0b1fa0c1c7
Cleanup: C++11 doesn't require a space between angle brackets
...
Change-Id: Id0777cf3deac94395bd63aee40b49375dff3e35a
2014-07-30 11:32:05 +09:00
6c3b0d3caa
Merge "Add TrieMap." into lmp-dev
2014-07-25 11:19:20 +00:00
de3121dead
Add TrieMap.
...
Bug: 14425059
Change-Id: Ief36f808ed4f3e35bfab07837ea314d2564973ab
2014-07-29 17:00:29 +09:00
2e32e83b6e
Merge "Get n-gram probability in structure policy." into lmp-dev
2014-07-24 16:04:26 +00:00
1229879e7c
Get n-gram probability in structure policy.
...
Bug: 14425059
Change-Id: Id955a2e07dbdfb90ae55720f0c92597e0594c0d9
2014-07-29 12:01:18 +09:00
96d47fe745
Change getUnigramProbabilityOfPtNode to getProbabilityOfPtNode()
...
Bug: 14425059
Change-Id: I92403d750d2979408b41554dcd79b0ed31b41161
2014-07-29 11:35:57 +09:00
179f38cc8c
Merge "Change getUnigramProbabilityOfPtNode to getProbabilityOfPtNode()" into lmp-dev
2014-07-25 11:19:20 +00:00
3225b6fe66
Add boundary check for ver2 bigram reading.
...
Bug: 16330528
Change-Id: I6aca6c7a735e2a652eb325572d44dff660789cff
2014-07-28 21:48:00 +09:00
825243bfdd
Merge "Add BufferWithExtendablebufferTest" into lmp-dev
2014-07-24 15:37:54 +00:00
d4c9d50ef0
Add BufferWithExtendablebufferTest
...
Bug: 13754552
Change-Id: Ib9c330dc85bdb5d4d3d5bc15cc3ce5f28faa0b12
2014-07-25 07:02:10 +09:00
ff6ca09905
Add BufferWithExtendableBuffer::extend()
...
Bug: 14425059
Change-Id: I13dd8412ba4d16a1325ac2210b3852d580e71ad3
2014-07-25 07:02:05 +09:00
dfbe2a8ca8
Merge "Add BufferWithExtendableBuffer::extend()" into lmp-dev
2014-07-24 15:35:58 +00:00
f78eb27c7e
Merge "Refactoring checkAndPrepareWriting." into lmp-dev
2014-07-24 15:35:58 +00:00
5a289ed293
Revert "Revert "Revert "Use mclinker"""
...
This reverts commit b48c93b3fc
2014-07-23 19:58:17 -07:00
6810e8df1e
Refactoring checkAndPrepareWriting.
...
Bug: 14425059
Change-Id: I98940f3841a6c61b0482440b4da21f415dc843f6
2014-07-24 10:24:42 +09:00
81a48d47d1
Add -mstackrealign to avoid crashes with SSE instructions on pre-K x86 devices.
...
bug: 16213554
Change-Id: Icd67ed4fd57fcc5f5bf8039b7892d0d446210247
2014-07-15 20:26:55 +09:00
b22f95ec8a
Remove isUpdatable from constructors of dict contents.
...
Change-Id: I2d54f477d9b341e944e265786a734f23d152bb81
2014-07-11 15:23:55 +09:00
2ac934296c
Concatenate dict buffers other than header to a single file.
...
Bug: 13664080
Change-Id: I34c9d8046b339c9b855be378a5fad907382d1359
2014-07-11 15:15:47 +09:00
198be3a6c5
Fix: wrong bigram entry pos can be used during GC.
...
Bug: 14425059
Change-Id: I4e7c977c5ef184953682175b118de5473cdb64a6
2014-07-09 11:18:35 +09:00
3b8f2ece40
Merge "Move phrase gesture from additional features to public."
2014-07-02 20:35:42 +00:00
b8a9479b57
Move phrase gesture from additional features to public.
...
Bug: 15758242
Change-Id: I703dc2703afdf9402c5d2ac27411b74ece993dba
2014-07-08 16:36:06 +09:00
b00973952f
Get bigrams iterator via dict structure policy.
...
Bug: 14425059
Change-Id: Ie4c6afbb6a3b707b5aa8e9e4f941c9da6e6bcdbf
2014-07-08 16:23:31 +09:00
804f7450fc
Use linked list for bigram list.
...
BinaryDictionaryTests for VERSION4_DEV:
Before
Time: 36.461
After
Time: 33.031
Bug: 14425059
Change-Id: I9ca2714f450f61f713df6ebd34c953dece991cdb
2014-07-07 21:09:25 +09:00
6afd14dc94
Remove unused method.
...
Bug: 13664080
Change-Id: I47fd90f01ea9a18b11037c966150fa5fd926101b
2014-06-27 15:23:38 +09:00
c152d7c19d
Fix unit tests that use getNgramProbabilityNative().
...
Change-Id: I8548094bc8d1a0ea125b29e2a0ea82a6834b3e48
2014-06-26 19:34:27 +09:00
05b1e0d42f
Extend jni method to use multiple previous words.
...
Bug: 14425059
Change-Id: I8150e8812ee32f8c713315a234b52e5b3a79d7a0
2014-06-26 18:47:25 +09:00
8681bef03c
Remove BigramDictionary form native code.
...
Bug: 14425059
Change-Id: I48d1a4ae6a4317afaaf67748060618f8f9485d40
2014-06-26 15:15:13 +09:00
d58a07666e
Merge "Rename jni method for n-gram supporting."
2014-06-24 01:52:26 +00:00
83b6ee2538
Rename jni method for n-gram supporting.
...
Bug: 14425059
Change-Id: I242d1de5d9db37344f02d8fba9035829794a56c8
2014-06-25 14:14:40 +09:00
520765491c
Merge "Make Beginning-of-Sentence prediction require two exposures."
2014-06-24 01:52:26 +00:00
0aef59746c
Make Beginning-of-Sentence prediction require two exposures.
...
Bug: 15868192
Change-Id: I4b577ad11c992d872d6f902fd50527d9ca5cc1ba
2014-06-25 20:20:44 +09:00
5961f2dfac
Merge "Simplify a make file"
2014-06-24 01:59:00 +00:00
cc9b60401e
Simplify a make file
...
This CL simplifies the makefile for host unittest.
BUG: 13754552
Change-Id: Id09da77b45610db2747897533c18a6d0d81c59d7
2014-06-25 23:10:19 +09:00
88fa47a27d
Support migration/dump of Beginning-of-Sentence entries.
...
Bug: 14119293
Change-Id: Ie975138f819794d5c34a7a547be5a6117050e084
2014-06-24 12:37:07 +09:00
f7322b166b
Make getNextWordAndNextToken output code point count.
...
Bug: 14425059
Change-Id: Id1c2927c8a1be0b1680206d444dbdf0c9453dceb
2014-06-23 19:08:30 +09:00
a807663aae
Merge "Remove hasBigrams/hasShortcut flags from ver4 PtNode."
2014-06-19 23:04:31 +00:00
24d49ee577
Remove hasBigrams/hasShortcut flags from ver4 PtNode.
...
Always check bigram/shortcut content instead of having
flags in each PtNode.
Bug: 14425059
Change-Id: I9eb816681bf22fc12e3ab3c92a178a7990b90e93
2014-06-23 16:49:49 +09:00
762a356a45
Merge "Add native unittest support on target devices for LatinIME"
2014-06-19 22:58:18 +00:00
7f4cca0cd1
Add native unittest support on target devices for LatinIME
...
This CL adds native unittest support on target devices for
LatinIME.
Note that you need to specify --target option to run-tests.sh
to run native unittest on the target device.
BUG: 13754552
Change-Id: I1dfb78ae1461163db8d47c3ba9141d4812070fd0
2014-06-23 14:41:34 +09:00
0fbca1ac23
Remove word from personalized dicts when it's canceled.
...
Bug: 15555552
Bug: 15552347
Change-Id: Ia4d8c79d079e3ce233d46d4bbad4fff1be5c5c39
2014-06-20 14:46:13 +09:00
89899e14df
Merge "Update unit test for beginning-of-sentence."
2014-06-10 22:31:57 +00:00
e041bfab5c
Update unit test for beginning-of-sentence.
...
Bug: 14119293
Change-Id: I594a1ca1096f0c12c678dd30eb75de905e55c5bb
2014-06-12 16:07:39 +09:00
22931cd941
Enable Beginning-of-Sentence prediction for contextual dict.
...
Bug: 14161647
Bug: 14119293
Change-Id: I0c00f13966db88e4de85e245e7bced43c9d474b2
2014-06-12 12:26:18 +09:00
da0ea7603b
Merge "Add jni method for removeUnigramEntry()."
2014-06-10 22:31:57 +00:00
b4d77eca55
Add jni method for removeUnigramEntry().
...
Bug: 15552347
Change-Id: Iadcdc73d3335d561a27b9314d3fcdab0b0c96e49
2014-06-12 12:21:44 +09:00
f12985245c
Add removeUnigramEntry() to native dictionary policy.
...
Bug: 15552347
Change-Id: Ic713f79ef26b5963060304df9c0a3a402c3cc6d4
2014-06-12 12:14:11 +09:00
86fe8081b3
Merge "Add removeUnigramEntry() to native dictionary policy."
2014-06-10 22:29:12 +00:00
447c19364a
Merge "Enable Beginning-of-Sentence prediction for contextual dict."
2014-06-10 22:31:57 +00:00
59ed0c2db2
Block offensive words in native code.
...
Bug: 15300452
Change-Id: Ic6c91c47453e19fb5db2c62b66659619e72b1ecf
2014-06-12 11:36:00 +09:00
07e1412631
Purge dict reading code for 401 and create for 402.
...
Change-Id: Ib0150b3306bb2db8aff443d1158fecc8464cbbdb
2014-06-10 19:22:40 +09:00
d9b8602f48
Implement getMaxProbabilityOfExactMatches().
...
Bug: 13142176
Bug: 15428247
Change-Id: I5be6d683be95505412615ca7c88260de1ea05f54
2014-06-06 17:37:46 +09:00
d6b89e17a6
Add jni method for getMaxFrequencyOfExactMatches().
...
Bug: 13142176
Bug: 15428247
Change-Id: I2ae25090b67ad0c6df97dec7712e2f7e0bb08c40
2014-06-05 18:16:11 +09:00
7852765a50
Add length check for attaching a BoS marker.
...
Bug: 15297872
Change-Id: I7b0a27409b81b76561d19c6caa18a5011d3e90f6
2014-05-28 20:20:39 +09:00
f9ce867d80
Add boundary check for v4 bigram reading.
...
Bug: 14496386
Change-Id: Iedd3445c3222a777a2476beed7d9eb53773f406c
2014-05-27 19:29:35 +09:00
dfca51726e
Return whether the dynamic dict operation was success.
...
Bug: 12184250
Change-Id: Iee7e00c1e84c95551a077f4dd023c0a9b9ac9466
2014-05-27 17:30:00 +09:00
0088d1f668
Merge "Use whether it's exact match to detect distracters."
2014-05-26 13:53:19 +00:00
a6278eb9c1
Use whether it's exact match to detect distracters.
...
Bug: 13142176
Change-Id: Id5b7286d28897931f7bfe571be45d46ffeef4adf
2014-05-26 21:56:20 +09:00
67e02a6aaa
Specify c++_static for bundled Latin IME as well
...
APP_STL := c++_static has been specified for unbundled
Latin IME but somehow not for bundled build.
This CL fixes the inconsistency.
Change-Id: Ie1f4aba27e30981d3c2aa322a16c1cd18413e920
2014-05-26 18:30:48 +09:00
a37f374ad1
Version up dynamic dict format from 401 to 402.
...
Change-Id: Ibea36af905ade773ae3db3a5456f7b5a0ad7d220
2014-05-23 20:20:56 +09:00
1adca93381
Extend jni methods and enable Beginning-of-Sentence.
...
Bug: 14119293
Change-Id: I78fc877367dd0d6240eeacb750b6d2d0b93cba83
2014-05-23 19:58:58 +09:00
96990ca773
Support Beginning-of-Sentence in native code
...
Bug: 14119293
Change-Id: I0f382e33a19bf481823b23405d454de61ec835ff
2014-05-23 17:23:08 +09:00
6600340af5
Fix: PtNodeParams.representsNonWordInfo()
...
Change-Id: I7ab4fb280e8ac89f81d0b32b0663a86c9b69aa5d
2014-05-23 13:49:18 +09:00
2a015dcb25
Add Beginning-of-Sentence info in UnigramProperty.
...
Bug: 14119293
Bug: 14425059
Change-Id: I8a894352568377d32468e5563f4e89af00d22944
2014-05-23 00:07:14 +09:00
9f8c9a0161
Use PrevWordsInfo to add/remove n(bi)-gram in native code.
...
Bug: 14119293
Bug: 14425059
Change-Id: I4b9a46bfd670b35195418eaee51456d44fb91b6d
2014-05-21 18:30:34 +09:00
fa7db65dec
Support multiple previous words in DicNode.
...
Bug: 14425059
Change-Id: Ib8682befe4d7d9fe5122eb538e7c804f75ded463
2014-05-19 11:47:10 +09:00
45d1a936a7
Move prev word related logic to PrevWordsInfo.
...
Bug: 14119293
Bug: 14425059
Change-Id: I1bbd7ab4ace2c475f27bc468cb7b4d67e1ae2f9f
2014-05-16 22:31:45 +09:00
b94ec1437b
Introduce MAX_PREV_WORD_COUNT_FOR_N_GRAM.
...
Bug: 14425059
Change-Id: I587f90df026a14359d2ee452040bbfaf02c1ae51
2014-05-15 18:45:49 +09:00
b87fffb8be
Refactoring: Move prev word information into PrevWordsInfo.
...
Bug: 14119293
Bug: 14425059
Change-Id: I5a5f81c6b189e3ad1da093343a3121463f87c21c
2014-05-15 18:39:23 +09:00
d6fdd58cc0
Cleanup DicTraverseSession.
...
Change-Id: I953665e1958e7214e9365e2bc9d3f3843016dc81
2014-05-15 17:41:23 +09:00
e810a266fd
Merge "Quit use bigram probability diff for ver4 dict."
2014-05-15 07:07:25 +00:00
64341927d2
Quit use bigram probability diff for ver4 dict.
...
Change-Id: I2cfcfbcf351877d1dff466a24974dbb05908f14e
2014-05-15 16:02:58 +09:00
a709bc7f93
Merge "Reduce the cost for handling intentional omission."
2014-05-15 03:31:39 +00:00
39e5a15af0
Merge "Always keep PtNodes that represent non-word info during GC."
2014-05-15 02:38:57 +00:00
91d7538225
Merge "Add VERSION_4_DEV(402) in native code."
2014-05-14 13:40:10 +00:00
7116ea98f4
Add VERSION_4_DEV(402) in native code.
...
Bug: 13406708
Change-Id: I96cfacf524d670a6a5637a96a63bcd47aaf09ca0
2014-05-14 22:37:05 +09:00
cf700695ea
Always keep PtNodes that represent non-word info during GC.
...
Bug: 14119293
Change-Id: Ie50b341a512be6a6efe3e05b60e1d09560b01d1f
2014-05-14 22:29:21 +09:00
2dc8e36f8e
Use nullptr instead of MmappedBufferPtr(nullptr).
...
Change-Id: I9bc35f723f1c105ef6155a49630b8cd492900bc8
2014-05-14 22:05:00 +09:00
32bdf9f344
Merge "Use JniDataUtils::putXxxToArray() to output a value."
2014-05-14 11:12:09 +00:00
5c00bde9bc
Merge "Filter out control characters and non-unicode code points."
2014-05-14 11:07:32 +00:00
304a71d171
Use JniDataUtils::putXxxToArray() to output a value.
...
Change-Id: Ifb7bed6623b01acb524566a0fe00dcbdf7273888
2014-05-14 20:05:15 +09:00
e9121a68a6
Filter out control characters and non-unicode code points.
...
Bug: 14119293
Bug: 13758761
Change-Id: I6b79cff0714152807f5e20b7a75060a0a772b28b
2014-05-14 20:05:10 +09:00
728141d55a
Merge "Generate dict code for version 401."
2014-05-14 10:51:12 +00:00
6bf268132d
Generate dict code for version 401.
...
Bug: 13406708
Change-Id: I769ac84d54d997e7aefab0c9c16727455a132e0b
2014-05-14 19:09:01 +09:00
72d6061efb
Merge "Use JniDataUtils::outputCodePoints() to output code points"
2014-05-14 09:07:45 +00:00
ed16af72e3
Restrict the permission of dict files created on device.
...
Bug: 13497304
Change-Id: I7bf67e2e81bc63a67bd91cbc0f753ecac88349f6
2014-05-14 17:48:28 +09:00
d2f7cd28ae
Use JniDataUtils::outputCodePoints() to output code points
...
Bug: 14119293
Bug: 13758761
Change-Id: I516d2f96e219e6e65246f502186ccb9bd5f0670f
2014-05-14 17:42:47 +09:00
c1e86d3f49
Merge "Skip PtNodes with non-Unicode code points for suggestion."
2014-05-14 06:22:22 +00:00
14dd663fe5
Reduce the cost for handling intentional omission.
...
Bug: 14602770
Change-Id: I3a678a3e9b227fc4c3b8d23012aba18ca2e52da5
2014-05-14 13:54:32 +09:00
0c8ce96bec
Add "// namespace latinime"
...
Bug: 13406708
Change-Id: I0fa85875fb5b98b4e40a149e3e33e5f56bee9a97
2014-05-13 15:16:43 +09:00
6e4b674f83
Move files under bigram/shortcut to under structure.
...
Bug: 13406708
Change-Id: I48e9d4ff30a8b50d4f1694ebbefb02cf189f7713
2014-05-13 15:16:43 +09:00
d0d0113983
Code cleanup.
...
Change-Id: Ic31b66cccfd77348f2ff7961959a3eaf9f7ad5d8
2014-05-13 01:32:38 +09:00
620a05ae59
Support bigram historical information migration.
...
Bug: 13406708
Change-Id: I4bae53e43cb7653eac3b5bd13da2d2bc8aaf88a9
2014-05-13 01:28:30 +09:00
79ba633402
Skip PtNodes with non-Unicode code points for suggestion.
...
Bug: 14119293
Change-Id: Id1d3b789b5f18757070878dba35a7980bfb44591
2014-05-12 19:38:26 +09:00
9d7e8c717f
Support unigram historical information migration.
...
Bug: 13406708
Change-Id: Ibed15b3bc5d5ae68faefa379028dbe10d32b0c0f
2014-05-12 19:21:06 +09:00
6b74f516dc
Merge "Refactoring: Use UnigramProperty to add/update unigram."
2014-05-09 11:39:17 +00:00
b7f71cdf8c
Merge "Avoid copying bigram list if possible."
2014-05-09 10:09:54 +00:00
b636e25e95
Refactoring: Use UnigramProperty to add/update unigram.
...
Bug: 13406708
Change-Id: I26fd541fb465d3543faa5f155becc455ddbb6c9c
2014-05-09 17:22:17 +09:00
eaa347bc1a
Merge "Add VERSION4_TEST for testing."
2014-05-09 07:06:06 +00:00
455dc84cf2
Add VERSION4_TEST for testing.
...
Bug: 13406708
Change-Id: I0b434717ea3edbb131650af634c53cfbfe113c3e
2014-05-09 15:17:01 +09:00
08ea74eb2c
Merge "Implement migrateNative()."
2014-05-08 05:21:06 +00:00
08d12a1be3
Merge "Extend jni interface for dictionary migration."
2014-05-08 05:20:33 +00:00
ad518d9a5b
Avoid copying bigram list if possible.
...
Constructing en_US main dict using dicttool:
Before:
real 1m8.699s
user 1m10.600s
sys 0m2.390s
After:
real 0m17.204s
user 0m20.560s
sys 0m0.720s
Bug: 13406708
Change-Id: I3b0476be57e5cb93c6497025b3ffa7064ac326c6
2014-05-08 14:19:33 +09:00
8a9d9de72a
Implement migrateNative().
...
Bug: 13406708
Change-Id: Ie786a68e780baa298fedf82d21390ba45d871a52
2014-05-08 12:31:32 +09:00
1471fbad66
Extend jni interface for dictionary migration.
...
Bug: 13406708
Change-Id: Iadad6df296467d0e5b631fba4a409d53c8a5a6f2
2014-05-08 12:31:04 +09:00
ad8f2201e2
Make initial additional buffer size 0.
...
Bug: 14113369
Change-Id: I3b7b3a452544725577101dc3b9bcb85b3e08afe9
2014-05-07 23:44:32 +09:00
8e8a5a58c4
Merge "Add new bigram entry at the tail of existing list."
2014-05-01 11:19:36 +00:00
8d8fb396a0
Add new bigram entry at the tail of existing list.
...
Bug: 13406708
Change-Id: If3162e65fc9aa2c47f046aee528276cb51fad9f4
2014-05-01 19:29:43 +09:00
ab5839ae0b
Merge "Add CODE_POINT_BEGINNING_OF_SENTENCE in native code."
2014-05-01 02:08:27 +00:00
4162cfdc59
Add CODE_POINT_BEGINNING_OF_SENTENCE in native code.
...
Bug: 14119293
Change-Id: Ib101435e2840172ba004ead081022669647a8ad9
2014-04-30 20:40:02 +09:00
fc2858c55b
Small clean up for LARGEST_INT_DIGIT_COUNT
...
Change-Id: I4a61c037370bf57b396d80ba7212d94328eaf7b9
2014-04-30 19:41:42 +09:00
8dac7ce2e2
Move PatriciaTrieReadingUtils under pt_common.
...
Change-Id: Ib8ec62b97318563785a2aafb854aabdc3f46f187
2014-04-30 14:28:08 +09:00
9e15b4551e
Small clean up on MAX_LOCALE_STRING_LENGTH
...
Change-Id: I77f93879e841f33b81f6d193d1bd5782ad2124f5
2014-04-28 16:50:06 +09:00
3b7984752c
Support creating BinaryDictionary without creating dict file.
...
Bug: 14166482
Change-Id: Ic8c78ec2c8f39358a1f085a041b608972a380eef
2014-04-22 13:18:34 -07:00
ce76821dce
Revert "Support creating BinaryDictionary without creating dict file."
...
This reverts commit 89939b8708
2014-04-22 19:34:44 +00:00
89939b8708
Support creating BinaryDictionary without creating dict file.
...
Bug: 14166482
Change-Id: Ib065279f96e227ab0fee7c8141560c4ada744d3b
2014-04-22 12:01:33 -07:00
903be5bbd3
Implement latinime_BinaryDictionary_createOnMemory().
...
Bug: 14166482
Change-Id: If7ec3345ab34edcd6bc5cef9e72580ced894a0e3
2014-04-22 12:01:22 -07:00
361881b82b
Merge "Separate JniDataUtils::constructAttributeMap()."
2014-04-22 17:07:27 +00:00
68b4f2ada9
Merge "Add jni interface to use on memory dictionary."
2014-04-22 17:07:16 +00:00
edc7d02d76
Separate JniDataUtils::constructAttributeMap().
...
Bug: 14166482
Change-Id: Ic2dc407231743ea668fe0ab8869eb8a7f8b9625f
2014-04-21 19:59:21 -07:00
61cb852d33
Add jni interface to use on memory dictionary.
...
Bug; 14166482
Change-Id: I33ab08dad1e39aa7617d391f7eb2561d6f2504bb
2014-04-21 19:59:09 -07:00
b48c93b3fc
Revert "Revert "Use mclinker""
...
This reverts commit de8f85a29d
2014-04-20 07:51:46 +00:00
de8f85a29d
Revert "Use mclinker"
...
This reverts commit 47b4321ed5
2014-04-20 02:22:16 +00:00
47b4321ed5
Use mclinker
...
Change-Id: Ib34f66c106f357cd82b1577566e00f490cee2c5a
2014-04-19 12:07:58 +09:00
7b43d987fa
Pass max trie structure size to on memory Ver4DictBuffers.
...
Bug: 14166482
Bug: 14161647
Change-Id: I3b0dd192d7a81c3809f1873bb66ef8fe637f8af0
2014-04-18 17:57:28 -07:00
d4e54af0ba
Merge "Make addUnigramWord use UnigramProperty."
2014-04-14 11:03:30 +00:00
793124855d
Make addUnigramWord use UnigramProperty.
...
Bug: 13406708
Change-Id: I10c108dd7047fe230c60495f13800f32fdc46d0d
2014-04-14 18:49:19 +09:00
8ca9be17db
s/hash_map_compat/unordered_map/
...
Change-Id: Icce5f9a12b04bdd7540c52750d303a585d71f28a
2014-04-11 18:07:59 +09:00
100eb53292
Merge "Increase terminal cache size for gesture."
2014-04-09 10:36:30 +00:00
627fcc6c92
Merge "Quit limiting gesture search space by distance."
2014-04-09 10:35:58 +00:00
d4dbbd5008
Use C++11 random library
...
srand() and its friends are supposed to be discouraged since C++14.
This CL replaces srand() with new C++11 random libraries.
Change-Id: If2c25158c88c674cd3fd6d891559a9e32283e19e
2014-04-09 17:59:31 +09:00
111c05ff35
Add BloomFilterTest.
...
Change-Id: If97b9e9cc3bbaa4c7877991c11d7935626268ca3
2014-04-09 17:15:55 +09:00
63d33f42c8
Increase terminal cache size for gesture.
...
Before:
(0) 670.00 (10.52%)
(1) 5530.00 (86.81%)
(2) 120.00 (1.88%)
Total 6370.00 (sum of others 6320.00)
After:
(0) 730.00 (11.06%)
(1) 5750.00 (87.12%)
(2) 100.00 (1.52%)
Total 6600.00 (sum of others 6580.00)
Bug: 13773693
Bug: 10701902
Bug: 9505397
Change-Id: Ie53640994180a7acabe05da544ab2166403e2394
2014-04-09 16:50:31 +09:00
bc9500fb14
Quit limiting gesture search space by distance.
...
Before:
(0) 470.00 (8.25%)
(1) 5160.00 (90.53%)
(2) 50.00 (0.88%)
(66) 10.00 (0.18%)
Total 5700.00 (sum of others 5690.00)
After:
(0) 670.00 (10.52%)
(1) 5530.00 (86.81%)
(2) 120.00 (1.88%)
Total 6370.00 (sum of others 6320.00)
Bug: 13773693
Bug: 10701902
Bug: 9505397
Change-Id: Ie168ac4ae0ca0e954512b08e3cc0f6399a3c163d
2014-04-09 16:50:31 +09:00
26c806620c
Use 2D normal distribution for gesture.
...
Bug: 13799846
Bug: 10701902
Bug: 9505397
Change-Id: I6c3f84f035f2310f2f7dfec4432ebdb6e50d5df0
2014-04-09 16:50:31 +09:00
e3d57ae792
Merge "Use bitset for BloomFilter."
2014-04-09 07:39:49 +00:00
2fd0bf9a37
Use bitset for BloomFilter.
...
Before:
(0) 660.00 (1.43%)
(1) 45320.00 (98.18%)
(2) 80.00 (0.17%)
Total 46160.00 (sum of others 46060.00)
After:
(0) 620.00 (1.34%)
(1) 45310.00 (98.05%)
(2) 130.00 (0.28%)
Total 46210.00 (sum of others 46060.00)
Change-Id: I936b639c50e15208aee999a929b33983c6caa59d
2014-04-09 16:18:23 +09:00
b417d7d69f
Make NELEMS type-safe
...
Change-Id: I867271665b3c595dc40ac63e93e68c87dc213d08
2014-04-09 15:51:39 +09:00
e41b2ed8d3
Separate unigram/bigram property from WordProperty.
...
Bug: 13406708
Change-Id: I48e9fccedd9dcdc1a35ffe027745b58966a83315
2014-04-08 18:24:06 +09:00
cafab169cd
s/stdint.h/cstdint/
...
Somehow, we were not able to use cstdint gcc target build. That's no
longer the case with Clang.
Removed unnecessary header inclusions too.
Change-Id: Ic83a4adf696f1d5ec7a9809253f3c95804e622e1
2014-04-07 12:39:07 +09:00
694114feca
Remove redundant LOCAL_IS_HOST_MODULE assignments
...
Also, remove irrelevant LOCAL_NDK_STL_VARIANT for host modules.
Change-Id: I45e916c11f7c1f9b13956f01274a82ee7de1f558
2014-04-04 22:32:45 +09:00
3bf9647a26
Separate NormalDistribution from ProximityInfoUtils.
...
Bug: 13773693
Change-Id: I9e835cc92e16f8ae0e0492af0715d0ef5cd84a35
2014-04-04 18:49:12 +09:00
4df668d197
Merge "Remove unused code."
2014-04-03 05:20:20 +00:00
5f6a247744
Remove unused code.
...
Bug: 13773693
Change-Id: Ic9d7f81b0eed40e945b04a91fd97ba40fa1cd262
2014-04-03 14:09:25 +09:00
ed2781cf91
Exclude liblatinime_host_unittests from Mac build
...
Change-Id: I786c0ad92ba7ce95182e617686c6466a8b2f400e
2014-04-03 13:07:10 +09:00
de2b312c6d
Use same language weight for all dictionaries.
...
Bug: 8187060
Change-Id: Ib9d8a8aed2c141137c1bb3c748a89fb8216293e7
2014-04-03 01:43:36 +09:00
35314af0d8
Merge "Extend jni interface to input/output languageWeight."
2014-04-02 16:20:28 +00:00
1de95ceada
Extend jni interface to input/output languageWeight.
...
Bug: 8187060
Change-Id: Ic55d328b87f258f4d65fff207233789a53b2b0ff
2014-04-03 01:01:51 +09:00
c73b46f40a
Do not call exit 1 when loaded with source command
...
BUG: 13754552
Change-Id: I3d5e4c0786547521325405100c175dd1b21754df
2014-04-02 19:47:08 +09:00
8855306cf9
Add a script to run native tests
...
This script saves your time to remember how to build and run
native unittests for LatinIME.
BUG: 13754552
Change-Id: I98398648f0eb0a0100a8729df26f71d53b54c5e3
2014-04-02 16:28:34 +09:00
711ed47d24
Merge "Add an initial native test on host environment"
2014-04-02 07:11:08 +00:00
c72652cb00
Add an initial native test on host environment
...
This CL adds an initial native test that runs on host
environment, from which we can extend the coverage of native
test.
BUG: 13754552
Change-Id: I0af9d1b5dd049c83b955f5b05add4b39f3cfcc6c
2014-04-02 14:23:53 +09:00
77de3a4b65
Change wrongly used "lookahead" to "completion".
...
Change-Id: I111cf59d0d24fa869217788c314fffa94ee9f9f9
2014-04-02 12:44:41 +09:00
543fea98a4
Merge "Parameter tuning for typing."
2014-04-01 09:45:17 +00:00
7dc7a9a398
Parameter tuning for typing.
...
accidently -> accidentally (top suggest)
convienent -> convenient (top suggest)
dissapear -> disappear (top suggest)
Execution time: +31%
Before:
(0) 610.00 (1.66%)
(1) 35820.00 (97.66%)
(2) 130.00 (0.35%)
Total 36680.00 (sum of others 36560.00)
After:
(0) 820.00 (1.69%)
(1) 47200.00 (97.50%)
(2) 210.00 (0.43%)
Total 48410.00 (sum of others 48230.00)
Bug: 13588483
Bug: 13456384
Bug: 9816611
Change-Id: Ia17491e135a63aaca6e980c3a59bd829441dac40
2014-04-01 17:25:43 +09:00
f6c29aa52b
Remove -std=c++11 as it is enabled by default now
...
Change-Id: I53edb2f3d281d78c0301474d65e60f86cc6ff363
2014-04-01 17:07:00 +09:00
da93bc54b2
Merge "Remove useless methods from DicNode."
2014-04-01 05:40:29 +00:00
94c7bd471f
Merge "Separate DicNodePool from DicNodePriorityQueue."
2014-04-01 05:36:35 +00:00
ef1d4ddc8f
Remove useless methods from DicNode.
...
Change-Id: I6ea5eb7e848dbce0f0d468160c16e5da76b23b20
2014-04-01 14:09:02 +09:00
67ff21f321
Separate DicNodePool from DicNodePriorityQueue.
...
Change-Id: Ie500a4185792c2ffa0f5185ea5919626fe31c6fe
2014-04-01 14:08:59 +09:00
ff1b3947c6
Split SuggestionsOutputUtils::outputSuggestions.
...
Bug: 13333066
Change-Id: Ie5e513dacdc5502e7263ddf709824bbd6bc6b74a
2014-03-28 20:11:27 +09:00
a0ea92f76c
Remove mPartiallyCommited.
...
Bug: 13333066
Change-Id: I4e3aa31aa501866c23cc4b86093b866306161bfd
2014-03-28 20:08:51 +09:00
655b65cb0b
Cleanup DicNodePriorityQueue.
...
Change-Id: Ia44ca0e14f8aad090ae2b8007771dea6d9b41221
2014-03-28 17:19:53 +09:00
144b9a6336
Remove DicNode.managedDelete.
...
Change-Id: I8146975d72878ba34d1c5054a7cf5fdcc41a3332
2014-03-28 17:19:28 +09:00
d73edf23ac
Use SuggestionResults to get suggestion.
...
Bug: 8187060
Bug: 13333066
Change-Id: I435096ecf8422453f9b167adb0ca3b9c8a840018
2014-03-27 20:05:33 +09:00
2426bc2943
Merge "Remove DicNodeUtils::appendTwoWords()."
2014-03-27 09:49:50 +00:00
a83b013eec
Remove DicNodeUtils::appendTwoWords().
...
Change-Id: I7402793b3f71ef5d786abea2f97bd4b624e4405f
2014-03-27 17:54:14 +09:00
b4a983d400
Merge "Remove DicNode.isFirstWord()."
2014-03-27 08:17:05 +00:00
63b48311b0
RegisterNatives() returns 0 on success.
...
cf. http://docs.oracle.com/javase/6/docs/technotes/guides/jni/spec/functions.html#wp5833
Change-Id: I2c599f2d8765a7475c7076e6b049f77ad79feb79
2014-03-26 20:47:14 +09:00
90f6411899
Remove DicNode.isFirstWord().
...
Change-Id: I825c0f7cf1fcf66c6309e0bab8e0fdd767170107
2014-03-25 18:07:14 +09:00
eddbb7ac88
Merge DicNodeStatePrevWord into DicNoteStateOutput.
...
Before:
(0) 2232.70 (0.86%)
(1) 255258.50 (98.89%)
(2) 585.73 (0.23%)
(66) 0.26 (0.00%)
Total 258126.46 (sum of others 258077.18)
After:
(0) 2249.23 (0.93%)
(1) 239883.63 (98.83%)
(2) 554.82 (0.23%)
(66) 0.35 (0.00%)
Total 242734.38 (sum of others 242688.04)
Change-Id: I9760cae5b98b3d1f4804b6b60317887eaa3ff71c
2014-03-25 18:07:09 +09:00
cf88cf6593
Add a check for ForgettingCurveUtils::decodeProbability.
...
Bug: 13607383
Change-Id: I1a56c52173d0e458864e65fb1c1f4603c0c81c6f
2014-03-24 11:11:07 +00:00
ef665816d0
Add boundary check for SparseTable.
...
Bug: 13592288
Change-Id: I8bc4ff778c6073d22f86b6050a880b6fb69de31e
2014-03-24 09:17:53 +00:00
4c93770430
Fix: wrong size checking in SparseTable.
...
Bug: 13592288
Change-Id: I52f03081c5abf25e3c160e2b8fff5e98f8448499
2014-03-24 14:28:36 +09:00
7c20f140e0
Merge "Remove unused partial commit."
2014-03-20 09:54:15 +00:00
5a0381f7d0
Remove unused partial commit.
...
Change-Id: Ia9341a5cb24947d93056810890d94c1f66481d8c
2014-03-20 18:47:45 +09:00
18ba146b72
Stop apply Completion for DicNodes without any proximity chars.
...
Bug: 13538127
Change-Id: Ifffc0cde1ea8a0ceb13e4e4e57c151b3ea33a522
2014-03-20 18:06:06 +09:00
46b6f60551
Switch to Clang and libc++
...
Change-Id: Id425997af58967e49094ab593ed8f0b70c72bbbc
2014-03-18 12:09:10 +09:00
622589ab43
Several cleanups
...
Remove obsolete comment and unused macros. Cosmetic fixes as well.
Change-Id: I9843331c8ce90d9b10b54f425ea1c7416b57c541
2014-03-17 16:33:37 +09:00
73a2426d45
Change default decaying parameters.
...
Bug: 13458617
Change-Id: I4942af4a48881fb6ca866c74140b262e6d323f4a
2014-03-14 12:23:24 +09:00
4bc35daaa2
Check "." and ".." to delete all files in a dir.
...
Bug: 13421999
Change-Id: I9d0f65cfc9a0f18c7affc152a5b54f9970048e9c
2014-03-12 15:31:49 +09:00
5dc17c22ca
Fix: wrong suggestion comparator.
...
Change-Id: I8829c7cb3060955e345fbdc003cf77f8469d37c0
2014-03-11 11:57:56 +00:00
34ab038414
Merge "Stop new BigramDictionary."
2014-03-11 09:38:14 +00:00
e7ddf49d50
Merge "Use emplace_back in getWordProperty()."
2014-03-11 09:38:00 +00:00
ed72a768d6
Merge "Make getWordProperty return reconstructed bigram probability."
2014-03-11 09:37:49 +00:00
ca42ec0f44
Use emplace_back in getWordProperty().
...
Change-Id: If164d2b897bd6ad9c89baf0e9a90356100c5087b
2014-03-11 15:21:55 +09:00
a34bdc395b
Make getWordProperty return reconstructed bigram probability.
...
Bug: 13403530
Change-Id: I7ed95a54344d8b77b88922093cf3ef0e530fcae6
2014-03-11 15:20:12 +09:00
b43ea5c335
Use isFirstCharUppercase instead of get first code point.
...
Change-Id: I0a28305397bfc1e7218e16df00839781a74f5599
2014-03-10 18:39:45 +09:00
0a5efa31de
Add getter methods for public member variables.
...
Change-Id: Ic6656bb3db6db992b37923db53816e0a73a7621f
2014-03-10 18:39:45 +09:00
6066069f35
Move initialization logic for from DicNode to DicNodeState.
...
Change-Id: Ic7075349e2e9c7f4ca707efa12ad1d24b49a2c87
2014-03-10 18:39:43 +09:00
258260bef2
Remove unused member of DicNodeStatePrevWord.
...
Change-Id: I265855da58e3a2e070e525e116ac0d18d1a10d18
2014-03-10 18:39:15 +09:00
632c9aca5b
Improve DicNode handling.
...
- Stop creating useless DicNode and DicNodeVector.
- Remove useless virtual.
- Implement copy constructor and assignment operator of DicNodeState.
- Remove useless memset.
Before:
(0) 2266.21 (0.79%)
(1) 285422.05 (98.97%)
(2) 642.62 (0.22%)
(66) 0.19 (0.00%)
Total 288384.35 (sum of others 288331.07)
After:
(0) 2232.70 (0.86%)
(1) 255258.50 (98.89%)
(2) 585.73 (0.23%)
(66) 0.26 (0.00%)
Total 258126.46 (sum of others 258077.18)
Change-Id: I0bb1e9de8b38a6743a11aaeb2b17bd0da5b7ad34
2014-03-10 17:57:53 +09:00
87db47d175
Use emplace_back to push DicNode to vector.
...
Before:
(0) 2234.43 (0.71%)
(1) 310083.71 (99.07%)
(2) 626.88 (0.20%)
(66) 0.26 (0.00%)
Total 312995.33 (sum of others 312945.28)
After
(0) 2266.21 (0.79%)
(1) 285422.05 (98.97%)
(2) 642.62 (0.22%)
(66) 0.19 (0.00%)
Total 288384.35 (sum of others 288331.07)
Change-Id: I5ab98076c54d147ff7ec2a29280859f4558e24d0
2014-03-10 15:41:33 +09:00
66cc9dec55
Stop new BigramDictionary.
...
BigramDictionary is allocated inside of Dictionary.
Change-Id: If224b4c408403f43eb3d2e292c0e0ecb86429290
2014-03-10 05:42:36 +00:00
e137ec0a91
Introduce SuggestionResults and use it for predictions.
...
Bug: 8187060
Bug: 13333066
Change-Id: I1ead897024508b7e40fbd93af7d14bfe74b93826
2014-03-07 19:36:19 +09:00
c36c97b4f7
Merge "Use unique_ptr."
2014-03-07 09:06:58 +00:00
6767f88e3c
Address warnings pointed out by clang
...
Change-Id: I7943f6c7f9ba08f283a3116adc2af29495f04a21
2014-03-07 17:05:09 +09:00
4ce480d5ce
Use unique_ptr.
...
Change-Id: Id92a5b07da4f7f95e2cd293ce8dc1a5f979b7853
2014-03-07 14:31:54 +09:00
865e6cf497
Revert "Revert "Use std::min() and std::max()""
...
This reverts commit f63000abea
2014-03-07 14:19:56 +09:00
a1e0ef4836
Fix: point to line segment distance can be NaN.
...
Change-Id: I7db6bfea925a0eda82bfb1f7b5e1110b193dabdb
2014-03-07 14:19:52 +09:00
3339224813
Merge "Use nullptr instead of 0 for pointers."
2014-03-07 03:56:56 +00:00
f63000abea
Revert "Use std::min() and std::max()"
...
This somehow breaks TRT.
bug: 13350753
This reverts commit cf612a3abf
2014-03-07 02:30:18 +00:00
6c7ebc4023
Use nullptr instead of 0 for pointers.
...
Change-Id: Ic9425de07b896f940ca11c51968c637ebb897514
2014-03-07 10:04:44 +09:00
cf612a3abf
Use std::min() and std::max()
...
Change-Id: I2992fa16692ace2a6febedc4393812faf763638f
2014-03-06 23:19:54 +09:00
72c362985c
Use C++11 deleted functions to implement DISALLOW_ macros
...
With C++ deleted functions, compilers can generate more
descriptive error messages when we are doing something disallowed.
Change-Id: I48d23e5eced545732558e56f5ff9ff70c95a6ff0
2014-03-06 20:48:43 +09:00
ca0a0da864
Switch to C++11
...
Change-Id: Ib2970327c36422d7b11103d52ba7e9e52db5554f
2014-03-06 20:32:20 +09:00
9fd50e34a8
Fix: Bug of I39e905b6ddfc8d3.
...
primaryKey have to be the first elemnet of the proximities.
Bug: 13315755
Change-Id: I6c94408a2ef2750fa85ff12b93bed8b8d874717e
2014-03-06 18:25:15 +09:00
2c7e97dcdd
Merge "Create suggest/core/result directory."
2014-03-06 07:32:19 +00:00
fb1588dd3c
Create suggest/core/result directory.
...
Bug: 8187060
Bug: 13333066
Change-Id: I185c93bd4542d997be101b61561a00d69111c00d
2014-03-06 14:35:47 +09:00
a84f7848d8
Merge "Fix: The top left key is a proximity of nonexistent keys."
2014-03-05 10:27:27 +00:00
6501255111
Fix: The top left key is a proximity of nonexistent keys.
...
Bug: 13315755
Change-Id: I39e905b6ddfc8d3510c408a3bea853390a75d088
2014-03-05 19:06:18 +09:00
e784148ae6
Separate utility methods from BinaryDictionary.
...
Bug: 8187060
Change-Id: Ice2984e332b7bd3bb17174aefc80b5635b72fc50
2014-03-05 18:19:34 +09:00
9e51c6c0c6
Separate utility methods from BinaryDictionary in native code.
...
Bug: 8187060
Change-Id: I099de557d2aaee95c6b809450108139550e9b0aa
2014-03-05 12:49:04 +09:00
5128935ac4
Add header attributes for evaluation.
...
Bug: 13197276
Change-Id: Ib5247da691ff24a73e13485288237ccc51bb54f0
2014-02-28 21:06:03 +09:00
3d70932857
Use MAX_PROBABILITY for the limit of probabilities.
...
Bug: 13197276
Change-Id: Ic3f855e566603b395395dff1f860f3d76ecb019c
2014-02-26 20:48:53 +09:00
7919a594fc
Merge "Create more aggressive probability tables."
2014-02-26 11:18:44 +00:00
b368089dbf
Stop dividing unigram probability by 2 for backoff.
...
Bug: 13197276
Change-Id: I8eaa24b6f710383a8d257e3ec28c37a1a1da8e31
2014-02-26 19:40:18 +09:00
70566266be
Create more aggressive probability tables.
...
Bug: 13197276
Change-Id: I1451dcbe61088d7301bbef5ceedc72f5649e6764
2014-02-26 19:36:57 +09:00
2b27e06733
Merge "Read and write forgetting curve header attributes."
2014-02-26 09:06:56 +00:00
6112cc26a7
Read and write forgetting curve header attributes.
...
Bug: 13197276
Change-Id: I6c38a127e1745903594b7bf0ec80ef179e794feb
2014-02-26 18:04:12 +09:00
94080a37e8
Merge "Check header attributes for forgetting curve."
2014-02-26 08:58:48 +00:00
57816c7a8b
Check header attributes for forgetting curve.
...
Bug: 13197276
Change-Id: Ib360010f309fd1ed3e81cf23aa10c1cfe82781a6
2014-02-26 17:41:31 +09:00
7b496a5861
Add boundary check for ver4 bigram/shortcut reading.
...
Bug: 13185316
Change-Id: I5236222e2a5acda69821062a140c9e36a3024bd2
2014-02-26 14:03:24 +09:00
33e38096ad
Fix: -1 can be used as a code point of most probable string.
...
Bug: 11797518
Change-Id: Id2e8bce92d000f39d506af7cb844447696bcc019
2014-02-24 20:40:16 +09:00
d934fb43ad
Remove corrupted ver4 dictionaries.
...
Bug: 12916055
Change-Id: I2c390ab1dc483915691b47a605772cbc2dfeaf09
2014-02-21 15:09:37 +09:00
be81b75dec
Add boundary check for ver2 dict reading.
...
Bug: 12916055
Change-Id: I78ad1f98a5401f920dcfc3379aa431eb2311ae02
2014-02-21 13:26:01 +09:00
b96012acef
Record reading error during traversing dictionaries.
...
Bug: 12916055
Change-Id: I439f21aa87cfa1f71e0354370a1514af03d68f6c
2014-02-20 19:12:32 +09:00
303e767728
Fix: crash when opening a broken dictionary.
...
Bug: 13085169
Change-Id: Icfb6184dfefc6a336432203c071d9e30ae8bf990
2014-02-19 22:11:09 +09:00
f2a6f2db3e
Merge "Fix: using wrong method to call ArrayList.add."
2014-02-19 02:27:33 +00:00
14fe931362
Fix: using wrong method to call ArrayList.add.
...
bug: 13072808
Change-Id: I60dc5ae1e535f2f0b3784a12c40ac082560a436f
2014-02-19 11:24:39 +09:00
7e79814aa3
Fix wrong Java method call function
...
bug: 13072808
Change-Id: I189fda85b59ce40e3657bfbbcc313e7e1225a0da
2014-02-18 23:40:24 +09:00
2046bd6b85
Merge "Make dotted i the base character of dotless i."
2014-02-17 09:44:17 +00:00
220dc2d7a8
Make dotted i the base character of dotless i.
...
This is already the case for the capital version, and natives
Turkish speakers seem to think it should be the case. An
important reason to make it so is that the Turkish keyboard
has only the dotless i as a "more keys" key, so it's really
hard to type words with a dotless i without this, especially
those with several of them.
Bug: 11519119
Change-Id: I4df2a289783e4eb3c1291b8ad0a2ba5947bf7671
2014-02-17 18:24:28 +09:00
0fc93fe445
Implement PatriciaTriePolicy::getNextWordAndNextToken().
...
Bug: 12810574
Change-Id: Id1d44f90de9455d9cbe7b6e0a161cae91d6d422c
2014-02-15 17:39:20 +09:00
8fa7a09f1e
Merge "Implement PatriciaTriePolicy::getWordProperty()."
2014-02-14 09:08:09 +00:00
c63d183473
Implement PatriciaTriePolicy::getWordProperty().
...
Bug: 12810574
Change-Id: I7bcccfd3641ebbcf2b8d857d33bb4734c42af5eb
2014-02-14 17:56:45 +09:00
6890246259
Fix reading uninitialized memory in BloomFilter.
...
Bug: 12967899
Change-Id: I180b9d728c887c480b6d956bbc4599079c1c359f
2014-02-14 12:37:03 +09:00
a000a32c80
Fix reading uninitialized memory.
...
Bug: 12967899
Change-Id: Ia17e4ca9dd8c1e0b24b0fb7e73d07b97c5d81c0c
2014-02-13 21:18:02 +09:00
be61170588
Create Ver2PtNodeArrayReader.
...
Bug: 12810574
Change-Id: I7708d24d735680b2fe9e6700316076018e88c98d
2014-02-10 21:09:55 +09:00
cf2b075146
Stop passing buffer directly to DynamicPtReadingHelper.
...
Bug: 12810574
Change-Id: I656d99f504d8cf4e057080713b174943afd9dd4c
2014-02-10 21:06:09 +09:00
1e2752924d
Create Ver2ParticiaTrieNodeReader.
...
Bug: 12810574
Change-Id: I7d3298b5f419d557755ae433c8b8cc0d145f4cc3
2014-02-10 21:06:09 +09:00
1d6afa179c
Refactoring: extract PtNode array reading logic form helper.
...
Bug: 12810574
Change-Id: I2d2660871862f11630c3ad7bf04bb49ade57c1e7
2014-02-10 21:06:07 +09:00
fc9ca59cc1
Implement getHeaderInfoNative.
...
Bug: 11281877
Bug: 12810574
Change-Id: Ia3d85ae2cfdb486e74b8636a62431eae883c85da
2014-02-06 18:19:42 +09:00
43cf9076b2
[HD04] Make the locale mandatory.
...
Bug: 11281748
Change-Id: I69281b0053bec404c3e3c713ade3f65a140f51b1
2014-02-05 17:35:25 +09:00
c488048634
Merge "Check isEligibleForAutoCommit when batch input is ended."
2014-02-05 03:34:46 +00:00
8c5c01e981
Check isEligibleForAutoCommit when batch input is ended.
...
Bug: 11951198
Change-Id: Ibbe09fa38eaa3ebf8f9b69f744a29db7ac598975
2014-02-05 11:40:17 +09:00
ad37cddd79
Merge "Add jni interface to get header information from native."
2014-02-04 12:52:50 +00:00
927aff72bc
Add jni interface to get header information from native.
...
Bug: 12810574
Change-Id: I2508483bcb3157f04cc1fe13f24f864d301f1f28
2014-02-04 21:42:09 +09:00
1d3058daa1
Merge "Don't boost exact matches for personalized dicts."
2014-02-04 09:13:48 +00:00
54622d38c2
Don't boost exact matches for personalized dicts.
...
Bug: 12800726
Change-Id: Ia3a2f82db6cdc9645cad0e329c0b79328d7452cc
2014-02-04 17:47:14 +09:00
941734695b
Implement Ver4PatriciaTriePolicy::getNextWordAndNextToken.
...
Bug: 12810574
Change-Id: Idea44f03c477964f58e65fbf2b55e3fcd77a2934
2014-02-04 12:42:14 +09:00
38f341a2a5
Add a jni method to iterate words in a dictionary.
...
Bug: 12810574
Change-Id: I87b13559765f0262dfd06c2ba40d43af6437ea7f
2014-02-03 14:51:58 +09:00
9221772ab7
Get bigram information via getWordProperty().
...
Bug: 12810574
Change-Id: I2750a5659ccbc3e31307c28e35dd9a1dbdffbeee
2014-02-03 11:47:26 +09:00
94d9a2309f
Extend jni interface to get bigrams in WordProperty.
...
Bug: 12810574
Change-Id: Ia4b88d02ea8790a5c47d32376cc0b84c3e071ddd
2014-01-31 20:32:44 +09:00
17e7768a3e
Fetch bigram information in getWordProperty().
...
Bug: 12810574
Change-Id: Ic67e964b01c2753f2eec82b079dc0e5650f340bb
2014-01-31 20:24:23 +09:00
20b7786ece
Add BigramProperty and ShortcutProperty in WordProperty.
...
Bug: 12810574
Change-Id: Ia9e497c49bb2cf10897bae3a79317113325db819
2014-01-31 15:26:43 +09:00
b0df28f4cc
Merge "[HD02] Make the date header attribute mandatory."
2014-01-31 03:58:55 +00:00
748f32feba
Merge "Rename UnigramProperty to WordProperty."
2014-01-31 03:06:44 +00:00
e9085da8cb
Merge "Simplify UnigramProperty."
2014-01-31 03:06:33 +00:00
080a35e959
Rename UnigramProperty to WordProperty.
...
Bug: 12810574
Change-Id: If5ddd803948aaf6e491ddcbaa5436fb3af3f7257
2014-01-31 11:06:42 +09:00
a137c21c9c
[HD02] Make the date header attribute mandatory.
...
Bug: 11281748
Change-Id: I48a6f3d95ca89ced0c51335527201ecabfb7998e
2014-01-30 18:19:21 +09:00
5f7f6a1615
Simplify UnigramProperty.
...
Bug: 12810574
Change-Id: I606f559b5dd340b7525280ecead2c2c7ec920a78
2014-01-30 17:10:23 +09:00
324adefca3
[HD01] Small initial refactoring
...
Bug: 11281748
Change-Id: I3c64c75ecd17729bdacf03048311d76ca9f37ae2
2014-01-30 17:08:13 +09:00
21e2380234
Improve the double letter word promotion logic.
...
The old logic only checks the top 3 suggestions before the
final adjustment. It leads to instability in scores.
Bug: 10700674
Change-Id: I986aed2aefd66c1fba6196a8f100fcb5bc838a38
2014-01-28 16:33:20 +09:00
51c5ec10f9
Add length check for dict update operations.
...
Bug: 12602903
Change-Id: I6835dee8bf8b356f0f1cf6c0531bee5b3415a13f
2014-01-24 16:32:42 -08:00
3e0777e726
Use memmove for all place src and dest can be same.
...
Change-Id: I03e5c8f95cb22c7096ff545f1181f914b80a6c58
2014-01-20 11:27:01 -08:00
d78a447d10
Add a dedicated method to control time in native code.
...
Bug: 12443085
Change-Id: I41a5cf6c895cb59e54af98b40efded36afcd3247
2014-01-15 14:55:57 -08:00
20a8a4a3d9
Fix native method signature
...
Change-Id: Ia2d566f162f746c6b2b2b874f7278d86abd9e839
2014-01-15 18:56:40 +09:00
9638693479
Fix native crash in BigramDictionary::addWordBigram()
...
Bug: 12479653
Change-Id: I7d263f744f711202000524a47769dc2d3d0e0de6
2014-01-14 18:51:49 -08:00
84c52a3c81
Boundary check for ProximityInfoState::getProximityTypeG().
...
Bug: 12481052
Change-Id: Ic0b64d2fa17eb8f65f3ad1a7b468cdf6dddf7e70
2014-01-10 20:15:36 +09:00
05113c1847
Check whether the word is OOV or not for amanatto update.
...
Bug: 11736529
Change-Id: I27973212da7e922b2185dbb4febfb5bb4dfbdcbb
2014-01-08 21:02:35 +09:00
b68dd6cd0b
Merge "Differentiate exact matches' minor errors."
2013-12-19 04:14:11 +00:00
afa6c07d30
Differentiate exact matches' minor errors.
...
Bug: 8844931
Change-Id: I06754643188ccd28ba8c873878f7761787d91ff6
2013-12-19 12:37:56 +09:00
abe3a35abf
Add C++ compiler warning options
...
Change-Id: I0d79d450c5cca887d02a1087128c1d3eb0bf0b7f
2013-12-19 00:12:01 +09:00
d8f35f7b4c
Move methods for outputting from Suggest.
...
Bug: 8844931
Change-Id: I83dde6c37b75ed1e1ae4e0972e169d30ada8faf5
2013-12-18 16:47:23 +09:00
9ee9095528
Move methods for scoring from Traversal to Scoring.
...
Bug: 8844931
Change-Id: I6137d06e597f4e7b81aaf29555199e18984f2c39
2013-12-18 07:13:44 +00:00
d5f5dd74c2
Quit suggest words that do not include proximity chars.
...
Bug: 10416722
Change-Id: I74d27c6a22b4ca47d02eb238b2fbcc49f5dee99c
2013-12-18 14:31:10 +09:00
b5215d456a
Increment version number of ver4 format to 401.
...
Bug: 11073222
Change-Id: I3878aef02040b1ef73165645fc70ede586289c51
2013-12-16 23:02:54 +09:00
9b08a9e611
Fix: incompatibility of sparse table.
...
Bug: 11073222
Change-Id: Id17178efd8f9f3828d821cc718d35606e8bd4b1a
2013-12-16 22:46:29 +09:00
c1163c8518
Align block sizes for ver4 format to java side.
...
Bug: 11073222
Change-Id: I09646cbc81529576d5e34dcfa7bc29083a64076f
2013-12-16 20:42:32 +09:00
a245d15da5
Have dicttool use the native library to generate v4 dicts.
...
Yay !
Change-Id: Iea8ced9e81031b9ab7eff05ad9ef7215be248de9
2013-12-13 18:18:20 +09:00
2fa3693c26
Reset to 9bd6dac470
...
The bulk merge from -bayo to klp-dev should not have been merged to master.
Change-Id: I527a03a76f5247e4939a672f27c314dc11cbb854
2013-12-13 17:13:32 +09:00
6bc5acaa79
Fix: Suggested words from user history are invalid.
...
- Suggestions form user history can contain invalid words.
- isValidWord always returns false.
Bug: 11139426
Change-Id: I6075b275603332ddb00f4a9284afcaa82d824270
2013-10-22 05:23:48 -07:00
6d91e4ce74
Fix offdevice test build.
...
Change-Id: I42143bdc4f6f5aa4f55530de84819ab722a22f72
2013-10-08 16:05:42 +09:00
6d3d53955e
Merge "Fix a bug: wrong parent position is written when moving."
2013-10-08 04:48:53 +00:00
802e6383ea
Fix a bug: wrong parent position is written when moving.
...
Change-Id: I93d33ba9105eb85327108cca5706d8db3399de6a
2013-10-08 12:44:00 +09:00
86f7711407
Merge "Don't auto-correct to non-whitelist shortcuts"
2013-10-07 10:04:18 +00:00
f309f2288b
Don't auto-correct to non-whitelist shortcuts
...
Bug: 11076722
Change-Id: I0de10ab24d33ec31f45664fe92d80d5a7bec9c20
2013-10-07 19:01:57 +09:00
cfb018ba6d
Fix bug and Add large test for decaying dictionary.
...
- GC gets failure when the dictionary become empty.
- Useless unigrams are sometimes not removed.
Bug: 10197478
Change-Id: I8d1479c01efba61a81f03bc077da6bcb4797a940
2013-10-07 17:31:01 +09:00
15b1a0fd14
Parameter optimization.
...
[Category diff]
+1 194
-1 21
+2 15
-2 1
+3 1
-3 15
+4 152
-4 90
+5 108
-5 197
+6 94
-6 136
+7 28
-7 132
[Weighted category diff]
+1 230
-1 23
+2 15
-2 1
+3 1
-3 15
+4 180
-4 106
+5 122
-5 224
+6 107
-6 158
+7 29
-7 157
show diff for ./en_user_log_phones_2011_08.csv
+1 171
-1 9
+2 7
-2 1
+3 1
-3 7
+4 123
-4 76
+5 84
-5 157
+6 66
-6 119
+7 20
-7 103
Before
---- count ----
Count(1):75.64%, 177913
Count(2):1.06%, 2510
Count(3):0.56%, 1319
Count(4):6.63%, 15612
Count(5):9.87%, 23223
Count(6):2.79%, 6580
Count(7):3.41%, 8038
---- weight ----
Weight(1):96.88%, 2009907
Weight(2):0.24%, 5157
Weight(3):0.09%, 2025
Weight(4):0.77%, 16095
Weight(5):1.11%, 23077
Weight(6):0.39%, 8172
Weight(7):0.48%, 10146
---- score ----
Conservative score = 66.406
Normal score = 81.512
Agressive score = 89.064
Insane score = 92.841
After
---- count ----
Count(1):75.71%, 178087
Count(2):1.07%, 2524
Count(3):0.55%, 1305
Count(4):6.66%, 15677
Count(5):9.83%, 23133
Count(6):2.78%, 6539
Count(7):3.37%, 7930
---- weight ----
Weight(1):96.89%, 2010118
Weight(2):0.24%, 5171
Weight(3):0.09%, 2011
Weight(4):0.78%, 16184
Weight(5):1.1%, 22972
Weight(6):0.39%, 8109
Weight(7):0.48%, 10014
---- score ----
Conservative score = 66.431
Normal score = 81.531
Agressive score = 89.08
Insane score = 92.855
No diffs for 10+ freq user log.
Change-Id: Ica4a7604507a2c91aaa7daf5bacf4fce4039f547
2013-10-07 12:39:51 +09:00
3e5f4b53b0
Merge "Check the elapsed time for decaying."
2013-10-04 07:16:17 +00:00
67c855ea6f
Check the elapsed time for decaying.
...
Bug: 6669677
Change-Id: I0401a4c0908c702ce65abfa5e017dd16cb1296f9
2013-10-04 16:11:11 +09:00
0b62621446
Merge "Optimize the parameters for the typing algorithm"
2013-10-04 03:25:43 +00:00
2ed09c214a
Optimize the parameters for the typing algorithm
...
The new set of parameters are optimized for both
keystroke savings and regression test scores.
This change is corresponding to the patch 6 of
Change-Id: Ib8439a85de26cbbba58837344717f0acbfcf0ab0
in the regression test repository.
Here is the link to the doc analyzing the
“nnow → know” case:
https://docs.google.com/a/google.com/document/d/1XIHfAHLlP1f3F8R-u7yxPGWcP58tokygzN_lQKXFFgM/edit
Here is the link to the spreadsheet showing
the diff of the words with frequencies >= 10
in en_user_log_phones_2011_08.csv.
https://docs.google.com/a/google.com/spreadsheet/ccc?key=0Am_RQlV4zC6SdFFVTlhJT0RLUENCWWZOZ3JQTUpMQ2c&usp=drive_web#gid=0
Updated TRT Results for this change:
[Category diff]
+1 783
-1 717
+2 20
-2 34
+3 34
-3 20
+4 575
-4 777
+5 765
-5 755
+6 785
-6 666
+7 479
-7 472
[Weighted category diff]
+1 999
-1 965
+2 21
-2 35
+3 35
-3 21
+4 804
-4 980
+5 970
-5 971
+6 954
-6 831
+7 645
-7 625
Bug: 10613502
Change-Id: I5cd447673a196ad5af641a2118602bec879bdefb
2013-10-03 19:30:26 -07:00
864ee881bd
Merge "Fix UserHistoryDictionaryTests."
2013-10-03 12:02:34 +00:00
11f7cae094
Fix UserHistoryDictionaryTests.
...
Bug: 6669677
Bug: 10667710
Change-Id: I6cdc6a6c9cacc7f276fda3a26ec31e3eb928471c
2013-10-03 20:55:34 +09:00
9cb1e78a44
Fix: Native crash when an empty attribute is written.
...
Bug: 10964805
Change-Id: Ia3cd891d20aee2226092f0f646d8f280901786fc
2013-10-03 17:30:54 +09:00
3d92954120
Fix build.
...
Change-Id: Ib33b27214e67378646e44f5b45bda298f960524f
2013-10-02 23:02:42 +09:00
7c4dcf1e91
Use probability table for decaying dictionaries.
...
Bug: 6669677
Change-Id: Ib5994a2e343dfcdaf23755e523f52846709b1c6c
2013-10-02 18:01:47 +09:00
c76bbceedc
Stochastic decay.
...
Bug: 6669677
Change-Id: Ib2d9228b951c77dab7a8675ce9db60677e87e771
2013-10-02 17:51:12 +09:00
Keisuke Kuroyanagi
Ken Wakasa
Stephen Hines
Yohei Yukawa
Jean Chalard
Tadashi G. Takaoka
Xiaojun Bi