Keisuke Kuroyanagi
|
88fa47a27d
|
Support migration/dump of Beginning-of-Sentence entries.
Bug: 14119293
Change-Id: Ie975138f819794d5c34a7a547be5a6117050e084
|
2014-06-24 12:37:07 +09:00 |
|
Keisuke Kuroyanagi
|
f7322b166b
|
Make getNextWordAndNextToken output code point count.
Bug: 14425059
Change-Id: Id1c2927c8a1be0b1680206d444dbdf0c9453dceb
|
2014-06-23 19:08:30 +09:00 |
|
Keisuke Kuroyanagi
|
24d49ee577
|
Remove hasBigrams/hasShortcut flags from ver4 PtNode.
Always check bigram/shortcut content instead of having
flags in each PtNode.
Bug: 14425059
Change-Id: I9eb816681bf22fc12e3ab3c92a178a7990b90e93
|
2014-06-23 16:49:49 +09:00 |
|
Keisuke Kuroyanagi
|
0fbca1ac23
|
Remove word from personalized dicts when it's canceled.
Bug: 15555552
Bug: 15552347
Change-Id: Ia4d8c79d079e3ce233d46d4bbad4fff1be5c5c39
|
2014-06-20 14:46:13 +09:00 |
|
Keisuke Kuroyanagi
|
89899e14df
|
Merge "Update unit test for beginning-of-sentence."
|
2014-06-10 22:31:57 +00:00 |
|
Keisuke Kuroyanagi
|
e041bfab5c
|
Update unit test for beginning-of-sentence.
Bug: 14119293
Change-Id: I594a1ca1096f0c12c678dd30eb75de905e55c5bb
|
2014-06-12 16:07:39 +09:00 |
|
Keisuke Kuroyanagi
|
22931cd941
|
Enable Beginning-of-Sentence prediction for contextual dict.
Bug: 14161647
Bug: 14119293
Change-Id: I0c00f13966db88e4de85e245e7bced43c9d474b2
|
2014-06-12 12:26:18 +09:00 |
|
Keisuke Kuroyanagi
|
86fe8081b3
|
Merge "Add removeUnigramEntry() to native dictionary policy."
|
2014-06-10 22:29:12 +00:00 |
|
Keisuke Kuroyanagi
|
f12985245c
|
Add removeUnigramEntry() to native dictionary policy.
Bug: 15552347
Change-Id: Ic713f79ef26b5963060304df9c0a3a402c3cc6d4
|
2014-06-12 12:14:11 +09:00 |
|
Keisuke Kuroyanagi
|
447c19364a
|
Merge "Enable Beginning-of-Sentence prediction for contextual dict."
|
2014-06-10 22:31:57 +00:00 |
|
Keisuke Kuroyanagi
|
59ed0c2db2
|
Block offensive words in native code.
Bug: 15300452
Change-Id: Ic6c91c47453e19fb5db2c62b66659619e72b1ecf
|
2014-06-12 11:36:00 +09:00 |
|
Keisuke Kuroyanagi
|
07e1412631
|
Purge dict reading code for 401 and create for 402.
Change-Id: Ib0150b3306bb2db8aff443d1158fecc8464cbbdb
|
2014-06-10 19:22:40 +09:00 |
|
Keisuke Kuroyanagi
|
d9b8602f48
|
Implement getMaxProbabilityOfExactMatches().
Bug: 13142176
Bug: 15428247
Change-Id: I5be6d683be95505412615ca7c88260de1ea05f54
|
2014-06-06 17:37:46 +09:00 |
|
Keisuke Kuroyanagi
|
7852765a50
|
Add length check for attaching a BoS marker.
Bug: 15297872
Change-Id: I7b0a27409b81b76561d19c6caa18a5011d3e90f6
|
2014-05-28 20:20:39 +09:00 |
|
Keisuke Kuroyanagi
|
f9ce867d80
|
Add boundary check for v4 bigram reading.
Bug: 14496386
Change-Id: Iedd3445c3222a777a2476beed7d9eb53773f406c
|
2014-05-27 19:29:35 +09:00 |
|
Keisuke Kuroyanagi
|
dfca51726e
|
Return whether the dynamic dict operation was success.
Bug: 12184250
Change-Id: Iee7e00c1e84c95551a077f4dd023c0a9b9ac9466
|
2014-05-27 17:30:00 +09:00 |
|
Keisuke Kuroyanagi
|
a6278eb9c1
|
Use whether it's exact match to detect distracters.
Bug: 13142176
Change-Id: Id5b7286d28897931f7bfe571be45d46ffeef4adf
|
2014-05-26 21:56:20 +09:00 |
|
Keisuke Kuroyanagi
|
a37f374ad1
|
Version up dynamic dict format from 401 to 402.
Change-Id: Ibea36af905ade773ae3db3a5456f7b5a0ad7d220
|
2014-05-23 20:20:56 +09:00 |
|
Keisuke Kuroyanagi
|
1adca93381
|
Extend jni methods and enable Beginning-of-Sentence.
Bug: 14119293
Change-Id: I78fc877367dd0d6240eeacb750b6d2d0b93cba83
|
2014-05-23 19:58:58 +09:00 |
|
Keisuke Kuroyanagi
|
96990ca773
|
Support Beginning-of-Sentence in native code
Bug: 14119293
Change-Id: I0f382e33a19bf481823b23405d454de61ec835ff
|
2014-05-23 17:23:08 +09:00 |
|
Keisuke Kuroyanagi
|
6600340af5
|
Fix: PtNodeParams.representsNonWordInfo()
Change-Id: I7ab4fb280e8ac89f81d0b32b0663a86c9b69aa5d
|
2014-05-23 13:49:18 +09:00 |
|
Keisuke Kuroyanagi
|
2a015dcb25
|
Add Beginning-of-Sentence info in UnigramProperty.
Bug: 14119293
Bug: 14425059
Change-Id: I8a894352568377d32468e5563f4e89af00d22944
|
2014-05-23 00:07:14 +09:00 |
|
Keisuke Kuroyanagi
|
9f8c9a0161
|
Use PrevWordsInfo to add/remove n(bi)-gram in native code.
Bug: 14119293
Bug: 14425059
Change-Id: I4b9a46bfd670b35195418eaee51456d44fb91b6d
|
2014-05-21 18:30:34 +09:00 |
|
Keisuke Kuroyanagi
|
fa7db65dec
|
Support multiple previous words in DicNode.
Bug: 14425059
Change-Id: Ib8682befe4d7d9fe5122eb538e7c804f75ded463
|
2014-05-19 11:47:10 +09:00 |
|
Keisuke Kuroyanagi
|
45d1a936a7
|
Move prev word related logic to PrevWordsInfo.
Bug: 14119293
Bug: 14425059
Change-Id: I1bbd7ab4ace2c475f27bc468cb7b4d67e1ae2f9f
|
2014-05-16 22:31:45 +09:00 |
|
Keisuke Kuroyanagi
|
b94ec1437b
|
Introduce MAX_PREV_WORD_COUNT_FOR_N_GRAM.
Bug: 14425059
Change-Id: I587f90df026a14359d2ee452040bbfaf02c1ae51
|
2014-05-15 18:45:49 +09:00 |
|
Keisuke Kuroyanagi
|
b87fffb8be
|
Refactoring: Move prev word information into PrevWordsInfo.
Bug: 14119293
Bug: 14425059
Change-Id: I5a5f81c6b189e3ad1da093343a3121463f87c21c
|
2014-05-15 18:39:23 +09:00 |
|
Keisuke Kuroyanagi
|
d6fdd58cc0
|
Cleanup DicTraverseSession.
Change-Id: I953665e1958e7214e9365e2bc9d3f3843016dc81
|
2014-05-15 17:41:23 +09:00 |
|
Keisuke Kuroyanagi
|
e810a266fd
|
Merge "Quit use bigram probability diff for ver4 dict."
|
2014-05-15 07:07:25 +00:00 |
|
Keisuke Kuroyanagi
|
64341927d2
|
Quit use bigram probability diff for ver4 dict.
Change-Id: I2cfcfbcf351877d1dff466a24974dbb05908f14e
|
2014-05-15 16:02:58 +09:00 |
|
Keisuke Kuroyanagi
|
a709bc7f93
|
Merge "Reduce the cost for handling intentional omission."
|
2014-05-15 03:31:39 +00:00 |
|
Keisuke Kuroyanagi
|
39e5a15af0
|
Merge "Always keep PtNodes that represent non-word info during GC."
|
2014-05-15 02:38:57 +00:00 |
|
Keisuke Kuroyanagi
|
91d7538225
|
Merge "Add VERSION_4_DEV(402) in native code."
|
2014-05-14 13:40:10 +00:00 |
|
Keisuke Kuroyanagi
|
7116ea98f4
|
Add VERSION_4_DEV(402) in native code.
Bug: 13406708
Change-Id: I96cfacf524d670a6a5637a96a63bcd47aaf09ca0
|
2014-05-14 22:37:05 +09:00 |
|
Keisuke Kuroyanagi
|
cf700695ea
|
Always keep PtNodes that represent non-word info during GC.
Bug: 14119293
Change-Id: Ie50b341a512be6a6efe3e05b60e1d09560b01d1f
|
2014-05-14 22:29:21 +09:00 |
|
Keisuke Kuroyanagi
|
2dc8e36f8e
|
Use nullptr instead of MmappedBufferPtr(nullptr).
Change-Id: I9bc35f723f1c105ef6155a49630b8cd492900bc8
|
2014-05-14 22:05:00 +09:00 |
|
Keisuke Kuroyanagi
|
32bdf9f344
|
Merge "Use JniDataUtils::putXxxToArray() to output a value."
|
2014-05-14 11:12:09 +00:00 |
|
Keisuke Kuroyanagi
|
5c00bde9bc
|
Merge "Filter out control characters and non-unicode code points."
|
2014-05-14 11:07:32 +00:00 |
|
Keisuke Kuroyanagi
|
304a71d171
|
Use JniDataUtils::putXxxToArray() to output a value.
Change-Id: Ifb7bed6623b01acb524566a0fe00dcbdf7273888
|
2014-05-14 20:05:15 +09:00 |
|
Keisuke Kuroyanagi
|
e9121a68a6
|
Filter out control characters and non-unicode code points.
Bug: 14119293
Bug: 13758761
Change-Id: I6b79cff0714152807f5e20b7a75060a0a772b28b
|
2014-05-14 20:05:10 +09:00 |
|
Keisuke Kuroyanagi
|
728141d55a
|
Merge "Generate dict code for version 401."
|
2014-05-14 10:51:12 +00:00 |
|
Keisuke Kuroyanagi
|
6bf268132d
|
Generate dict code for version 401.
Bug: 13406708
Change-Id: I769ac84d54d997e7aefab0c9c16727455a132e0b
|
2014-05-14 19:09:01 +09:00 |
|
Keisuke Kuroyanagi
|
72d6061efb
|
Merge "Use JniDataUtils::outputCodePoints() to output code points"
|
2014-05-14 09:07:45 +00:00 |
|
Keisuke Kuroyanagi
|
ed16af72e3
|
Restrict the permission of dict files created on device.
Bug: 13497304
Change-Id: I7bf67e2e81bc63a67bd91cbc0f753ecac88349f6
|
2014-05-14 17:48:28 +09:00 |
|
Keisuke Kuroyanagi
|
d2f7cd28ae
|
Use JniDataUtils::outputCodePoints() to output code points
Bug: 14119293
Bug: 13758761
Change-Id: I516d2f96e219e6e65246f502186ccb9bd5f0670f
|
2014-05-14 17:42:47 +09:00 |
|
Keisuke Kuroyanagi
|
c1e86d3f49
|
Merge "Skip PtNodes with non-Unicode code points for suggestion."
|
2014-05-14 06:22:22 +00:00 |
|
Keisuke Kuroyanagi
|
14dd663fe5
|
Reduce the cost for handling intentional omission.
Bug: 14602770
Change-Id: I3a678a3e9b227fc4c3b8d23012aba18ca2e52da5
|
2014-05-14 13:54:32 +09:00 |
|
Keisuke Kuroyanagi
|
0c8ce96bec
|
Add "// namespace latinime"
Bug: 13406708
Change-Id: I0fa85875fb5b98b4e40a149e3e33e5f56bee9a97
|
2014-05-13 15:16:43 +09:00 |
|
Keisuke Kuroyanagi
|
6e4b674f83
|
Move files under bigram/shortcut to under structure.
Bug: 13406708
Change-Id: I48e9d4ff30a8b50d4f1694ebbefb02cf189f7713
|
2014-05-13 15:16:43 +09:00 |
|
Keisuke Kuroyanagi
|
d0d0113983
|
Code cleanup.
Change-Id: Ic31b66cccfd77348f2ff7961959a3eaf9f7ad5d8
|
2014-05-13 01:32:38 +09:00 |
|