nyancrimew
/
LatinIME
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
37,900 Commits
1 Branch
0 Tags
363 MiB
Commit Graph

865 Commits (779d4bb4293e2f37c3e2ff219e2e7ce4690036d7)

Author SHA1 Message Date
Jean Chalard 20c89b1cf5 [SD5(2)] Remove useless args 
Bug: 15840116
Change-Id: I1123426fbd9d420c1be64ccc917a5f870e70e6fa
 2014-07-01 13:34:25 +09:00
Jean Chalard 3fb5a541a4 Fix tests 
Change-Id: I12ba56d021b50c03dc62e3f3c8db3ecada2f6a4b
 2014-06-30 15:25:31 +09:00
Ken Wakasa 4569a734ad Revert "Move getPrevWordsInfoFromNthPreviousWord to StringUtlis." 
This reverts commit ba463c9a66 that broke the dicttool build.

Bug: 14425059
Change-Id: Ie1685587104d26e4416624747c97f6087c13388a
 2014-06-27 15:07:07 +00:00
Keisuke Kuroyanagi ba463c9a66 Move getPrevWordsInfoFromNthPreviousWord to StringUtlis. 
Bug: 14425059
Change-Id: I3eb24e840c165e43f68c2a60fccf9974affb57a6
 2014-06-27 18:08:17 +09:00
Keisuke Kuroyanagi 1c2f1ada83 Find multiple previous word information to support n-gram. 
Bug: 14425059

Change-Id: Ieace636334a9b2a094527341d4fcfc05958296c5
 2014-06-27 17:59:21 +09:00
Keisuke Kuroyanagi 92827b0712 Merge "Make PrevWordsInfo have multiple words' information." 2014-06-24 01:52:26 +00:00
Keisuke Kuroyanagi e708b1bc2e Make PrevWordsInfo have multiple words' information. 
Bug: 14425059
Change-Id: I2bd6a872904a44b80f638a13d91a97559217cc1a
 2014-06-25 14:14:37 +09:00
Keisuke Kuroyanagi 0aef59746c Make Beginning-of-Sentence prediction require two exposures. 
Bug: 15868192
Change-Id: I4b577ad11c992d872d6f902fd50527d9ca5cc1ba
 2014-06-25 20:20:44 +09:00
Keisuke Kuroyanagi 52cef13211 Fix: unit tests by clearing personalized dicts 
Bug: 14119293
Change-Id: I61cc05fb09342103f453ba83709c6be68d2f695e
 2014-06-25 11:40:29 +09:00
Keisuke Kuroyanagi 702e153fbc Merge "Support migration/dump of Beginning-of-Sentence entries." 2014-06-24 01:59:00 +00:00
Keisuke Kuroyanagi 88fa47a27d Support migration/dump of Beginning-of-Sentence entries. 
Bug: 14119293
Change-Id: Ie975138f819794d5c34a7a547be5a6117050e084
 2014-06-24 12:37:07 +09:00
Jean Chalard bfea7dec1a Add a test for Armenian periods. 
Bug: 11463389
Change-Id: Ic1a612bd6b2693369a1688e6a2273cff26fbe6d1
 2014-06-18 17:45:53 +09:00
Keisuke Kuroyanagi 17f03583c8 Merge "Add a method to update contextual dictionary." 2014-06-10 22:31:57 +00:00
Keisuke Kuroyanagi 356539699a Add a method to update contextual dictionary. 
Bug: 14161647
Change-Id: I2111f841c94e31d62b670da4236fc738df03a708
 2014-06-16 17:00:12 +09:00
Keisuke Kuroyanagi e041bfab5c Update unit test for beginning-of-sentence. 
Bug: 14119293
Change-Id: I594a1ca1096f0c12c678dd30eb75de905e55c5bb
 2014-06-12 16:07:39 +09:00
Jean Chalard 4863a06544 Special case periods in the spell checker 
Special case <valid word>.<valid word> to send as a suggestion
the same string where the periods is replaced by a space.

Bug: 10780091
Change-Id: I43c94675977f9ab5d7ee5671486cb742b39f3974
 2014-06-10 19:52:58 +09:00
Jean Chalard e689d37f72 Remove a useless method 
Change-Id: I21a4219f682f43f4a84b1ab12d00dd930b35caa1
 2014-06-10 12:47:55 +09:00
Jean Chalard 367c199de1 Remove mPrevWordsInfo 
This member has outlived its usefulness. It's not clear now that it
makes things really faster, but it does bring a lot of complexity
that we can avoid by removing it.

Change-Id: Ifbc8094a45b56b958fe165b1930f4cc358a97721
 2014-06-10 12:07:51 +09:00
Keisuke Kuroyanagi bdf745da32 Check isInDictionary() before the distracter test. 
Bug: 13142176
Bug: 15428247
Change-Id: I7ce2c09ebbef6ca8c056807c2a35f2f987fd436e
 2014-06-09 11:43:45 +09:00
Keisuke Kuroyanagi 1910392eed Add Dictionary.isInDictionary(). 
Bug: 13142176
Bug: 15428247
Change-Id: If2d1c1fea7a69e41809a828da8dd032211ad144e
 2014-06-09 11:04:28 +09:00
Keisuke Kuroyanagi 166d8c2293 Make Distracter filter use getMaxFrequencyOfExactMatches(). 
Bug: 13142176
Bug: 15428247

Change-Id: I5c23fbea2851f891f76f19d9da2cb70ae964569b
 2014-06-06 19:38:44 +09:00
Keisuke Kuroyanagi d9b8602f48 Implement getMaxProbabilityOfExactMatches(). 
Bug: 13142176
Bug: 15428247
Change-Id: I5be6d683be95505412615ca7c88260de1ea05f54
 2014-06-06 17:37:46 +09:00
Jean Chalard 4a1113b6b0 Refactoring 
Rename `initialize' to `start' and `deactivate' to `stop' for ease
of understanding. It's completely bizarre that you can "deactivate"
a recapitalization and that will just restart a new one the next time
you press shift. Start and stop are easier to understand.

Change-Id: I455175aebfcfe11198c6c61bf2c6b19efc3f82df
 2014-06-04 16:29:29 +09:00
Keisuke Kuroyanagi 8f71fab2ed Make prevWord = null if the next word starts from a connector. 
This fixes PunctuationTests#
testAutoCorrectionWithSingleQuotesAround.

Bug: 14119293
Bug: 15334309

Change-Id: I604c21a21e89a5fc431fd56ab7b6ad03f4736b01
 2014-05-30 20:30:17 +09:00
Jean Chalard d0d3d813d2 Fix tests 
DEBUG in LatinIME has been changed by Ie52007dc to mean both
DebugSettings.PREF_DEBUG_MODE and Settings.PREF_KEY_IS_INTERNAL
instead of just DEBUG_MODE as used to be the case. Tests depend
on the debug mode to test many things and they make sure they run
in debug mode or they fail. This has tests understand the change in
policy.

Change-Id: Ie9f29e6a1d85e19704c8940d3fcf97c13c3dbaa6
 2014-05-29 22:15:56 +09:00
Keisuke Kuroyanagi c4a3b9f0d6 Merge "Remove PrioritizedSerialExecutor." 2014-05-29 08:52:23 +00:00
Jean Chalard 944923f266 Fix: too many calls to getSuggestedWordsForTypingInput 
This reverts commit d941ea18 and builds on it to fix the behavior
of the broken cases.
It also fixes a small, related bug that probably has existed for
a very long time: predictions not displayed when cancelling
double-space-to-period.

Bug: 15148015
Change-Id: I1f9358f8b6f5804f831643611576be347e83999d
 2014-05-29 17:36:46 +09:00
Keisuke Kuroyanagi 94f88b4881 Remove PrioritizedSerialExecutor. 
Bug: 15320560
Change-Id: Icb88a96ebd685da1d2cba7b07889a2751c603a2e
 2014-05-29 17:36:32 +09:00
Keisuke Kuroyanagi b9a3775203 Merge "Add PersonalizationDictionaryTests." 2014-05-29 07:37:47 +00:00
Keisuke Kuroyanagi 8d0a0d1f3e Add PersonalizationDictionaryTests. 
Bug: 11778342
Change-Id: Ice88f439ae11714e5ec9dd3b7616d0c2d59ea812
 2014-05-29 16:33:21 +09:00
Jean Chalard 2381b8cfdc Disable a test that fails for an unknown reason 
It works when tested on the actual device, and on some versions
of the platform. Until we know what's wrong with resource loading
when running under the test harness, we need to disable this test.

Change-Id: I2d7ed9db940b9b73739de8325665bdafb6af58cb
 2014-05-29 14:02:44 +09:00
Keisuke Kuroyanagi b1e43d58a6 Merge "Stop directly checking SuggestedWordInfo.mKind" 2014-05-28 11:52:00 +00:00
Keisuke Kuroyanagi 4bffac6db9 Stop directly checking SuggestedWordInfo.mKind 
Bug: 15298959

Change-Id: Iba6eeb7981634e7ddb896404978b30f6efd6e72f
 2014-05-28 20:35:45 +09:00
Jean Chalard fa69784a96 Run test only on KitKat devices 
This won't work on < KK because it needs the armenian locale
to be present on the device. I don't know why, but when under
test, apps don't seem to be able to resolve resources for locales
not supported by the system.

Change-Id: Ie0f4fc30954978061cae751024bab5569a2ab2eb
 2014-05-28 17:45:28 +09:00
Keisuke Kuroyanagi 3faf4fc5e7 Merge "Return whether the dynamic dict operation was success." 2014-05-27 09:01:46 +00:00
Keisuke Kuroyanagi dfca51726e Return whether the dynamic dict operation was success. 
Bug: 12184250
Change-Id: Iee7e00c1e84c95551a077f4dd023c0a9b9ac9466
 2014-05-27 17:30:00 +09:00
Keisuke Kuroyanagi 301eeaa976 Fix unit test build. 
Change-Id: Id2c92c5035d7b357fa66c7ca671b72a1a33ebf3b
 2014-05-27 16:43:11 +09:00
Keisuke Kuroyanagi 00da83ed75 Stop filtering out when perfect freq > top non-perfect freq. 
Bug: 13142176
Change-Id: I0290df918a5bd5018bf55231dc462d5e797155c6
 2014-05-27 16:09:59 +09:00
Keisuke Kuroyanagi 17bd4eb0c9 Apply distracter filter for UserHistoryDictionary. 
Bug: 13142176
Change-Id: I67d63a5c789d7c587bcd7abacd26b2e76da11978
 2014-05-27 01:10:04 +09:00
Keisuke Kuroyanagi a6278eb9c1 Use whether it's exact match to detect distracters. 
Bug: 13142176
Change-Id: Id5b7286d28897931f7bfe571be45d46ffeef4adf
 2014-05-26 21:56:20 +09:00
Tadashi G. Takaoka a91561aa58 Use Java 7 diamond operator 
Change-Id: If16ef50ae73147594615d0f49d6a22621eaf1aef
 2014-05-24 01:05:42 +09:00
Keisuke Kuroyanagi e782f1f415 Merge "Update RichInputConnectionAndTextRangeTests." 2014-05-23 14:53:29 +00:00
Keisuke Kuroyanagi 9f9988e996 Merge "Introduce EMPTY_PREV_WORDS_INFO and BEGINNING_OF_SENTENCE." 2014-05-23 14:53:13 +00:00
Keisuke Kuroyanagi f2c2657566 Update RichInputConnectionAndTextRangeTests. 
Bug: 14119293
Change-Id: I952daaa8e938c67bd9e0e699d71a77a3b0bf8b0d
 2014-05-23 23:19:35 +09:00
Keisuke Kuroyanagi a790c5b683 Introduce EMPTY_PREV_WORDS_INFO and BEGINNING_OF_SENTENCE. 
Bug: 14119293
Change-Id: I5020e5f0aa64bc3e97b3a3c2c07a60c8b765ed64
 2014-05-23 23:19:33 +09:00
Keisuke Kuroyanagi a37f374ad1 Version up dynamic dict format from 401 to 402. 
Change-Id: Ibea36af905ade773ae3db3a5456f7b5a0ad7d220
 2014-05-23 20:20:56 +09:00
Keisuke Kuroyanagi 1adca93381 Extend jni methods and enable Beginning-of-Sentence. 
Bug: 14119293
Change-Id: I78fc877367dd0d6240eeacb750b6d2d0b93cba83
 2014-05-23 19:58:58 +09:00
Jean Chalard 47ea762fb2 Add a test for armenian period. 
Bug: 11463389
Change-Id: Ib482290672947df61b86cdb4e78461e9ce843f94
 2014-05-23 19:35:43 +09:00
Keisuke Kuroyanagi 85befc0873 Merge "Make DistracterFilter interface." 2014-05-23 10:11:57 +00:00
Jean Chalard cfdb1b8d26 Fix some auto-caps problems: 
- (mainly for Spanish) auto-caps after inverted bang and what
- (German only) don't auto-cap after digits-period-space

Bug: 15177663
Bug: 12206753
Change-Id: Ia214bc067319469d9debbbfbdcb1dcff980847f0
 2014-05-23 18:17:09 +09:00
Keisuke Kuroyanagi f498e53933 Make DistracterFilter interface. 
Bug: 13142176
Bug: 15094186
Change-Id: If94b0a155b5ea2ff6b839e7da9d12a9cc6553931
 2014-05-23 18:12:37 +09:00
Keisuke Kuroyanagi 1fa3e9044f Move distracter filter to dictionary facilitator. 
Bug: 13142176
Bug: 15094186
Change-Id: Ib9e42f8e25538009f3ba62cf1e034cae3f6823c7
 2014-05-23 16:10:36 +09:00
Keisuke Kuroyanagi 17f326b745 Add beginning of sentence information in PrevWordsInfo. 
Bug: 14119293
Bug: 14425059
Change-Id: I65320920e840082b0b697bb621676716d0933e0c
 2014-05-21 15:40:08 +09:00
Keisuke Kuroyanagi e507d92aa3 Use PrevWordsInfo for get/add/remove n-gram(bigram) entry. 
Bug: 14119293
Bug: 14425059
Bug: 15102610
Change-Id: Ib482390f8d15b37d44a1a54e8c243a9eaec3f815
 2014-05-21 11:15:38 +09:00
Ken Wakasa 4e21d3711f Revert "Use PrevWordsInfo for get/add/remove n-gram(bigram) entry." 
This reverts commit ff50b39176.

Bug: 14119293
Bug: 14425059
Bug: 15102610

Change-Id: If278b4ab236e38d20d8cdc0761b0438911bd4ff9
 2014-05-20 14:01:06 +00:00
Keisuke Kuroyanagi ff50b39176 Use PrevWordsInfo for get/add/remove n-gram(bigram) entry. 
Bug: 14119293
Bug: 14425059

Change-Id: I12e9ba977c153b514c6591ab52940712fd0874e3
 2014-05-20 13:37:04 +09:00
Keisuke Kuroyanagi 83c40a2301 Use PrevWordsInfo instead of String in Java side. 
Bug: 14119293
Bug: 14425059

Change-Id: I3d5da84881a49a04550180dd9aac2c37da2ed762
 2014-05-19 13:55:40 +09:00
Keisuke Kuroyanagi 23246ed18d Use dedicated DictionaryFacilitator for DistracterFilter 
Bug: 15002249
Change-Id: Ic77eaa7d627d406daad7dcd15cb4884d9f647312
 2014-05-17 01:18:08 +09:00
Keisuke Kuroyanagi 34873a66f0 Fix: StringIndexOutOfBoundsException. 
Bug: 14985751
Change-Id: I9df2f737555ab02e24e0fbd231a97c1eec26bc57
 2014-05-16 15:32:12 +09:00
Keisuke Kuroyanagi e810a266fd Merge "Quit use bigram probability diff for ver4 dict." 2014-05-15 07:07:25 +00:00
Keisuke Kuroyanagi 64341927d2 Quit use bigram probability diff for ver4 dict. 
Change-Id: I2cfcfbcf351877d1dff466a24974dbb05908f14e
 2014-05-15 16:02:58 +09:00
Keisuke Kuroyanagi aa7329de15 Merge "Add VERSION4_DEV(402) in Java side and use it for tests." 2014-05-14 13:42:24 +00:00
Keisuke Kuroyanagi 04536f14b0 Add VERSION4_DEV(402) in Java side and use it for tests. 
Bug: 13406708
Change-Id: I7c9c53bf34d12dced7331a359a83f6444490783a
 2014-05-14 22:37:07 +09:00
Jean Chalard 5ce39dfa78 Fix a bug where changing languages kills the composition. 
Bug: 14926896
Change-Id: Id2a06c68a51f833db4d8bbc858a232c2696afb6e
 2014-05-14 20:34:32 +09:00
Jean Chalard 4b6660f8f9 Merge "Fix unit tests." 2014-05-14 07:18:56 +00:00
Jean Chalard 68730d1c8e Fix unit tests. 
Language change has always been strange. That's because we
didn't call the right method >.>
Also, extra values were not passed in correctly.

Change-Id: Ifc345988df944ad691fe22cb71cb519e47a5a223
 2014-05-14 16:09:40 +09:00
Xiaojun Bi 25ec32f635 Merge "Implement the distracter filter" 2014-05-13 23:08:40 +00:00
Xiaojun Bi ac20253806 Implement the distracter filter 
Bug: 13142176

Change-Id: I85a048cdcbbad3d6020a25f900250d8d7a0fe3da
 2014-05-13 15:52:14 -07:00
Keisuke Kuroyanagi 5c154edb55 Merge "Add large unit test for dictionary migration." 2014-05-13 06:40:28 +00:00
Keisuke Kuroyanagi 3c7f140e8e Add large unit test for dictionary migration. 
Bug: 13406708
Change-Id: Ic1eb627139a1ff57c0000d95d9bd57aa3609f753
 2014-05-13 15:16:30 +09:00
Keisuke Kuroyanagi 61fc329901 Merge "Support bigram historical information migration." 2014-05-13 02:56:36 +00:00
Keisuke Kuroyanagi 620a05ae59 Support bigram historical information migration. 
Bug: 13406708
Change-Id: I4bae53e43cb7653eac3b5bd13da2d2bc8aaf88a9
 2014-05-13 01:28:30 +09:00
Jean Chalard 61ddac28de Merge "Add initial reordering rules for Myanmar" 2014-05-12 11:29:53 +00:00
Keisuke Kuroyanagi 9d7e8c717f Support unigram historical information migration. 
Bug: 13406708
Change-Id: Ibed15b3bc5d5ae68faefa379028dbe10d32b0c0f
 2014-05-12 19:21:06 +09:00
Jean Chalard 281dbc3973 Add initial reordering rules for Myanmar 
Bug: 13945569
Change-Id: Ib546ba110e87bf72afa7f42c878cc5f638bff6c7
 2014-05-12 19:17:47 +09:00
Keisuke Kuroyanagi 455dc84cf2 Add VERSION4_TEST for testing. 
Bug: 13406708
Change-Id: I0b434717ea3edbb131650af634c53cfbfe113c3e
 2014-05-09 15:17:01 +09:00
Jean Chalard 29c00ff538 Introduce clustering punctuation 
Bug: 10081730
Change-Id: If198fa3df68ecb267da0a278da41fd509d6165f1
 2014-05-01 15:45:24 +09:00
Keisuke Kuroyanagi 1737b7ff5c Use ReentrantReadWriteLock in ExpandableBinaryDictionary. 
Bug: 8187060
Change-Id: Ic665f0a5e940708aa9addedac068a64900b307e7
 2014-04-28 20:56:01 +09:00
Keisuke Kuroyanagi 67c0ed8f8c Handle user history dictionary as an ExpandableBinaryDictionary. 
Bug: 13755213
Change-Id: I1ea8a6df007af7153852f2d32bf5e8ec669c432b
 2014-04-24 14:48:01 -07:00
Keisuke Kuroyanagi 2dcb5c1b4d Remove clearAndFlushDictionary() and use clear(). 
clearAndFlushDictionary() was needed when dictionaries are constructed
in java side. All expandable dictionaries now use native code; thus,
this method is same to clear() and no longer needed.

Bug: 13755213
Change-Id: Ifd836e64f8ff807930f7cd2319b103b65e8fce70
 2014-04-24 11:25:47 -07:00
Keisuke Kuroyanagi 3b7984752c Support creating BinaryDictionary without creating dict file. 
Bug: 14166482
Change-Id: Ic8c78ec2c8f39358a1f085a041b608972a380eef
 2014-04-22 13:18:34 -07:00
Keisuke Kuroyanagi ce76821dce Revert "Support creating BinaryDictionary without creating dict file." 
This reverts commit 89939b8708.

Change-Id: I8ca1b55609ad305a93178063bd88bd1cede872af
 2014-04-22 19:34:44 +00:00
Keisuke Kuroyanagi 89939b8708 Support creating BinaryDictionary without creating dict file. 
Bug: 14166482
Change-Id: Ib065279f96e227ab0fee7c8141560c4ada744d3b
 2014-04-22 12:01:33 -07:00
Jean Chalard 2282e8520a Fix updating the shift state upon backspace 
Bug: 13514349
Change-Id: If4c9db12b0ab5be676f7a2f72715f469066ee537
 2014-04-14 21:28:24 +09:00
Jean Chalard 4370ff0998 Fix some flaky tests. 
In tests, we create many instances of LatinIME, but we never
destroy them. That means we never close the dictionaries nor
the handlers.
This change calls onDestroy, which closes all dictionaries, and
adds some code to finish the handlers.

Change-Id: I942517a2a940c54256b08763f6b38f5b55809f55
 2014-04-10 17:32:05 +09:00
Jean Chalard 5f430e0189 [CB25] Refactor some array copying 
Bug: 13406701
Change-Id: I09edd822f5cc2446b324d41c76d835bcff1191e6
 2014-04-09 18:38:29 +09:00
Jean Chalard 90608190ec Add shift mode tests 
Change-Id: I067e91a1f899c1f83fd60adeae66495606812a95
 2014-04-08 22:24:25 +09:00
Jean Chalard 28a59dd049 Fix a bug with double-space-to-period 
Bug: 13778001
Change-Id: I3ebd57950cdfacbbcdc64ed214c0590519a0665c
 2014-04-03 22:07:57 +09:00
Tadashi G. Takaoka 9364d46ac3 Add SpacebarLanguageUtils class 
The SpacebarLanguageUtils class is separated from SubtypeLocaleUtils
and handles the language name on the spacebar.

Bug: 8084704
Change-Id: I82f79a061d4f0cc2895263298c3ebf8ee444c61d
 2014-04-01 12:17:06 +09:00
Keisuke Kuroyanagi 781e3df73b Merge "Dictionary migration in Java side." 2014-03-28 08:07:26 +00:00
Jean Chalard 35645ac39a Merge "[CB14.5] Stop copying WordComposers." 2014-03-28 06:51:17 +00:00
Jean Chalard 8e829c37df [CB14.5] Stop copying WordComposers. 
This is an overdue refactoring that I have been wanted to
do forever, and that we can at last do now that suggestions
come only from instances of BinaryDictionary instances.

With this, all unit tests and regression tests are
passing again.

Bug: 13667648
Bug: 13665487
Bug: 8636060
Change-Id: Ie23a19f9b7e692edf2ee0b107ddaff2d7db564b6
 2014-03-28 15:26:27 +09:00
Tadashi G. Takaoka 2202d47386 Stop displaying locale string on short space bar 
Bug: 12070355
Change-Id: I2d6fa20431bc56d5139caeac33e396b73906d075
 2014-03-28 13:05:13 +09:00
Keisuke Kuroyanagi a785fa8edd Dictionary migration in Java side. 
Bug: 13406708

Change-Id: If83938e4b4810d2e8353c70cdd8ef3ea97a29571
 2014-03-27 17:46:35 +09:00
Keisuke Kuroyanagi 6008898b99 Merge "Move code only used for dicttool and tests under tests." 2014-03-27 06:37:10 +00:00
Keisuke Kuroyanagi 93cda5bb39 Move code only used for dicttool and tests under tests. 
Bug: 13035567
Change-Id: I13c6df013ef2b67c9bf67455d9c32d283bf9ea2e
 2014-03-27 15:30:32 +09:00
Jean Chalard 1079665c3c [CB14] Implement backspace in the combiner chain 
Bug: 13622107
Bug: 13406701
Change-Id: I0023b398c4451253f9f717e2bd990b8a054004bc
 2014-03-25 17:57:03 +09:00
Jean Chalard 72b67f6541 Rework the logic that tells if the cursor touches words 
Bug: 13312942
Change-Id: I6be6a558bbc6c88508150f9c25cadbd0240ff88e
 2014-03-20 23:16:53 +09:00
Keisuke Kuroyanagi 599e61d70c Merge "Change default decaying parameters." 2014-03-14 06:16:02 +00:00
Keisuke Kuroyanagi 98705b6bf5 Fix unit tests. 
Change-Id: I2a85763358e1eef0f76ef827413afffeb4cb8058
 2014-03-14 12:27:23 +09:00
Keisuke Kuroyanagi 73a2426d45 Change default decaying parameters. 
Bug: 13458617
Change-Id: I4942af4a48881fb6ca866c74140b262e6d323f4a
 2014-03-14 12:23:24 +09:00
Keisuke Kuroyanagi 61467744e7 Unit test update for I7ed95a54344d8b. 
Change-Id: Ic8af56b8741ee7c231d73ce6a660fd32c9f5a3b3
 2014-03-12 15:41:20 +09:00
Keisuke Kuroyanagi 3ad4af2354 Move DictionaryOptions from FusionDictionary to FormatSpec. 
Bug: 8187060
Bug:13035567

Change-Id: Id4f45e589521ae98c926a4c0607be10ce1a983f2
 2014-03-06 18:53:09 +09:00
Keisuke Kuroyanagi 516f86815d Separate WeightedString from FusionDictionary. 
Bug: 8187060

Change-Id: I40c1dafca3eb52244c64fdb4c1db30a56385d678
 2014-03-06 18:53:06 +09:00
Keisuke Kuroyanagi e784148ae6 Separate utility methods from BinaryDictionary. 
Bug: 8187060
Change-Id: Ice2984e332b7bd3bb17174aefc80b5635b72fc50
 2014-03-05 18:19:34 +09:00
Keisuke Kuroyanagi d302b98ce6 Added a method and run GC for testing. 
Bug: 13231889
Change-Id: If64b7422967c3e4107c845072b64a7bb26a35f7e
 2014-02-28 18:17:09 +09:00
Jean Chalard 890b44e537 Correctly read the header of APK-embedded dicts 
Bug: 13164518
Change-Id: I8768ad887af8b89ad9f29637f606c3c68629c7ca
 2014-02-24 22:54:01 +09:00
Tadashi G. Takaoka 8e2951f299 Merge "Fix punctuation test for tablet" 2014-02-21 11:54:28 +00:00
Tadashi G. Takaoka d28a58c25d Fix punctuation test for tablet 
It seems that some test devices are tablet and some are phone. The
unit test should aware of which device the test is running.

Change-Id: I8651a540993de29aa1cd9f40919dffe7a8df9512
 2014-02-21 17:50:07 +09:00
Keisuke Kuroyanagi 239256b156 Merge "Add an auto-correction by user history test." 2014-02-21 07:59:05 +00:00
Keisuke Kuroyanagi 4cc582f3ba Add an auto-correction by user history test. 
Bug: 11122480
Change-Id: I830bb3399f9839a80c6d86fbf582299bce424871
 2014-02-21 13:12:26 +09:00
Keisuke Kuroyanagi e03e4257f1 Merge "Add test only methods to test personalized dicts." 2014-02-20 13:25:59 +00:00
Keisuke Kuroyanagi d36328cecf Add test only methods to test personalized dicts. 
Bug: 11122480
Change-Id: I79a4a73ff09a2d34d4ca094d705e901fb4bc855c
 2014-02-20 22:20:43 +09:00
Keisuke Kuroyanagi 21f9482999 Fix: UserHistoryDictionaryTests.testDecaying(). 
Bug: 13106697
Change-Id: If81f77c3cefdefae94cb9145aa9f700494f8237a
 2014-02-20 21:23:57 +09:00
Keisuke Kuroyanagi 0bc66daae3 Add user history dictionary decaying test. 
Bug: 10667710

Change-Id: Ib2be57d8c4cbbb34f64555d84ea6fd571cfdd247
 2014-02-20 18:36:46 +09:00
Jean Chalard fbb8cb5a82 Fix build 
This is a forgotten rebase

Change-Id: I7c7c381775488ed9239dc284bd9c31247a86a972
 2014-02-18 20:08:53 +09:00
Jean Chalard 28e0b24965 Merge "Fix a bug where the cache would be out of sync" 2014-02-18 10:58:50 +00:00
Jean Chalard fe92c174ea Fix a bug where the cache would be out of sync 
During recorrection, the cursor position when calling
commitText is not necessarily at the end of the
composing text.
Besides, RichInputConnection assumes the cursor is
always after any composing text. This is not correct,
but in the practice, it seems all code paths work.
We should fix this in the future.

Bug: 13060691
Change-Id: I15f71fff62d36e80cf6e4a022c5e78af634b199d
 2014-02-18 19:55:54 +09:00
Jean Chalard 63be066544 Cleanup. 
Less code, less chance of stuff escaping, and a bit of a clarification.
Yay.

Change-Id: I3193fd8ad7ac28195260cbc231c4e498a63a460c
 2014-02-18 17:07:46 +09:00
Yohei Yukawa 6d43124215 Stop using deprecated InputMethodSubtype constructor 
The constructors of InputMethodSubtype were deprecated in API level 19.
However we cannot yet switch to a new InputMethodSubtypeBuilder style
due to our minimum support API level.

As an intermediate solution, this patch replaces the these API calls
with InputMethodSubtypeCompatUtils.newInputMethodSubtype so that
these legacy API call can be consolidated at the same place.

BUG: 13030512
Change-Id: I561a585f5dbea56c337680b645be5ef07015a0b1
 2014-02-17 15:32:33 +09:00
Keisuke Kuroyanagi 95d16561e0 Remove unused code. 
Bug: 12810574
Change-Id: I9c7fff60ae0e94d52f3bd19c3e88de5a53b917d7
 2014-02-15 17:39:24 +09:00
Keisuke Kuroyanagi 0fc93fe445 Implement PatriciaTriePolicy::getNextWordAndNextToken(). 
Bug: 12810574
Change-Id: Id1d44f90de9455d9cbe7b6e0a161cae91d6d422c
 2014-02-15 17:39:20 +09:00
Keisuke Kuroyanagi 85fe06e759 Merge "Remove unused argument from readDictionaryBinary." 2014-02-14 10:37:56 +00:00
Keisuke Kuroyanagi 8e3a1d0f89 Remove unused argument from readDictionaryBinary. 
Bug: 12810574
Change-Id: Ice415ebd8d11162facca3fe8927ef8a616b11424
 2014-02-14 19:02:15 +09:00
Keisuke Kuroyanagi 8fa7a09f1e Merge "Implement PatriciaTriePolicy::getWordProperty()." 2014-02-14 09:08:09 +00:00
Tadashi G. Takaoka e4b0add353 Fix SpacingAndPunctuationsTests due to I2219224840 
Bug: 12640318
Change-Id: If0b0696b937c580d69cb909ddaf414d01ea2c01b
 2014-02-14 17:59:53 +09:00
Keisuke Kuroyanagi c63d183473 Implement PatriciaTriePolicy::getWordProperty(). 
Bug: 12810574
Change-Id: I7bcccfd3641ebbcf2b8d857d33bb4734c42af5eb
 2014-02-14 17:56:45 +09:00
Tadashi G. Takaoka a273319c59 Add PunctuationSuggestions class 
This change must be checked in together with I366c477516.

Bug: 12640318
Change-Id: I8d3864b9d9649c9e3306e82b01a6327b11281b1f
 2014-02-14 14:13:39 +09:00
Tadashi G. Takaoka bd0591ce62 Merge "Make InputLogicTest more robust" 2014-02-13 10:44:44 +00:00
Tadashi G. Takaoka da973e75dc Make InputLogicTest more robust 
Change-Id: I134f14971126cbeed05b472c08747f2b88ad30e6
 2014-02-13 19:38:51 +09:00
Jean Chalard 5dc0d405b4 Merge "Clean-up follow-up to I3ecc8496" 2014-02-13 10:26:48 +00:00
Jean Chalard 2d68f4b392 Clean-up follow-up to I3ecc8496 
Change-Id: I8db952a4152dab027e4f34bc5270bfca508d154d
 2014-02-13 19:18:29 +09:00
Tadashi G. Takaoka 36b8962a9a Merge "Fix UserHistoryDictionaryTests" 2014-02-13 07:49:51 +00:00
Tadashi G. Takaoka 0cda0e8a9c Fix UserHistoryDictionaryTests 
Change-Id: I5f2f555f9c3f471545921ef80e4cf528976be837
 2014-02-13 16:16:44 +09:00
Jean Chalard e0a425681c Merge "Fix a test." 2014-02-13 05:20:58 +00:00
Jean Chalard cf03ff02b1 Fix a test. 
This fixes two separate problems:
- The word finds itself with two separate suggestion spans.
This is fine for LatinIME, but it's hard to predict whether it's
fine for other interested parties (other keyboards).
- The test for the blue underline was incorrect.

Change-Id: I3ecc849676851bf25a25238d694adaa956521a26
 2014-02-13 14:01:37 +09:00
Jean Chalard bac89ecc50 Fix a failing test. 
A replay of that old, horribly hard-to-find bug: we post a
resume message during onStartInputView, so we need
to process it before we start the test. But now the message
is posted with a delay, so we need to wait for the delay...

Change-Id: I843d70e636fa51a68aadbdbbaa73b1711ad7bddd
 2014-02-12 23:32:51 +09:00
Keisuke Kuroyanagi 2ef87aee3e Merge "Make PtNode have ProbabilityInfo instead of raw value." 2014-02-10 06:10:51 +00:00
Keisuke Kuroyanagi 8ffc631826 Make PtNode have ProbabilityInfo instead of raw value. 
Bug: 11281877
Bug: 12810574
Change-Id: Id1cda0afc74c4e30633c735729143491b2274a7b
 2014-02-10 15:05:08 +09:00
Tadashi G. Takaoka bd9887a574 Fix possible NPE while finding device override value from resource 
Bug: 12949735
Change-Id: Iffda08db413b3b3d338ab9bf625bb0968c2e48dd
 2014-02-10 14:38:53 +09:00
Keisuke Kuroyanagi ab6a93773b Use native logic to read Ver4 dict. 
Bug: 11281877
Bug: 12810574
Change-Id: Ief371d3ef61818e4e031de4659aee3c9584c7379
 2014-02-06 21:55:37 +09:00
Jean Chalard a9e1930a6a Merge "Conditionally store the raw suggestions." 2014-02-06 07:31:22 +00:00
Jean Chalard a49f61f8a7 Conditionally store the raw suggestions. 
Bug: 12913520
Change-Id: Ie15f97d90c142c51089280252b35b5ad1d226e19
 2014-02-06 16:14:41 +09:00
Keisuke Kuroyanagi 337dce8074 Merge "Consolidate WordProperty and Word." 2014-02-06 07:02:07 +00:00
Keisuke Kuroyanagi 5f5feeba13 Consolidate WordProperty and Word. 
Bug: 11281877
Bug: 12810574
Change-Id: I9dc99188f80f25a8780c1860dab46e4aa80a23e5
 2014-02-06 15:13:33 +09:00
Jean Chalard 58eed6360d Merge "Stop considering personalization dicts outputs as words" 2014-02-05 13:33:12 +00:00
Jean Chalard 5095fabdd0 Stop considering personalization dicts outputs as words 
Bug: 12800726
Bug: 12798403
Change-Id: I6d60f9ad39761757f8a64533f40d6441f3a36410
 2014-02-05 21:57:37 +09:00
Keisuke Kuroyanagi 239f7daf4a Merge "Make WeightedString have ProbabilityInfo." 2014-02-05 12:53:14 +00:00
Keisuke Kuroyanagi df1d3e733e Make WeightedString have ProbabilityInfo. 
Bug: 11281877
Bug: 12810574
Change-Id: I265e3d8654c75766cd0e0d09d67ef62b4566298a
 2014-02-05 21:44:55 +09:00
Jean Chalard 43cf9076b2 [HD04] Make the locale mandatory. 
Bug: 11281748
Change-Id: I69281b0053bec404c3e3c713ade3f65a140f51b1
 2014-02-05 17:35:25 +09:00
Keisuke Kuroyanagi b986f78ba8 Separate header class from FormatSpec. 
Bug: 12810574
Change-Id: Iacf1cd05a268bf690ab864b5e32a18a4b0ccc693
 2014-02-04 21:36:04 +09:00
Keisuke Kuroyanagi d79fd29f61 Make dumpAllWordsForDebug() use getNextWordProperty(). 
Bug: 11736680
Bug: 12810574
Change-Id: I32a388e23ee7da5d7291e88a46c90b61d2f25dee
 2014-02-04 13:51:49 +09:00
Keisuke Kuroyanagi 941734695b Implement Ver4PatriciaTriePolicy::getNextWordAndNextToken. 
Bug: 12810574
Change-Id: Idea44f03c477964f58e65fbf2b55e3fcd77a2934
 2014-02-04 12:42:14 +09:00
Keisuke Kuroyanagi 9221772ab7 Get bigram information via getWordProperty(). 
Bug: 12810574
Change-Id: I2750a5659ccbc3e31307c28e35dd9a1dbdffbeee
 2014-02-03 11:47:26 +09:00
Keisuke Kuroyanagi 94d9a2309f Extend jni interface to get bigrams in WordProperty. 
Bug: 12810574
Change-Id: Ia4b88d02ea8790a5c47d32376cc0b84c3e071ddd
 2014-01-31 20:32:44 +09:00
Keisuke Kuroyanagi 35ff07c70b Merge "Fix BinaryDictDecoderEncoderTests." 2014-01-31 10:58:26 +00:00
Keisuke Kuroyanagi 5cb7509314 Fix BinaryDictDecoderEncoderTests. 
Bug: 12809791
Change-Id: I04313df78692b01e153a34c932a37f079a924105
 2014-01-31 19:44:17 +09:00
Jean Chalard 79b2e4d86c [HD03] Straighten out attribute key names in Java. 
Bug: 11281748
Change-Id: I1d813bdacd45bcfd9c4cc73ac1d67c5c89854e86
 2014-01-31 14:46:07 +09:00
Keisuke Kuroyanagi 080a35e959 Rename UnigramProperty to WordProperty. 
Bug: 12810574
Change-Id: If5ddd803948aaf6e491ddcbaa5436fb3af3f7257
 2014-01-31 11:06:42 +09:00
Keisuke Kuroyanagi 26bd46095a Reading dictionary containing timestamps in Java Side. 
Just skipping historical information fields.

Bug: 11281877
Change-Id: I43d2adaa576b7da11ed3ca54990265dbb6f53b08
 2014-01-29 20:19:24 +09:00
Tadashi G. Takaoka c2e2b3949b Merge "Add SubtypeLocaleUtils.isRtlLanguage method" 2014-01-28 01:28:47 +00:00
Tadashi G. Takaoka c0c74d22a0 Add SubtypeLocaleUtils.isRtlLanguage method 
Change-Id: I2e399ae9ca111638b583c5681de08b0e6db86e3a
 2014-01-27 19:05:16 +09:00
Jean Chalard 6d1c8b2c3f Merge "Try to figure out whether d.quotes open or close." 2014-01-27 10:01:17 +00:00
Tadashi G. Takaoka 73472efac1 Fix SubtypeLocaleUtilsTests 
Change-Id: Ifbdfd320b1416d210592ec14099e4dd9d9d0047d
 2014-01-27 18:23:54 +09:00
Jean Chalard c7ef305bbc Try to figure out whether d.quotes open or close. 
Bug: 8911672
Change-Id: I5d5635949530a67f95e5208986907251b7bce903
 2014-01-27 18:17:33 +09:00
Keisuke Kuroyanagi 963d97af6d Merge "Add length check for dict update operations." 2014-01-25 00:47:27 +00:00
Keisuke Kuroyanagi 51c5ec10f9 Add length check for dict update operations. 
Bug: 12602903
Change-Id: I6835dee8bf8b356f0f1cf6c0531bee5b3415a13f
 2014-01-24 16:32:42 -08:00
Ken Wakasa 0acd121083 Fix wrong indents. 
Removed an unused method too.

Change-Id: Id364009fd4e94ec65862fc3651a181e862909a42
 2014-01-24 23:55:33 +09:00
Jean Chalard 90adbc7fdf Fix build 
Missing change after a thousandth comment fix

Change-Id: Iec48f892978507fb9823236cd1c5a70209b58b0e
 2014-01-24 12:16:22 +09:00
Jean Chalard 1d6e647ac3 [IL69.1] Move a static method to a utility class. 
This is a followup to IL69.

Change-Id: Iba154517aa7f75b9f16aa1b808c0da8d84be837f
 2014-01-24 11:59:23 +09:00
Jean Chalard 1284e556f4 [IL70] Remove unused arguments 
Bug: 8636060
Change-Id: Iec56bce362ebfc52fedab02b127978abb4f3c7f9
 2014-01-23 15:33:14 +09:00
Jean Chalard d1f463eacf [IL69] Oust Keyboard from WordComposer#setComposingWord 
Bug: 8636060
Change-Id: I624a45500603dfad355ee3b8b794b2d895219c0b
 2014-01-23 15:32:59 +09:00
Tadashi G. Takaoka c93cf1c398 Use sorted int[] to represent word separators 
Change-Id: I4103541d99fe59bfcf12379a1298a0a690497846
 2014-01-20 19:40:02 +09:00
Tadashi G. Takaoka 837cdd738b Add SpacingAndPunctuationsTests 
Change-Id: I78d488ad84a11af809ee1f8d3d2fa01a89fbfa28
 2014-01-20 18:33:45 +09:00
Jean Chalard 2334bf6d8c Merge "Fix a bug specific to German capitalization." 2014-01-17 01:49:14 +00:00
Jean Chalard 60afa7000f Fix a bug specific to German capitalization. 
Bug: 9663105
Change-Id: Ib68ee4edb135e96dfca229c1ccce308e7e638bdd
 2014-01-17 02:06:24 +09:00
Keisuke Kuroyanagi d78a447d10 Add a dedicated method to control time in native code. 
Bug: 12443085
Change-Id: I41a5cf6c895cb59e54af98b40efded36afcd3247
 2014-01-15 14:55:57 -08:00
Tadashi G. Takaoka 7b9b095090 Move LanguageModelParams class to utility package 
This change must be checked in together with Ic82d951237.

Change-Id: I2ab451330f85a0147563b805682f26edecb71a29
 2014-01-15 16:14:53 +09:00
Keisuke Kuroyanagi 68069c55c4 Fix flaky unit test. 
Change-Id: I8df0f9a0398b29f679844f256ad84f09ebcea8ee
 2014-01-14 18:51:29 -08:00
Jean Chalard 7b6e999cd1 Fix a test. 
Bug: 12483313
Change-Id: Ia811d614b9260367871bc5717f587538adf46789
 2014-01-10 21:39:43 +09:00
Jean Chalard 84a3047e80 Fix build. 
Change-Id: I6d0b572190080e58e95f72856ad39e72a49537b7
 2014-01-10 12:18:26 +09:00
Tadashi G. Takaoka ee35e69eae Passing SpacingAndPunctuations to StringUtils.looksValidForDictionaryInsertion 
This change must be checked in together with Iec437d6df0.

Change-Id: Idf745b8870965f3bdf690de7ff3b22f83f6204bf
 2014-01-09 19:05:09 +09:00
Tadashi G. Takaoka 494e2d6c17 Passing SpacingAndPunctuations to RichInputConnection.getNthPreviousWords 
Change-Id: I174c50f509ed6998b755e1a712e7f6c0f82f4425
 2014-01-09 18:33:25 +09:00
Tadashi G. Takaoka d7660c6f56 Merge "Passing SpacingAndPunctuations to CapsModeUtils.getCapsMode" 2014-01-09 09:31:32 +00:00
Tadashi G. Takaoka 0a75cf51af Passing SpacingAndPunctuations to CapsModeUtils.getCapsMode 
Change-Id: I0b06e8cc75a403f7061864c5b7f3f6a2cacd60eb
 2014-01-09 18:19:17 +09:00
Keisuke Kuroyanagi e4ae5855cb Fix a unit test in InputLogicTests. 
Change-Id: I63a20bb2e4b3c39495fade6cae3a14fdd11ca48c
 2014-01-09 16:23:43 +09:00
Keisuke Kuroyanagi 5742a415f3 Merge "Make reloadMainDict() private." 2014-01-08 11:03:02 +00:00
Keisuke Kuroyanagi 9f1fe87580 Make reloadMainDict() private. 
Bug: 8187060
Change-Id: I852a751d748f39512e62c9cd69748dfbe87b2151
 2014-01-08 18:59:43 +09:00
Tadashi G. Takaoka ad78058a93 Rename InputPointers.addPointer and ResizableIntArray.add 
Change-Id: I5580250c91b29f93ed886b080ce33845b3b67ace
 2014-01-08 14:30:21 +09:00
Tadashi G. Takaoka e13cc9d7e5 Fix ResizableIntArrayTests readability 
Change-Id: I68862b98f228210f1d76fef4fd7454edbfd8e01d
 2014-01-08 14:30:21 +09:00
Tadashi G. Takaoka e7dc5302af Fix InputPointersTests 
InputPointers.getTime(int) has a validity check of time values. And
the check is enabled when LatinImeLogger.sDBG is on. Such situation
may occur while unit testing. This change ensure that time values are
monotonic while unit testing.

Change-Id: I9ff2cff2bcd253de0e8206dd3be964fe565170fa
 2014-01-08 14:14:42 +09:00
Jean Chalard 1e50c681af [IL52] Remove a useless method. 
This old method doesn't even re-read the old suggestions. It used to
recompute them without the coordinates.
Re-using the recorrection code, which is much more advanced, is
the right thing to do here.

Also, refining the test. It's no use trying to resume suggestion
if we don't have a suggestion strip, since we aren't going to
auto-correct anything anyway.

Not the motivation for this change, but this also fixes
Bug: 11620256
Change-Id: Id49efa32e293c49837c61fdc752c86bbac1d2c88
 2013-12-27 22:40:19 +09:00
Jean Chalard 6bca9ac43d Fix a bug where predictions would not pop upon manual pick 
Bug: 12295276
Change-Id: Id359c92acde44758b12929e7bac719d5c9c7577b
 2013-12-26 23:19:29 +09:00
Keisuke Kuroyanagi d77ad1902b Fix NPE in a unit test. 
Change-Id: I0dfc23232ed77e1ff1aedecfa6ac022020cb1c19
 2013-12-26 17:01:48 +09:00
Keisuke Kuroyanagi 4a55ee1440 Fix typo in a unit test. 
Change-Id: I9222533704722265511b9fe6fb5caf99765e198b
 2013-12-25 13:13:43 +09:00
Jean Chalard 1404c1af85 [IL21] Move the workaround utils to a better place. 
Bug: 8636060
Change-Id: I566f9e109ebcabe3a6a778118434ce79d02d1113
 2013-12-20 16:48:54 +09:00
Jean Chalard dfbe2bfe08 Add some info to test crashes to help diagnose flakiness 
Bug: 11142685
Change-Id: Ic3a5d452f6c325248ac4e1bfa37774c58586f359
 2013-12-18 18:10:56 +09:00
Keisuke Kuroyanagi c2fd53ee0e Remove ver4 dict updater. 
Change-Id: I468994c98d091be621b9fb3fbe6405c67fc6a465
 2013-12-17 18:17:51 +09:00
Keisuke Kuroyanagi 42334bb493 Quit checking bigram order in BinaryDictDecoderEncoderTests. 
Change-Id: I1b8eb6ab2ea797d2590495b1f57f9ec9560ea817
 2013-12-17 17:38:24 +09:00
Keisuke Kuroyanagi b54c747d7c Merge "Move DictUpdater to the tests directory." 2013-12-17 05:33:16 +00:00
Keisuke Kuroyanagi 4fdcefe504 Move DictUpdater to the tests directory. 
Bug: 11245133
Change-Id: I0907a091ac3ae960eaf3b27da78dbb48a24b2ea1
 2013-12-17 14:31:25 +09:00
Jean Chalard 7cd7cf73f4 Fix a bug with languages without spaces and predictions 
This is simpler and more correct.

Change-Id: I41806d2fc12b4ca25f76e32972b38f91f3d05c2b
 2013-12-16 23:16:02 +09:00
Jean Chalard b868375763 Fix failing tests 
- Version 3 is not supported
- Now passing the right string to open v4 dicts. Fix the tests for this.

Change-Id: I7829330c3568a715b96396ba4e4e69c6e17775ab
 2013-12-16 14:32:19 +09:00
Jean Chalard f08b1ea41a Merge "Remove references to the v3 dictionary." 2013-12-13 10:08:12 +00:00
Jean Chalard 1dc7eca114 Remove references to the v3 dictionary. 
Change-Id: I811c8c923ad67a6d9bfdd11bdef8991eb7135c27
 2013-12-13 18:53:41 +09:00
Keisuke Kuroyanagi 3e81d9c39f Merge "Remove code for forgetting curve in Java side." 2013-12-13 09:44:16 +00:00
Keisuke Kuroyanagi cc8c544ee2 Remove code for forgetting curve in Java side. 
Change-Id: I294ed179c642ff52452b5884326c1083477e1bce
 2013-12-13 18:40:58 +09:00
Jean Chalard a245d15da5 Have dicttool use the native library to generate v4 dicts. 
Yay !

Change-Id: Iea8ced9e81031b9ab7eff05ad9ef7215be248de9
 2013-12-13 18:18:20 +09:00
Jean Chalard 7b55cd3e2b Remove flags from Java side. 
This simplifies the code quite a bit.
- GERMAN_UMLAUTS are now handled through a key-value attribute.
  The dictionary generator does not need to know about it any more.
- FRENCH_LIGATURES are deprecated as we handle them with shortcuts now.
- CONTAINS_BIGRAMS is deprecated. Bigram processing is always applied
  regardless of this flag.

Bug: 11281748
Change-Id: If567e52e245a9342adc7f3104a0f7d8d782df8c1
 2013-12-13 18:15:05 +09:00
Ken Wakasa 2fa3693c26 Reset to 9bd6dac470 
The bulk merge from -bayo to klp-dev should not have been merged to master.

Change-Id: I527a03a76f5247e4939a672f27c314dc11cbb854
 2013-12-13 17:13:32 +09:00
Jean Chalard 5b5ed3d609 Fix a bug where autocaps would jam auto-commit 
Bug: 11311002
Change-Id: I62955e364c9ffc75322cf05fa3ad7985f1d09259
 2013-10-22 05:23:48 -07:00
Ken Wakasa eacb2be8fe Fix unit test for If8c94ef91ed58bb5028f51be7c8d9beb677436a4 
Change-Id: I056013de3a5e09feed429dfd8097d3d85331a0ab
 2013-10-11 16:52:12 +09:00
Yuichiro Hanada 9514ed5c2a Add the new format of bigram entries. 
In new format, each bigram entry has flags (1 byte), a terminal id (3 byte),
a time-stamp (4 byte), a counter (1 byte) and a level (1 byte).

Bug: 10920255
Bug: 10920165
Change-Id: I0f7fc125a6178e6d25a07e8462afc41a7f57e3e1
 2013-10-11 14:50:41 +09:00
Ken Wakasa 56402cf10a Revert "Add Swiss French and German keyboard layouts." 
This reverts commit 220ce8f269.

Sorry, but we are now in the week before the final cut for the next launch. We shouldn't be taking new features like this at this point. Let me revert this change for now. I'll re-revert this after the cut next week.

Change-Id: Ia8b00680c992ec526e6a858945f2380cbcdfdd55
 2013-10-10 02:05:50 +00:00
Fredrik Roubert 220ce8f269 Add Swiss French and German keyboard layouts. 
There used to be two "Swiss" keyboard layouts, labelled fr_CH and de_QY,
available in LatinIME. They were, however, not actually Swiss layouts
but instead work-arounds to be able to get French or German with qwertz
or qwerty (instead of azerty and qwertz) layouts, respectively. These
were thus removed by commit f6972561fc
replacing them with the generic fr-qwertz and de-qwerty layouts instead.

Here, now, is a proper Swiss keyboard layout, following Swiss standards
for people accustomed to typing on Swiss keyboards, with the expected
tailorings for French and German.

Change-Id: I9feed752053ecc694c84db713284f69bc1daf155
 2013-10-09 17:42:17 +02:00
Jean Chalard 36c56caee3 Merge "Make the sentence separator a resource." 2013-10-08 06:44:20 +00:00
Jean Chalard 10581e68af Make the sentence separator a resource. 
This will help handing correctly the armenian full stop.

Bug: 10082781
Change-Id: Id7bb219ebd89daba203216eab362d1cc26a65a36
 2013-10-08 15:28:43 +09:00
Keisuke Kuroyanagi 61aae2b450 Merge "Add Ime language switching test." 2013-10-08 05:35:25 +00:00
Keisuke Kuroyanagi 72bc9ad37e Add Ime language switching test. 
Change-Id: I6a96dc5fdd533899353d537382608c2759faff1c
 2013-10-08 14:00:57 +09:00
Keisuke Kuroyanagi a81d37eef6 Merge "Add a large test adding bigrams for decaying dictionary." 2013-10-08 03:52:09 +00:00
Keisuke Kuroyanagi a2821fde60 Add a large test adding bigrams for decaying dictionary. 
Bug: 10197478
Change-Id: I34d3c21bd7f70885a3031ce91a4d4c4ba3564856
 2013-10-08 12:43:58 +09:00
Jean Chalard a6047aae94 Merge "Set the shortcut frequency correctly." 2013-10-07 10:00:34 +00:00
Jean Chalard f3204eebb1 Set the shortcut frequency correctly. 
14 is the right value.

Bug: 11076722
Change-Id: I95d404b540f7fbe4932d1f8498cde23f1df0314f
 2013-10-07 18:55:42 +09:00
Keisuke Kuroyanagi cfb018ba6d Fix bug and Add large test for decaying dictionary. 
- GC gets failure when the dictionary become empty.
- Useless unigrams are sometimes not removed.

Bug: 10197478
Change-Id: I8d1479c01efba61a81f03bc077da6bcb4797a940
 2013-10-07 17:31:01 +09:00
Jean Chalard 5db7eabafb Merge "Accept double-space-period after emoji." 2013-10-04 13:05:43 +00:00
Jean Chalard 8142fd83a6 Accept double-space-period after emoji. 
This also includes a fix that allows this code to read surrogate
pairs in this processing.

Bug: 11070482
Change-Id: If5ef8d6863938252f09128b7e99ea07ece6e7019
 2013-10-04 22:01:36 +09:00
Ken Wakasa 676bb517ed Merge "Add Ver4DictUpdater." 2013-10-04 09:48:27 +00:00
Ken Wakasa 618158e675 Merge "Refactor BinaryDictIOUtilsTests." 2013-10-04 09:47:35 +00:00
Yuichiro Hanada e4e0add9fb Add Ver4DictUpdater. 
Change-Id: I986ab26faf535fc4bc98443053f534eced9d048f
 2013-10-04 17:33:29 +09:00
Keisuke Kuroyanagi 966af8b5ba Merge "Make BinaryDictionaryTests use current time as a seed." 2013-10-04 08:04:05 +00:00
Keisuke Kuroyanagi bcb196e3b5 Make BinaryDictionaryTests use current time as a seed. 
Bug: 10197478
Change-Id: Ib79cd3a81b01b16259df29b36e1df6b8f0affca8
 2013-10-04 16:48:22 +09:00
Keisuke Kuroyanagi 3e5f4b53b0 Merge "Check the elapsed time for decaying." 2013-10-04 07:16:17 +00:00
Keisuke Kuroyanagi 67c855ea6f Check the elapsed time for decaying. 
Bug: 6669677
Change-Id: I0401a4c0908c702ce65abfa5e017dd16cb1296f9
 2013-10-04 16:11:11 +09:00
Yuichiro Hanada 75d60e821c Refactor BinaryDictIOUtilsTests. 
Change-Id: I2208378b33038771b460abb33f9a690872e998e2
 2013-10-04 14:19:13 +09:00
Keisuke Kuroyanagi 864ee881bd Merge "Fix UserHistoryDictionaryTests." 2013-10-03 12:02:34 +00:00
Keisuke Kuroyanagi 11f7cae094 Fix UserHistoryDictionaryTests. 
Bug: 6669677
Bug: 10667710

Change-Id: I6cdc6a6c9cacc7f276fda3a26ec31e3eb928471c
 2013-10-03 20:55:34 +09:00
Yuichiro Hanada d6e307a4b7 Add DictUpdater. 
Change-Id: Ic586e46e5a9f59de53d53e59886d635345940974
 2013-10-03 20:16:34 +09:00
Ken Wakasa 596a565ae7 Merge "Remove some unused variables." 2013-10-02 09:38:00 +00:00
Keisuke Kuroyanagi 21ce9c4a89 Merge "Stochastic decay." 2013-10-02 09:37:56 +00:00
Yuichiro Hanada 3aa8977cb2 Remove some unused variables. 
Change-Id: Iaf1556fec194d17cb4318f2bdcc837f8d79449ef
 2013-10-02 18:26:03 +09:00
Keisuke Kuroyanagi c76bbceedc Stochastic decay. 
Bug: 6669677
Change-Id: Ib2d9228b951c77dab7a8675ce9db60677e87e771
 2013-10-02 17:51:12 +09:00
Yuichiro Hanada 4284e9aae7 Make SparseTable have multiple content tables. 
Bug: 10920165
Change-Id: Ie9008452ee292fb0b1fec66e2ffed228c4af6c3e
 2013-10-02 15:36:13 +09:00
Jean Chalard fa946d4a0f Fix a test and crash with a better error message when reading 
When there are too many bigrams, we stop reading the file,
so the file pointer is in an inconsistent place. This means we
have no idea what's going to happen next. It's better to crash
right away.

Change-Id: Id3b7b78cbe4fda3493b3c9c46758763e1ab5f6a3
 2013-10-02 11:48:47 +09:00
Keisuke Kuroyanagi 6995310996 Separate "GC" and "GC with decay". 
Bug: 6669677
Change-Id: I9d6aba76cef2616f0549e612db9701e1d6a19467
 2013-10-01 18:09:31 +09:00
Keisuke Kuroyanagi fd02b2d6ee Implement simple dictionary decay. 
Groundwork and implement simple decay.
Increment probability when typed and decrement probability
at GC.

Bug: 6669677

Change-Id: Ib12caead0cbeef4ce7808fe8ac0b00ee331523fe
 2013-09-30 20:53:35 +09:00
Keisuke Kuroyanagi b698e9c1fa Fix build. 
Change-Id: If7c76ca5f7030ba2003228ed1877bdb948b4b99d
 2013-09-30 14:21:48 +09:00
Keisuke Kuroyanagi 1cf4789ba6 Merge "Set header attributes for ExpandableBinaryDictionary." 2013-09-29 05:14:22 +00:00
Keisuke Kuroyanagi 5ed30a7660 Set header attributes for ExpandableBinaryDictionary. 
Bug: 6669677

Change-Id: I2462777eaa07600f1c774226adfc4f351882f523
 2013-09-28 12:50:09 +09:00
Keisuke Kuroyanagi 8b580819a5 Merge "Add unigram/bigram counting." 2013-09-27 14:14:49 +00:00
Keisuke Kuroyanagi 31097a57cc Add unigram/bigram counting. 
Bug: 6669677
Change-Id: I05ea2201d822dddf062b08c8467daa336760e16c
 2013-09-27 23:12:12 +09:00
Yuichiro Hanada a328f538c3 Fix PrioritizedSerialExecutor. 
It was possible that fetchNextTasks() would be called by multiple
threads concurrently.
If it happens, some tasks in the task queues might be ignored.

Change-Id: Idc81c43c45e382da3850cc55b9a42c281548d2a8
 2013-09-27 16:46:34 +09:00
Keisuke Kuroyanagi e3e10317b0 Merge "Create empty dictionary file in native code." 2013-09-26 08:03:38 +00:00
Yuichiro Hanada d188af7022 Add SparseTable. 
Bug: 10920165
Change-Id: I749dd0269e788799e30b10beb2671813d40ce15f
 2013-09-26 16:16:30 +09:00
Keisuke Kuroyanagi 5ef6209656 Create empty dictionary file in native code. 
Bug: 6669677
Change-Id: I46d23deee1fd091678f4593561cb8687eb815212
 2013-09-26 12:59:02 +09:00
Ken Wakasa f56b82f809 Fix the offdevice regression test build 
Followup to If4e44eca3cdc5bb02cf2e0c8c44ecd4bf27fae57

bug: 10622489
Change-Id: If98b2c75725f8692f0c2b41c33e448086404479b
 2013-09-25 19:13:47 +09:00
Keisuke Kuroyanagi 2e58670da9 Quit using ExpandableDictionary. 
Bug: 6669677
Change-Id: Ie90417fa9b726454fe729a665fcd549efabb9e94
 2013-09-24 22:57:15 +09:00
Keisuke Kuroyanagi 3e6b68bc0e Merge "Allow large memory space for GC." 2013-09-24 10:24:28 +00:00
Keisuke Kuroyanagi 3d2802ef2e Allow large memory space for GC. 
Bug: 6669677
Change-Id: I021c92a1ca5cd28f745cbfe729c99e346c58074d
 2013-09-24 19:21:17 +09:00
Jean Chalard 3d68b06662 Copy only the spans we are interested in. 
The PARAGRAPH type of span is dangerous, as concatenating
CharSequences that contain it may crash. We also don't use
other spans than SuggestionSpans, so we don't copy them.

Bug: 10622489
Change-Id: If4e44eca3cdc5bb02cf2e0c8c44ecd4bf27fae57
 2013-09-24 19:04:51 +09:00
Keisuke Kuroyanagi f3cd38f2c7 GC step 5. Add large tests and fix bugs. 
Bug: 6669677
Change-Id: I41e44a64730f9c66645995095a7ecff51ffd5351
 2013-09-24 16:32:25 +09:00
Keisuke Kuroyanagi dd7d95bd4a Merge "GC step 4. Update all positions in new dict and add a test." 2013-09-24 06:45:25 +00:00
Keisuke Kuroyanagi 2cfe7f9e3b GC step 4. Update all positions in new dict and add a test. 
Bug: 6669677
Change-Id: I035d848a210653dcd3c1a1f21781968adced9225
 2013-09-24 15:29:56 +09:00
Yuichiro Hanada 1625aeafd2 Fix runReadUnigramsAndBigramsTests. 
Change-Id: Idd9176c9943dfacac5a06957f1a07187b642b207
 2013-09-24 12:31:45 +09:00
Yuichiro Hanada 14087ba52c Add Ver4DictDecoder. 
Bug: 9618601
Change-Id: I43c5840505c6a847aaf4893a400392ccd45903c0
 2013-09-19 16:11:23 +09:00
Keisuke Kuroyanagi 561a83118c Merge "Add dictionary header writing methods." 2013-09-18 09:17:54 +00:00
Keisuke Kuroyanagi 484fa7b59c Add dictionary header writing methods. 
Bug: 6669677
Change-Id: I392ac4776b55779903cbaa17e683005d80017a41
 2013-09-18 18:08:33 +09:00
Satoshi Kataoka 8837deab73 Merge "Fix Emoji recents" 2013-09-18 08:46:25 +00:00
Satoshi Kataoka ea7bfa5cd5 Fix Emoji recents 
Bug: 10538430

Change-Id: Ia2e423eb1843195b3c3218afc79a5820b8cd729b
 2013-09-18 17:44:16 +09:00
Keisuke Kuroyanagi 72e53a1e38 Merge "Implement dictionary flush." 2013-09-18 05:20:05 +00:00
Keisuke Kuroyanagi 1560543754 Implement dictionary flush. 
Bug: 6669677
Change-Id: I1d70ac6319fb6d8700074de382568c2108887960
 2013-09-18 13:19:14 +09:00
Keisuke Kuroyanagi 9465819cf6 Merge "Add BinaryDictionary.getBigramProbabilityNative()." 2013-09-18 04:10:38 +00:00
Keisuke Kuroyanagi 4d02a2d44d Add BinaryDictionary.getBigramProbabilityNative(). 
Bug: 10197478
Change-Id: Id16e3ee22a17679c46cc7a0199a9e28065177aa3
 2013-09-18 11:18:28 +09:00
Jean Chalard e8f717943f Improve trailing quotes processing 
Bug: 10445496
Change-Id: Ib7bd05aea59ae6c9b8ce31299ef2235521b0e350
 2013-09-17 22:17:22 +09:00
Keisuke Kuroyanagi d9f450ef00 Implement removeBigramWords() for DynamicPatriciaTrie. 
Bug: 6669677
Change-Id: I99cb517511b4c968b8bf937baab5d7f42b0f534e
 2013-09-17 18:05:32 +09:00
Jean Chalard 7e51989b3f Merge "[AC7] Actually auto-commit." 2013-09-17 08:20:47 +00:00
Keisuke Kuroyanagi e8754aba1c [AC7] Actually auto-commit. 
Bug: 9059617
Change-Id: I7e5d89a9037b9181a0a6456c12043b4bfda8fe4b
 2013-09-17 16:44:50 +09:00
Keisuke Kuroyanagi 71cce2dd3e Add a large test for BinaryDictionary.addBigramWords(). 
Bug; 10197478

Change-Id: I52590dd1ff9469557672a4bef4f898ad94b47b6f
 2013-09-17 15:32:37 +09:00
Keisuke Kuroyanagi 78b55a31cb Fix handling multi-bytes characters and add a test. 
Bug: 6669677

Change-Id: Id2154db47adea2929559a4187a726f9dfa83363e
 2013-09-17 15:11:24 +09:00
Keisuke Kuroyanagi cd6a0430c7 Implement addBigramWords() for DynamicPatriciaTrie. 
Bug: 6669677
Change-Id: Ia6aa76c212165690191c65fee9dacdc44be5acd5
 2013-09-17 12:52:21 +09:00
Jean Chalard 41aaff6cdf Merge "[AC4] Add native methods necessary for auto-commit" 2013-09-13 11:41:55 +00:00
Jean Chalard 24aad5a4d5 [AC4] Add native methods necessary for auto-commit 
Bug: 9059617
Change-Id: I7a47b0675446fc4f39628c60d16de9aea90d1b4d
 2013-09-13 20:15:15 +09:00
Ken Wakasa fbc7e61a3e Merge "Add Ver4DictEncoder." 2013-09-13 08:51:58 +00:00
Yuichiro Hanada a099a3e341 Add shutdown and isTerminated to PrioritizedSerialExecutor. 
Change-Id: Id185224d135c8571a39efe8a41a66ce769142903
 2013-09-13 17:46:50 +09:00
Yuichiro Hanada a141d8ef7d Add Ver4DictEncoder. 
Bug: 9618601
Change-Id: I161d2845906f07c1251deb8005fdffe49c5b7940
 2013-09-13 17:33:51 +09:00
Yuichiro Hanada 0e40cd0c40 Add getDictDecoder. 
Bug: 9618601
Change-Id: I173100ac704c03f7d5d0d53477e83cab5d1110d4
 2013-09-12 20:14:09 +09:00
Yuichiro Hanada 95bc256f41 Add a flag to readDictioanryBinary in DictDecoder. 
Change-Id: I356adb72047ebc43c924fbff1ff45e7460508a31
 2013-09-11 18:20:56 +09:00
Keisuke Kuroyanagi 5b51355b9e Add tests for BinaryDictionary.addUnigramWord(). 
Bug: 10197478
Change-Id: Ie46f360b8c75183b49d42d00fefed4a8531f64a9
 2013-09-10 22:46:10 +09:00
Keisuke Kuroyanagi b8e857f799 Merge "Add binary dictionary tests." 2013-09-10 11:35:58 +00:00
Keisuke Kuroyanagi 4be103df0e Add binary dictionary tests. 
Bug: 10197478

Change-Id: I13cf9b67d1b61b8e89fe90b431c2d6e066ca8e7a
 2013-09-10 19:16:33 +09:00
Yuichiro Hanada e193c5255d Revert Ida230ca42 and I6adf7d08f. 
Change-Id: I2ddb250d5a473ea955a5171656974de7288a13f7
 2013-09-10 19:08:43 +09:00
Yuichiro Hanada ef073f4024 Use PrioritizedSerialExecutor instead of ReentrantReadWriteLock. 
Change-Id: I003b769e408ebd692085a7e17fed6d9396876202
 2013-09-10 19:05:41 +09:00
Yuichiro Hanada acdabb25f4 Add AsyncResultHolder. 
Change-Id: Icfa685bcda2f5c74f5649f09098d00b4bd321c5a
 2013-09-10 15:48:06 +09:00
Satoshi Kataoka be96361156 Merge "Check contents in user history dictionary tests" 2013-09-09 06:46:45 +00:00
Satoshi Kataoka e5a35711b8 Check contents in user history dictionary tests 
Bug: 10667710

Change-Id: I45ebb08cb4ef9a9f6d2da31e2c50e740f88209c2
 2013-09-09 15:28:50 +09:00
Yuichiro Hanada cc2751ba03 Make commitCurrentAutoCorrection asynchronous. 
Change-Id: Ida230ca4243347fb3ab9fda7de3a9a18f886cd1c
 2013-09-09 14:47:26 +09:00
Keisuke Kuroyanagi 6e04d65932 Make DynamicPred...Base extend ExpandableBinaryDictionary. 
Bug: 6669677
Change-Id: I06afad35d3eb73510c34d10cd4116f5bcf934f7c
 2013-08-26 18:50:22 +09:00
Yuichiro Hanada 2232a70806 Clean up unused imports. 
Change-Id: I7147ca237b99399e79210852aa5bf5a01101d779
 2013-08-26 08:29:16 +00:00
Yuichiro Hanada 752a33640c [Refactor] Add DictDecoder.readUnigramsAndBigramsBinary. 
Change-Id: I259db91d837c67cbcb3b6dc504b21dca23a6a5be
 2013-08-26 17:24:38 +09:00
Yuichiro Hanada bb5b84a826 [Refactor] Add DictDecoder.getTerminalPosition. 
Change-Id: I9d04f64a58f5481cbb64cf1c09b5c485dd4176b4
 2013-08-26 16:14:59 +09:00
Yuichiro Hanada 576f625ee1 Rename CharGroup to PtNode. 
Bug: 10233675
Change-Id: I7b0eb07d195cd386cd0d9e97cd59bf48fcf24107
 2013-08-26 15:58:30 +09:00