nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
33693 commits 1 branch 0 tags 363 MiB
Commit graph

250 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
82fa755bac Fix unit tests by adding @UsedForTesting 
Change-Id: I9448b1bfa7bf94039de737725851e63a2921a443
 2014-05-09 14:44:44 +09:00
Keisuke Kuroyanagi
1471fbad66 Extend jni interface for dictionary migration. 
Bug: 13406708

Change-Id: Iadad6df296467d0e5b631fba4a409d53c8a5a6f2
 2014-05-08 12:31:04 +09:00
Keisuke Kuroyanagi
3b7984752c Support creating BinaryDictionary without creating dict file. 
Bug: 14166482
Change-Id: Ic8c78ec2c8f39358a1f085a041b608972a380eef
 2014-04-22 13:18:34 -07:00
Keisuke Kuroyanagi
ce76821dce Revert "Support creating BinaryDictionary without creating dict file." 
This reverts commit 89939b8708.

Change-Id: I8ca1b55609ad305a93178063bd88bd1cede872af
 2014-04-22 19:34:44 +00:00
Keisuke Kuroyanagi
89939b8708 Support creating BinaryDictionary without creating dict file. 
Bug: 14166482
Change-Id: Ib065279f96e227ab0fee7c8141560c4ada744d3b
 2014-04-22 12:01:33 -07:00
Keisuke Kuroyanagi
68b4f2ada9 Merge "Add jni interface to use on memory dictionary." 2014-04-22 17:07:16 +00:00
Keisuke Kuroyanagi
61cb852d33 Add jni interface to use on memory dictionary. 
Bug; 14166482

Change-Id: I33ab08dad1e39aa7617d391f7eb2561d6f2504bb
 2014-04-21 19:59:09 -07:00
Keisuke Kuroyanagi
3acbf7d00c Merge "Add BinaryDictionary.flushWithGCIfHasUpdated()." 2014-04-22 00:10:42 +00:00
Keisuke Kuroyanagi
c6704dbe51 Add BinaryDictionary.flushWithGCIfHasUpdated(). 
Bug: 14166482
Bug: 14161647
Change-Id: I98b0a8b86897b1486491a3aea91729bc9e4cc03c
 2014-04-21 15:21:55 -07:00
Xiaojun Bi
11b7076168 Fix a bug for counting code points in WordComposer.java 
This bug threw an ArrayIndexOutOfBoundsException when the word length
is 49 (maxSize + 1) when calling StringUtils.copyCodePointsAndReturnCodePointCount(...)
in the same function. This bug is discovered by running SKETCH.

The intent is to count the code points from index 0 to index i (included).
The original code only counted the code points from index 0 to index (i-1).

Bug: 13969542
Change-Id: Idbf596aba2379ba552dbe580c83c42044d505aaf
 2014-04-18 14:56:35 -07:00
Jean Chalard
5f430e0189 [CB25] Refactor some array copying 
Bug: 13406701
Change-Id: I09edd822f5cc2446b324d41c76d835bcff1191e6
 2014-04-09 18:38:29 +09:00
Jean Chalard
45e34b4374 [CB24] Remove a useless test 
If 1 character, then for sure !isGesture

Bug: 13406701
Change-Id: If8e9b080372eb8ddb15b8f97cce1399dc0c7f099
 2014-04-08 21:36:52 +09:00
Keisuke Kuroyanagi
fdd2db576d Always close binary dicts for personalized dicts. 
Bug: 10923130
Bug: 13664080
Change-Id: Ib247c775194a03462387994cd832b1650bfd1915
 2014-04-03 18:08:23 +09:00
Keisuke Kuroyanagi
1de95ceada Extend jni interface to input/output languageWeight. 
Bug: 8187060
Change-Id: Ic55d328b87f258f4d65fff207233789a53b2b0ff
 2014-04-03 01:01:51 +09:00
Keisuke Kuroyanagi
18f21f96e0 Add languageWeight as an argument of getSuggestions. 
Bug: 8187060
Change-Id: I8ae20c957a8e127b76c83cc3a65ff052d43bf2b5
 2014-04-03 00:47:28 +09:00
Keisuke Kuroyanagi
781e3df73b Merge "Dictionary migration in Java side." 2014-03-28 08:07:26 +00:00
Jean Chalard
8e829c37df [CB14.5] Stop copying WordComposers. 
This is an overdue refactoring that I have been wanted to
do forever, and that we can at last do now that suggestions
come only from instances of BinaryDictionary instances.

With this, all unit tests and regression tests are
passing again.

Bug: 13667648
Bug: 13665487
Bug: 8636060
Change-Id: Ie23a19f9b7e692edf2ee0b107ddaff2d7db564b6
 2014-03-28 15:26:27 +09:00
Jean Chalard
75715f7d9f Revert "[CB15] Remove a redundant variable." 
This reverts commit 0de7a6d1a2.

Change-Id: I327679b76a14cf9c3aec4b00b013b921408c32f9
 2014-03-27 09:43:45 +00:00
Keisuke Kuroyanagi
a785fa8edd Dictionary migration in Java side. 
Bug: 13406708

Change-Id: If83938e4b4810d2e8353c70cdd8ef3ea97a29571
 2014-03-27 17:46:35 +09:00
Jean Chalard
0de7a6d1a2 [CB15] Remove a redundant variable. 
This is a tiny bit slower, but probably unnoticeable.
Still, it gains some performance in other places,
saves memory, and more importantly makes for simpler
code, so it's certainly better.

Change-Id: Id1ab4f73f71acd73f5920bc729817abd22cf0d07
 2014-03-27 16:47:27 +09:00
Keisuke Kuroyanagi
5a0381f7d0 Remove unused partial commit. 
Change-Id: Ia9341a5cb24947d93056810890d94c1f66481d8c
 2014-03-20 18:47:45 +09:00
Keisuke Kuroyanagi
32326a9d7a Merge "Move DictionaryOptions from FusionDictionary to FormatSpec." 2014-03-07 10:42:18 +00:00
Keisuke Kuroyanagi
e137ec0a91 Introduce SuggestionResults and use it for predictions. 
Bug: 8187060
Bug: 13333066
Change-Id: I1ead897024508b7e40fbd93af7d14bfe74b93826
 2014-03-07 19:36:19 +09:00
Keisuke Kuroyanagi
3ad4af2354 Move DictionaryOptions from FusionDictionary to FormatSpec. 
Bug: 8187060
Bug:13035567

Change-Id: Id4f45e589521ae98c926a4c0607be10ce1a983f2
 2014-03-06 18:53:09 +09:00
Keisuke Kuroyanagi
de36b47d29 Use BinaryDictionaryUtils to read dictionary header. 
Bug: 8187060
Bug:13035567
Change-Id: I90a5e0665c367f5a1bd786f4babf0d03e79e68fa
 2014-03-05 19:42:53 +09:00
Keisuke Kuroyanagi
e784148ae6 Separate utility methods from BinaryDictionary. 
Bug: 8187060
Change-Id: Ice2984e332b7bd3bb17174aefc80b5635b72fc50
 2014-03-05 18:19:34 +09:00
Keisuke Kuroyanagi
58a536e41a Merge "Use dynamic operations to construct all ver4 dicts." 2014-02-28 09:37:23 +00:00
Keisuke Kuroyanagi
d302b98ce6 Added a method and run GC for testing. 
Bug: 13231889
Change-Id: If64b7422967c3e4107c845072b64a7bb26a35f7e
 2014-02-28 18:17:09 +09:00
Keisuke Kuroyanagi
ea89cb40b7 Use dynamic operations to construct all ver4 dicts. 
Bug: 8187060
Bug: 13127350
Change-Id: I081ee904c41898128efa8ba7a1bf3fa0a46c6231
 2014-02-27 23:21:09 +09:00
Keisuke Kuroyanagi
d934fb43ad Remove corrupted ver4 dictionaries. 
Bug: 12916055
Change-Id: I2c390ab1dc483915691b47a605772cbc2dfeaf09
 2014-02-21 15:09:37 +09:00
Keisuke Kuroyanagi
fc9ca59cc1 Implement getHeaderInfoNative. 
Bug: 11281877
Bug: 12810574
Change-Id: Ia3d85ae2cfdb486e74b8636a62431eae883c85da
 2014-02-06 18:19:42 +09:00
Keisuke Kuroyanagi
337dce8074 Merge "Consolidate WordProperty and Word." 2014-02-06 07:02:07 +00:00
Keisuke Kuroyanagi
5f5feeba13 Consolidate WordProperty and Word. 
Bug: 11281877
Bug: 12810574
Change-Id: I9dc99188f80f25a8780c1860dab46e4aa80a23e5
 2014-02-06 15:13:33 +09:00
Jean Chalard
43cf9076b2 [HD04] Make the locale mandatory. 
Bug: 11281748
Change-Id: I69281b0053bec404c3e3c713ade3f65a140f51b1
 2014-02-05 17:35:25 +09:00
Keisuke Kuroyanagi
927aff72bc Add jni interface to get header information from native. 
Bug: 12810574
Change-Id: I2508483bcb3157f04cc1fe13f24f864d301f1f28
 2014-02-04 21:42:09 +09:00
Keisuke Kuroyanagi
53fb86c447 Add a utility method to StringUtils. 
Bug: 12810574
Change-Id: I607803e924b9e99855df7690e67488b2861c120e
 2014-02-04 21:42:06 +09:00
Keisuke Kuroyanagi
941734695b Implement Ver4PatriciaTriePolicy::getNextWordAndNextToken. 
Bug: 12810574
Change-Id: Idea44f03c477964f58e65fbf2b55e3fcd77a2934
 2014-02-04 12:42:14 +09:00
Keisuke Kuroyanagi
38f341a2a5 Add a jni method to iterate words in a dictionary. 
Bug: 12810574
Change-Id: I87b13559765f0262dfd06c2ba40d43af6437ea7f
 2014-02-03 14:51:58 +09:00
Keisuke Kuroyanagi
94d9a2309f Extend jni interface to get bigrams in WordProperty. 
Bug: 12810574
Change-Id: Ia4b88d02ea8790a5c47d32376cc0b84c3e071ddd
 2014-01-31 20:32:44 +09:00
Keisuke Kuroyanagi
080a35e959 Rename UnigramProperty to WordProperty. 
Bug: 12810574
Change-Id: If5ddd803948aaf6e491ddcbaa5436fb3af3f7257
 2014-01-31 11:06:42 +09:00
Keisuke Kuroyanagi
d78a447d10 Add a dedicated method to control time in native code. 
Bug: 12443085
Change-Id: I41a5cf6c895cb59e54af98b40efded36afcd3247
 2014-01-15 14:55:57 -08:00
Tadashi G. Takaoka
7b9b095090 Move LanguageModelParams class to utility package 
This change must be checked in together with Ic82d951237.

Change-Id: I2ab451330f85a0147563b805682f26edecb71a29
 2014-01-15 16:14:53 +09:00
Keisuke Kuroyanagi
05113c1847 Check whether the word is OOV or not for amanatto update. 
Bug: 11736529
Change-Id: I27973212da7e922b2185dbb4febfb5bb4dfbdcbb
 2014-01-08 21:02:35 +09:00
Jean Chalard
a245d15da5 Have dicttool use the native library to generate v4 dicts. 
Yay !

Change-Id: Iea8ced9e81031b9ab7eff05ad9ef7215be248de9
 2013-12-13 18:18:20 +09:00
Ken Wakasa
2fa3693c26 Reset to 9bd6dac470 
The bulk merge from -bayo to klp-dev should not have been merged to master.

Change-Id: I527a03a76f5247e4939a672f27c314dc11cbb854
 2013-12-13 17:13:32 +09:00
Keisuke Kuroyanagi
cfb018ba6d Fix bug and Add large test for decaying dictionary. 
- GC gets failure when the dictionary become empty.
- Useless unigrams are sometimes not removed.

Bug: 10197478
Change-Id: I8d1479c01efba61a81f03bc077da6bcb4797a940
 2013-10-07 17:31:01 +09:00
Jean Chalard
459cd6f8ef Implement the heuristic for auto-commit. 
Bug: 9059617
Change-Id: I066abf018df5aaeabf415425dd822ebe233e6008
 2013-10-01 21:00:40 +09:00
Keisuke Kuroyanagi
126d758c1e Merge "Quit blocking getSuggestion during GC." 2013-10-01 07:08:11 +00:00
Jean Chalard
bb57090f1d Create the wiring for auto-commit confidence computation. 
Bug: 9059617
Change-Id: I7e4e05ffa8c68cfebbe362a977fd176555cad12a
 2013-10-01 15:04:15 +09:00
Keisuke Kuroyanagi
03cb8f751a Quit blocking getSuggestion during GC. 
Bug: 10831272

Change-Id: I995c619dc18a9120a47f547d31045cb73a9353ec
 2013-10-01 12:04:06 +09:00
Keisuke Kuroyanagi
c18510049a Prepare dictionary decay. 
Bug: 6669677
Change-Id: I8fbae190dd44a6bdbee7e9b6d3a16208322727f7
 2013-09-30 13:57:54 +09:00
Keisuke Kuroyanagi
31097a57cc Add unigram/bigram counting. 
Bug: 6669677
Change-Id: I05ea2201d822dddf062b08c8467daa336760e16c
 2013-09-27 23:12:12 +09:00
Keisuke Kuroyanagi
5ef6209656 Create empty dictionary file in native code. 
Bug: 6669677
Change-Id: I46d23deee1fd091678f4593561cb8687eb815212
 2013-09-26 12:59:02 +09:00
Keisuke Kuroyanagi
6142068a33 Clear traverse sessions when closing. 
Bug: 6669677
Change-Id: I859be934f0c60485e04cdc4cab288a18242fa04e
 2013-09-25 18:32:40 +09:00
Keisuke Kuroyanagi
2e58670da9 Quit using ExpandableDictionary. 
Bug: 6669677
Change-Id: Ie90417fa9b726454fe729a665fcd549efabb9e94
 2013-09-24 22:57:15 +09:00
Keisuke Kuroyanagi
9465819cf6 Merge "Add BinaryDictionary.getBigramProbabilityNative()." 2013-09-18 04:10:38 +00:00
Keisuke Kuroyanagi
4d02a2d44d Add BinaryDictionary.getBigramProbabilityNative(). 
Bug: 10197478
Change-Id: Id16e3ee22a17679c46cc7a0199a9e28065177aa3
 2013-09-18 11:18:28 +09:00
Jean Chalard
060917ed9a [AC9] Resize an array 
It's not easy for native code to only output the first
result, so let's supply enough room for it to output all.

Bug: 9059617
Change-Id: Ie93b7e54284c8c5d01fdc15846cf52d3442287b6
 2013-09-17 19:05:30 +09:00
Keisuke Kuroyanagi
d0246277fd Prepare dictionary saving in native code. 
Bug: 6669677

Change-Id: I0787f66409e2b183c6328fa05805945520e1e93a
 2013-09-17 18:07:16 +09:00
Keisuke Kuroyanagi
e8754aba1c [AC7] Actually auto-commit. 
Bug: 9059617
Change-Id: I7e5d89a9037b9181a0a6456c12043b4bfda8fe4b
 2013-09-17 16:44:50 +09:00
Jean Chalard
41aaff6cdf Merge "[AC4] Add native methods necessary for auto-commit" 2013-09-13 11:41:55 +00:00
Jean Chalard
24aad5a4d5 [AC4] Add native methods necessary for auto-commit 
Bug: 9059617
Change-Id: I7a47b0675446fc4f39628c60d16de9aea90d1b4d
 2013-09-13 20:15:15 +09:00
Keisuke Kuroyanagi
4c2767857a Change cache capacity depending on the dictionary size. 
Bug: 10699291

Change-Id: I7042d4c1307da2d991d4dd10d637f18026acb996
 2013-09-12 18:47:56 +09:00
Keisuke Kuroyanagi
fe87f5f417 Pass additionalFeaturesOptions for getSuggestions(). 
This fixes null pointer exceptions that are caused when
getSuggestion() is called from spell checker.

Change-Id: Ifc9e7abb900e1a4646e33c91022effde439673e4
 2013-08-28 19:24:28 +09:00
Jean Chalard
e8ef095670 [AC2] Reference a dict rather than a string in suggestion infos 
Bug: 9059617
Change-Id: Ic17bc0fd5d812268fd37d7fd35b4e9ebfb95fa5e
 2013-08-20 19:18:09 +09:00
Jean Chalard
ef1e363016 [AC1] Add a memory of where to cut the first word. 
Bug: 9059617
Change-Id: I931b6d1eb49f9f7dd7d5b18956e35751d1b2b631
 2013-08-20 18:43:19 +09:00
Satoshi Kataoka
ffcbbaf127 Refactor on UserHistoryDictionary 
Bug: 9429906
Change-Id: I576a91643bdaf5017cc826ac2e07a74a9a275d60
 2013-07-26 13:00:19 +09:00
Ken Wakasa
a7d2fc6bef Move settings related classes to "settings" 
Change-Id: Id170dbfe2dcfc93130b7be4a84615940403ec37f
 2013-07-22 16:35:44 +09:00
Keisuke Kuroynagi
f8d2796724 Add methods for dynamic updating binary dictionary. 
Bug: 6669677
Change-Id: I7e681ceec2af712214a647630350cb20be6b0354
 2013-07-04 21:17:49 +09:00
Keisuke Kuroynagi
5bf1be7162 Add jni methods for dynamically handling a dictionary. 
Bug: 6669677
Change-Id: I8a26623adbb41a78e3c023c652be635c635e3b47
 2013-06-26 12:51:33 +09:00
Keisuke Kuroynagi
981717da4c Add a parameter isUpdatable to the constructor of BinaryDictionary. 
Bug: 6669677
Change-Id: I6bc25131afd97112e3bbde036a81ab559a9a6460
 2013-06-25 17:39:06 +09:00
Keisuke Kuroynagi
f3b62900c7 Allow mmapping dictionary file in writable mode in openNative. 
Bug: 6669677
Change-Id: I447668932de118b158fa029ddc977b3f3cc06cb8
 2013-06-25 16:03:33 +09:00
Ken Wakasa
e28eba5074 Move util classes to the latin/utils directory 
Change-Id: I1c5b27c8edf231680edb8d96f63b9d04cfc6a6fa
 2013-06-24 17:04:40 +09:00
Keisuke Kuroyanagi
1b100610b3 Adding additional feature settings. 
Change-Id: I9fec0c03b7da9ce0305b494193f4cfe3fca144f3
 2013-05-28 00:27:48 -07:00
Keisuke Kuroyanagi
50db5f0fff Passing options to native suggestion method. 
Change-Id: I6da180cfa1b9e5aa39600e78e3bc41209a40f583
Signed-off-by: Keisuke Kuroyanagi <ksk@google.com>
 2013-05-24 10:21:04 -07:00
Jean Chalard
2dbb5957e3 Pass blockOffensiveWords as a parameter 
Bug: 8773353
Change-Id: Ic1019742ce7ff6e4f7fff4d2729f8ab52d841488
 2013-05-01 20:47:35 +09:00
Jean Chalard
bb61293675 [ZF2] Read settings for profanity filtering. 
Bug: 7226877
Change-Id: Ie0c713e1eba1529c0b288a1e5011023a79bedd6b
 2013-04-25 20:29:14 +09:00
Jean Chalard
99e998286d [ZF1] Check profanity in Java rather than in native 
Bug: 7226877
Change-Id: Ib6c32bfee9977c27dbf7e1e590b2b00d9ceb7301
 2013-04-25 20:29:11 +09:00
Jean Chalard
f0e579a171 Don't kill suggestions with native score < 1 
Change-Id: I954856b7fec0b91e19a467f2a87978d49caa639d
 2013-04-22 14:21:43 +09:00
Jean Chalard
1061bfdb34 Break dependencies to allow offdevice tests to build 
Change-Id: Ia9a2e8f0672b3f72943f26fb15de1d3c7c5ce7f1
 2013-03-19 16:45:25 +09:00
Jean Chalard
0cc0544a29 Merge the dictionary pack in Latin IME. 
Bug: 8161354
Change-Id: I17c23f56dd3bc2f27726556bf2c5a9d5520bd172
 2013-03-19 15:40:14 +09:00
Satoshi Kataoka
e0e6737373 Refactor parameters by naming convention 
Change-Id: I8bda8075b33f656ecbec08320afcd864b620fe77
 2013-03-18 15:42:15 +09:00
Jean Chalard
da0d771fe9 Tiny cleanup 
Change-Id: I5d7150a4abb3a498e790f41af569093217cb8b43
 2013-02-22 19:42:45 -08:00
Ken Wakasa
6c22439bf8 Remove MAX_PROXIMITY_CHARS_SIZE_INTERNAL 
Change-Id: I18a997503de4033b5341b564145bca862a872098
 2013-01-22 13:18:49 +09:00
Tadashi G. Takaoka
8aa9963a89 Fix Apache license comment 
Change-Id: Ic56167f952a7f4449da366e1e81610e72c966086
 2013-01-21 22:23:37 +09:00
Ken Wakasa
5db594abba Remove MAX_WORD_LENGTH_INTERNAL 
Change-Id: Ie11ff000675601acff5fbb00e9e9f48eb32c5071
 2013-01-15 12:39:08 +09:00
Ken Wakasa
f6870cc82d Remove BinaryDictionary.MAX_PREDICTION and MAX_SPACES, and rename MAX_WORDS to MAX_RESULTS 
Change-Id: Iab2a422b367e7521f346481c7fe5e2575f2e9de3
 2013-01-11 20:47:42 +09:00
Ken Wakasa
96b22200be Privatize a few constants in BinaryDictionary.java 
Change-Id: I7defaf1f577fd67e678cac83ff935e8181dd0a48
 2012-12-17 17:46:57 +09:00
Ken Wakasa
fe9ec6bc7d Remove unused variables 
Change-Id: Ia5079368a1bc86ccdf0052445dc6945041c0abca
 2012-11-16 19:28:56 +09:00
Ken Wakasa
1e61493c50 Use 32-bit code points for suggestions output 
This is a multi-project commit with Ic43dd666

bug: 6526418
Change-Id: I39c1acb4e91d04cd8a4ec5a943c8cf575da75ebc
 2012-11-01 00:09:51 +09:00
Tadashi G. Takaoka
7f77aed507 Merge "Replace useless CharSequence to String" 2012-10-22 14:27:35 -07:00
Tadashi G. Takaoka
15f6d4ae34 Add @UsedForTesting and @ExternallyReferenced annotations 
Bug: 7268357
Change-Id: I0b7e0c19f04af9ae30874d0a4c26ad81bc80be8c
 2012-10-22 11:18:43 -07:00
Tadashi G. Takaoka
bc464e2952 Replace useless CharSequence to String 
Change-Id: Idc478f901185ee1b4912acc82d0cbc54fee4e991
 2012-10-22 11:03:28 -07:00
Ken Wakasa
b02ee3d67a Make use of the NELEMS and KEYCODE_SPACE macro. Also, remove an unused parameter. 
Change-Id: I3c7e6c59990c92b0d5e2fb80493e8673cdd37b09
 2012-10-09 11:17:50 +09:00
Satoshi Kataoka
66d955ad71 Throw illegal argument exception in BinaryDictionary::editDistance 
Bug: 7276803
Change-Id: Icd9bdec0a04179a29d00336819d205627f77b71a
 2012-10-03 17:15:47 +09:00
Tadashi G. Takaoka
a28a05e971 Cleanup: Make some classes as final 
Change-Id: I6009b3c1950ba32b7f1e205a3db2307fe0cd688e
 2012-09-27 19:03:30 +09:00
Tadashi G. Takaoka
02a67200fc Fix gesture start detection algorithm 
Bug: 7032858
Change-Id: I9f4d939fa87fdead4c5a5921338a16cd0a59b7ac
 2012-09-21 17:30:00 +09:00
Yuichiro Hanada
eae7b293e4 Check the length of the word when add to FusionDictionary. 
Change-Id: Id98d18e90a8b83b597507728b467f56888c8fd12
 2012-09-10 12:35:53 +09:00
Tadashi G. Takaoka
ecfbf4625c Add static construct method for SparseArray 
Change-Id: I6da97f6ea23578318f403bb5d64c30b1663c69ee
 2012-08-22 14:22:20 +09:00
Tadashi G. Takaoka
5f282ea9e4 Add CollectionUtils class to create generic collection easily 
Change-Id: I6b4de9187e122298e5e9cd8ddc9070d062df6a89
 2012-08-22 10:21:38 +09:00