6a1b37353d
Fix dicttool build
...
This CL partially reverts
- Id88b02b74bdfe4ca05b08181ceb6b34d5652fc0c
- I05c7d8429e8d9a26139456763c77997340fea8c2
And followup (remove shortcut support)
- I73b7dc008a5acaf75a31a36a2d332b5afabd82d0
Bug: 28255684
Test: make -j10 dicttool_aosp
Change-Id: I2e01ed86b9517a1141aee35ea6d8ef39258981d1
2018-10-29 15:59:05 +09:00
d4ee11f9a4
"spellcheking" needs spellchecking.
...
Change-Id: Iaf4cd5d11b113be4738182fb662e5dc54b2f5366
2015-03-27 14:48:20 -07:00
c15bbb52a3
Retire Delight2 migration code to speed up tests.
...
We're waiting 10 minutes for tests to run, and half of that time is spent in
depreacted code related to migration of Delight2 dictionary files.
LatinIME will never migrate another Delight2 dictionary file again, so we can
delete this code.
Change-Id: I05c7d8429e8d9a26139456763c77997340fea8c2
2015-03-20 11:16:46 -07:00
77fd5dbf3e
Remove dead code, including tests.
...
Change-Id: Id88b02b74bdfe4ca05b08181ceb6b34d5652fc0c
2015-03-10 17:22:41 -07:00
12d80ebead
Remove shortcut support from LatinIME.
...
Note this change does not affect the native decoder interface.
Change-Id: I73b7dc008a5acaf75a31a36a2d332b5afabd82d0
2015-02-11 13:02:41 -08:00
0f7d881dc7
Move decoder specific constants to DecoderSpecificConstants.java
...
Change-Id: Ie4d325b3152e1e7e424b8b436e222e194e4d9da0
2015-02-05 13:27:36 -08:00
1da382b81e
Remove unused import
...
Change-Id: I9e2a79534673b2c6587f57fad663b85d971658b9
2014-11-12 16:27:14 -08:00
5b91b551e5
Move util classes under common
...
Also why did we have two copies of LocaleUtils >.>
Bug: 18108776
Change-Id: I03b4403dfd51934e66b567f2f8b87da419cfb3ab
2014-11-07 18:00:03 +09:00
e1652d7570
Fix the build : move offdevice tests in an off device file
...
Also fix a failing test
Change-Id: I280aa6b5836c7332da08a88f1258546edeb25a37
2014-11-06 22:33:57 +09:00
5b33d197ba
Add a header command to dicttool.
...
This will allow to greatly improve the performance of the
metadata-generating files, as they won't have to wait for
the info command to read the entire dictionary when the
header is all we need.
Also add tests, and while we're at it, use the seed as
intended to enable reproducible tests.
Change-Id: I0ba79ef62f0292b23e63aed57ff565bb102281a2
2014-11-06 18:50:59 +09:00
f6b0e32df3
Add a *FAST* dictionary header reader.
...
It's still unused as of this change but the next change will use it
As a reference point, generating the metadata for Bayo takes
3'02" on my machine with the info command; it's down to 16" if
made to use this instead. The gains increases with the number
of dictionaries obviously.
Change-Id: I0eeea2d8f81bb74b0d1570af658e91b56f7c2b79
2014-11-06 13:17:08 +09:00
88480f39f6
Update unit tests for new static dict version.
...
Bug: 11031090
Change-Id: Ifd7b241f1a0a30678ca7de97cc6e96927a9b5c8f
2014-10-31 14:50:18 +09:00
7c87859d4c
Using "blacklist" flag as "possibly offensive"
...
Bug: 11031090
Change-Id: I5cc0d006ab003656498eb82b0875eb9c051d331e
2014-10-31 14:33:05 +09:00
9342484e8d
Move Constants.java to the latin.common package
...
Our intention is to have classes of latinime-common under the common
package as much as we can.
Change-Id: I76efbbbe7bebf1a4aa943715cdff64f91675e20d
2014-10-23 20:27:37 +09:00
d3a4c51324
Fix Javadoc and null analysis related warnings
...
This CL also adds @SuppressWarning("unused" to java-overridable package.
Bug: 18003991
Change-Id: If70527e30654384705d7a814f5efd181d9f539e1
2014-10-23 09:58:42 +09:00
54a1b8ec54
Add latinime-common local lib
...
This is just a placeholder in this CL. It will be shared by LatinIME,
dicttool, and tests.
Change-Id: I6fb3516a5061555f6f24b29141c2871d2319b023
2014-10-22 19:26:21 +09:00
5f00fe09e9
Fix some compiler warnings
...
This CL fixes the following compiler warnings.
- Indirect access to static member
- Access to a non-accessible member of an enclosing type
- Parameter assignment
- Method can be static
- Local variable declaration hides another field or variable
- Value of local variable is not used
- Unused import
- Unused private member
- Unnecessary 'else' statement
- Unnecessary declaration of throw exception
- Redundant type arguments
- Missing '@Override' annotation
- Unused '@SuppressWarning' annotations
Bug: 18003991
Change-Id: Icfebe753e53a2cc621848f769d6a3d7ce501ebc7
2014-10-21 19:28:37 +09:00
05172bf1a5
Renaming "blacklist" flag to "possibly offensive"
...
No behaviour changes.
Unified the overloaded FusionDictionary::add method to always take an
isPossiblyOffensive argument.
Bug: 11031090
Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
2014-10-21 11:51:47 +09:00
3a41528cbe
Merge "Fix testCharacterTableIsPresent to use BinaryDictUtils.getDictFile"
2014-10-03 12:04:05 +00:00
6164f1fcb9
Fix testCharacterTableIsPresent to use BinaryDictUtils.getDictFile
...
Bug:17097992
Change-Id: Ic26c95fccb63d592883f85fe34f4570f1861b8c3
2014-10-03 20:07:41 +09:00
80861cde9d
Merge "Fix bug of testCharacterTableIsPresent (dicttool test)"
2014-10-03 10:07:04 +00:00
71f9b8d50b
Fix bug of testCharacterTableIsPresent (dicttool test)
...
Bug:17097992
Change-Id: Ibe343b8cc704631e84ed9d3a39feee30a54bdc38
2014-10-03 18:56:41 +09:00
b28d1cc487
Fix a behavior change in dicttool
...
The behavior change was introduced by I8b3458ad. Concretely,
empty bigram lists would end up as empty lists instead of null.
Change-Id: Ibcdf7e6aabc6aba3f5db0477335882394e050ce5
2014-10-03 18:04:10 +09:00
fb051c3957
Merge changes I3c1f5ac1,I269c9aa8
...
* changes:
Switch code point table
Test for code point table (dicttool test)
2014-10-03 07:55:59 +00:00
7e5614520a
Merge "Include a code point table in the binary dictionary."
2014-10-02 08:55:18 +00:00
f51d3667fc
Switch code point table
...
Bug:17097992
Change-Id: I3c1f5ac183ebb5d3757b8ff258655869ab61f2e7
2014-10-02 12:28:04 +09:00
25c884ba65
Test for code point table (dicttool test)
...
Bug:17097992
Change-Id: I269c9aa86378f32083f8688f4ce91862d47dd181
2014-10-02 12:28:04 +09:00
9168ab60cf
Include a code point table in the binary dictionary.
...
Bug:17097992
Change-Id: I677a5eb3a704e4386f6573360e44ca335d81d2df
2014-10-02 12:27:49 +09:00
108dad1491
Merge "Introduce NgramProperty in Java side."
2014-10-01 07:53:04 +00:00
c6a6f6a990
Introduce NgramProperty in Java side.
...
Bug: 14425059
Change-Id: I8b3458ad22730b3dccbe0caea2c5930f5276dc82
2014-10-01 11:21:08 +09:00
0c2cdcc735
Fix bug of testCodePointTable.
...
Bug:17097992
Change-Id: Ia26bfceb008f52e2c3b760159c5129b7eca5d6d6
2014-09-30 12:49:25 +09:00
5e828b2c61
Merge "Create a code point table based on occurrence counts."
2014-09-29 06:31:33 +00:00
bb0eca5705
Rename PrevWordsInfo to NgramContext.
...
Bug: 14425059
Change-Id: Id06a71681fa8b5e589e29fba10fe5c1cfed66984
2014-09-29 10:52:18 +09:00
8a6e96d286
Create a code point table based on occurrence counts.
...
Bug:17097992
Change-Id: Ifd76dbd4d385d800af416368e25c9e56a76d0fbf
2014-09-26 15:15:16 +09:00
f4329f7fff
Read dicttool option for switching code point table
...
Bug:17097992
Change-Id: I0b3f12c4450f784b9a33470d1dc4c306062de91e
2014-09-26 15:15:10 +09:00
ed798fa308
Remove unused dictionary writing methods.
...
Change-Id: Ica6ac057c0d0f037b7dd5539ab5b591c83bfa4d7
2014-08-21 17:22:54 +09:00
c21619fe73
Make dict log cleanup.
...
Delete unneeded output when creating a dictionary
Change-Id: If7dc5dc74a53d0054967cb801e5ccfdd53ebe179
2014-08-06 15:32:18 +09:00
92827b0712
Merge "Make PrevWordsInfo have multiple words' information."
2014-06-24 01:52:26 +00:00
e708b1bc2e
Make PrevWordsInfo have multiple words' information.
...
Bug: 14425059
Change-Id: I2bd6a872904a44b80f638a13d91a97559217cc1a
2014-06-25 14:14:37 +09:00
88fa47a27d
Support migration/dump of Beginning-of-Sentence entries.
...
Bug: 14119293
Change-Id: Ie975138f819794d5c34a7a547be5a6117050e084
2014-06-24 12:37:07 +09:00
dfca51726e
Return whether the dynamic dict operation was success.
...
Bug: 12184250
Change-Id: Iee7e00c1e84c95551a077f4dd023c0a9b9ac9466
2014-05-27 17:30:00 +09:00
a91561aa58
Use Java 7 diamond operator
...
Change-Id: If16ef50ae73147594615d0f49d6a22621eaf1aef
2014-05-24 01:05:42 +09:00
1adca93381
Extend jni methods and enable Beginning-of-Sentence.
...
Bug: 14119293
Change-Id: I78fc877367dd0d6240eeacb750b6d2d0b93cba83
2014-05-23 19:58:58 +09:00
e507d92aa3
Use PrevWordsInfo for get/add/remove n-gram(bigram) entry.
...
Bug: 14119293
Bug: 14425059
Bug: 15102610
Change-Id: Ib482390f8d15b37d44a1a54e8c243a9eaec3f815
2014-05-21 11:15:38 +09:00
4e21d3711f
Revert "Use PrevWordsInfo for get/add/remove n-gram(bigram) entry."
...
This reverts commit ff50b39176
2014-05-20 14:01:06 +00:00
ff50b39176
Use PrevWordsInfo for get/add/remove n-gram(bigram) entry.
...
Bug: 14119293
Bug: 14425059
Change-Id: I12e9ba977c153b514c6591ab52940712fd0874e3
2014-05-20 13:37:04 +09:00
93cda5bb39
Move code only used for dicttool and tests under tests.
...
Bug: 13035567
Change-Id: I13c6df013ef2b67c9bf67455d9c32d283bf9ea2e
2014-03-27 15:30:32 +09:00
3ad4af2354
Move DictionaryOptions from FusionDictionary to FormatSpec.
...
Bug: 8187060
Bug:13035567
Change-Id: Id4f45e589521ae98c926a4c0607be10ce1a983f2
2014-03-06 18:53:09 +09:00
516f86815d
Separate WeightedString from FusionDictionary.
...
Bug: 8187060
Change-Id: I40c1dafca3eb52244c64fdb4c1db30a56385d678
2014-03-06 18:53:06 +09:00
e784148ae6
Separate utility methods from BinaryDictionary.
...
Bug: 8187060
Change-Id: Ice2984e332b7bd3bb17174aefc80b5635b72fc50
2014-03-05 18:19:34 +09:00
Tadashi G. Takaoka
Chieu Nguyen
Dan Zivkovic
Mohammadinamul Sheik
Jean Chalard
Adrian Velicu
Ken Wakasa
Akifumi Yoshimoto
Keisuke Kuroyanagi