nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
41093 commits 1 branch 0 tags 363 MiB
Commit graph

189 commits

Author SHA1 Message Date
Tadashi G. Takaoka
6a1b37353d Fix dicttool build 
This CL partially reverts
  - Id88b02b74bdfe4ca05b08181ceb6b34d5652fc0c
  - I05c7d8429e8d9a26139456763c77997340fea8c2
And followup (remove shortcut support)
  - I73b7dc008a5acaf75a31a36a2d332b5afabd82d0

Bug: 28255684
Test: make -j10 dicttool_aosp
Change-Id: I2e01ed86b9517a1141aee35ea6d8ef39258981d1
 2018-10-29 15:59:05 +09:00
Dan Willemsen
6e29475b9f Clean up Makefiles, remove HOST_JDK_IS_64BIT_VERSION 
This builds on Darwin fine, so remove the non-standard darwin checks.

Remove HOST_JDK_IS_64BIT_VERSION, it's always true now, and this is the
only user.

Test: mmm packages/inputmethods/LatinIME/tools/dicttool:liblatinime-aosp-dicttool-host
Change-Id: I750c6baa29cf1d27a885ff064f0daf9d986db0b9
 2017-07-26 10:59:15 -07:00
Paul Duffin
982f0fa29f Use junit-host instead of junit 
Use framework/junit-host.jar instead of framework/junit.jar

Ran the script before and after making the change and it failed
in the same way with a build error but it was not due to a
problem with JUnit.

Bug: 30188076
Test: make checkbuild and ran the test-dicttool.sh script
Change-Id: I4cdd518f38184ff3ade5a06d968d6902770ece6b
 2016-11-30 11:24:59 +00:00
Elliott Hughes
8fd22fa494 Rely on the platform -std default. 
Bug: http://b/32019064
Test: builds
Change-Id: I17611b6d9598992bd52cf3dc93509f0f5e0bdcde
 2016-10-07 15:41:05 -07:00
Tadashi G. Takaoka
b0a0ce0b31 Remove unused import and local variable 
Change-Id: I256d1c6bf96c07b10d2d063d7935e20e0ab8ea17
 2014-11-28 11:53:12 +09:00
Adrian Velicu
9f46834839 dicttool header to read stream exhaustively 
Change-Id: I50a286c115f5bd6e93763bd2f79031676d6fffd8
 2014-11-11 18:10:26 -08:00
Adrian Velicu
1e72f9da12 Dicttool to handle unpackaging non-latest version dicts 
Change-Id: I738735186213b3a40eff997ae2fd83069c6445f1
 2014-11-11 16:35:04 -08:00
Adrian Velicu
0691f29d36 Merge "Making 'dicttool header' output format version" 2014-11-11 01:34:36 +00:00
Adrian Velicu
8e394ffcf4 Making 'dicttool header' output format version 
Change-Id: I4198f6b463711feb4ab78020934cca4d23870fbb
 2014-11-08 10:35:37 +09:00
Jean Chalard
5b91b551e5 Move util classes under common 
Also why did we have two copies of LocaleUtils >.>

Bug: 18108776
Change-Id: I03b4403dfd51934e66b567f2f8b87da419cfb3ab
 2014-11-07 18:00:03 +09:00
Jean Chalard
536bf61658 Merge "Remove dicttool dependency to NativeSuggestOptions" 2014-11-07 06:00:40 +00:00
Jean Chalard
e1652d7570 Fix the build : move offdevice tests in an off device file 
Also fix a failing test

Change-Id: I280aa6b5836c7332da08a88f1258546edeb25a37
 2014-11-06 22:33:57 +09:00
Jean Chalard
03eb9de961 Remove dicttool dependency to NativeSuggestOptions 
Bug: 18108776
Change-Id: I0f57594617f8d5080aea9002b2356d18bfe97043
 2014-11-06 21:38:11 +09:00
Jean Chalard
5b33d197ba Add a header command to dicttool. 
This will allow to greatly improve the performance of the
metadata-generating files, as they won't have to wait for
the info command to read the entire dictionary when the
header is all we need.

Also add tests, and while we're at it, use the seed as
intended to enable reproducible tests.

Change-Id: I0ba79ef62f0292b23e63aed57ff565bb102281a2
 2014-11-06 18:50:59 +09:00
Jean Chalard
f6b0e32df3 Add a *FAST* dictionary header reader. 
It's still unused as of this change but the next change will use it

As a reference point, generating the metadata for Bayo takes
3'02" on my machine with the info command; it's down to 16" if
made to use this instead. The gains increases with the number
of dictionaries obviously.

Change-Id: I0eeea2d8f81bb74b0d1570af658e91b56f7c2b79
 2014-11-06 13:17:08 +09:00
Jean Chalard
5564317f83 Genericize getting a raw dictionary 
This will allow for not copying the whole dictionary when only
the header is needed.

Change-Id: Ie4a649b507ccd4a430201824ed87b8b8bbf55e9f
 2014-11-06 13:12:39 +09:00
Jean Chalard
ae55db95a7 Large simplification in obtaining a raw dictionary 
That is where the last refactorings were leading. This code is
simpler, but it's far more flexible. Importantly, it only makes
a single copy instead of making a full disk copy for every
intermediate step.
Next we're going to make the "copy" part modular for processes
that don't need to copy the whole file.

Change-Id: Ief32ac665d804b9b20c44f443a9c87452ceb367a
 2014-11-05 12:27:35 +09:00
Keisuke Kuroyanagi
3cde19ded1 Merge "Initial commit for native dicttoolkit." 2014-10-31 11:29:20 +00:00
Keisuke Kuroyanagi
e101a53ffc Initial commit for native dicttoolkit. 
Bug: 10059681

Change-Id: Ib730af8ebc944e08aaada869c0626724a499747c
 2014-10-31 20:27:06 +09:00
Jean Chalard
652b655eab Remove some dicttool dependencies 
Bug: 18108776
Change-Id: Ic81c5df2a685160c249021ff4cfe41553dbdeebe
 2014-10-31 17:52:46 +09:00
Jean Chalard
5840a7c6e7 Merge "Remove Dict dependency on WordComposer and ProximityInfo" 2014-10-31 07:59:12 +00:00
Adrian Velicu
7c87859d4c Using "blacklist" flag as "possibly offensive" 
Bug: 11031090
Change-Id: I5cc0d006ab003656498eb82b0875eb9c051d331e
 2014-10-31 14:33:05 +09:00
Jean Chalard
ecab6aff59 Remove Dict dependency on WordComposer and ProximityInfo 
Bug: 18108776
Change-Id: I9b399a44241e05a7add9bb8094263aa76de37880
 2014-10-29 12:27:24 +09:00
Jean Chalard
36799b2aa2 Move InputPointers and ResizableIntArray to common 
Bug: 18108776
Change-Id: Ie5c0430aa41a8d6c58bf510a10173223d7dfe9fe
 2014-10-29 12:09:11 +09:00
Jean Chalard
4beeb9253a Move StringUtils under common. 
Bug: 18108776
Change-Id: Ia46a4102a0e86e71118ca5e641f9f531998e166b
 2014-10-28 22:44:30 +09:00
Tadashi G. Takaoka
067d8cdf56 Fix unit test breakage 
Change-Id: I538288054a58eb2c81ce3cbe5c9bef900fb653a5
 2014-10-24 16:48:46 +09:00
Jean Chalard
9e58ae4698 Merge "Some more simplification of DecoderSpec works" 2014-10-24 03:56:22 +00:00
Jean Chalard
40c11fdbff Merge "Simplify handling of steps in DecoderChainSpec" 2014-10-24 03:50:47 +00:00
Keisuke Kuroyanagi
2811592934 Merge "Fix dicttool build." 2014-10-23 10:14:55 +00:00
Keisuke Kuroyanagi
323ac64d98 Fix dicttool build. 
Change-Id: Idc4533e57b7f4ddccd66b1f1a4730153064b1e27
 2014-10-23 19:08:55 +09:00
Jean Chalard
afdde63374 Some more simplification of DecoderSpec works 
Change-Id: I23fa4e4ed96228406e70aa94d84fd7b8d3f69347
 2014-10-23 16:57:14 +09:00
Jean Chalard
52e92b8a3f Simplify handling of steps in DecoderChainSpec 
This is a preliminary refactoring change to improve performance
in dicttool diagnostic tools.

Change-Id: I9a59328af62e336809246be5bebbbf2e154366b3
 2014-10-23 16:57:11 +09:00
Tadashi G. Takaoka
92d073c2fd Remove unused import and method 
Bug: 18003991
Change-Id: Id6b67bf66b397301e5186826dba2b60df9cb4c65
 2014-10-23 16:37:07 +09:00
Ken Wakasa
b11fc7d423 Move annotations classes to latiime-common 
Move Constants.java too.

Change-Id: I55e8cf06f61c0a37746a7328834a52a5306cf0f2
 2014-10-23 13:00:46 +09:00
Tadashi G. Takaoka
d3a4c51324 Fix Javadoc and null analysis related warnings 
This CL also adds @SuppressWarning("unused" to java-overridable package.

Bug: 18003991
Change-Id: If70527e30654384705d7a814f5efd181d9f539e1
 2014-10-23 09:58:42 +09:00
Ken Wakasa
54a1b8ec54 Add latinime-common local lib 
This is just a placeholder in this CL. It will be shared by LatinIME,
dicttool, and tests.

Change-Id: I6fb3516a5061555f6f24b29141c2871d2319b023
 2014-10-22 19:26:21 +09:00
Jean Chalard
90aa229f01 Remove XML input/output from dicttool. 
This hasn't been used for a while. It's deprecated. Let's kill it.

Change-Id: Ib1c491fa14b6406f6f77f2b0869f4db1810eb078
 2014-10-22 17:28:33 +09:00
Tadashi G. Takaoka
5f00fe09e9 Fix some compiler warnings 
This CL fixes the following compiler warnings.

- Indirect access to static member
- Access to a non-accessible member of an enclosing type
- Parameter assignment
- Method can be static
- Local variable declaration hides another field or variable
- Value of local variable is not used
- Unused import
- Unused private member
- Unnecessary 'else' statement
- Unnecessary declaration of throw exception
- Redundant type arguments
- Missing '@Override' annotation
- Unused '@SuppressWarning' annotations

Bug: 18003991
Change-Id: Icfebe753e53a2cc621848f769d6a3d7ce501ebc7
 2014-10-21 19:28:37 +09:00
Adrian Velicu
05172bf1a5 Renaming "blacklist" flag to "possibly offensive" 
No behaviour changes.
Unified the overloaded FusionDictionary::add method to always take an
isPossiblyOffensive argument.

Bug: 11031090
Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
 2014-10-21 11:51:47 +09:00
Jean Chalard
b498d2cf84 Fix a possible NPE in Dicttool 
I've never seen the NPE happen and only happened to notice
this by chance. Let's fix the code.

Change-Id: If458646229f9cadcd6c15779348133f382fde783
 2014-10-06 23:15:22 +09:00
Jean Chalard
33cbd1fb38 Align a compat file for a change in native signature 
Change-Id: I89eb530c1a44e5ea9b5fcb37c792cb8c81d6dc1c
 2014-10-03 19:35:18 +09:00
Akifumi Yoshimoto
7e5614520a Merge "Include a code point table in the binary dictionary." 2014-10-02 08:55:18 +00:00
Akifumi Yoshimoto
9168ab60cf Include a code point table in the binary dictionary. 
Bug:17097992
Change-Id: I677a5eb3a704e4386f6573360e44ca335d81d2df
 2014-10-02 12:27:49 +09:00
Keisuke Kuroyanagi
c6a6f6a990 Introduce NgramProperty in Java side. 
Bug: 14425059
Change-Id: I8b3458ad22730b3dccbe0caea2c5930f5276dc82
 2014-10-01 11:21:08 +09:00
Keisuke Kuroyanagi
bb0eca5705 Rename PrevWordsInfo to NgramContext. 
Bug: 14425059
Change-Id: Id06a71681fa8b5e589e29fba10fe5c1cfed66984
 2014-09-29 10:52:18 +09:00
Akifumi Yoshimoto
f4329f7fff Read dicttool option for switching code point table 
Bug:17097992
Change-Id: I0b3f12c4450f784b9a33470d1dc4c306062de91e
 2014-09-26 15:15:10 +09:00
Ken Wakasa
fb74ab15c1 Abolish source code overlay and inroduce overridable src dir 
This should make IDEs happy with appropriate source code directory
selection.

bug: 16829244
Change-Id: Ic734bd4d20aa050c688a3158b1a382ae0ac18991
 2014-08-16 03:37:54 +09:00
Ken Wakasa
ec8472b5f5 am 7f545a57: [HW7.5] Introduce the @Nonnull annotation (take 2) 
* commit '7f545a57c987862d55966ac08ef64cfe0b9f51e4':
  [HW7.5] Introduce the @Nonnull annotation (take 2)
 2014-07-30 16:58:00 +00:00
Jean Chalard
99e13e485a am bf2a3210: Merge "[HW6] Split processing and applying the event." into lmp-dev 
* commit 'bf2a32100568a01d25edb56d3d9d46b5f5d2c0eb':
  [HW6] Split processing and applying the event.
 2014-07-30 16:57:58 +00:00
Ken Wakasa
7f545a57c9 [HW7.5] Introduce the @Nonnull annotation (take 2) 
Change-Id: I05512b5434810046c8b72d6bb41567b6cd8b9d6e
 2014-07-30 04:13:58 +00:00