9f46834839
dicttool header to read stream exhaustively
...
Change-Id: I50a286c115f5bd6e93763bd2f79031676d6fffd8
2014-11-11 18:10:26 -08:00
1e72f9da12
Dicttool to handle unpackaging non-latest version dicts
...
Change-Id: I738735186213b3a40eff997ae2fd83069c6445f1
2014-11-11 16:35:04 -08:00
0691f29d36
Merge "Making 'dicttool header' output format version"
2014-11-11 01:34:36 +00:00
8e394ffcf4
Making 'dicttool header' output format version
...
Change-Id: I4198f6b463711feb4ab78020934cca4d23870fbb
2014-11-08 10:35:37 +09:00
5b91b551e5
Move util classes under common
...
Also why did we have two copies of LocaleUtils >.>
Bug: 18108776
Change-Id: I03b4403dfd51934e66b567f2f8b87da419cfb3ab
2014-11-07 18:00:03 +09:00
536bf61658
Merge "Remove dicttool dependency to NativeSuggestOptions"
2014-11-07 06:00:40 +00:00
e1652d7570
Fix the build : move offdevice tests in an off device file
...
Also fix a failing test
Change-Id: I280aa6b5836c7332da08a88f1258546edeb25a37
2014-11-06 22:33:57 +09:00
03eb9de961
Remove dicttool dependency to NativeSuggestOptions
...
Bug: 18108776
Change-Id: I0f57594617f8d5080aea9002b2356d18bfe97043
2014-11-06 21:38:11 +09:00
5b33d197ba
Add a header command to dicttool.
...
This will allow to greatly improve the performance of the
metadata-generating files, as they won't have to wait for
the info command to read the entire dictionary when the
header is all we need.
Also add tests, and while we're at it, use the seed as
intended to enable reproducible tests.
Change-Id: I0ba79ef62f0292b23e63aed57ff565bb102281a2
2014-11-06 18:50:59 +09:00
f6b0e32df3
Add a *FAST* dictionary header reader.
...
It's still unused as of this change but the next change will use it
As a reference point, generating the metadata for Bayo takes
3'02" on my machine with the info command; it's down to 16" if
made to use this instead. The gains increases with the number
of dictionaries obviously.
Change-Id: I0eeea2d8f81bb74b0d1570af658e91b56f7c2b79
2014-11-06 13:17:08 +09:00
5564317f83
Genericize getting a raw dictionary
...
This will allow for not copying the whole dictionary when only
the header is needed.
Change-Id: Ie4a649b507ccd4a430201824ed87b8b8bbf55e9f
2014-11-06 13:12:39 +09:00
ae55db95a7
Large simplification in obtaining a raw dictionary
...
That is where the last refactorings were leading. This code is
simpler, but it's far more flexible. Importantly, it only makes
a single copy instead of making a full disk copy for every
intermediate step.
Next we're going to make the "copy" part modular for processes
that don't need to copy the whole file.
Change-Id: Ief32ac665d804b9b20c44f443a9c87452ceb367a
2014-11-05 12:27:35 +09:00
3cde19ded1
Merge "Initial commit for native dicttoolkit."
2014-10-31 11:29:20 +00:00
e101a53ffc
Initial commit for native dicttoolkit.
...
Bug: 10059681
Change-Id: Ib730af8ebc944e08aaada869c0626724a499747c
2014-10-31 20:27:06 +09:00
652b655eab
Remove some dicttool dependencies
...
Bug: 18108776
Change-Id: Ic81c5df2a685160c249021ff4cfe41553dbdeebe
2014-10-31 17:52:46 +09:00
5840a7c6e7
Merge "Remove Dict dependency on WordComposer and ProximityInfo"
2014-10-31 07:59:12 +00:00
7c87859d4c
Using "blacklist" flag as "possibly offensive"
...
Bug: 11031090
Change-Id: I5cc0d006ab003656498eb82b0875eb9c051d331e
2014-10-31 14:33:05 +09:00
ecab6aff59
Remove Dict dependency on WordComposer and ProximityInfo
...
Bug: 18108776
Change-Id: I9b399a44241e05a7add9bb8094263aa76de37880
2014-10-29 12:27:24 +09:00
36799b2aa2
Move InputPointers and ResizableIntArray to common
...
Bug: 18108776
Change-Id: Ie5c0430aa41a8d6c58bf510a10173223d7dfe9fe
2014-10-29 12:09:11 +09:00
4beeb9253a
Move StringUtils under common.
...
Bug: 18108776
Change-Id: Ia46a4102a0e86e71118ca5e641f9f531998e166b
2014-10-28 22:44:30 +09:00
067d8cdf56
Fix unit test breakage
...
Change-Id: I538288054a58eb2c81ce3cbe5c9bef900fb653a5
2014-10-24 16:48:46 +09:00
9e58ae4698
Merge "Some more simplification of DecoderSpec works"
2014-10-24 03:56:22 +00:00
40c11fdbff
Merge "Simplify handling of steps in DecoderChainSpec"
2014-10-24 03:50:47 +00:00
2811592934
Merge "Fix dicttool build."
2014-10-23 10:14:55 +00:00
323ac64d98
Fix dicttool build.
...
Change-Id: Idc4533e57b7f4ddccd66b1f1a4730153064b1e27
2014-10-23 19:08:55 +09:00
afdde63374
Some more simplification of DecoderSpec works
...
Change-Id: I23fa4e4ed96228406e70aa94d84fd7b8d3f69347
2014-10-23 16:57:14 +09:00
52e92b8a3f
Simplify handling of steps in DecoderChainSpec
...
This is a preliminary refactoring change to improve performance
in dicttool diagnostic tools.
Change-Id: I9a59328af62e336809246be5bebbbf2e154366b3
2014-10-23 16:57:11 +09:00
92d073c2fd
Remove unused import and method
...
Bug: 18003991
Change-Id: Id6b67bf66b397301e5186826dba2b60df9cb4c65
2014-10-23 16:37:07 +09:00
b11fc7d423
Move annotations classes to latiime-common
...
Move Constants.java too.
Change-Id: I55e8cf06f61c0a37746a7328834a52a5306cf0f2
2014-10-23 13:00:46 +09:00
d3a4c51324
Fix Javadoc and null analysis related warnings
...
This CL also adds @SuppressWarning("unused" to java-overridable package.
Bug: 18003991
Change-Id: If70527e30654384705d7a814f5efd181d9f539e1
2014-10-23 09:58:42 +09:00
54a1b8ec54
Add latinime-common local lib
...
This is just a placeholder in this CL. It will be shared by LatinIME,
dicttool, and tests.
Change-Id: I6fb3516a5061555f6f24b29141c2871d2319b023
2014-10-22 19:26:21 +09:00
90aa229f01
Remove XML input/output from dicttool.
...
This hasn't been used for a while. It's deprecated. Let's kill it.
Change-Id: Ib1c491fa14b6406f6f77f2b0869f4db1810eb078
2014-10-22 17:28:33 +09:00
5f00fe09e9
Fix some compiler warnings
...
This CL fixes the following compiler warnings.
- Indirect access to static member
- Access to a non-accessible member of an enclosing type
- Parameter assignment
- Method can be static
- Local variable declaration hides another field or variable
- Value of local variable is not used
- Unused import
- Unused private member
- Unnecessary 'else' statement
- Unnecessary declaration of throw exception
- Redundant type arguments
- Missing '@Override' annotation
- Unused '@SuppressWarning' annotations
Bug: 18003991
Change-Id: Icfebe753e53a2cc621848f769d6a3d7ce501ebc7
2014-10-21 19:28:37 +09:00
05172bf1a5
Renaming "blacklist" flag to "possibly offensive"
...
No behaviour changes.
Unified the overloaded FusionDictionary::add method to always take an
isPossiblyOffensive argument.
Bug: 11031090
Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
2014-10-21 11:51:47 +09:00
b498d2cf84
Fix a possible NPE in Dicttool
...
I've never seen the NPE happen and only happened to notice
this by chance. Let's fix the code.
Change-Id: If458646229f9cadcd6c15779348133f382fde783
2014-10-06 23:15:22 +09:00
33cbd1fb38
Align a compat file for a change in native signature
...
Change-Id: I89eb530c1a44e5ea9b5fcb37c792cb8c81d6dc1c
2014-10-03 19:35:18 +09:00
826186f66b
Use Devanagari Danda letter as full stop on Nepali keyboard
...
Bug: 17741882
Change-Id: I62e8c9a3f194b9a3a6724c7d1a92292b150ddeb9
2014-10-03 09:48:18 +00:00
7e5614520a
Merge "Include a code point table in the binary dictionary."
2014-10-02 08:55:18 +00:00
9168ab60cf
Include a code point table in the binary dictionary.
...
Bug:17097992
Change-Id: I677a5eb3a704e4386f6573360e44ca335d81d2df
2014-10-02 12:27:49 +09:00
31c16d41bc
Add Uzbek keyboard
...
Bug: 13222403
Change-Id: I9a4cf447a8ab0c26c4dc7f7794c57390024660cc
2014-10-01 09:29:34 +00:00
a987f6d0cc
Use Devanagari Danda letter as full stop on Hindi keyboard
...
Bug: 17418371
Change-Id: I22bb2913015a83604301576e68095974c38b7c9a
2014-10-01 18:20:31 +09:00
d368975cdb
Merge "Add Akkhor Layout for Bengali Bangladesh"
2014-10-01 08:13:46 +00:00
c6a6f6a990
Introduce NgramProperty in Java side.
...
Bug: 14425059
Change-Id: I8b3458ad22730b3dccbe0caea2c5930f5276dc82
2014-10-01 11:21:08 +09:00
a4a4e9d96b
Merge "Rename PrevWordsInfo to NgramContext."
2014-09-29 03:00:55 +00:00
bb0eca5705
Rename PrevWordsInfo to NgramContext.
...
Bug: 14425059
Change-Id: Id06a71681fa8b5e589e29fba10fe5c1cfed66984
2014-09-29 10:52:18 +09:00
76150b8133
Add Akkhor Layout for Bengali Bangladesh
...
Bug: 16143057
Change-Id: I0b4a3d0d1125f9af25a98ee7a1852129ae1c1d2c
2014-09-26 18:20:25 +00:00
dade81d78c
Fix adding more diacritics letters for Nordic languages
...
Bug: 10787354
Change-Id: Ia71417069a0cc10d7908d0c404ce85eb0cd76540
2014-09-26 20:21:17 +09:00
207b979087
Merge "Add Serbian Latin keyboard"
2014-09-26 07:31:05 +00:00
8108a3e1cd
Add Serbian Latin keyboard
...
Bug: 9687668
Change-Id: I0631ab04cf33e3d454c965e98a756c31666537bf
2014-09-26 16:01:34 +09:00
f4329f7fff
Read dicttool option for switching code point table
...
Bug:17097992
Change-Id: I0b3f12c4450f784b9a33470d1dc4c306062de91e
2014-09-26 15:15:10 +09:00
Adrian Velicu
Jean Chalard
Keisuke Kuroyanagi
Tadashi G. Takaoka
Ken Wakasa
Akifumi Yoshimoto