Keisuke Kuroyanagi
4e9d115401
Merge "Remove or rename native codes for ver3 dictionary format."
2013-12-12 06:31:59 +00:00
Keisuke Kuroyanagi
90cff563a0
Remove or rename native codes for ver3 dictionary format.
...
Change-Id: I2d1fe515fc8bbbc7095581fccb4af94377ec11b2
2013-12-12 14:53:11 +09:00
Keisuke Kuroyanagi
84cc5a2c76
Create ver4 dictionary files with the dictionary name.
...
Bug: 12025402
Change-Id: Ia0bb13b2e26aa60a67dff73f3f6a1e276f1bb1dd
2013-12-11 19:30:18 +09:00
Keisuke Kuroyanagi
54653533d2
Merge "Fix offdevice build."
2013-12-11 08:19:22 +00:00
Keisuke Kuroyanagi
4fbf4f8340
Fix offdevice build.
...
Change-Id: I6e1032ae5f899732fc5121d14d2d2f2b0fb6f759
2013-12-11 17:06:46 +09:00
Jean Chalard
f2e703eb95
Read options from attributes
...
This reads the German umlaut option from the key-attribute
store, and removes all native references to the flag.
This also completely removes the French ligatures option which
has been unused for some time.
Bug: 11281748
Change-Id: I407c02640ad0f2e01585db9087633c01507b5f3f
2013-12-11 15:43:47 +09:00
Jean Chalard
3839defc90
Split the header into a separate file.
...
Bug: 11281748
Change-Id: Ia2490d18bf159990310e10ed45fb6b3a0dee1c5f
2013-12-11 12:03:40 +09:00
Keisuke Kuroyanagi
6038895611
Discard useless bigrams when overflowing.
...
Bug: 11734037
Change-Id: I339999dffc1902f62e0a6706d969c8f410bb656f
2013-12-10 18:49:28 +09:00
Keisuke Kuroyanagi
962d2c083a
Discard useless unigrams when overflowing.
...
Bug: 11734037
Change-Id: I5f991dd1f8fa79fd0c442be323d20c76b47ae22e
2013-12-10 18:37:06 +09:00
Keisuke Kuroyanagi
2fdb62a6a2
Start using historical info for decaying.
...
Bug: 11073222
Change-Id: Iad5f42d7268939df35589c4900bf6f4425adaa3f
2013-12-10 17:53:06 +09:00
Keisuke Kuroyanagi
26266bd53b
Update historical info for GC.
...
Bug: 11073222
Change-Id: I08a61c02f9f5d527897095eee2de395f86050e2d
2013-12-09 21:02:41 +09:00
Keisuke Kuroyanagi
ebb57c02c2
Move probability updating during GC to PtNodeWriter.
...
Bug: 11073222
Change-Id: Id452f953c4f72c4e83f6866a87be5f3766d00a31
2013-12-09 20:39:06 +09:00
Keisuke Kuroyanagi
88af9eb862
Add willBecomeNonTerminal flag.
...
willBecomeNonTerminal flag is used during GC to indicate
the PtNode is no longer terminal, even though the PtNode has
terminal attributes.
Bug: 11073222
Change-Id: I2514bc4106fa7539201979affcfb713d2b8430a3
2013-12-09 09:23:02 +00:00
Keisuke Kuroyanagi
3ce4c17d00
Update has shortcut targets and has bigrams flags.
...
Bug: 11073222
Change-Id: I75db86c485138dd86256989f28e15abed58d154d
2013-12-09 18:01:41 +09:00
Keisuke Kuroyanagi
4c46faa074
Support current time controlling for testing.
...
Bug: 11073222
Change-Id: I8a0e96ea6711f1f1165209873d8d6a2a77008541
2013-12-09 16:58:43 +09:00
Keisuke Kuroyanagi
6c1382b4ae
Start updating historical information.
...
Bug: 11073222
Change-Id: Ic74951f46af05d3edfe08fca37352c5d5c1047e0
2013-12-09 16:02:07 +09:00
Keisuke Kuroyanagi
0a213fd625
Merge "Start to support adding shortcuts."
2013-12-09 05:35:29 +00:00
Keisuke Kuroyanagi
5f88c1e0f1
Start to support adding shortcuts.
...
Bug: 11073222
Bug: 11956652
Change-Id: Iea81603a140697594cfea4f4939e82cd1d3963ca
2013-12-09 13:05:44 +09:00
Keisuke Kuroyanagi
291db3d4b0
Introduce HistoricalInfo.
...
Bug: 11073222
Change-Id: I5220656a333c93d10163bd3dff71d011c8f6d965
2013-12-09 12:08:06 +09:00
Keisuke Kuroyanagi
c980b1bfa7
Move NOT_A_TIMESTAMP to defines.h
...
Bug: 11073222
Change-Id: Id47af32f40b1a82fdf45628f2d0e37b99dca3921
2013-12-08 21:28:46 +09:00
Ken Wakasa
f925b1e34a
Fix offdevice TRT build
...
Change-Id: Idc2f3897e592433c13361bd8af94530d81621764
2013-12-06 19:46:33 +09:00
Jean Chalard
90c9199753
Merge "[RF4] Actually remove ver4 dicts"
2013-12-06 08:54:33 +00:00
Keisuke Kuroyanagi
fc16c320c6
Merge "Add a jni method to fetch unigram information."
2013-12-06 08:53:21 +00:00
Keisuke Kuroyanagi
9fb28f78f7
Add a jni method to fetch unigram information.
...
Bug: 11956652
Change-Id: I59f1823bbc0146f6d2f34cbed8166bb6de197208
2013-12-06 17:17:38 +09:00
Jean Chalard
c5db41a9d5
[RF4] Actually remove ver4 dicts
...
And fix a couple bugs.
Bug: 11281748
Change-Id: If07953a4b1ff9eb1165af03fdb332d7e47cd8f32
2013-12-06 17:07:59 +09:00
Jean Chalard
a72e8f1ede
[RF3] Cleanups
...
Make the version number a single number on native and java side.
Also, remove the hasValidContents method. It's useless since the
native code already checks this when creating the dictionary (I
wish I had known that when I added it).
Bug: 11281748
Change-Id: I572d37429972b2f280e4bdb748b709e5d0d7737e
2013-12-06 14:53:03 +09:00
Keisuke Kuroyanagi
bc33efa4bd
Implement shortcut adding method.
...
Bug: 11073222
Change-Id: Ia98bf40bd5263caad8b65680eabcf429328290a9
2013-12-05 20:12:10 +09:00
Keisuke Kuroyanagi
5b0ca975c4
Merge "Support controlling some unigram flags in addUnigramWord."
2013-12-04 11:43:46 +00:00
Keisuke Kuroyanagi
aa191c5995
Support controlling some unigram flags in addUnigramWord.
...
Bug: 11073222
Change-Id: I717fae2faf22316782b42a78c48d7066f6950496
2013-12-04 20:22:01 +09:00
Keisuke Kuroyanagi
edd0216ee5
Merge "Make ProbabilityEntry immutable."
2013-12-04 10:53:55 +00:00
Keisuke Kuroyanagi
d7a179f437
Make ProbabilityEntry immutable.
...
Bug: 11073222
Change-Id: Ia3c0eb2d8cac00f0d82a72b27a08ad13eb095e8a
2013-12-04 19:50:59 +09:00
Keisuke Kuroyanagi
8ca8807b96
Merge "Separate TimeKeeper from ForgettingCurveUtils."
2013-12-04 08:55:58 +00:00
Keisuke Kuroyanagi
ef7409bfaa
Separate TimeKeeper from ForgettingCurveUtils.
...
Bug: 11073222
Change-Id: I6c27156edc01186f4e2a958283a45a62dbb2c113
2013-12-04 17:43:12 +09:00
Jean Chalard
743c7e0e6e
Merge "[RF1] Remove files that don't match the expected format, step 1"
2013-12-04 08:19:26 +00:00
Jean Chalard
5e80e699c4
[RF1] Remove files that don't match the expected format, step 1
...
This implements the skeleton implementation, and enables a
fallback implementation in the case the file is coming from the
dictionary provider.
- A better scheme should be used for provider-supplied dicts.
- This does not implement the solution for device-generated
dicts yet. This will come in a future change.
- This does not implement the checking process on the native
side yet. This will come in a future change.
Bug: 11281748
Change-Id: Ifa6e237d19dfbffe503e3674915480ea867b0ddf
2013-12-04 16:19:55 +09:00
Keisuke Kuroyanagi
850bad9bb1
Refactoring: Get header policy form Ver4DictBuffers.
...
Bug: 11073222
Change-Id: I8d19e265b147c6b6ef8a5ec3e39e34fe136f1404
2013-12-04 12:52:45 +09:00
Keisuke Kuroyanagi
f7bcb762d1
Read hasHistoricalInfo from dictionary header.
...
Bug: 11073222
Change-Id: I04f39eca2d26b7169159b9218c8faede6727c073
2013-12-04 12:51:34 +09:00
Keisuke Kuroyanagi
a0befc6490
Start passing timestamp for dynamic dictionaries.
...
Bug: 11073222
Change-Id: I89e1277f734d5959e33d61e7e9e7048084b9007a
2013-12-04 11:57:45 +09:00
Keisuke Kuroyanagi
2cdb07c849
Remove newBigramLinkedNodePos from ver4 format.
...
Bug: 11973488
Change-Id: I98045abaaf8566b1122fa5a531f8f48ad9562680
2013-12-03 21:39:16 +09:00
Keisuke Kuroyanagi
294fe541c8
Merge "Fix build."
2013-12-03 12:10:30 +00:00
Keisuke Kuroyanagi
505ca6f409
Fix build.
...
Change-Id: Id8eb3953e19b1f9954702aa9985f7ea4c3936c9f
2013-12-03 21:08:04 +09:00
Keisuke Kuroyanagi
cf66bb8cbc
Merge "Purge ver3 dictionary reading in native code."
2013-12-03 12:00:05 +00:00
Keisuke Kuroyanagi
b4aea1acaa
Fix: terminal lookup table flushing.
...
Bug: 11073222
Change-Id: I17865dc400ad21cbfb3e3ed93cfe620dde1c7b6d
2013-12-03 15:20:02 +09:00
Keisuke Kuroyanagi
647ea07eb1
Purge ver3 dictionary reading in native code.
...
Bug: 11073222
Change-Id: I52892516fc9b8f1efdddb175da1bc87cbc0c66f0
2013-12-02 21:59:56 +09:00
Keisuke Kuroyanagi
e717f64659
Purge Ver3 dictionary writing in native code.
...
Bug: 11073222
Change-Id: Iccedd618970b270a1e4178cfb178cd87c8208f3d
2013-12-02 21:59:56 +09:00
Keisuke Kuroyanagi
33dd9d1e51
Fix: write bigram entry at wrong position.
...
Change-Id: I69ef84c764243e44145fd906ba3332e02d3b1aa1
2013-12-02 20:45:58 +09:00
Keisuke Kuroyanagi
69e6165d2e
Extend bigram probability field to support historical info.
...
Bug: 11073222
Change-Id: I020520251629c5a7c5b5fac21108392c8c2a38b6
2013-12-02 19:45:37 +09:00
Keisuke Kuroyanagi
6e587b7f17
Merge changes Icf107950,I1637525e
...
* changes:
Move methods of MultiBigramMap to cpp file.
Fix: ver4 bigram GC.
2013-12-02 07:40:28 +00:00
Keisuke Kuroyanagi
b685ffa13c
Move methods of MultiBigramMap to cpp file.
...
Change-Id: Icf10795037a7e966ac843cd168fe45955b6aef56
2013-12-02 16:11:27 +09:00
Keisuke Kuroyanagi
11765ee804
Fix: ver4 bigram GC.
...
Bug: 11073222
Change-Id: I1637525ead60026cdf75ac90d40f97d02ce44ea1
2013-12-02 16:11:25 +09:00