nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
27827 commits 1 branch 0 tags 363 MiB
Commit graph

982 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
4e9d115401 Merge "Remove or rename native codes for ver3 dictionary format." 2013-12-12 06:31:59 +00:00
Keisuke Kuroyanagi
90cff563a0 Remove or rename native codes for ver3 dictionary format. 
Change-Id: I2d1fe515fc8bbbc7095581fccb4af94377ec11b2
 2013-12-12 14:53:11 +09:00
Keisuke Kuroyanagi
84cc5a2c76 Create ver4 dictionary files with the dictionary name. 
Bug: 12025402

Change-Id: Ia0bb13b2e26aa60a67dff73f3f6a1e276f1bb1dd
 2013-12-11 19:30:18 +09:00
Keisuke Kuroyanagi
54653533d2 Merge "Fix offdevice build." 2013-12-11 08:19:22 +00:00
Keisuke Kuroyanagi
4fbf4f8340 Fix offdevice build. 
Change-Id: I6e1032ae5f899732fc5121d14d2d2f2b0fb6f759
 2013-12-11 17:06:46 +09:00
Jean Chalard
f2e703eb95 Read options from attributes 
This reads the German umlaut option from the key-attribute
store, and removes all native references to the flag.
This also completely removes the French ligatures option which
has been unused for some time.

Bug: 11281748
Change-Id: I407c02640ad0f2e01585db9087633c01507b5f3f
 2013-12-11 15:43:47 +09:00
Jean Chalard
3839defc90 Split the header into a separate file. 
Bug: 11281748
Change-Id: Ia2490d18bf159990310e10ed45fb6b3a0dee1c5f
 2013-12-11 12:03:40 +09:00
Keisuke Kuroyanagi
6038895611 Discard useless bigrams when overflowing. 
Bug: 11734037
Change-Id: I339999dffc1902f62e0a6706d969c8f410bb656f
 2013-12-10 18:49:28 +09:00
Keisuke Kuroyanagi
962d2c083a Discard useless unigrams when overflowing. 
Bug: 11734037
Change-Id: I5f991dd1f8fa79fd0c442be323d20c76b47ae22e
 2013-12-10 18:37:06 +09:00
Keisuke Kuroyanagi
2fdb62a6a2 Start using historical info for decaying. 
Bug: 11073222

Change-Id: Iad5f42d7268939df35589c4900bf6f4425adaa3f
 2013-12-10 17:53:06 +09:00
Keisuke Kuroyanagi
26266bd53b Update historical info for GC. 
Bug: 11073222

Change-Id: I08a61c02f9f5d527897095eee2de395f86050e2d
 2013-12-09 21:02:41 +09:00
Keisuke Kuroyanagi
ebb57c02c2 Move probability updating during GC to PtNodeWriter. 
Bug: 11073222

Change-Id: Id452f953c4f72c4e83f6866a87be5f3766d00a31
 2013-12-09 20:39:06 +09:00
Keisuke Kuroyanagi
88af9eb862 Add willBecomeNonTerminal flag. 
willBecomeNonTerminal flag is used during GC to indicate
the PtNode is no longer terminal, even though the PtNode has
terminal attributes.

Bug: 11073222
Change-Id: I2514bc4106fa7539201979affcfb713d2b8430a3
 2013-12-09 09:23:02 +00:00
Keisuke Kuroyanagi
3ce4c17d00 Update has shortcut targets and has bigrams flags. 
Bug: 11073222
Change-Id: I75db86c485138dd86256989f28e15abed58d154d
 2013-12-09 18:01:41 +09:00
Keisuke Kuroyanagi
4c46faa074 Support current time controlling for testing. 
Bug: 11073222
Change-Id: I8a0e96ea6711f1f1165209873d8d6a2a77008541
 2013-12-09 16:58:43 +09:00
Keisuke Kuroyanagi
6c1382b4ae Start updating historical information. 
Bug: 11073222

Change-Id: Ic74951f46af05d3edfe08fca37352c5d5c1047e0
 2013-12-09 16:02:07 +09:00
Keisuke Kuroyanagi
0a213fd625 Merge "Start to support adding shortcuts." 2013-12-09 05:35:29 +00:00
Keisuke Kuroyanagi
5f88c1e0f1 Start to support adding shortcuts. 
Bug: 11073222
Bug: 11956652

Change-Id: Iea81603a140697594cfea4f4939e82cd1d3963ca
 2013-12-09 13:05:44 +09:00
Keisuke Kuroyanagi
291db3d4b0 Introduce HistoricalInfo. 
Bug: 11073222
Change-Id: I5220656a333c93d10163bd3dff71d011c8f6d965
 2013-12-09 12:08:06 +09:00
Keisuke Kuroyanagi
c980b1bfa7 Move NOT_A_TIMESTAMP to defines.h 
Bug: 11073222
Change-Id: Id47af32f40b1a82fdf45628f2d0e37b99dca3921
 2013-12-08 21:28:46 +09:00
Ken Wakasa
f925b1e34a Fix offdevice TRT build 
Change-Id: Idc2f3897e592433c13361bd8af94530d81621764
 2013-12-06 19:46:33 +09:00
Jean Chalard
90c9199753 Merge "[RF4] Actually remove ver4 dicts" 2013-12-06 08:54:33 +00:00
Keisuke Kuroyanagi
fc16c320c6 Merge "Add a jni method to fetch unigram information." 2013-12-06 08:53:21 +00:00
Keisuke Kuroyanagi
9fb28f78f7 Add a jni method to fetch unigram information. 
Bug: 11956652

Change-Id: I59f1823bbc0146f6d2f34cbed8166bb6de197208
 2013-12-06 17:17:38 +09:00
Jean Chalard
c5db41a9d5 [RF4] Actually remove ver4 dicts 
And fix a couple bugs.

Bug: 11281748
Change-Id: If07953a4b1ff9eb1165af03fdb332d7e47cd8f32
 2013-12-06 17:07:59 +09:00
Jean Chalard
a72e8f1ede [RF3] Cleanups 
Make the version number a single number on native and java side.
Also, remove the hasValidContents method. It's useless since the
native code already checks this when creating the dictionary (I
wish I had known that when I added it).

Bug: 11281748
Change-Id: I572d37429972b2f280e4bdb748b709e5d0d7737e
 2013-12-06 14:53:03 +09:00
Keisuke Kuroyanagi
bc33efa4bd Implement shortcut adding method. 
Bug: 11073222
Change-Id: Ia98bf40bd5263caad8b65680eabcf429328290a9
 2013-12-05 20:12:10 +09:00
Keisuke Kuroyanagi
5b0ca975c4 Merge "Support controlling some unigram flags in addUnigramWord." 2013-12-04 11:43:46 +00:00
Keisuke Kuroyanagi
aa191c5995 Support controlling some unigram flags in addUnigramWord. 
Bug: 11073222
Change-Id: I717fae2faf22316782b42a78c48d7066f6950496
 2013-12-04 20:22:01 +09:00
Keisuke Kuroyanagi
edd0216ee5 Merge "Make ProbabilityEntry immutable." 2013-12-04 10:53:55 +00:00
Keisuke Kuroyanagi
d7a179f437 Make ProbabilityEntry immutable. 
Bug: 11073222
Change-Id: Ia3c0eb2d8cac00f0d82a72b27a08ad13eb095e8a
 2013-12-04 19:50:59 +09:00
Keisuke Kuroyanagi
8ca8807b96 Merge "Separate TimeKeeper from ForgettingCurveUtils." 2013-12-04 08:55:58 +00:00
Keisuke Kuroyanagi
ef7409bfaa Separate TimeKeeper from ForgettingCurveUtils. 
Bug: 11073222
Change-Id: I6c27156edc01186f4e2a958283a45a62dbb2c113
 2013-12-04 17:43:12 +09:00
Jean Chalard
743c7e0e6e Merge "[RF1] Remove files that don't match the expected format, step 1" 2013-12-04 08:19:26 +00:00
Jean Chalard
5e80e699c4 [RF1] Remove files that don't match the expected format, step 1 
This implements the skeleton implementation, and enables a
fallback implementation in the case the file is coming from the
dictionary provider.
- A better scheme should be used for provider-supplied dicts.
- This does not implement the solution for device-generated
    dicts yet. This will come in a future change.
- This does not implement the checking process on the native
    side yet. This will come in a future change.

Bug: 11281748
Change-Id: Ifa6e237d19dfbffe503e3674915480ea867b0ddf
 2013-12-04 16:19:55 +09:00
Keisuke Kuroyanagi
850bad9bb1 Refactoring: Get header policy form Ver4DictBuffers. 
Bug: 11073222
Change-Id: I8d19e265b147c6b6ef8a5ec3e39e34fe136f1404
 2013-12-04 12:52:45 +09:00
Keisuke Kuroyanagi
f7bcb762d1 Read hasHistoricalInfo from dictionary header. 
Bug: 11073222
Change-Id: I04f39eca2d26b7169159b9218c8faede6727c073
 2013-12-04 12:51:34 +09:00
Keisuke Kuroyanagi
a0befc6490 Start passing timestamp for dynamic dictionaries. 
Bug: 11073222
Change-Id: I89e1277f734d5959e33d61e7e9e7048084b9007a
 2013-12-04 11:57:45 +09:00
Keisuke Kuroyanagi
2cdb07c849 Remove newBigramLinkedNodePos from ver4 format. 
Bug: 11973488
Change-Id: I98045abaaf8566b1122fa5a531f8f48ad9562680
 2013-12-03 21:39:16 +09:00
Keisuke Kuroyanagi
294fe541c8 Merge "Fix build." 2013-12-03 12:10:30 +00:00
Keisuke Kuroyanagi
505ca6f409 Fix build. 
Change-Id: Id8eb3953e19b1f9954702aa9985f7ea4c3936c9f
 2013-12-03 21:08:04 +09:00
Keisuke Kuroyanagi
cf66bb8cbc Merge "Purge ver3 dictionary reading in native code." 2013-12-03 12:00:05 +00:00
Keisuke Kuroyanagi
b4aea1acaa Fix: terminal lookup table flushing. 
Bug: 11073222
Change-Id: I17865dc400ad21cbfb3e3ed93cfe620dde1c7b6d
 2013-12-03 15:20:02 +09:00
Keisuke Kuroyanagi
647ea07eb1 Purge ver3 dictionary reading in native code. 
Bug: 11073222
Change-Id: I52892516fc9b8f1efdddb175da1bc87cbc0c66f0
 2013-12-02 21:59:56 +09:00
Keisuke Kuroyanagi
e717f64659 Purge Ver3 dictionary writing in native code. 
Bug: 11073222
Change-Id: Iccedd618970b270a1e4178cfb178cd87c8208f3d
 2013-12-02 21:59:56 +09:00
Keisuke Kuroyanagi
33dd9d1e51 Fix: write bigram entry at wrong position. 
Change-Id: I69ef84c764243e44145fd906ba3332e02d3b1aa1
 2013-12-02 20:45:58 +09:00
Keisuke Kuroyanagi
69e6165d2e Extend bigram probability field to support historical info. 
Bug: 11073222
Change-Id: I020520251629c5a7c5b5fac21108392c8c2a38b6
 2013-12-02 19:45:37 +09:00
Keisuke Kuroyanagi
6e587b7f17 Merge changes Icf107950,I1637525e 
* changes:
  Move methods of MultiBigramMap to cpp file.
  Fix: ver4 bigram GC.
 2013-12-02 07:40:28 +00:00
Keisuke Kuroyanagi
b685ffa13c Move methods of MultiBigramMap to cpp file. 
Change-Id: Icf10795037a7e966ac843cd168fe45955b6aef56
 2013-12-02 16:11:27 +09:00
Keisuke Kuroyanagi
11765ee804 Fix: ver4 bigram GC. 
Bug: 11073222
Change-Id: I1637525ead60026cdf75ac90d40f97d02ce44ea1
 2013-12-02 16:11:25 +09:00