Commit Graph

780 Commits (cbc3856c2cca43174b3f5cb6aa8627b4e4387d71)

Author SHA1 Message Date
Keisuke Kuroyanagi 9ff51527a3 Quit passing header file path to native.
Bug: 12089197
Change-Id: Ia898f8d2836c0c131a1834dc0a396d9121ecb972
2013-12-12 16:48:34 +09:00
Keisuke Kuroyanagi 4e9d115401 Merge "Remove or rename native codes for ver3 dictionary format." 2013-12-12 06:31:59 +00:00
Keisuke Kuroyanagi 90cff563a0 Remove or rename native codes for ver3 dictionary format.
Change-Id: I2d1fe515fc8bbbc7095581fccb4af94377ec11b2
2013-12-12 14:53:11 +09:00
Keisuke Kuroyanagi 84cc5a2c76 Create ver4 dictionary files with the dictionary name.
Bug: 12025402

Change-Id: Ia0bb13b2e26aa60a67dff73f3f6a1e276f1bb1dd
2013-12-11 19:30:18 +09:00
Keisuke Kuroyanagi 54653533d2 Merge "Fix offdevice build." 2013-12-11 08:19:22 +00:00
Keisuke Kuroyanagi 4fbf4f8340 Fix offdevice build.
Change-Id: I6e1032ae5f899732fc5121d14d2d2f2b0fb6f759
2013-12-11 17:06:46 +09:00
Jean Chalard f2e703eb95 Read options from attributes
This reads the German umlaut option from the key-attribute
store, and removes all native references to the flag.
This also completely removes the French ligatures option which
has been unused for some time.

Bug: 11281748
Change-Id: I407c02640ad0f2e01585db9087633c01507b5f3f
2013-12-11 15:43:47 +09:00
Jean Chalard 3839defc90 Split the header into a separate file.
Bug: 11281748
Change-Id: Ia2490d18bf159990310e10ed45fb6b3a0dee1c5f
2013-12-11 12:03:40 +09:00
Keisuke Kuroyanagi 6038895611 Discard useless bigrams when overflowing.
Bug: 11734037
Change-Id: I339999dffc1902f62e0a6706d969c8f410bb656f
2013-12-10 18:49:28 +09:00
Keisuke Kuroyanagi 962d2c083a Discard useless unigrams when overflowing.
Bug: 11734037
Change-Id: I5f991dd1f8fa79fd0c442be323d20c76b47ae22e
2013-12-10 18:37:06 +09:00
Keisuke Kuroyanagi 2fdb62a6a2 Start using historical info for decaying.
Bug: 11073222

Change-Id: Iad5f42d7268939df35589c4900bf6f4425adaa3f
2013-12-10 17:53:06 +09:00
Keisuke Kuroyanagi 26266bd53b Update historical info for GC.
Bug: 11073222

Change-Id: I08a61c02f9f5d527897095eee2de395f86050e2d
2013-12-09 21:02:41 +09:00
Keisuke Kuroyanagi ebb57c02c2 Move probability updating during GC to PtNodeWriter.
Bug: 11073222

Change-Id: Id452f953c4f72c4e83f6866a87be5f3766d00a31
2013-12-09 20:39:06 +09:00
Keisuke Kuroyanagi 88af9eb862 Add willBecomeNonTerminal flag.
willBecomeNonTerminal flag is used during GC to indicate
the PtNode is no longer terminal, even though the PtNode has
terminal attributes.

Bug: 11073222
Change-Id: I2514bc4106fa7539201979affcfb713d2b8430a3
2013-12-09 09:23:02 +00:00
Keisuke Kuroyanagi 3ce4c17d00 Update has shortcut targets and has bigrams flags.
Bug: 11073222
Change-Id: I75db86c485138dd86256989f28e15abed58d154d
2013-12-09 18:01:41 +09:00
Keisuke Kuroyanagi 4c46faa074 Support current time controlling for testing.
Bug: 11073222
Change-Id: I8a0e96ea6711f1f1165209873d8d6a2a77008541
2013-12-09 16:58:43 +09:00
Keisuke Kuroyanagi 6c1382b4ae Start updating historical information.
Bug: 11073222

Change-Id: Ic74951f46af05d3edfe08fca37352c5d5c1047e0
2013-12-09 16:02:07 +09:00
Keisuke Kuroyanagi 0a213fd625 Merge "Start to support adding shortcuts." 2013-12-09 05:35:29 +00:00
Keisuke Kuroyanagi 5f88c1e0f1 Start to support adding shortcuts.
Bug: 11073222
Bug: 11956652

Change-Id: Iea81603a140697594cfea4f4939e82cd1d3963ca
2013-12-09 13:05:44 +09:00
Keisuke Kuroyanagi 291db3d4b0 Introduce HistoricalInfo.
Bug: 11073222
Change-Id: I5220656a333c93d10163bd3dff71d011c8f6d965
2013-12-09 12:08:06 +09:00
Keisuke Kuroyanagi c980b1bfa7 Move NOT_A_TIMESTAMP to defines.h
Bug: 11073222
Change-Id: Id47af32f40b1a82fdf45628f2d0e37b99dca3921
2013-12-08 21:28:46 +09:00
Ken Wakasa f925b1e34a Fix offdevice TRT build
Change-Id: Idc2f3897e592433c13361bd8af94530d81621764
2013-12-06 19:46:33 +09:00
Jean Chalard 90c9199753 Merge "[RF4] Actually remove ver4 dicts" 2013-12-06 08:54:33 +00:00
Keisuke Kuroyanagi fc16c320c6 Merge "Add a jni method to fetch unigram information." 2013-12-06 08:53:21 +00:00
Keisuke Kuroyanagi 9fb28f78f7 Add a jni method to fetch unigram information.
Bug: 11956652

Change-Id: I59f1823bbc0146f6d2f34cbed8166bb6de197208
2013-12-06 17:17:38 +09:00
Jean Chalard c5db41a9d5 [RF4] Actually remove ver4 dicts
And fix a couple bugs.

Bug: 11281748
Change-Id: If07953a4b1ff9eb1165af03fdb332d7e47cd8f32
2013-12-06 17:07:59 +09:00
Jean Chalard a72e8f1ede [RF3] Cleanups
Make the version number a single number on native and java side.
Also, remove the hasValidContents method. It's useless since the
native code already checks this when creating the dictionary (I
wish I had known that when I added it).

Bug: 11281748
Change-Id: I572d37429972b2f280e4bdb748b709e5d0d7737e
2013-12-06 14:53:03 +09:00
Keisuke Kuroyanagi bc33efa4bd Implement shortcut adding method.
Bug: 11073222
Change-Id: Ia98bf40bd5263caad8b65680eabcf429328290a9
2013-12-05 20:12:10 +09:00
Keisuke Kuroyanagi 5b0ca975c4 Merge "Support controlling some unigram flags in addUnigramWord." 2013-12-04 11:43:46 +00:00
Keisuke Kuroyanagi aa191c5995 Support controlling some unigram flags in addUnigramWord.
Bug: 11073222
Change-Id: I717fae2faf22316782b42a78c48d7066f6950496
2013-12-04 20:22:01 +09:00
Keisuke Kuroyanagi edd0216ee5 Merge "Make ProbabilityEntry immutable." 2013-12-04 10:53:55 +00:00
Keisuke Kuroyanagi d7a179f437 Make ProbabilityEntry immutable.
Bug: 11073222
Change-Id: Ia3c0eb2d8cac00f0d82a72b27a08ad13eb095e8a
2013-12-04 19:50:59 +09:00
Keisuke Kuroyanagi 8ca8807b96 Merge "Separate TimeKeeper from ForgettingCurveUtils." 2013-12-04 08:55:58 +00:00
Keisuke Kuroyanagi ef7409bfaa Separate TimeKeeper from ForgettingCurveUtils.
Bug: 11073222
Change-Id: I6c27156edc01186f4e2a958283a45a62dbb2c113
2013-12-04 17:43:12 +09:00
Jean Chalard 743c7e0e6e Merge "[RF1] Remove files that don't match the expected format, step 1" 2013-12-04 08:19:26 +00:00
Jean Chalard 5e80e699c4 [RF1] Remove files that don't match the expected format, step 1
This implements the skeleton implementation, and enables a
fallback implementation in the case the file is coming from the
dictionary provider.
- A better scheme should be used for provider-supplied dicts.
- This does not implement the solution for device-generated
    dicts yet. This will come in a future change.
- This does not implement the checking process on the native
    side yet. This will come in a future change.

Bug: 11281748
Change-Id: Ifa6e237d19dfbffe503e3674915480ea867b0ddf
2013-12-04 16:19:55 +09:00
Keisuke Kuroyanagi 850bad9bb1 Refactoring: Get header policy form Ver4DictBuffers.
Bug: 11073222
Change-Id: I8d19e265b147c6b6ef8a5ec3e39e34fe136f1404
2013-12-04 12:52:45 +09:00
Keisuke Kuroyanagi f7bcb762d1 Read hasHistoricalInfo from dictionary header.
Bug: 11073222
Change-Id: I04f39eca2d26b7169159b9218c8faede6727c073
2013-12-04 12:51:34 +09:00
Keisuke Kuroyanagi a0befc6490 Start passing timestamp for dynamic dictionaries.
Bug: 11073222
Change-Id: I89e1277f734d5959e33d61e7e9e7048084b9007a
2013-12-04 11:57:45 +09:00
Keisuke Kuroyanagi 2cdb07c849 Remove newBigramLinkedNodePos from ver4 format.
Bug: 11973488
Change-Id: I98045abaaf8566b1122fa5a531f8f48ad9562680
2013-12-03 21:39:16 +09:00
Keisuke Kuroyanagi 294fe541c8 Merge "Fix build." 2013-12-03 12:10:30 +00:00
Keisuke Kuroyanagi 505ca6f409 Fix build.
Change-Id: Id8eb3953e19b1f9954702aa9985f7ea4c3936c9f
2013-12-03 21:08:04 +09:00
Keisuke Kuroyanagi cf66bb8cbc Merge "Purge ver3 dictionary reading in native code." 2013-12-03 12:00:05 +00:00
Keisuke Kuroyanagi b4aea1acaa Fix: terminal lookup table flushing.
Bug: 11073222
Change-Id: I17865dc400ad21cbfb3e3ed93cfe620dde1c7b6d
2013-12-03 15:20:02 +09:00
Keisuke Kuroyanagi 647ea07eb1 Purge ver3 dictionary reading in native code.
Bug: 11073222
Change-Id: I52892516fc9b8f1efdddb175da1bc87cbc0c66f0
2013-12-02 21:59:56 +09:00
Keisuke Kuroyanagi e717f64659 Purge Ver3 dictionary writing in native code.
Bug: 11073222
Change-Id: Iccedd618970b270a1e4178cfb178cd87c8208f3d
2013-12-02 21:59:56 +09:00
Keisuke Kuroyanagi 33dd9d1e51 Fix: write bigram entry at wrong position.
Change-Id: I69ef84c764243e44145fd906ba3332e02d3b1aa1
2013-12-02 20:45:58 +09:00
Keisuke Kuroyanagi 69e6165d2e Extend bigram probability field to support historical info.
Bug: 11073222
Change-Id: I020520251629c5a7c5b5fac21108392c8c2a38b6
2013-12-02 19:45:37 +09:00
Keisuke Kuroyanagi 6e587b7f17 Merge changes Icf107950,I1637525e
* changes:
  Move methods of MultiBigramMap to cpp file.
  Fix: ver4 bigram GC.
2013-12-02 07:40:28 +00:00
Keisuke Kuroyanagi b685ffa13c Move methods of MultiBigramMap to cpp file.
Change-Id: Icf10795037a7e966ac843cd168fe45955b6aef56
2013-12-02 16:11:27 +09:00