nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
38179 commits 1 branch 0 tags 363 MiB
Commit graph

57 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
88bc312ad3 Move dictionary code to top level dictionary dir. 
Bug: 18725954
Change-Id: Ia442ba4b5d84311057d83edf6e7aeb151d6a820b
 2014-12-17 16:02:09 +09:00
Keisuke Kuroyanagi
ad546afbaa Remove dependency on jni.h from WordProperty. 
Bug: 18725954
Change-Id: Ic97d3a56b036ff042322c9f794504064046fd7d7
 2014-12-15 18:09:45 +09:00
Keisuke Kuroyanagi
60021bbdc2 Enable Quadgram for personalized dicts. 
Before:
Total words: 1134659, Success Num: 944709, Success Percentage: 83.259%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1258, Bad Failure Percentage: 0.111%
Failures, with auto-correction (F-C): 28013, F-C Percentage: 2.469%
Max Keystrokes: 6072844, Min Keystrokes: 3347332, Keystroke Saving Percentage:44.880%

After:
Total words: 1134665, Success Num: 945026, Success Percentage: 83.287%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1271, Bad Failure Percentage: 0.112%
Failures, with auto-correction (F-C): 27756, F-C Percentage: 2.446%
Max Keystrokes: 6072850, Min Keystrokes: 3290996, Keystroke Saving Percentage:45.808%

Change-Id: I16af52a3e9c371b95fd6f0741f45ee6b2443bea6
 2014-11-25 19:07:13 +09:00
Keisuke Kuroyanagi
78212a6d3d Use enum to specify ngram type. 
Change-Id: Ie28768ceadcd7a2d940c57eb30be7d4c364e509f
 2014-11-25 19:07:10 +09:00
Jean Chalard
2a3ed8c988 Fix the base character of D with stroke 
Bug: 18436480
Change-Id: Ic92cae7c85c07c8f62a5b6e69d2b71e204aff50d
 2014-11-19 17:26:00 +09:00
Keisuke Kuroyanagi
580420d21b Implement IntArrayView::split for dicttoolkit. 
Bug: 10059681
Change-Id: Ic29e79d049bb532727cf5cb1e529fec5d35156ed
 2014-11-11 15:06:48 +09:00
Keisuke Kuroyanagi
7d5420aa5e Make profiler use getTimeInMicroSec(). 
Bug: 17797064
Change-Id: Ie992c9454edfc3bf93d5ea367c3a4427b513a205
 2014-11-11 01:38:49 +09:00
Keisuke Kuroyanagi
16cc3992d7 Use trigrams for personalization dict. 
5Bug: 14425059
Change-Id: I73cf6904e569d60996a3b079f16ea6df0cb90f02
 2014-10-23 14:32:45 +09:00
Keisuke Kuroyanagi
c9865785f4 Support ngram entry migration. 
Bug: 14425059
Change-Id: I98cb9fa303af2d93a0a3512e8732231c564e3c5d
 2014-10-22 11:31:16 +09:00
Keisuke Kuroyanagi
45783013bf Rename prev_words_info.h to ngram_context.h 
Bug: 14425059
Change-Id: I0e906631ecad2361a8198b3f9e3394bb22c5bf83
 2014-10-09 21:28:19 +09:00
Keisuke Kuroyanagi
72e2383d11 Rename PrevWordsInfo to NgramContext. 
Bug: 14425059
Change-Id: I30703fc80e9450d4e2dbfec965e7f9f4468f6a11
 2014-10-09 17:34:32 +09:00
Keisuke Kuroyanagi
2842e50c4b Use std::move for dictionary properties. 
Change-Id: I15056b36b7493f4bac1dbcbb46a0b44343ede153
 2014-09-25 11:36:52 +09:00
Keisuke Kuroyanagi
8806248386 Pass prevWordCount to native code for getSuggestion. 
Bug: 14425059
Change-Id: Id2b49a448982c997e5c0a22445b115e675156c3e
 2014-09-18 19:18:55 +09:00
Keisuke Kuroyanagi
5849feeee1 Merge "Use ReadOnlyByteArrayView in PatriciaTriePolicy." 2014-09-17 12:50:16 +00:00
Keisuke Kuroyanagi
180e7b4c07 Use ReadOnlyByteArrayView in PatriciaTriePolicy. 
Change-Id: I4ef01c0af73f27c256cc1a719343be836913dc71
 2014-09-17 21:38:46 +09:00
Keisuke Kuroyanagi
09c154925f Add firstOrDefault and lastOrDefault to IntArrayView. 
Change-Id: I854c02eff3fa0b53c72a5f1cabce001f4854ada0
 2014-09-17 21:16:31 +09:00
Keisuke Kuroyanagi
7eb6e28b9e Update input checking logic for adding/removing n-gram. 
Bug: 14425059
Change-Id: Ifb4e3c3f06aaf9a16f632ff208ba76cf741cea83
 2014-09-16 14:14:22 +09:00
Keisuke Kuroyanagi
537f6eea8a Use WordIdArrayView for prevWordIds. 
Bug: 14425059
Change-Id: Ia84fb997d89564e60111b46ca83bbfa3b187f316
 2014-09-11 19:36:22 +09:00
Keisuke Kuroyanagi
a3b0eb1685 Implement IntArrayView.copyToBuffer(). 
Bug: 14425059
Change-Id: Ic1b7de72701eae0c0b1bb28d12514099446a66a9
 2014-09-11 15:21:52 +09:00
Keisuke Kuroyanagi
395fe8e98d Implement LanguageModelDictContent.getWordProbability(). 
Bug: 14425059
Change-Id: I290a05cee6f341caa25fb222892505529cef1eb7
 2014-09-10 19:51:12 +09:00
Keisuke Kuroyanagi
29dcf97e74 Add CharUtilsTest. 
Change-Id: I69b57d88a5376393b5d09d8b8e056c82cb8b8a3c
 2014-09-03 13:57:32 +09:00
Keisuke Kuroyanagi
e394a0c6ff Implement IntArrayView::skip(). 
Change-Id: Ib7f13963ac1d9c64eff2c08391154c6a25024126
 2014-08-28 12:12:56 +09:00
Keisuke Kuroyanagi
6ae4d79d81 Use IntArrayView for dictionary structure policy. 
Change-Id: I0dc94908259d70d5085ff22abf422d90affb1452
 2014-08-27 20:28:43 +09:00
Keisuke Kuroyanagi
1f6e52ef02 Use byte array view in ver4 dict contents. 
Change-Id: Icf79a51a200f7ccd775264d1a83dd61e7dcfbab2
 2014-08-18 22:46:10 +09:00
Keisuke Kuroyanagi
9a23f0fba2 Add bigrams to language model content. 
Bug: 14425059

Change-Id: Id81e3775ea0104750a23e3dca62c00681ed8dc2e
 2014-08-12 20:32:42 +09:00
Keisuke Kuroyanagi
9069d30043 Use IntArrayView to add/remove n-gram entry. 
Bug: 14425059
Change-Id: I734f12dfde5161abdfb019a6391677dba8984ff4
 2014-08-06 12:52:01 +09:00
Keisuke Kuroyanagi
03dc44f543 Add/Get n-gram probability entry in languageModelDictContent 
Bug: 14425059
Change-Id: I7926c3812f89b9a71fe1873a5bc32f793f91b640
 2014-08-06 00:42:56 +00:00
Keisuke Kuroyanagi
0889484266 Add methods for unigrams to LanguageModelDictContent. 
Bug: 14425059
Change-Id: I0a6b480a3d4735787ffac68c47b4ffefc3f1b8a5
 2014-08-05 12:38:55 +09:00
Keisuke Kuroyanagi
c0c674cdc0 Make MmappedBuffer use byte array view. 
Bug: 16691311
Change-Id: I2122c01ee27c33e11dec52643925c069927bea2b
 2014-08-01 19:26:01 +09:00
Keisuke Kuroyanagi
75d8c20d03 Add memory view class for int and uint8_t. 
Bug: 16691311
Change-Id: I32eb692cdb758861e24b772fdcda57642b95ae1b
 2014-08-01 12:39:31 +09:00
Keisuke Kuroyanagi
05b1e0d42f Extend jni method to use multiple previous words. 
Bug: 14425059
Change-Id: I8150e8812ee32f8c713315a234b52e5b3a79d7a0
 2014-06-26 18:47:25 +09:00
Keisuke Kuroyanagi
88fa47a27d Support migration/dump of Beginning-of-Sentence entries. 
Bug: 14119293
Change-Id: Ie975138f819794d5c34a7a547be5a6117050e084
 2014-06-24 12:37:07 +09:00
Keisuke Kuroyanagi
96990ca773 Support Beginning-of-Sentence in native code 
Bug: 14119293
Change-Id: I0f382e33a19bf481823b23405d454de61ec835ff
 2014-05-23 17:23:08 +09:00
Keisuke Kuroyanagi
304a71d171 Use JniDataUtils::putXxxToArray() to output a value. 
Change-Id: Ifb7bed6623b01acb524566a0fe00dcbdf7273888
 2014-05-14 20:05:15 +09:00
Keisuke Kuroyanagi
e9121a68a6 Filter out control characters and non-unicode code points. 
Bug: 14119293
Bug: 13758761
Change-Id: I6b79cff0714152807f5e20b7a75060a0a772b28b
 2014-05-14 20:05:10 +09:00
Keisuke Kuroyanagi
d2f7cd28ae Use JniDataUtils::outputCodePoints() to output code points 
Bug: 14119293
Bug: 13758761

Change-Id: I516d2f96e219e6e65246f502186ccb9bd5f0670f
 2014-05-14 17:42:47 +09:00
Keisuke Kuroyanagi
79ba633402 Skip PtNodes with non-Unicode code points for suggestion. 
Bug: 14119293
Change-Id: Id1d3b789b5f18757070878dba35a7980bfb44591
 2014-05-12 19:38:26 +09:00
Keisuke Kuroyanagi
903be5bbd3 Implement latinime_BinaryDictionary_createOnMemory(). 
Bug: 14166482
Change-Id: If7ec3345ab34edcd6bc5cef9e72580ced894a0e3
 2014-04-22 12:01:22 -07:00
Keisuke Kuroyanagi
edc7d02d76 Separate JniDataUtils::constructAttributeMap(). 
Bug: 14166482
Change-Id: Ic2dc407231743ea668fe0ab8869eb8a7f8b9625f
 2014-04-21 19:59:21 -07:00
Keisuke Kuroyanagi
d4e54af0ba Merge "Make addUnigramWord use UnigramProperty." 2014-04-14 11:03:30 +00:00
Keisuke Kuroyanagi
793124855d Make addUnigramWord use UnigramProperty. 
Bug: 13406708
Change-Id: I10c108dd7047fe230c60495f13800f32fdc46d0d
 2014-04-14 18:49:19 +09:00
Ken Wakasa
8ca9be17db s/hash_map_compat/unordered_map/ 
Change-Id: Icce5f9a12b04bdd7540c52750d303a585d71f28a
 2014-04-11 18:07:59 +09:00
Keisuke Kuroyanagi
c36c97b4f7 Merge "Use unique_ptr." 2014-03-07 09:06:58 +00:00
Keisuke Kuroyanagi
4ce480d5ce Use unique_ptr. 
Change-Id: Id92a5b07da4f7f95e2cd293ce8dc1a5f979b7853
 2014-03-07 14:31:54 +09:00
Keisuke Kuroyanagi
865e6cf497 Revert "Revert "Use std::min() and std::max()"" 
This reverts commit f63000abea.

Change-Id: I6056d176a13c6ecad38e658ab8778bd898291d02
 2014-03-07 14:19:56 +09:00
Ken Wakasa
f63000abea Revert "Use std::min() and std::max()" 
This somehow breaks TRT.

bug: 13350753

This reverts commit cf612a3abf.

Change-Id: I812f067e7cc8106b054527732dc6fe4efd7cc0fe
 2014-03-07 02:30:18 +00:00
Ken Wakasa
cf612a3abf Use std::min() and std::max() 
Change-Id: I2992fa16692ace2a6febedc4393812faf763638f
 2014-03-06 23:19:54 +09:00
Ken Wakasa
ca0a0da864 Switch to C++11 
Change-Id: Ib2970327c36422d7b11103d52ba7e9e52db5554f
 2014-03-06 20:32:20 +09:00
Jean Chalard
220dc2d7a8 Make dotted i the base character of dotless i. 
This is already the case for the capital version, and natives
Turkish speakers seem to think it should be the case. An
important reason to make it so is that the Turkish keyboard
has only the dotless i as a "more keys" key, so it's really
hard to type words with a dotless i without this, especially
those with several of them.

Bug: 11519119
Change-Id: I4df2a289783e4eb3c1291b8ad0a2ba5947bf7671
 2014-02-17 18:24:28 +09:00
Jean Chalard
43cf9076b2 [HD04] Make the locale mandatory. 
Bug: 11281748
Change-Id: I69281b0053bec404c3e3c713ade3f65a140f51b1
 2014-02-05 17:35:25 +09:00