nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
33531 commits 1 branch 0 tags 363 MiB
Commit graph

164 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
b5ef884fbb Support dumping ngram entries. 
Bug: 14425059
Change-Id: Ib03a0c3d166ed6f1e60c67127b28006d55143b6b
 2014-10-22 18:15:53 +09:00
Keisuke Kuroyanagi
c9865785f4 Support ngram entry migration. 
Bug: 14425059
Change-Id: I98cb9fa303af2d93a0a3512e8732231c564e3c5d
 2014-10-22 11:31:16 +09:00
Keisuke Kuroyanagi
dfc82fa366 Merge changes I210acb81,Ie9508788 
* changes:
  Make NgramProperty have NgramContext.
  Create .cpp file for NgramContext.
 2014-10-21 10:28:25 +00:00
Keisuke Kuroyanagi
88bb28c132 Make NgramProperty have NgramContext. 
Bug: 14425059
Change-Id: I210acb816b122857dbbe1ee4dd6a35c5335bf2bf
 2014-10-21 17:12:32 +09:00
Adrian Velicu
05172bf1a5 Renaming "blacklist" flag to "possibly offensive" 
No behaviour changes.
Unified the overloaded FusionDictionary::add method to always take an
isPossiblyOffensive argument.

Bug: 11031090
Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
 2014-10-21 11:51:47 +09:00
Keisuke Kuroyanagi
45783013bf Rename prev_words_info.h to ngram_context.h 
Bug: 14425059
Change-Id: I0e906631ecad2361a8198b3f9e3394bb22c5bf83
 2014-10-09 21:28:19 +09:00
Keisuke Kuroyanagi
72e2383d11 Rename PrevWordsInfo to NgramContext. 
Bug: 14425059
Change-Id: I30703fc80e9450d4e2dbfec965e7f9f4468f6a11
 2014-10-09 17:34:32 +09:00
Keisuke Kuroyanagi
ab4437f468 Rename updateCounter to updateEntriesForWordWithNgramContext. 
Bug: 14425059
Change-Id: Id9b0dd7e32c711ed4292981517c3febd5fe9e897
 2014-10-09 17:34:29 +09:00
Keisuke Kuroyanagi
d7a51c242b Extend jni method to dump ngram entries. 
Bug: 14425059
Change-Id: Ib03b58525fae12f254b45630bee31ecbdde227b1
 2014-10-09 15:26:10 +09:00
Keisuke Kuroyanagi
36c4eaadfb Show prediction results in debug build. 
Bug: 16547409
Change-Id: If85418583998cd639c794bf5d5cfbbb972c34f72
 2014-10-06 18:36:54 +09:00
Keisuke Kuroyanagi
29777e3a8a Implement updateCounter() by using existing entry adding methods. 
Bug: 14425059
Change-Id: I0b6cb80e1fb8f738e9c7d9e80fbc0c479546b879
 2014-10-01 19:59:39 +09:00
Keisuke Kuroyanagi
ce5fd94b97 Add jni method to update entries for a word efficiently. 
Bug: 14425059
Change-Id: Ic628939ea68cdee17573409883a8403c73b78905
 2014-10-01 17:40:20 +09:00
Keisuke Kuroyanagi
287e155e44 Move HistoricalInfo to property and use it in *Property. 
Bug: 14425059
Change-Id: Icccccabad98fb543c6a6be2844cfc0086d80b739
 2014-10-01 11:39:33 +09:00
Keisuke Kuroyanagi
79bb37d499 Rename BigramProperty to NgramProperty. 
Remaining work is changing bigram to ngram for supporting
ngram entry counting, dumping, and migration.

Bug: 14425059
Change-Id: Ifba288a1166996d62a5e57698f63537ea0a2a8ee
 2014-09-29 19:10:39 +09:00
Keisuke Kuroyanagi
2842e50c4b Use std::move for dictionary properties. 
Change-Id: I15056b36b7493f4bac1dbcbb46a0b44343ede153
 2014-09-25 11:36:52 +09:00
Jean Chalard
6da9b21191 [ML8] Add a language weight 
...and rename an improperly named normalization value

Bug: 11230254
Change-Id: I0f5633148a9f66dbfd7d28540b8a8985131c4549
 2014-09-19 13:44:42 +09:00
Keisuke Kuroyanagi
8806248386 Pass prevWordCount to native code for getSuggestion. 
Bug: 14425059
Change-Id: Id2b49a448982c997e5c0a22445b115e675156c3e
 2014-09-18 19:18:55 +09:00
Keisuke Kuroyanagi
3e75c59133 Use CodePointArrayView in Dictionary. 
Change-Id: I63fa0a8348f6de6ec7a424a8033e936b4af72beb
 2014-09-17 20:13:36 +09:00
Keisuke Kuroyanagi
6ae4d79d81 Use IntArrayView for dictionary structure policy. 
Change-Id: I0dc94908259d70d5085ff22abf422d90affb1452
 2014-08-27 20:28:43 +09:00
Keisuke Kuroyanagi
c152d7c19d Fix unit tests that use getNgramProbabilityNative(). 
Change-Id: I8548094bc8d1a0ea125b29e2a0ea82a6834b3e48
 2014-06-26 19:34:27 +09:00
Keisuke Kuroyanagi
05b1e0d42f Extend jni method to use multiple previous words. 
Bug: 14425059
Change-Id: I8150e8812ee32f8c713315a234b52e5b3a79d7a0
 2014-06-26 18:47:25 +09:00
Keisuke Kuroyanagi
d58a07666e Merge "Rename jni method for n-gram supporting." 2014-06-24 01:52:26 +00:00
Keisuke Kuroyanagi
83b6ee2538 Rename jni method for n-gram supporting. 
Bug: 14425059
Change-Id: I242d1de5d9db37344f02d8fba9035829794a56c8
 2014-06-25 14:14:40 +09:00
Keisuke Kuroyanagi
88fa47a27d Support migration/dump of Beginning-of-Sentence entries. 
Bug: 14119293
Change-Id: Ie975138f819794d5c34a7a547be5a6117050e084
 2014-06-24 12:37:07 +09:00
Keisuke Kuroyanagi
f7322b166b Make getNextWordAndNextToken output code point count. 
Bug: 14425059
Change-Id: Id1c2927c8a1be0b1680206d444dbdf0c9453dceb
 2014-06-23 19:08:30 +09:00
Keisuke Kuroyanagi
da0ea7603b Merge "Add jni method for removeUnigramEntry()." 2014-06-10 22:31:57 +00:00
Keisuke Kuroyanagi
b4d77eca55 Add jni method for removeUnigramEntry(). 
Bug: 15552347
Change-Id: Iadcdc73d3335d561a27b9314d3fcdab0b0c96e49
 2014-06-12 12:21:44 +09:00
Keisuke Kuroyanagi
22931cd941 Enable Beginning-of-Sentence prediction for contextual dict. 
Bug: 14161647
Bug: 14119293
Change-Id: I0c00f13966db88e4de85e245e7bced43c9d474b2
 2014-06-12 12:26:18 +09:00
Keisuke Kuroyanagi
d9b8602f48 Implement getMaxProbabilityOfExactMatches(). 
Bug: 13142176
Bug: 15428247
Change-Id: I5be6d683be95505412615ca7c88260de1ea05f54
 2014-06-06 17:37:46 +09:00
Keisuke Kuroyanagi
d6b89e17a6 Add jni method for getMaxFrequencyOfExactMatches(). 
Bug: 13142176
Bug: 15428247
Change-Id: I2ae25090b67ad0c6df97dec7712e2f7e0bb08c40
 2014-06-05 18:16:11 +09:00
Keisuke Kuroyanagi
dfca51726e Return whether the dynamic dict operation was success. 
Bug: 12184250
Change-Id: Iee7e00c1e84c95551a077f4dd023c0a9b9ac9466
 2014-05-27 17:30:00 +09:00
Keisuke Kuroyanagi
1adca93381 Extend jni methods and enable Beginning-of-Sentence. 
Bug: 14119293
Change-Id: I78fc877367dd0d6240eeacb750b6d2d0b93cba83
 2014-05-23 19:58:58 +09:00
Keisuke Kuroyanagi
2a015dcb25 Add Beginning-of-Sentence info in UnigramProperty. 
Bug: 14119293
Bug: 14425059
Change-Id: I8a894352568377d32468e5563f4e89af00d22944
 2014-05-23 00:07:14 +09:00
Keisuke Kuroyanagi
9f8c9a0161 Use PrevWordsInfo to add/remove n(bi)-gram in native code. 
Bug: 14119293
Bug: 14425059
Change-Id: I4b9a46bfd670b35195418eaee51456d44fb91b6d
 2014-05-21 18:30:34 +09:00
Keisuke Kuroyanagi
b87fffb8be Refactoring: Move prev word information into PrevWordsInfo. 
Bug: 14119293
Bug: 14425059

Change-Id: I5a5f81c6b189e3ad1da093343a3121463f87c21c
 2014-05-15 18:39:23 +09:00
Keisuke Kuroyanagi
d6fdd58cc0 Cleanup DicTraverseSession. 
Change-Id: I953665e1958e7214e9365e2bc9d3f3843016dc81
 2014-05-15 17:41:23 +09:00
Keisuke Kuroyanagi
64341927d2 Quit use bigram probability diff for ver4 dict. 
Change-Id: I2cfcfbcf351877d1dff466a24974dbb05908f14e
 2014-05-15 16:02:58 +09:00
Keisuke Kuroyanagi
304a71d171 Use JniDataUtils::putXxxToArray() to output a value. 
Change-Id: Ifb7bed6623b01acb524566a0fe00dcbdf7273888
 2014-05-14 20:05:15 +09:00
Keisuke Kuroyanagi
e9121a68a6 Filter out control characters and non-unicode code points. 
Bug: 14119293
Bug: 13758761
Change-Id: I6b79cff0714152807f5e20b7a75060a0a772b28b
 2014-05-14 20:05:10 +09:00
Keisuke Kuroyanagi
d2f7cd28ae Use JniDataUtils::outputCodePoints() to output code points 
Bug: 14119293
Bug: 13758761

Change-Id: I516d2f96e219e6e65246f502186ccb9bd5f0670f
 2014-05-14 17:42:47 +09:00
Keisuke Kuroyanagi
620a05ae59 Support bigram historical information migration. 
Bug: 13406708
Change-Id: I4bae53e43cb7653eac3b5bd13da2d2bc8aaf88a9
 2014-05-13 01:28:30 +09:00
Keisuke Kuroyanagi
9d7e8c717f Support unigram historical information migration. 
Bug: 13406708
Change-Id: Ibed15b3bc5d5ae68faefa379028dbe10d32b0c0f
 2014-05-12 19:21:06 +09:00
Keisuke Kuroyanagi
8a9d9de72a Implement migrateNative(). 
Bug: 13406708
Change-Id: Ie786a68e780baa298fedf82d21390ba45d871a52
 2014-05-08 12:31:32 +09:00
Keisuke Kuroyanagi
1471fbad66 Extend jni interface for dictionary migration. 
Bug: 13406708

Change-Id: Iadad6df296467d0e5b631fba4a409d53c8a5a6f2
 2014-05-08 12:31:04 +09:00
Keisuke Kuroyanagi
903be5bbd3 Implement latinime_BinaryDictionary_createOnMemory(). 
Bug: 14166482
Change-Id: If7ec3345ab34edcd6bc5cef9e72580ced894a0e3
 2014-04-22 12:01:22 -07:00
Keisuke Kuroyanagi
61cb852d33 Add jni interface to use on memory dictionary. 
Bug; 14166482

Change-Id: I33ab08dad1e39aa7617d391f7eb2561d6f2504bb
 2014-04-21 19:59:09 -07:00
Keisuke Kuroyanagi
793124855d Make addUnigramWord use UnigramProperty. 
Bug: 13406708
Change-Id: I10c108dd7047fe230c60495f13800f32fdc46d0d
 2014-04-14 18:49:19 +09:00
Keisuke Kuroyanagi
e41b2ed8d3 Separate unigram/bigram property from WordProperty. 
Bug: 13406708

Change-Id: I48e9fccedd9dcdc1a35ffe027745b58966a83315
 2014-04-08 18:24:06 +09:00
Keisuke Kuroyanagi
de2b312c6d Use same language weight for all dictionaries. 
Bug: 8187060
Change-Id: Ib9d8a8aed2c141137c1bb3c748a89fb8216293e7
 2014-04-03 01:43:36 +09:00
Keisuke Kuroyanagi
1de95ceada Extend jni interface to input/output languageWeight. 
Bug: 8187060
Change-Id: Ic55d328b87f258f4d65fff207233789a53b2b0ff
 2014-04-03 01:01:51 +09:00