nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
38889 commits 1 branch 0 tags 363 MiB
Commit graph

50 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
88bc312ad3 Move dictionary code to top level dictionary dir. 
Bug: 18725954
Change-Id: Ia442ba4b5d84311057d83edf6e7aeb151d6a820b
 2014-12-17 16:02:09 +09:00
Keisuke Kuroyanagi
580420d21b Implement IntArrayView::split for dicttoolkit. 
Bug: 10059681
Change-Id: Ic29e79d049bb532727cf5cb1e529fec5d35156ed
 2014-11-11 15:06:48 +09:00
Keisuke Kuroyanagi
ea468cc9de Update v4 format version from 402 to 403. 
Without personalization:
Total words: 1134774, Success Num: 899230, Success Percentage: 79.243%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1871, Bad Failure Percentage: 0.165%
Failures, with auto-correction (F-C): 29084, F-C Percentage: 2.563%
Max Keystrokes: 6072959, Min Keystrokes: 4436090, Keystroke Saving Percentage:26.953%

Before:
Total words: 1134646, Success Num: 925194, Success Percentage: 81.540%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1316, Bad Failure Percentage: 0.116%
Failures, with auto-correction (F-C): 28288, F-C Percentage: 2.493%
Max Keystrokes: 6072831, Min Keystrokes: 3946188, Keystroke Saving Percentage:35.019%

After
Total words: 1134659, Success Num: 944746, Success Percentage: 83.263%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1258, Bad Failure Percentage: 0.111%
Failures, with auto-correction (F-C): 28016, F-C Percentage: 2.469%
Max Keystrokes: 6072844, Min Keystrokes: 3387333, Keystroke Saving Percentage:44.222%

Change-Id: I3af42ec37a11847c0429c28616e726f6a339247f
 2014-10-31 17:23:39 +09:00
Keisuke Kuroyanagi
2383575d2d Change v403 historical info format. 
count -> 2B, level -> 0B.

Change-Id: I3b241126f56eb33cdf09cb1ebfed04f534e4ec48
 2014-10-31 17:22:13 +09:00
Keisuke Kuroyanagi
0cd1f222fd Fix: native unit test build. 
Change-Id: Id2bd4b60d6a4023815a630ebb3059a435b72c193
 2014-10-31 12:50:45 +09:00
Keisuke Kuroyanagi
0a9c3f30b6 Add method to encode probability. 
Bug: 14425059
Change-Id: I3e5d359ba5fa38f1669f0e98dfae792ff53efbf8
 2014-10-30 12:42:35 +09:00
Keisuke Kuroyanagi
6b0561f9d2 Add a class to have global counters for LanguageModelDictContent. 
Bug: 14425059
Change-Id: I08ec19903432356b6028853fd73b4eefce20218e
 2014-10-29 21:05:41 +09:00
Keisuke Kuroyanagi
287e155e44 Move HistoricalInfo to property and use it in *Property. 
Bug: 14425059
Change-Id: Icccccabad98fb543c6a6be2844cfc0086d80b739
 2014-10-01 11:39:33 +09:00
Keisuke Kuroyanagi
2842e50c4b Use std::move for dictionary properties. 
Change-Id: I15056b36b7493f4bac1dbcbb46a0b44343ede153
 2014-09-25 11:36:52 +09:00
Keisuke Kuroyanagi
bd0ac97917 Fix: native unit test. 
Bug: 14425059
Change-Id: I7c5103eac35e01a5732f1f4594d730df06dfca96
 2014-09-24 15:26:26 +09:00
Akifumi Yoshimoto
fb2bde5a68 Native side reads character table 
Bug:17097992
Change-Id: Ibcfc67833a6754fe6a2d82a3e3023b33886b9ea2
 2014-09-19 18:00:16 +09:00
Keisuke Kuroyanagi
09c154925f Add firstOrDefault and lastOrDefault to IntArrayView. 
Change-Id: I854c02eff3fa0b53c72a5f1cabce001f4854ada0
 2014-09-17 21:16:31 +09:00
Keisuke Kuroyanagi
4926b90ec5 Support n-gram for look-up. 
Bug: 14425059
Change-Id: I19523c29fb802cd65158c7540d1608e7f55c4ca7
 2014-09-17 16:20:00 +09:00
Keisuke Kuroyanagi
7eb6e28b9e Update input checking logic for adding/removing n-gram. 
Bug: 14425059
Change-Id: Ifb4e3c3f06aaf9a16f632ff208ba76cf741cea83
 2014-09-16 14:14:22 +09:00
Keisuke Kuroyanagi
36ba139ca6 Support decaying dict in getWordProbability(). 
Bug: 14425059
Change-Id: I24db3f9131c2999fc388035dc365c7faaef3bdb1
 2014-09-14 17:29:50 +09:00
Keisuke Kuroyanagi
537f6eea8a Use WordIdArrayView for prevWordIds. 
Bug: 14425059
Change-Id: Ia84fb997d89564e60111b46ca83bbfa3b187f316
 2014-09-11 19:36:22 +09:00
Keisuke Kuroyanagi
a3b0eb1685 Implement IntArrayView.copyToBuffer(). 
Bug: 14425059
Change-Id: Ic1b7de72701eae0c0b1bb28d12514099446a66a9
 2014-09-11 15:21:52 +09:00
Keisuke Kuroyanagi
395fe8e98d Implement LanguageModelDictContent.getWordProbability(). 
Bug: 14425059
Change-Id: I290a05cee6f341caa25fb222892505529cef1eb7
 2014-09-10 19:51:12 +09:00
Keisuke Kuroyanagi
5d95e8d747 Add FormatUtilsTest. 
Change-Id: I39ee1d18e0b70d9f4504d29a94cabc9354e4527e
 2014-09-09 14:10:53 +09:00
Keisuke Kuroyanagi
fbddeedff6 Add HeaderReadWriteUtilsTest 
Change-Id: I08aeaa3e5852008874e38ed4799ab8989759e861
 2014-09-04 15:32:30 +09:00
Keisuke Kuroyanagi
29dcf97e74 Add CharUtilsTest. 
Change-Id: I69b57d88a5376393b5d09d8b8e056c82cb8b8a3c
 2014-09-03 13:57:32 +09:00
Keisuke Kuroyanagi
69732169cc Add DamerauLevenshteinEditDistancePolicyTest 
Change-Id: Ia36bc6ddd0ec553fee151153061428c7c66d32d2
 2014-09-02 19:47:43 +09:00
Keisuke Kuroyanagi
985b2c2e91 Add GeometryUtilsTest. 
Change-Id: I6ea9ef137c2930ca8e8745fec829b9bcaf1d10b9
 2014-09-02 17:10:42 +09:00
Keisuke Kuroyanagi
93e3b5a16f Add TerminalPositionLookupTableTest. 
Change-Id: I4a3ab4c94a7759d7f24c7edc9c167fe6bbdd3eb7
 2014-08-29 14:16:15 +09:00
Keisuke Kuroyanagi
40b6d6cbd1 Add DicNodePoolTest. 
Change-Id: I9bec708def3af6bea1c82b9576b80ce1b7901ddc
 2014-08-29 13:02:22 +09:00
Keisuke Kuroyanagi
e394a0c6ff Implement IntArrayView::skip(). 
Change-Id: Ib7f13963ac1d9c64eff2c08391154c6a25024126
 2014-08-28 12:12:56 +09:00
Keisuke Kuroyanagi
82f7d3a9de Merge "Add a method to iterate entries in LanguageModelDictContent." 2014-08-27 10:35:38 +00:00
Keisuke Kuroyanagi
78aea9f133 Add TimeKeeperTest. 
Change-Id: Id35823414f8552fd6820a5a559d6c9d54c7d6cb6
 2014-08-27 14:39:27 +09:00
Keisuke Kuroyanagi
07b3b41c25 Add a method to iterate entries in LanguageModelDictContent. 
Bug: 14425059
Change-Id: I4e9c3a97891c020f762fa709f806d333c067f496
 2014-08-26 12:01:08 +09:00
Keisuke Kuroyanagi
30e6b21af0 Add SparseTableTest. 
Change-Id: I5684a24f9584cd326e014274c2298773aa3a91ca
 2014-08-25 22:27:01 +09:00
Keisuke Kuroyanagi
c04ae77583 Add ByteArrayUtilsTest. 
Change-Id: I4695a2573b4d2d8331fc9ce1e9ff83397791a586
 2014-08-25 16:52:12 +09:00
Keisuke Kuroyanagi
9c9f2d06bc Fix TrieMap: Cannot create next level map of small value entry. 
Bug: 14425059
Change-Id: I864f81ea7dd1d847ef2b016366ce046b1c43d5e5
 2014-08-20 20:48:25 +09:00
Keisuke Kuroyanagi
623067a183 Add BoS flag in probability entry. 
Bug: 14425059

Change-Id: I50439630034ada0280c44cbbb308aa0b95b72048
 2014-08-19 11:49:05 +09:00
Keisuke Kuroyanagi
b4531d861e Add method to remove entry from language model dict content. 
Bug: 14425059
Change-Id: Id21af0110e770caa3e95cb5d7ba8b3d1af8e0b12
 2014-08-18 12:34:48 +09:00
Keisuke Kuroyanagi
5fe1bed2e4 Add TrieMap::remove(). 
Bug: 14425059
Change-Id: Ifb9a873eab79efdd6bee8e0da73c0cf37727350e
 2014-08-13 21:10:48 +09:00
Keisuke Kuroyanagi
9a23f0fba2 Add bigrams to language model content. 
Bug: 14425059

Change-Id: Id81e3775ea0104750a23e3dca62c00681ed8dc2e
 2014-08-12 20:32:42 +09:00
Keisuke Kuroyanagi
9069d30043 Use IntArrayView to add/remove n-gram entry. 
Bug: 14425059
Change-Id: I734f12dfde5161abdfb019a6391677dba8984ff4
 2014-08-06 12:52:01 +09:00
Keisuke Kuroyanagi
da8cda0578 Clean up IntArrayViewTest 
Change-Id: I30138f0722571100fe13efc96f8332efde846c2e
 2014-08-06 10:09:02 +09:00
Keisuke Kuroyanagi
03dc44f543 Add/Get n-gram probability entry in languageModelDictContent 
Bug: 14425059
Change-Id: I7926c3812f89b9a71fe1873a5bc32f793f91b640
 2014-08-06 00:42:56 +00:00
Keisuke Kuroyanagi
851e0458fe Remove ProbabilityDictContent and use LanguageModelDictContent 
Bug: 14425059
Change-Id: I1bb9e78ecb24139b87c99be6722e37eec0a2285d
 2014-08-05 14:13:07 +09:00
Keisuke Kuroyanagi
0889484266 Add methods for unigrams to LanguageModelDictContent. 
Bug: 14425059
Change-Id: I0a6b480a3d4735787ffac68c47b4ffefc3f1b8a5
 2014-08-05 12:38:55 +09:00
Keisuke Kuroyanagi
75d8c20d03 Add memory view class for int and uint8_t. 
Bug: 16691311
Change-Id: I32eb692cdb758861e24b772fdcda57642b95ae1b
 2014-08-01 12:39:31 +09:00
Keisuke Kuroyanagi
5c1decfbb9 Add entry iteration method to TrieMap. 
Bug: 14425059
Change-Id: I79420b755f29f651d8eed61e7e48b6eb001d8dd2
 2014-07-30 19:04:07 +09:00
Keisuke Kuroyanagi
de3121dead Add TrieMap. 
Bug: 14425059
Change-Id: Ief36f808ed4f3e35bfab07837ea314d2564973ab
 2014-07-29 17:00:29 +09:00
Keisuke Kuroyanagi
d4c9d50ef0 Add BufferWithExtendablebufferTest 
Bug: 13754552
Change-Id: Ib9c330dc85bdb5d4d3d5bc15cc3ce5f28faa0b12
 2014-07-25 07:02:10 +09:00
Yohei Yukawa
d4dbbd5008 Use C++11 random library 
srand() and its friends are supposed to be discouraged since C++14.
This CL replaces srand() with new C++11 random libraries.

Change-Id: If2c25158c88c674cd3fd6d891559a9e32283e19e
 2014-04-09 17:59:31 +09:00
Keisuke Kuroyanagi
111c05ff35 Add BloomFilterTest. 
Change-Id: If97b9e9cc3bbaa4c7877991c11d7935626268ca3
 2014-04-09 17:15:55 +09:00
Keisuke Kuroyanagi
26c806620c Use 2D normal distribution for gesture. 
Bug: 13799846
Bug: 10701902
Bug: 9505397

Change-Id: I6c3f84f035f2310f2f7dfec4432ebdb6e50d5df0
 2014-04-09 16:50:31 +09:00
Yohei Yukawa
b417d7d69f Make NELEMS type-safe 
Change-Id: I867271665b3c595dc40ac63e93e68c87dc213d08
 2014-04-09 15:51:39 +09:00
Yohei Yukawa
c72652cb00 Add an initial native test on host environment 
This CL adds an initial native test that runs on host
environment, from which we can extend the coverage of native
test.

BUG: 13754552
Change-Id: I0af9d1b5dd049c83b955f5b05add4b39f3cfcc6c
 2014-04-02 14:23:53 +09:00