nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
3121 commits 1 branch 0 tags 363 MiB
Commit graph

93 commits

Author SHA1 Message Date
satok
0f6c8e8aeb Move code related to ranking algorithm to correction_state.cpp 
Change-Id: I52b34de45969fef82e46d9c10079c2d45e0b94eb
 2011-08-03 20:34:19 +09:00
Jean Chalard
588e2f2964 Add bigram lookup implementation. 
Bug: 5046459
Change-Id: Id2c7686c5da078751ed587e559417e808779aa7a
 2011-08-02 18:05:59 +09:00
satok
612c6e49c0 Move code related to ranking algorithm to the correction state 
Change-Id: I2d9e2db81cf6597ca4e88d7bc6737ab3b52b34b2
 2011-08-02 15:44:59 +09:00
satok
db2c0919cf Remove old dictionary format code 
Change-Id: Ic4b9e069c9bd5c088769519f44d0a9ea45acb833
 2011-08-01 16:01:54 +09:00
satok
2df3060883 Add correction state 
Change-Id: I0d281cede1590893bd1def005cf83c9431d12750
 2011-08-01 15:42:09 +09:00
Jean Chalard
6a0e9642a8 Small native refactoring. 
Move a purely dictionary-format-related function that is needed
both by unigrams and bigrams to the binary format handling
file.
Also remove the empty UnigramDictionary::getBigrams placeholder
function, on grounds that it should be in the BigramDictionary
class.

Bug: 5046459
Change-Id: I8a67a25f72122e2fa0b19ae1d936db25eb0b20ba
 2011-07-26 16:13:53 +09:00
Jean Chalard
848b69a5f9 Some refactoring 
Getting the frequency of a terminal is not very useful, however
getting its position will be very useful for retrieving bigrams
later.
Moreover, from the position it's easy to find out the frequency.

Bug: 5046459
Change-Id: Ica53472c2038c7e407dbd1399d336511c731087f
 2011-07-26 15:44:51 +09:00
Jean Chalard
999ba61b34 Some native cleanup 
Take a function that does not need to be a member and make it
static inline.
Also replace the return value of -1 by a #define'd constant.

Change-Id: I92e0deaa1df65998b76aba6329a4c8eb4d287485
 2011-07-22 18:09:48 +09:00
Jean Chalard
f0a9809662 Check the binary dictionary magic number 
...and return NULL if it does not matched an expected value.

Bug: 5052486
Change-Id: I1dc7955d2785ee080bc5c22398be9befe332f096
 2011-07-20 19:43:14 +09:00
satok
d24df43eaf (Step2)Move functions related to proximity to proximity_info.cpp 
Change-Id: Iae0eb2a5cd758bda820fa42b4bc3eb3d2665bf96
 2011-07-14 15:47:32 +09:00
satok
46f2d44a29 Merge "(Step 1) Move proximity related parameters from unigram_dictionary to proximity_info" 2011-07-13 21:30:30 -07:00
satok
1d7eaf8462 (Step 1) Move proximity related parameters from unigram_dictionary to proximity_info 
Change-Id: Ic630b35f4abffeb84c38bcf5935795b7ff07556a
 2011-07-14 13:21:34 +09:00
satok
827ced8486 Separate logging definitions in C 
Change-Id: I1d79814d1fd74e92a280f355c535517618c51752
 2011-07-14 09:01:09 +09:00
satok
787945bf1e Fix build for profiling 
Change-Id: I39cd0fa37fb738dcbbcf82839b6bb030e3af606b
 2011-07-14 08:32:57 +09:00
satok
3e41c071e6 Merge "Add a flag for a profiling" 2011-07-12 23:27:51 -07:00
satok
20d9fdae3a Add a flag for a profiling 
Change-Id: Iae509a24fd0f0f416376c3f8051aa2eb92d48659
 2011-07-13 15:21:10 +09:00
Jean Chalard
0adf7ae299 Merge "New dict format, step 7" 2011-07-12 22:48:45 -07:00
Jean Chalard
1059f27364 New dict format, step 7 
This actually implements the new dictionary format, but does not
activate the implementation through #defines.

Bug: 4392433
Change-Id: I9b26b9bcb4b823a36e0984799b69730acfc6f7f3
 2011-07-13 14:33:48 +09:00
Doug Kwan
ce9efbff53 Compile code used in logging conditionally so that gcc does not complain 
about unused-but-set variables.

Change-Id: I141f438694a1854d54d08cb5a74c23222dd9d85e
 2011-07-08 00:29:11 -07:00
Jean Chalard
bb15e77511 Move a function to make next commit more readable 
Change-Id: Ieaa935ff4d68ce88137dcc5c672a4149a4c9c64f
 2011-06-30 20:14:38 +09:00
Jean Chalard
e6715e32d5 Move a function out of a #endif to reduce a future commit 
Change-Id: Ic8f3160a96b6d79ba19ff9c8eda1692e94a38e98
 2011-06-30 19:47:25 +09:00
Jean Chalard
0584f02ee1 Rename parameters for future change 
Change-Id: Id15a17340fb26f91c72687f30bef24b2d8b94940
 2011-06-30 19:23:16 +09:00
Jean Chalard
432789ac93 Internal cleanup 
Moving functions around, renaming parameters

Change-Id: I3ab480f483d7d9700b9328cb07b16b51005098e5
 2011-06-30 17:50:48 +09:00
Jean Chalard
ffefdb6c1a Cleanup. 
Function renaming, moving around for future patch readability

Change-Id: Id33b961cf2e899b5a3c9189951d2199aba801666
 2011-06-30 17:22:19 +09:00
Jean Chalard
980d6b6fef Internal cleanup. 
Function renaming, useless function supressing, fix comments

Change-Id: I148acbaf367cd556a85b89016676b46cc971af81
 2011-06-30 17:02:23 +09:00
Jean Chalard
594a9a1963 Internal cleanup. 
Removed unused function prototypes.

Change-Id: Ia56ea8e285deed17ce8377df855b045b7850d58d
 2011-06-30 16:51:17 +09:00
Jean Chalard
85a1d1ea74 New dict format, step 6 
Copy the modified functions to be able to see the diff

Bug: 4392433
Change-Id: Ic9b83b4b4b7b89cc922eed1825507d7d516aff24
 2011-06-21 22:24:54 +09:00
Jean Chalard
bc90c72faf New dict format, step 5 
Move functions that will be modified and enclose those that will
be replaced into #ifdefs.
This change does not modify any code, only move some code around.

Bug: 4392433
Change-Id: Ibefbda1eb8bdc8a0c72de47ad9c67a08d0aca960
 2011-06-21 12:15:00 +09:00
Ken Wakasa
ce9e52a12a Clean up in LatinIME native code 
Change-Id: I0062200a0181a491690115ac0fab8d11358e2f14
 2011-06-18 23:52:09 +09:00
Jean Chalard
23eb0fa0b5 Merge "New dict format, step 4" 2011-06-17 05:30:26 -07:00
Jean Chalard
ca5ef2890e New dict format, step 4 
Consolidate terminal cases, streamline the word adding process
and create the entrances for adding alternate spellings with an
empty implementation.

Bug: 4392433
Change-Id: I781c93ec49945d71c7c20624c86596aa49add4c8
 2011-06-17 20:59:21 +09:00
Jean Chalard
4fd9650f0b New dict format, step 3 - followup 
Make the passing of an argument clearer
Bug: 4392433

Change-Id: Id82662ff4dc25282f70a08bee77378fee2b4b590
 2011-06-17 17:08:09 +09:00
Jean Chalard
581335c3fb Fix a bug where bigram search would never return 
Bug: 4690487
Change-Id: Ie8f3f651508cc48bbb043a0b308f7e0d1524371c
 2011-06-17 12:45:17 +09:00
Jean Chalard
17e44a72e8 New dict format, step 3 
Some refactoring and add of a parameter that will be necessary.

Bug: 4392433
Change-Id: I17f001a7efd4f69f4c35f94ee1ca8e97391b81d5
 2011-06-16 23:28:09 +09:00
Jean Chalard
8124e64dcc New dict format, step 2 
Move some methods around and make static some methods

Bug: 4392433
Change-Id: I2bbe98aec118a416d21d1e293638e1d324505b9b
 2011-06-16 22:33:41 +09:00
Jean Chalard
293ece0f34 New dict format, step 1 
This renames some variables and removes dependancies to values that
will disappear

Bug: 4392433
Change-Id: I79a44462d6bf25248cc2de0d63d7918fc6925d68
 2011-06-16 22:18:10 +09:00
Jean Chalard
e93b1f2209 Allow reading a binary dictionary even without proximity info. 
This prepares the way for spell checking, which is to be done
without context so without proximity info.

Bug: 4176026
Change-Id: I1b4bfaefe2611e1b484acdf3c33598cb80f81ff4
 2011-06-02 12:10:13 +09:00
satok
99c908a595 Tweak the demotion rate for the mistyped space correction 
Bug: 4402942

Change-Id: I7f5412b9fd2f1506f529cff0c3399d748c6ece92
 2011-05-24 14:31:06 +09:00
satok
bb68d80119 Tweak the demotion rate of mistyped space correction 
Bug: 4402942

Change-Id: I6e0421dfa99e261c72a901c9699fec864ab4b3c5
 2011-05-23 18:35:29 +09:00
satok
d8db9f86d0 Fix a bug on the calculation of the freq on the mistyped space error correction 
Bug: 4402942

Change-Id: I0b611e3d0e8c25ca528ef7408c3949200e5cad85
 2011-05-18 18:36:54 +09:00
satok
0b6b0a5a98 Enable fast power 
Change-Id: I00a91381f63cde62d9e7cf7e17f75869294cf2df
 2011-04-27 16:29:27 +09:00
satok
b2e5e5937c Handle overflow properly in multiplyRate 
Bug: 3401513
Change-Id: I8dd2523caa58bb51c378a01e160a58f9106ce9b8
 2011-04-26 22:03:26 +09:00
satok
9674f654a7 Fix a bug that 2 length words were demoted. 
Change-Id: I4a3558d0f1f1b0a9d6a36c3f75db3089b0566d7f
 2011-04-20 17:15:27 +09:00
satok
63546344b3 Merge "Promote a word with a missing space because the formula was changed by Ifa4338c5f4" 2011-04-19 07:54:02 -07:00
satok
cbc66e0711 Promote a word with a missing space because the formula was changed by Ifa4338c5f4 
Change-Id: Id4bc965aef387800facb64164d8c36a3bdd2fa07
 2011-04-19 23:48:36 +09:00
satok
4c981d3a40 Demote a word with mistyped space and missing space according to the length of each word 
Change-Id: Ifa4338c5f43b37e6bcd0700767ef2178189de3af
 2011-04-19 23:14:27 +09:00
satok
a4374d2eb7 Promote the correction of words with a missing space character 
Change-Id: I37ba618b54f7115163a3e9c6c555485e7024dc92
 2011-04-18 12:36:11 +09:00
satok
9d2a3020ba Promote a word with a proximity character 
Bug: 4293295

Change-Id: Ib0ec8aff087c71c4fbe983f3f5bc78e9c7868fd8
 2011-04-14 20:30:25 +09:00
satok
72bc17ec9f Promote a word with only one proximity character. 
Bug: 4271049

Change-Id: I755986f582f43417fda6b117207530c519233baf
 2011-04-13 19:11:13 +09:00
satok
dc5301e590 Change the formula of the missing character. 
- Bug: 4271049
- Due to the result of the recent user study, a word with a missing character needs to be promoted a bit.

so I changed the formula from:
- freq * 70 * (n - 2) / (n - 1)
to:
- freq * 90 * (10n - 12) / (10n - 2)

Change-Id: Ibff72cbdb0f2d7b91460a06a0fd39a9f5749aa46
 2011-04-13 10:44:18 +09:00