nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
9535 commits 1 branch 0 tags 363 MiB
Commit graph

48 commits

Author SHA1 Message Date
Jean Chalard
5f9e008d60 am 005f3768: am 25b4a14e: am d03e065b: Don\'t consider non-words for split word suggestion 
* commit '005f3768400ce1d7bb29ef69151183084aceeb2c':
  Don't consider non-words for split word suggestion
 2012-10-17 17:06:11 -07:00
Jean Chalard
d03e065b86 Don't consider non-words for split word suggestion 
Bug: 7368683
Change-Id: Iecd8348be788e5a749dafabdf7eddc4a14d901e0
 2012-10-18 07:28:18 +09:00
Ken Wakasa
b02ee3d67a Make use of the NELEMS and KEYCODE_SPACE macro. Also, remove an unused parameter. 
Change-Id: I3c7e6c59990c92b0d5e2fb80493e8673cdd37b09
 2012-10-09 11:17:50 +09:00
Keisuke Kuroyanagi
1cd7ca9919 Using isSkippableChar instead of '\'' and '-'. 
Change-Id: I295a72b683b2ebc28a006baa66baf7e1b97100eb
 2012-09-14 18:03:10 +09:00
Ken Wakasa
7914e907b5 Add comments for meaningless lines 
Change-Id: I20ebe246f6980fd3054c2c7e98b5150eaabbcc77
 2012-09-07 08:55:16 +09:00
Jean Chalard
18ebba3a66 Fix one-off bugs reported by Valgrind 
Bug: 7108990
Change-Id: I40ba30f50a26b65bcac905fc005ad6bb9cb034cc
 2012-09-06 20:37:55 +09:00
Ken Wakasa
f2789819bd Cosmetic fixes and a bug fix in UnigramDictionary::testCharGroupForContinuedLikeness(). 
This change has actually been extracted from a change work in progress I4fe423834b8131fb122251892c98228a6e08ba25

Change-Id: I52568fa09da2ea22be7f8bfe9676b7cd73c31fa4
 2012-09-04 14:23:37 +09:00
Jean Chalard
72b1c93941 Reinstate the shortcut-only attribute 
Also add the blacklist attribute

Bug: 7005742
Bug: 2704000
Change-Id: Icbe60bdf25bfb098d9e3f20870be30d6aef07c9d
 2012-08-31 22:11:52 +09:00
Satoshi Kataoka
687a244703 Step 38-A Cleanup touch path 
Change-Id: I9bfac98b9ac10f3812290f21673c4002241eae01
 2012-08-23 18:15:43 +09:00
Jean Chalard
8af8c15c6b Allow one-character suggestions. 
Bug: 6906525
Change-Id: I62117653ac1281f825afc4ebb30f7e786902b750
 2012-08-17 11:10:58 +09:00
Jean Chalard
b14fc88e48 Tag the whitelisted entries in native code. 
Since this is already used in Java land, this actually does
activate the whitelist path, and the code is now fully
functional. We still have to remove the old whitelist resource
and to compile the dictionary that includes the whitelist.

Bug: 6906525
Change-Id: Iacde5313e303b9ed792940efaf6bcfa4ee1317bd
 2012-08-13 16:35:59 +09:00
Jean Chalard
926ef06a1e Pass the type from native code all the way to Java. 
Bug: 6906525
Change-Id: I057390d47a223450e22d8338509e22c28fc0d5f6
 2012-08-10 15:51:55 +09:00
Ken Wakasa
77e8e81ad9 Header cleanup. Moved a couple of functions from .h to .cpp. 
Change-Id: Ifd12a7632f75395bd0ef5e394d5c2abd6cbe28c6
 2012-08-02 20:19:39 +09:00
Jean Chalard
195605084e Move flags belonging to BinaryFormat to the right place. 
These masks and flags are constants that are an integral part
of the format. They belong in BinaryFormat and have nothing to
do in UnigramDictionary.
This needs I6751dda4 to not break the build

Bug: 6429243
Change-Id: Ic1c842b3245f7fdc25aa8d1459c5bb07b262e265
 2012-08-01 00:23:52 +09:00
Ken Wakasa
f1008c5501 Cleanup headers 
Change-Id: I9124366b2000cad54966fb6936bb4691bbf115a3
 2012-07-31 18:45:26 +09:00
Ken Wakasa
5460ea389d Misc cleanups 
Change-Id: I28308f12c3064299acefc346b72279036c3726a7
 2012-07-30 16:27:44 +09:00
Ken Wakasa
0bbb917d12 Cosmetic fixes and style fixes 
Change-Id: I69c42ff945cdf0d5205c6ca61d6861a0479492dc
 2012-07-25 18:56:51 +09:00
Jean Chalard
6931df9c17 Pass an array to output suggestion types (A119a) 
This needs the matching A119b change to not break the build.
The array is passed, but not used yet.

Bug: 6166228
Change-Id: Ia91d658461d989ee8c94e9b31bb06f4a36f4c5b6
 2012-07-12 19:21:42 +09:00
Jean Chalard
e9a86e2cdb Search bigrams for the lower case version of the word (A46) 
...if there aren't any for the exact case version.

Bug: 6752830
Change-Id: I2737148b01ba04a64febe009ceb2ef53c265d224
 2012-07-04 20:12:58 +09:00
satok
b1ed1d47ac Make native bigram dictionary const 
Change-Id: Id883f2d69483c9234877ad42446a582258e1cf91
 2012-06-14 18:01:27 -07:00
satok
1bc038c5e4 Move correction state to stack memory 
*Before
(0)  13.18 (0.01%)
(1)  93025.41 (62.06%)
(2)  10.75 (0.01%)
(3)  10.50 (0.01%)
(4)  117.50 (0.08%)
(5)  55678.98 (37.14%)
(6)  9.09 (0.01%)
(20) 883.84 (0.59%)
Total 149898.24 (sum of others 149749.25)

*After
(0)  17.41 (0.01%)
(1)  92673.41 (61.95%)
(2)  10.62 (0.01%)
(3)  10.37 (0.01%)
(4)  120.96 (0.08%)
(5)  55741.18 (37.26%)
(6)  11.01 (0.01%)
(20) 862.72 (0.58%)
Total 149595.52 (sum of others 149447.68)

Change-Id: Ia5a25a544fc388e4dab1e08d8f78d5117b249cf3
 2012-06-14 15:57:28 -07:00
Satoshi Kataoka
6bc051d291 Refactor step3: const unigram_dictionary 
- make all functions in unigram_dictionary const

Change-Id: I94a64865aa793435e6c81890e68d999f6374074e
 2012-06-08 20:04:36 +09:00
Satoshi Kataoka
4a3db7057f refactor native step 2 
- proximity_info is now stateless

Change-Id: I62725bfe05b161fa8fc050ea6b50867e10a354e2
 2012-06-08 18:14:49 +09:00
Satoshi Kataoka
3e8c58f68d Separate state from proximity_info step1 
Bug: 6548943

Change-Id: I7b4fbe20615a28151a74875be43b9f4a20e0dce9
 2012-06-07 13:35:34 +09:00
Satoshi Kataoka
02963c4032 am fb3fdf15: Merge "Enhance the safety net in multiple word suggestions" into jb-dev 
* commit 'fb3fdf15040cb67c311047dea0144fa5aa071185':
  Enhance the safety net in multiple word suggestions
 2012-05-31 01:14:57 -07:00
Satoshi Kataoka
67e3cc8488 Enhance the safety net in multiple word suggestions 
Bug: 6576793

Change-Id: I97100b482d3cf4e1b417c197b5d1e971a72b998d
 2012-05-31 17:07:31 +09:00
Satoshi Kataoka
d8096b1a12 am 6cbe204f: Fix the performance issue on suggesting aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 
* commit '6cbe204fce109fab652da15f4c8ea1ae35fca3e7':
  Fix the performance issue on suggesting aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 2012-05-30 02:50:29 -07:00
Satoshi Kataoka
6cbe204fce Fix the performance issue on suggesting aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 
Bug: 6576793

Change-Id: I46f56654cd25dc28668ad75ac71e0e3beb8cdcf3
 2012-05-30 18:43:23 +09:00
Satoshi Kataoka
40ab25cab0 am 51705efc: Merge "Add a JNI to get the frequency" into jb-dev 
* commit '51705efc96c1c555cf9e0f557ea8cdc1c1c97781':
  Add a JNI to get the frequency
 2012-05-29 01:30:26 -07:00
Satoshi Kataoka
2f854e170c Add a JNI to get the frequency 
Bug: 4192129
Change-Id: I3f220f5a10114d4eb23956148076cf76220bda0f
 2012-05-29 17:21:59 +09:00
satok
074e8c9206 am a0ac31fc: Fix the issue on multiple words suggestion 
* commit 'a0ac31fcaa01c21592a6e7af243c14dada65cf3e':
  Fix the issue on multiple words suggestion
 2012-05-23 05:06:08 -07:00
satok
a0ac31fcaa Fix the issue on multiple words suggestion 
Bug: 6509844
Change-Id: I823074a2b29befc3e60c63699ab4dc7719105c63
 2012-05-23 20:40:59 +09:00
Jean-Baptiste Queru
cd7c41352f Fix build 
Change-Id: I799811aa3afb59bba2e4086a063f5da03669bba3
 2012-05-16 16:56:11 -07:00
Ken Wakasa
3b088a2f36 Add missing includes. 
Change-Id: Ic7199045d0cffb208871f52cc167194013351d32
 2012-05-16 23:05:32 +09:00
satok
0028ed3627 Use "float" instead of "double" 
Change-Id: I93ed4d88ede4058f081dd8d634b00dfff4e96d07
 2012-05-16 20:45:05 +09:00
satok
db1939dbaa Reorder suggestions result according to auto correction threshold 
Bug: 5413904
Change-Id: I3aa3a8109ba45d2129b58d8242866fd3dd3473cb
 2012-05-16 19:58:48 +09:00
Jean Chalard
49ba135fde Perform the actual bigram frequency lookup. 
This still returns the unigram frequency, because the values stored
for bigrams in the dictionary are not ready to be returned in-place
instead of unigram values. Aside from this, the code is complete.

Bug: 6313806
Change-Id: If7bb7b644730782277f0f6663334c170b7fe13fb
 2012-05-10 20:01:44 +09:00
Jean Chalard
8950ce6c44 Replace the bigram list position with the map and filter 
Passing the position will not allow us a reasonable lookup
time. Replace this with a map and bloom filter for very fast
lookup.

Bug: 6313806
Change-Id: I3a61c0001cbc987c1c3c7b8df635d4590a370144
 2012-05-07 17:15:21 +09:00
Jean Chalard
4d9b202c40 Pass the bigram list position from the top level 
The position itself is still a const int = 0 until we have the previous
word passed to the function. This basically does the plumbing.

Bug: 6313806
Change-Id: Ib58995f334fe93e3ff5704d7c79f332017f101ac
 2012-04-24 16:47:09 +09:00
Jean Chalard
171d1809ff Add methods to inverse compute the probability. 
For now the probability is just returned with the same
value it had, but this is some ground work that needs to be
done anyway.

Bug: 6313806
Change-Id: I9bb8b96b294109771208ade558c9ad56932d2f8e
 2012-04-24 09:40:44 +09:00
Jean Chalard
522a04ea5b Pass words as int[] to the native code. 
We need to get the bigrams during the call to getSuggestions for
bug#6313806. We already give an int[] to getSuggestions and we
wanted to get rid of char[]'s anyway because it doesn't work with
surrogate pairs, so here we go.

Bug: 6313806
Change-Id: I56ce99f1db6b3302cdf42f0527343bded837091e
 2012-04-23 16:05:36 +09:00
Jean Chalard
338d3ec725 Replace the flags in getSuggestions with a boolean. 
Change-Id: I0ec44df1979cb1dc21017ea290d2151a2af0e7cd

Conflicts:

	java/src/com/android/inputmethod/latin/Suggest.java
 2012-04-06 19:34:48 +09:00
Jean Chalard
aa8df59914 Enable using the flags read from the binary file. 
Change-Id: Ib420c3e174ccc1a80c4b6fd066de3b7a2b6fb290
 2012-04-06 18:54:20 +09:00
Jean Chalard
cd274b1469 Save the flags in a member in the unigram dictionary. 
Change-Id: Ic8fad9110db6b97f98ace27af0f347b4e69de8c8
 2012-04-06 18:34:59 +09:00
Jean Chalard
e81ac8baa0 Add a method to get the flags from a binary dictionary. 
This method is not used yet

Change-Id: Ic15d3d423aff2c83c712bc0aa56571d30755e663
 2012-04-06 18:34:22 +09:00
Jean Chalard
5b0761e6a9 Remove write-only stuff 
Change-Id: I5ac8ab64c77a298502b3d063ea70db9b4da41716
 2012-04-06 17:52:18 +09:00
Jean Chalard
9a933a742d Read shortcuts as strings in the dictionary. 
This has no impact on performance.
Before:
(0)  9.61 (0.01%)
(1)  57514.58 (56.70%)
(2)  10.55 (0.01%)
(3)  10.79 (0.01%)
(4)  133.20 (0.13%)
(5)  43553.87 (42.94%)
(6)  10.03 (0.01%)
(20) 47.20 (0.05%)
Total 101431.47 (sum of others 101289.84)

After:
(0)  10.52 (0.01%)
(1)  56311.16 (56.66%)
(2)  13.40 (0.01%)
(3)  10.98 (0.01%)
(4)  136.72 (0.14%)
(5)  42707.92 (42.97%)
(6)  9.79 (0.01%)
(20) 51.35 (0.05%)
Total 99390.76 (sum of others 99251.84)

The difference is not significant with regard to measure imprecision

Change-Id: I2e4f1ef7a5e99082e67dd27f56cf4fc432bb48fa
 2012-04-06 16:22:08 +09:00
Ken Wakasa
3ef3e24a12 Move the "src" directory as a preparation for Ib4a47342 and I66f6c5b9 
Change-Id: I3ab65059f6e356530484bfd0bba26a634a4cba65
 2012-03-30 09:53:51 +09:00
Renamed from native/src/unigram_dictionary.cpp (Browse further)