nyancrimew
/
LatinIME
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
41,323 Commits
1 Branch
0 Tags
363 MiB
Commit Graph

7 Commits (6d4054689ca9649455106841630c72397d939cae)

Author SHA1 Message Date
Adrian Velicu 8dd31a28ae Update dictionaries (possibly_offensive flag) 
Correctly encoding possibly offensive words with their correct
frequency and the possibly_offensive flag set.

Continuing to encode with zero frequency only distracters or
words that should never come up.

https://paste.googleplex.com/5167060875214848

Bug: 11031090
Change-Id: Ia394b1827f292ff8d4791cc2f3e6e50b5aff4cbe
 2014-10-31 14:49:24 +09:00
Jean Chalard 004cec01a9 Update all dicts to version 44. 
Bug: 13164302
Change-Id: I8dc1a839c7dcfaa08a53e26cb6600e9f871447ce
 2014-02-24 21:27:25 +09:00
Jean Chalard a267ebed5a Update dictionaries 
Add KitKat to all dictionaries.
Version
da, fi, pl : 29 → 40
cs, de, hr, it, lt, lv, nb, nl, sl, sr, sv, tr : 35 → 40
es : 36 → 40
en_gb, en_us, en, fr, pt_br, pt_pt : 39 → 40

Bug: 10958192
Change-Id: I14436616285ced5eb3b70b8c44b9243da94eed4f
 2013-09-30 07:12:03 +00:00
Jean Chalard ffe7dbbe7a Update dictionaries 
>>> dictionaries/cs_wordlist.combined.gz
Header :
  date : 1355802831 <=> 1372393817
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/de_wordlist.combined.gz
Header :
  date : 1355802835 <=> 1372393817
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/en_GB_wordlist.combined.gz
Header :
  date : 1366272052 <=> 1372393817
  version : 31 <=> 35
Body :
Deleted: Sea 126
Added: LTE 25

>>> dictionaries/en_US_wordlist.combined.gz
Header :
  date : 1366272093 <=> 1372393817
  version : 31 <=> 35
Body :
Added: LTE 25

>>> dictionaries/en_wordlist.combined.gz
Header :
  date : 1366272977 <=> 1372393837
  version : 31 <=> 35
Body :
Deleted: Sea 126
Added: LTE 25

>>> dictionaries/es_wordlist.combined.gz
Header :
  date : 1355802832 <=> 1372393817
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/fr_wordlist.combined.gz
Header :
  date : 1366272255 <=> 1372393818
  version : 31 <=> 35
Body :
Deleted: R'n'B 95
Deleted: count 60
Deleted: d'Inti 34
Added: beurk 25

>>> dictionaries/hr_wordlist.combined.gz
Header :
  date : 1355802836 <=> 1372393818
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/it_wordlist.combined.gz
Header :
  date : 1355802836 <=> 1372393818
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/lt_wordlist.combined.gz
Header :
  date : 1355802843 <=> 1372393818
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/lv_wordlist.combined.gz
Header :
  date : 1355802843 <=> 1372393818
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/nb_wordlist.combined.gz
Header :
  date : 1366003450 <=> 1372393818
  version : 31 <=> 35
Body :
Added: LTE 25

>>> dictionaries/nl_wordlist.combined.gz
Header :
  date : 1355802844 <=> 1372393818
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/ru_wordlist.combined.gz
Header :
  date : 1370244430 <=> 1372393835
  version : 34 <=> 35
Body :
Freq changed: связывание 93 -> 0

>>> dictionaries/sl_wordlist.combined.gz
Header :
  date : 1355802835 <=> 1372393835
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/sr_wordlist.combined.gz
Header :
  date : 1355802853 <=> 1372393835
  version : 29 <=> 35
Body :
Added: LTE 25

>>> dictionaries/sv_wordlist.combined.gz
Header :
  date : 1366003804 <=> 1372393836
  version : 31 <=> 35
Body :
Added: LTE 25

>>> dictionaries/tr_wordlist.combined.gz
Header :
  date : 1355802858 <=> 1372393837
  version : 29 <=> 35
Body :
Added: LTE 25

>>> java/res/raw/main_de.dict
Header :
  date : 1355802835 <=> 1372393817
  version : 29 <=> 35
Body :
Added: LTE 25

>>> java/res/raw/main_en.dict
Header :
  date : 1366272977 <=> 1372393837
  version : 31 <=> 35
Body :
Deleted: Sea 126
Added: LTE 25

>>> java/res/raw/main_es.dict
Header :
  date : 1355802832 <=> 1372393817
  version : 29 <=> 35
Body :
Added: LTE 25

>>> java/res/raw/main_fr.dict
Header :
  date : 1366272255 <=> 1372393818
  version : 31 <=> 35
Body :
Deleted: R'n'B 95
Deleted: count 60
Deleted: d'Inti 34
Added: beurk 25

>>> java/res/raw/main_it.dict
Header :
  date : 1355802836 <=> 1372393818
  version : 29 <=> 35
Body :
Added: LTE 25

>>> java/res/raw/main_ru.dict
Header :
  date : 1370244430 <=> 1372393835
  version : 34 <=> 35
Body :
Freq changed: связывание 93 -> 0

Bug: 9301610
Bug: 9607966
Change-Id: I1117ed85d97fbb0ee50f11bc31776f1970b56f12
 2013-06-28 14:54:51 +09:00
Jean Chalard da175bdcb1 Update dictionaries 
>>> dictionaries/en_GB_wordlist.combined.gz
Header :
  date : 1355802832 <=> 1366003032
  version : 29 <=> 31
Body :
Deleted: HTTP 95
Deleted: WWW 72
Added: mm 135

>>> dictionaries/en_US_wordlist.combined.gz
Header :
  date : 1355112451 <=> 1366003070
  version : 28 <=> 31
Body :
Deleted: HTTP 95
Deleted: WWW 71
Added: mm 135

>>> dictionaries/en_wordlist.combined.gz
Header :
  date : 1355802851 <=> 1366003861
  version : 29 <=> 31
Body :
Deleted: HTTP 95
Deleted: WWW 71
Added: mm 135

>>> dictionaries/fr_wordlist.combined.gz
Header :
  date : 1357617878 <=> 1366003217
  version : 29 <=> 31
Body :
Not a word: re false -> true
Shortcut added: re le 15

>>> dictionaries/nb_wordlist.combined.gz
Header :
  date : 1355802836 <=> 1366003450
  version : 29 <=> 31
Body :
Freq changed: iPhone 91 -> 30
Added: app 30

>>> dictionaries/ru_wordlist.combined.gz
Header :
  date : 1358763720 <=> 1366003693
  version : 30 <=> 31
Body :
Freq changed: за 140 -> 181
Freq changed: не 140 -> 191
Freq changed: про 131 -> 151
Freq changed: эры 125 -> 140

>>> dictionaries/sv_wordlist.combined.gz
Header :
  date : 1355802856 <=> 1366003804
  version : 29 <=> 31
Body :
Added: vi 180

>>> java/res/raw/main_en.dict
Header :
  date : 1355802851 <=> 1366003861
  version : 29 <=> 31
Body :
Deleted: HTTP 95
Deleted: WWW 71
Added: mm 135

>>> java/res/raw/main_fr.dict
Header :
  date : 1357617878 <=> 1366003217
  version : 29 <=> 31
Body :
Not a word: re false -> true
Shortcut added: re le 15

>>> java/res/raw/main_ru.dict
Header :
  date : 1358763720 <=> 1366003693
  version : 30 <=> 31
Body :
Freq changed: за 140 -> 181
Freq changed: не 140 -> 191
Freq changed: про 131 -> 151
Freq changed: эры 125 -> 140

Bug: 8560415
Bug: 7556679
Change-Id: If1c628edcb1cc5efd67e1715acf94f19c0eb4643
 2013-04-15 14:51:02 +09:00
Jean Chalard 21dbe3701c Update dictionaries 
cs, da, de, el, es, fi, fr, hr, it, lt, lv, nb, nl, pl,
pt_BR, pt_PT, sl, sr, sv, tr : rescale frequencies to match
spec. This has no large effect in the practice except the
dictionary will become stronger vs spatial model (especially in
lower count corpora, like lt, lv, sr)
en* : Small changes (rounding going the other way essentially)
ru : the above rescaling, and remove the following words:
Дре, ОСТа, Планше, легкими, легком, легкому, легкости,
легкую, нелегкие, нелегкий, нелегким, нелегкое, нелегкой,
нелегкую, полулегком and add нелёгкие, нелёгкое, нелёгкую;
other accented forms were already in the dictionary.

Change-Id: I40386c2ebd4d2be38874e822bde89db7cb512ae6
 2012-12-18 13:06:48 +09:00
Jean Chalard a424ff06ec Switch the AOSP word lists to the combined format. 
This will help with managing the word lists.

Bug: 7388859
Change-Id: I89f049569b177d3027fe56d6c67eaca27d44dc7d
 2012-10-31 18:52:00 +09:00