8b580819a5
Merge "Add unigram/bigram counting."
2013-09-27 14:14:49 +00:00
31097a57cc
Add unigram/bigram counting.
...
Bug: 6669677
Change-Id: I05ea2201d822dddf062b08c8467daa336760e16c
2013-09-27 23:12:12 +09:00
67cb282b64
Add boundary checking for PtNode Array reading.
...
Bug: 6669677
Change-Id: Iea5e19d98d2fc26f137046dd5f8e339239672351
2013-09-27 22:28:54 +09:00
85463c7f40
Merge "Use base lower character to get point to key length."
2013-09-26 08:28:41 +00:00
e639d7346c
Use base lower character to get point to key length.
...
Bug: 9490364
Change-Id: I3755f00ab22f926f087fc917b95a2db7d722fa00
2013-09-26 16:36:05 +09:00
5ef6209656
Create empty dictionary file in native code.
...
Bug: 6669677
Change-Id: I46d23deee1fd091678f4593561cb8687eb815212
2013-09-26 12:59:02 +09:00
10b56df486
Merge "Prepare dictionary file creating in native code."
2013-09-26 02:38:19 +00:00
c6015327fb
Merge "Add empty PtNode checking for PatriciaTriePolicy."
2013-09-26 02:32:03 +00:00
9155eec0d9
Add empty PtNode checking for PatriciaTriePolicy.
...
Bug: 9503570
Change-Id: I784d29c307c1040699fa0aadfc6a47d97f03ffe4
2013-09-26 11:19:04 +09:00
36f4592128
Merge "Refactoring header attribute reading."
2013-09-26 01:57:22 +00:00
1592eb8a3a
Prepare dictionary file creating in native code.
...
Bug: 6669677
Change-Id: I7c476a6e99ec7ac883f05d84ef306265255154da
2013-09-26 10:48:43 +09:00
989596844e
Refactoring header attribute reading.
...
Bug: 6669677
Change-Id: Ifc11da614d5c331ac61019a324e3a0ff187329cd
2013-09-26 10:45:03 +09:00
009dcac33f
Boundary check for children creating of PatriciaTriePolicy.
...
Bug: 10537529
Change-Id: I0cd8b6de230795498395ca08789ccc1c74780f2c
2013-09-25 19:54:31 +09:00
3d2802ef2e
Allow large memory space for GC.
...
Bug: 6669677
Change-Id: I021c92a1ca5cd28f745cbfe729c99e346c58074d
2013-09-24 19:21:17 +09:00
f3cd38f2c7
GC step 5. Add large tests and fix bugs.
...
Bug: 6669677
Change-Id: I41e44a64730f9c66645995095a7ecff51ffd5351
2013-09-24 16:32:25 +09:00
2cfe7f9e3b
GC step 4. Update all positions in new dict and add a test.
...
Bug: 6669677
Change-Id: I035d848a210653dcd3c1a1f21781968adced9225
2013-09-24 15:29:56 +09:00
0355bf2d4c
GC step 3. Place and write valid PtNodes.
...
Bug: 6669677
Change-Id: Id2b7359bafb34acf12dc3bf4c595a03073fda805
2013-09-20 21:11:49 +09:00
77ef75cbe6
GC step 2. Finding garbage bigram entries.
...
Bug: 6669677
Change-Id: Ie3f406776ab56bf589ac10e15e2534ff8cb1f275
2013-09-20 20:04:57 +09:00
2a64726a16
Step 1 to implement GC. Finding garbage PtNodes.
...
Bug: 6669677
Change-Id: I3551fe2f16a09d2bf7761f4e1d73ebd4a03380e7
2013-09-20 15:37:14 +09:00
b7e8a9abf5
Groundwork for implementing GC.
...
Bug: 6669677
Change-Id: Ia2b2f338795ab62cc9eef73731285b2a5a0ac5e4
2013-09-19 14:48:59 +09:00
e28927dfb6
Change name of header_reading_utlis.*
...
Bug: 6669677
Change-Id: I91389050148237580ef640d3a58b935ea752954e
2013-09-18 18:27:01 +09:00
484fa7b59c
Add dictionary header writing methods.
...
Bug: 6669677
Change-Id: I392ac4776b55779903cbaa17e683005d80017a41
2013-09-18 18:08:33 +09:00
72e53a1e38
Merge "Implement dictionary flush."
2013-09-18 05:20:05 +00:00
1560543754
Implement dictionary flush.
...
Bug: 6669677
Change-Id: I1d70ac6319fb6d8700074de382568c2108887960
2013-09-18 13:19:14 +09:00
9465819cf6
Merge "Add BinaryDictionary.getBigramProbabilityNative()."
2013-09-18 04:10:38 +00:00
4d02a2d44d
Add BinaryDictionary.getBigramProbabilityNative().
...
Bug: 10197478
Change-Id: Id16e3ee22a17679c46cc7a0199a9e28065177aa3
2013-09-18 11:18:28 +09:00
4e17b42d0f
Output input index of second word's first char.
...
This is for partial commit.
Bug: 9059617
Change-Id: I77a0245b63c29b7234fd9b06d362e05aebf30051
2013-09-17 20:31:34 +09:00
ac7e005ef0
Merge "Prepare dictionary saving in native code."
2013-09-17 09:18:32 +00:00
d0246277fd
Prepare dictionary saving in native code.
...
Bug: 6669677
Change-Id: I0787f66409e2b183c6328fa05805945520e1e93a
2013-09-17 18:07:16 +09:00
d9f450ef00
Implement removeBigramWords() for DynamicPatriciaTrie.
...
Bug: 6669677
Change-Id: I99cb517511b4c968b8bf937baab5d7f42b0f534e
2013-09-17 18:05:32 +09:00
78b55a31cb
Fix handling multi-bytes characters and add a test.
...
Bug: 6669677
Change-Id: Id2154db47adea2929559a4187a726f9dfa83363e
2013-09-17 15:11:24 +09:00
6d1a29eaab
Fix build.
...
Change-Id: I1c3c2996ca11bfe8864df774e9280893cf17c0d4
2013-09-17 13:03:12 +09:00
cd6a0430c7
Implement addBigramWords() for DynamicPatriciaTrie.
...
Bug: 6669677
Change-Id: Ia6aa76c212165690191c65fee9dacdc44be5acd5
2013-09-17 12:52:21 +09:00
cb816e5e16
Merge NOT_A_VALID_WORD_POS into NOT_A_DICT_POS.
...
Change-Id: I2ac3aa2a19d14e8c4159a59334e7816bd1409688
2013-09-16 18:37:23 +09:00
9ea9c61c99
Move methods using ByteArrayUtils from .h to .cpp.
...
Bug: 10402083
Change-Id: Ic5f1aa11eb403f5bdc83de8e38a6457200519cae
2013-09-16 18:37:08 +09:00
f874728496
Add boundary check for PtNode reading position.
...
Bug: 10743878
Change-Id: I6727b12b0ef98bb9cfb3ca95aeab2c79749f47a2
2013-09-16 18:34:34 +09:00
41aaff6cdf
Merge "[AC4] Add native methods necessary for auto-commit"
2013-09-13 11:41:55 +00:00
24aad5a4d5
[AC4] Add native methods necessary for auto-commit
...
Bug: 9059617
Change-Id: I7a47b0675446fc4f39628c60d16de9aea90d1b4d
2013-09-13 20:15:15 +09:00
04bf3cd4e0
Merge "Employ "bigram link" for handling moved bigram target."
2013-09-13 09:46:27 +00:00
8c69ddb53e
Employ "bigram link" for handling moved bigram target.
...
Bug: 6669677
Change-Id: I9a6c0cdb28265e3215ced88f38344df12c25a76d
2013-09-13 18:36:29 +09:00
ebe3b3e8fd
Merge "Fix bug related to dynamic patricia trie bigram adding."
2013-09-13 05:49:26 +00:00
0243c9ae3d
Update children's parent position when the node get moved.
...
Bug: 6669677
Change-Id: Ifcaf784afd218c7afd70167045cd2aed8b7909c2
2013-09-13 14:26:00 +09:00
1c0fc852f6
Fix bug related to dynamic patricia trie bigram adding.
...
Bug: 6669677
Change-Id: Ia1216a1860a7c5c12a0d8a0816dda8d6a3bea123
2013-09-13 11:38:53 +09:00
4c2767857a
Change cache capacity depending on the dictionary size.
...
Bug: 10699291
Change-Id: I7042d4c1307da2d991d4dd10d637f18026acb996
2013-09-12 18:47:56 +09:00
1b80a45e79
Merge "Make terminal cache small."
2013-09-12 05:21:49 +00:00
80ca7abea3
Make terminal cache small.
...
Bug: 10699291
Before:
(0) 2997.63 (0.98%)
(1) 303760.77 (98.92%)
(2) 274.94 (0.09%)
(66) 0.38 (0.00%)
Total 307062.27 (sum of others 307033.73)
After:
(0) 2953.22 (0.96%)
(1) 304633.86 (98.93%)
(2) 293.76 (0.10%)
(66) 0.38 (0.00%)
Total 307915.65 (sum of others 307881.22)
Change-Id: I6905abeb590ef50d48ddfcd8ef8b5351af399150
2013-09-12 14:18:48 +09:00
f1233b58c2
Use same session id for typing and gesture.
...
Bug: 10699291
Change-Id: I7c8a3a57e8d189b72a17e4b9c6831becee6ec146
2013-09-12 12:08:22 +09:00
f38969f3f8
Fix bug of dictionary dynamic updating methods.
...
Bug: 6669677
Change-Id: I5483adb03e1ac0c27bbfd99d5f4d7cc29809d70a
2013-09-10 22:32:30 +09:00
e531c2241e
Move a flag about switching dynamic update to java.
...
Bug: 6669677
Change-Id: I6aa99cae4a227f9202179c2873d13473a773e024
2013-09-10 18:45:53 +09:00
210669605a
Merge "Fix: ExtendableBuffer"
2013-09-10 06:45:41 +00:00
4e79fb24ab
Fix: ExtendableBuffer
...
Bug: 6669677
Change-Id: I73142fdabac1cbd4128b83c3b26b642b4b4f4da7
2013-09-10 15:40:11 +09:00
216617062a
Merge "Implement split and create node methods."
2013-09-10 06:38:05 +00:00
fdcd67ba15
Implement split and create node methods.
...
Bug: 6669677
Change-Id: Iac4afb637a8ba3d55f7a88f4a532831c1731f93e
2013-09-10 15:27:19 +09:00
c5f35a9c86
Merge "Calculate parent offset from the head of moved node."
2013-09-10 06:08:56 +00:00
9c820de7a1
Calculate parent offset from the head of moved node.
...
Bug: 6669677
Change-Id: I710453f1c37ec14e5b6830595c1afb2caff83cf2
2013-09-10 15:03:44 +09:00
1d4a07f6c7
Merge "Re-call getBuffer after writing in bigram/shortcut policy."
2013-09-10 03:27:30 +00:00
c987120cbc
Re-call getBuffer after writing in bigram/shortcut policy.
...
Bug: 6669677
Change-Id: I35dc290aa9582e019681b8aae49db3f8d37c90d4
2013-09-10 12:12:42 +09:00
a159ad473c
Implement create children array and add child method.
...
Bug: 6669677
Change-Id: Ic89c3dfe01937e771db8fc59d5259496a9464a47
2013-09-09 16:44:17 +09:00
7bd7dc5d0d
Implement update node probability method.
...
Bug: 6669677
Change-Id: I61ac0d05e362fc7d8a967ddd8286580998c70487
2013-09-09 15:29:11 +09:00
3fbc5ef196
Implement inserting new node into PtNode array.
...
Bug: 6669677
Change-Id: I0171476231181e41234dde76ac9061febb2e8c35
2013-09-06 20:40:08 +09:00
40182c737d
Merge "Compute probability using structure policy."
2013-09-06 08:10:07 +00:00
65d19946be
Compute probability using structure policy.
...
Bug: 6669677
Change-Id: Icd50fc30274cce65ebeb2e7cc8368b59e5cda05a
2013-09-06 16:50:09 +09:00
e4dcebe0c3
Add node flags creating methods.
...
Bug: 6669677
Change-Id: Ieb4178da61fa38f6b32baefa099cc0724f9fb6be
2013-09-06 14:56:59 +09:00
96a0631664
DynamicPatriciaTrieWritingUtils to write PtNodes.
...
Bug: 6669677
Change-Id: I67cce3c1d338cf747ed2204c96768907d990d269
2013-09-05 20:12:56 +09:00
2a41a35635
Add code point writing methods for updatable dictionaries.
...
Bug: 6669677
Change-Id: If7ab6fefdb9a7f0d21c397edbb7d9e7fddc0e0db
2013-09-05 14:24:07 +09:00
5901b5e1bd
Check usesForgettingCurve in HeaderPolicy.
...
Bug: 6669677
Change-Id: I47ebfc50f477b2a6514fba6fad421dd90f29ecb1
2013-09-05 12:28:38 +09:00
91486bdb3d
Merge "Employ a header attribute map in headerPolicy."
2013-09-04 10:06:05 +00:00
5754817a5e
Employ a header attribute map in headerPolicy.
...
Bug: 6669677
Change-Id: I4a084cdd7fcd7a8ed3a70fb7e365031eedd981e5
2013-09-04 19:00:53 +09:00
5d8fd5457d
Change name of bigram_list_reading_utils.* .
...
Bug: 6669677
Change-Id: Ifd2baa11fb4ee083be1d23e8235f6f903c1b5747
2013-09-03 20:44:58 +09:00
202e416b51
Add bigram writing methods.
...
Bug: 6669677
Change-Id: Ib62f6c31c4bcbb41ac200dccccb13e366b3c2173
2013-09-03 20:44:51 +09:00
9e3082e016
Add DynamicShortcutListPolicy::copyAllShortcuts().
...
Bug: 6669677
Change-Id: I74959fe3ca59d77ba0279c75f4d72db13735322f
2013-09-03 18:36:53 +09:00
f1cd7a081c
Implement reading side of updating methods of dpt.
...
Reading methods are used to determine the position to
be updated in dynamic patricia trie.
Bug: 6669677
Change-Id: Ie9acdcdbc73aa3fd4294c97aa39451a96b165ed9
2013-09-03 14:47:30 +09:00
75d1cb667d
Add buffer writing methods.
...
Bug: 6669677
Change-Id: Ic3345e36a7842b77598c21de9b54f7c2863df38f
2013-09-02 19:27:01 +09:00
2660f83a12
Change name of extendable_buffer.h to buffer_with_... .
...
Bug: 6669677
Change-Id: Id2bd79d8f86c690d5c16d1ab726c5f6fa28ba5e3
2013-09-02 17:18:41 +09:00
3e76487c6c
Consolidating dict buffers into BufferWithExtendableBuffer.
...
Bug: 6669677
Change-Id: Ied58c123b68199bddb91293ff5cf5d96691e1f6b
2013-09-02 17:18:41 +09:00
4d814bfcb7
Introduce DynamicPatriciaTrieReadingHelper.
...
It supports iterating nodes and dealing with additional
buffer. It counts nodes and node arrays to avoid infinite
loop.
Bug: 6669677
Change-Id: I322e7263c0535e098635a1e5de098838de09467d
2013-08-30 19:41:58 +09:00
69ebca0643
Fix children position reading for dynamic patricia trie.
...
Bug: 6669677
Change-Id: I68ad68361676f952bd25903c253c22617d3ce361
2013-08-29 18:31:15 +09:00
6c4d09e9e1
Use extendable buffer for reading node info.
...
Bug: 6669677
Change-Id: I78ba80100e3a38f2b49e43db1e6aef4e56ed062c
2013-08-27 18:06:42 +09:00
2f0c1253e2
Use extendable buffer for reading bigram and shortcut.
...
Bug: 6669677
Change-Id: I4017c0ecc5d8baff1b16ff370d3eec85de9a0f9f
2013-08-27 17:48:04 +09:00
27b12933cd
Rename CharGroup to PtNode in native code.
...
Bug: 10233675
Change-Id: I5a4215cc79b37bfd317e60101e06b2ab9c332653
2013-08-26 14:51:43 +09:00
ad4e0108a9
Fix: reading uninitialized area.
...
Bug: 10402083
Change-Id: I083beea29fe563b1e7739653d756b77820753e3f
2013-08-23 19:55:55 +09:00
02833d11c3
Fix the autocorrection normalized score calculation
...
Bug: 10441240
Change-Id: I256021dc55481960d6a605046daa17b1a2d55b95
2013-08-23 16:22:02 +09:00
941811cbd6
Introduce ExtendableBuffer for dynamic update.
...
Bug: 6669677
Change-Id: I6343c348334c0dace8b12a71eb992d6f040e8c95
2013-08-22 18:05:15 +09:00
a72a33388f
Fix native crash by caused wrong munmap.
...
Bug: 10402083
Change-Id: I5aa2cecd20cd3202c2326b1cbb6758257afd6d5d
2013-08-21 18:57:58 +09:00
112257e40f
Rename BinaryDictDecoder to Ver3DictDecoder.
...
Change-Id: Ibf9b95b658df6e2c2218bdb62e2380f326a03832
2013-08-20 17:11:51 +09:00
4a65258bc7
Fix possible SIGSEGV.
...
Change-Id: I6008c0457a8da9b90434a3b96a51da1487948f1b
2013-08-19 18:58:10 +09:00
381c12df20
Move methods in BinaryFormat to PatriciaTriePolicy.
...
Bug: 6669677
Change-Id: Ic9bc03a9d8ec789281d83d4b9e58042a083c3ba1
2013-08-16 16:42:17 +09:00
0624cc6cf3
Remove BinaryDictionaryInfo and introduce MmapedBuffer.
...
Bug: 6669677
Change-Id: I70e47fa20109060b6ea7a04bcc42ab8f7c543f77
2013-08-16 12:52:04 +09:00
0238e1eb01
Merge "Revert "Remove BinaryDictionaryInfo and introduce MmapedBuffer.""
2013-08-15 11:39:08 +00:00
d4fcf1dbc5
Revert "Remove BinaryDictionaryInfo and introduce MmapedBuffer."
...
This reverts commit d14ffcfcbchttps://sponge.corp.google.com/target?id=a8a62bd0-3aab-4520-ae64-53f9652ef64b&target=com.google.android.inputmethod.latin.tests&searchFor=&show=FAILED&sortBy=STATUS
Change-Id: I1eae460e09808513eacefd523609330819d73d16
2013-08-15 11:37:48 +00:00
94460eba11
[Refactor] Divide BinaryDictInputOutput into BinaryDictEncoder and BinaryDictDecoder.
...
Change-Id: I7c3269d77e3e3b567e459dcaa1bc029903941744
2013-08-15 20:23:07 +09:00
0663bc047b
Merge "Remove BinaryDictionaryInfo and introduce MmapedBuffer."
2013-08-15 09:34:28 +00:00
d14ffcfcbc
Remove BinaryDictionaryInfo and introduce MmapedBuffer.
...
Bug: 6669677
Change-Id: I1459bb53a9761d920427e4b5d925a2844955c88c
2013-08-15 18:17:44 +09:00
e7870a2c0d
Add an initial JNI interface to dicttool.
...
Bug: 10100269
Change-Id: I883992c2033e7d9e7c754c0bf653767728b221b6
2013-08-15 17:58:55 +09:00
dc83fe37ba
Merge "Revert "[Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils and BinaryDictOutputUtils.""
2013-08-15 08:56:28 +00:00
117f18e844
Revert "[Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils and BinaryDictOutputUtils."
...
This reverts commit 4c63d0614e
2013-08-15 08:54:29 +00:00
f74ddfbb06
Merge "[Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils and BinaryDictOutputUtils."
2013-08-15 06:53:23 +00:00
4c63d0614e
[Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils and BinaryDictOutputUtils.
...
Change-Id: I0d476abe763c11ba9005152f928e8dccf15ac9de
2013-08-15 15:46:58 +09:00
08ce337d3f
Fix: BinaryDictionaryInfo.isDynamicallyUpdatable().
...
Change-Id: Ifb3acded5e19f1302c7fcc8881b74addd20c1571
2013-08-15 13:39:32 +09:00
6ec3f63d59
Merge "Make dictionary structure policy have updating methods."
2013-08-15 03:15:43 +00:00
Keisuke Kuroyanagi
Jean Chalard
Satoshi Kataoka
Yuichiro Hanada
Ken Wakasa