nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
34648 commits 1 branch 0 tags 363 MiB
Commit graph

1219 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
733a023b64 Remove redundant code. 
Change-Id: I173eac15dc128e84893881ec4ee0ad1ad2fce44b
 2014-08-27 20:28:48 +09:00
Keisuke Kuroyanagi
6ae4d79d81 Use IntArrayView for dictionary structure policy. 
Change-Id: I0dc94908259d70d5085ff22abf422d90affb1452
 2014-08-27 20:28:43 +09:00
Keisuke Kuroyanagi
b85bf4ebb8 Merge "Use word id to construct DicNode instead of isTerminal flag." 2014-08-27 11:21:41 +00:00
Keisuke Kuroyanagi
fe395232d6 Remove bigram dict content. 
Bug: 14425059
Change-Id: I75918c6761a50832da511088eb83becd56b23662
 2014-08-27 20:05:59 +09:00
Keisuke Kuroyanagi
758d093644 Get entry count after truncation using LanguageModelDictContent. 
Bug: 14425059
Change-Id: I41b237c1c22c21740946d52e3be9d6f963c9cd54
 2014-08-27 20:04:39 +09:00
Keisuke Kuroyanagi
c7f1de826c Merge "Use LanguageModelDictContent in getWordProperty()." 2014-08-27 10:58:28 +00:00
Keisuke Kuroyanagi
7c08ede12b Merge "Use LanguageModelDictContent in iterateNgramEntries()." 2014-08-27 10:44:21 +00:00
Keisuke Kuroyanagi
82f7d3a9de Merge "Add a method to iterate entries in LanguageModelDictContent." 2014-08-27 10:35:38 +00:00
Keisuke Kuroyanagi
78aea9f133 Add TimeKeeperTest. 
Change-Id: Id35823414f8552fd6820a5a559d6c9d54c7d6cb6
 2014-08-27 14:39:27 +09:00
Keisuke Kuroyanagi
7d47500357 Use word id to construct DicNode instead of isTerminal flag. 
Bug: 14425059
Change-Id: I8484d34756bd76668ece34211e7366a4758d7bf5
 2014-08-26 14:33:19 +09:00
Keisuke Kuroyanagi
8b4409f4b9 Use LanguageModelDictContent in getWordProperty(). 
Bug: 14425059
Change-Id: Ic230f764ff5570f24ce6ce930023798718f326df
 2014-08-26 12:05:02 +09:00
Keisuke Kuroyanagi
1c14effab5 Use LanguageModelDictContent in iterateNgramEntries(). 
Bug: 14425059
Change-Id: I8a5028657ea5a4eeee8ef40db52a80f09b878972
 2014-08-26 12:03:14 +09:00
Keisuke Kuroyanagi
07b3b41c25 Add a method to iterate entries in LanguageModelDictContent. 
Bug: 14425059
Change-Id: I4e9c3a97891c020f762fa709f806d333c067f496
 2014-08-26 12:01:08 +09:00
Keisuke Kuroyanagi
30e6b21af0 Add SparseTableTest. 
Change-Id: I5684a24f9584cd326e014274c2298773aa3a91ca
 2014-08-25 22:27:01 +09:00
Keisuke Kuroyanagi
c04ae77583 Add ByteArrayUtilsTest. 
Change-Id: I4695a2573b4d2d8331fc9ce1e9ff83397791a586
 2014-08-25 16:52:12 +09:00
Keisuke Kuroyanagi
295e60234c Get bigram probability using language model dict content. 
Bug: 14425059
Change-Id: Ia0493ed94e9bd47e9396d8cda94511b47820db0d
 2014-08-22 20:13:06 +09:00
Keisuke Kuroyanagi
063f86d40f Truncate entries in language model dict content. 
Bug: 14425059

Change-Id: I023c1d5109a2c43fcea3bb11a0fd7198c82891ba
 2014-08-22 20:13:04 +09:00
Keisuke Kuroyanagi
9aa6699107 Update probabilities in language model dict content for GC. 
Bug: 14425059
Change-Id: I354408afd8e5c1955ff0acea3d0243d628fe3843
 2014-08-22 20:07:54 +09:00
Keisuke Kuroyanagi
9c9f2d06bc Fix TrieMap: Cannot create next level map of small value entry. 
Bug: 14425059
Change-Id: I864f81ea7dd1d847ef2b016366ce046b1c43d5e5
 2014-08-20 20:48:25 +09:00
Keisuke Kuroyanagi
ace03d7919 Merge "Add BoS flag in probability entry." 2014-08-16 04:15:21 +00:00
Keisuke Kuroyanagi
623067a183 Add BoS flag in probability entry. 
Bug: 14425059

Change-Id: I50439630034ada0280c44cbbb308aa0b95b72048
 2014-08-19 11:49:05 +09:00
Keisuke Kuroyanagi
bfcd5efd50 Merge "Use byte array view in ver4 dict contents." 2014-08-16 04:15:21 +00:00
Keisuke Kuroyanagi
1f6e52ef02 Use byte array view in ver4 dict contents. 
Change-Id: Icf79a51a200f7ccd775264d1a83dd61e7dcfbab2
 2014-08-18 22:46:10 +09:00
Keisuke Kuroyanagi
2f34f0d1a8 Merge "Remove entry from language model dict content." 2014-08-16 04:15:21 +00:00
Keisuke Kuroyanagi
d3097c67ca Remove entry from language model dict content. 
Bug: 14425059
Change-Id: Iea51c0ae908d499da19839de06222a1c4d19088e
 2014-08-18 12:34:50 +09:00
Keisuke Kuroyanagi
b4531d861e Add method to remove entry from language model dict content. 
Bug: 14425059
Change-Id: Id21af0110e770caa3e95cb5d7ba8b3d1af8e0b12
 2014-08-18 12:34:48 +09:00
Keisuke Kuroyanagi
0db136e51f Merge "Add method to remove entry from language model dict content." 2014-08-16 04:12:14 +00:00
Keisuke Kuroyanagi
7be252d479 Use %zd to print size_t value. 
Change-Id: Id46f50353b489d84b9a97dd4ddc5519bd99492cd
 2014-08-15 16:50:23 +09:00
Keisuke Kuroyanagi
ed1ab3b363 Improve accent error handling in exact match logic. 
Bug: 16963362
Change-Id: I50a48806bc3147388d165faab6b572415a851f29
 2014-08-15 16:50:23 +09:00
Keisuke Kuroyanagi
5409957440 Merge "Remove unigram for v402 with historical info." 2014-08-15 05:02:04 +00:00
Keisuke Kuroyanagi
8890b01550 Remove unigram for v402 with historical info. 
Bug: 15531638
Change-Id: If1b73ac693e45a80df987ea16b2dece5597697e8
 2014-08-15 15:47:53 +09:00
Keisuke Kuroyanagi
d9d94f40c7 Merge "Make FormatUtils use ByteArrayView." 2014-08-15 05:03:06 +00:00
Keisuke Kuroyanagi
4fbb2148ee Make FormatUtils use ByteArrayView. 
Change-Id: I472b238a0d59f0092ee1f5f3b12ad63823025fae
 2014-08-14 18:09:30 +09:00
Keisuke Kuroyanagi
5fe1bed2e4 Add TrieMap::remove(). 
Bug: 14425059
Change-Id: Ifb9a873eab79efdd6bee8e0da73c0cf37727350e
 2014-08-13 21:10:48 +09:00
Keisuke Kuroyanagi
9a23f0fba2 Add bigrams to language model content. 
Bug: 14425059

Change-Id: Id81e3775ea0104750a23e3dca62c00681ed8dc2e
 2014-08-12 20:32:42 +09:00
Keisuke Kuroyanagi
9069d30043 Use IntArrayView to add/remove n-gram entry. 
Bug: 14425059
Change-Id: I734f12dfde5161abdfb019a6391677dba8984ff4
 2014-08-06 12:52:01 +09:00
Keisuke Kuroyanagi
da8cda0578 Clean up IntArrayViewTest 
Change-Id: I30138f0722571100fe13efc96f8332efde846c2e
 2014-08-06 10:09:02 +09:00
Keisuke Kuroyanagi
03dc44f543 Add/Get n-gram probability entry in languageModelDictContent 
Bug: 14425059
Change-Id: I7926c3812f89b9a71fe1873a5bc32f793f91b640
 2014-08-06 00:42:56 +00:00
Keisuke Kuroyanagi
851e0458fe Remove ProbabilityDictContent and use LanguageModelDictContent 
Bug: 14425059
Change-Id: I1bb9e78ecb24139b87c99be6722e37eec0a2285d
 2014-08-05 14:13:07 +09:00
Keisuke Kuroyanagi
0889484266 Add methods for unigrams to LanguageModelDictContent. 
Bug: 14425059
Change-Id: I0a6b480a3d4735787ffac68c47b4ffefc3f1b8a5
 2014-08-05 12:38:55 +09:00
Keisuke Kuroyanagi
c4696b2eb6 Save language model in the body buffer. 
Bug: 14425059
Change-Id: Iaec277f7bed03d6c6780c6ce90fbe5fe799e175e
 2014-08-01 20:19:16 +09:00
Keisuke Kuroyanagi
c0c674cdc0 Make MmappedBuffer use byte array view. 
Bug: 16691311
Change-Id: I2122c01ee27c33e11dec52643925c069927bea2b
 2014-08-01 19:26:01 +09:00
Keisuke Kuroyanagi
0257e40345 Use ReadWriteByteArrayView in BufferWithExtendableBuffer. 
Bug: 16691311
Change-Id: Ibd68354a53cebf284a886d76bd8ce9848a51346f
 2014-08-01 08:44:32 +00:00
Keisuke Kuroyanagi
df11f9b8e6 Merge "Add LanguageModelDictContent." into lmp-dev 2014-07-24 16:04:26 +00:00
Keisuke Kuroyanagi
dc3856d758 Add LanguageModelDictContent. 
This class will replace BigramDictContent and
ProbabilityDictContent.

Bug: 14425059
Change-Id: I3d15c833957e27b2f5999386db042188272bbb4b
 2014-08-01 12:45:00 +09:00
Keisuke Kuroyanagi
90b7c1729f Remove DictContent. 
Bug: 14425059
Change-Id: I74fa4b6ba4605447c1c87427371e4be5eb8e7ae6
 2014-08-01 12:06:21 +09:00
Keisuke Kuroyanagi
0e6a1d1020 Remove getBigramsIteratorOfPtNode from structure policy. 
Bug: 14425059
Change-Id: I427fbfd026c1e33b5e9cf78949fe862d8748b7ec
 2014-08-01 12:06:21 +09:00
Keisuke Kuroyanagi
35c62b2cc9 Use NgramListener in MultiBigramMap. 
Bug: 14425059
Change-Id: I425536290111f2a8172f31370706f858a1e07f6e
 2014-08-01 02:51:07 +00:00
Keisuke Kuroyanagi
de5c3a2562 Construct TrieMap from existing buffer. 
Bug: 14425059
Change-Id: Ia1c58d88540f55fb38fe0bdfcd7c0a34ebc7415e
 2014-07-31 09:06:22 +00:00
Keisuke Kuroyanagi
e7c9415688 Merge "Remove DictContent." into lmp-dev 2014-07-24 16:04:26 +00:00