nyancrimew/LatinIME
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
32702 commits 1 branch 0 tags 363 MiB
Commit graph

1042 commits

Author SHA1 Message Date
Keisuke Kuroyanagi
2111e3abc9 Introduce WordAttributes to get word probability and flags. 
Bug: 14425059

Change-Id: Iee11d038e0893d7ddd6c52447907f8c55fecb6a5
 2014-09-10 19:51:48 +09:00
Keisuke Kuroyanagi
11a48f92a5 Use getProbabilityOfWordInContext for prediction. 
Bug: 14425059
Change-Id: I9d5c905a0adda3503c593bfbf0bb9af8d1686f5d
 2014-09-10 19:51:14 +09:00
Keisuke Kuroyanagi
395fe8e98d Implement LanguageModelDictContent.getWordProbability(). 
Bug: 14425059
Change-Id: I290a05cee6f341caa25fb222892505529cef1eb7
 2014-09-10 19:51:12 +09:00
Keisuke Kuroyanagi
9f8da0f833 Use MultiBigramMap in structure policy. 
Bug: 14425059
Change-Id: I4d78da4839ef177e0223e6e5bcf0ebd7315c3099
 2014-09-09 17:53:44 +09:00
Keisuke Kuroyanagi
138647876b Merge "Rename probability to unigramProbability." 2014-09-09 06:16:08 +00:00
Keisuke Kuroyanagi
72ee1c7ee5 Merge "Remove mHasChildrenPtNodes from DicNodeProperties." 2014-09-09 06:03:36 +00:00
Keisuke Kuroyanagi
3e6c5edcf9 Merge "Add FormatUtilsTest." 2014-09-09 05:24:28 +00:00
Keisuke Kuroyanagi
5d95e8d747 Add FormatUtilsTest. 
Change-Id: I39ee1d18e0b70d9f4504d29a94cabc9354e4527e
 2014-09-09 14:10:53 +09:00
Keisuke Kuroyanagi
9c42ad47d4 Rename probability to unigramProbability. 
Bug: 14425059
Change-Id: I6a204c3b8fb257d037ad95a1a455ae6fb89068fd
 2014-09-09 14:09:01 +09:00
Keisuke Kuroyanagi
d028294890 Remove mHasChildrenPtNodes from DicNodeProperties. 
Bug: 14425059
Change-Id: I3a9511e7f7c3a722f9942f525530f04def5965da
 2014-09-09 14:08:41 +09:00
Keisuke Kuroyanagi
3f779718cc Merge "Remove DicNode.getPtNodePos()." 2014-09-05 10:15:45 +00:00
Keisuke Kuroyanagi
9ff6fee838 Remove DicNode.getPtNodePos(). 
Bug: 14425059
Change-Id: If6e291d23e68342792febb85f8a576ce785b3845
 2014-09-05 17:27:01 +09:00
Keisuke Kuroyanagi
5cfa023777 Merge "Add HeaderReadWriteUtilsTest" 2014-09-04 07:30:59 +00:00
Keisuke Kuroyanagi
fbddeedff6 Add HeaderReadWriteUtilsTest 
Change-Id: I08aeaa3e5852008874e38ed4799ab8989759e861
 2014-09-04 15:32:30 +09:00
Keisuke Kuroyanagi
94e4cd25a8 Use word id to get code ponits of the word. 
Bug: 14425059
Change-Id: I81accffcdf5abe447c33ffc3a8e8315f9a4cde7f
 2014-09-03 18:55:31 +09:00
Keisuke Kuroyanagi
ac983b13a9 Use word id to get shortcut iterator. 
Bug: 14425059
Change-Id: I1b35a139bd29f70b328cbc82648783b99f633d72
 2014-09-03 18:33:10 +09:00
Keisuke Kuroyanagi
847a026cd8 Make dictionary structure policy return shortcut iterator. 
Bug: 14425059

Change-Id: I0da22c41f818673430c285103af340397aaba9fb
 2014-09-03 18:20:14 +09:00
Keisuke Kuroyanagi
259ee830f5 Fix: Missing include. 
Change-Id: I23cb5fffa474d916f3e80b951bfb30902498e043
 2014-09-03 17:03:04 +09:00
Keisuke Kuroyanagi
cc6081c51b Merge "Use word id for methods related to n-grams." 2014-09-03 07:42:02 +00:00
Keisuke Kuroyanagi
89a003b12b Use word id for methods related to n-grams. 
Bug: 14425059

Change-Id: I81e5d3793527776d3c9faa5594005ddbd4a71354
 2014-09-03 16:32:43 +09:00
Keisuke Kuroyanagi
29dcf97e74 Add CharUtilsTest. 
Change-Id: I69b57d88a5376393b5d09d8b8e056c82cb8b8a3c
 2014-09-03 13:57:32 +09:00
Keisuke Kuroyanagi
69732169cc Add DamerauLevenshteinEditDistancePolicyTest 
Change-Id: Ia36bc6ddd0ec553fee151153061428c7c66d32d2
 2014-09-02 19:47:43 +09:00
Keisuke Kuroyanagi
985b2c2e91 Add GeometryUtilsTest. 
Change-Id: I6ea9ef137c2930ca8e8745fec829b9bcaf1d10b9
 2014-09-02 17:10:42 +09:00
Keisuke Kuroyanagi
93e3b5a16f Add TerminalPositionLookupTableTest. 
Change-Id: I4a3ab4c94a7759d7f24c7edc9c167fe6bbdd3eb7
 2014-08-29 14:16:15 +09:00
Keisuke Kuroyanagi
40b6d6cbd1 Add DicNodePoolTest. 
Change-Id: I9bec708def3af6bea1c82b9576b80ce1b7901ddc
 2014-08-29 13:02:22 +09:00
Keisuke Kuroyanagi
e394a0c6ff Implement IntArrayView::skip(). 
Change-Id: Ib7f13963ac1d9c64eff2c08391154c6a25024126
 2014-08-28 12:12:56 +09:00
Keisuke Kuroyanagi
733a023b64 Remove redundant code. 
Change-Id: I173eac15dc128e84893881ec4ee0ad1ad2fce44b
 2014-08-27 20:28:48 +09:00
Keisuke Kuroyanagi
6ae4d79d81 Use IntArrayView for dictionary structure policy. 
Change-Id: I0dc94908259d70d5085ff22abf422d90affb1452
 2014-08-27 20:28:43 +09:00
Keisuke Kuroyanagi
b85bf4ebb8 Merge "Use word id to construct DicNode instead of isTerminal flag." 2014-08-27 11:21:41 +00:00
Keisuke Kuroyanagi
fe395232d6 Remove bigram dict content. 
Bug: 14425059
Change-Id: I75918c6761a50832da511088eb83becd56b23662
 2014-08-27 20:05:59 +09:00
Keisuke Kuroyanagi
758d093644 Get entry count after truncation using LanguageModelDictContent. 
Bug: 14425059
Change-Id: I41b237c1c22c21740946d52e3be9d6f963c9cd54
 2014-08-27 20:04:39 +09:00
Keisuke Kuroyanagi
c7f1de826c Merge "Use LanguageModelDictContent in getWordProperty()." 2014-08-27 10:58:28 +00:00
Keisuke Kuroyanagi
7c08ede12b Merge "Use LanguageModelDictContent in iterateNgramEntries()." 2014-08-27 10:44:21 +00:00
Keisuke Kuroyanagi
82f7d3a9de Merge "Add a method to iterate entries in LanguageModelDictContent." 2014-08-27 10:35:38 +00:00
Keisuke Kuroyanagi
78aea9f133 Add TimeKeeperTest. 
Change-Id: Id35823414f8552fd6820a5a559d6c9d54c7d6cb6
 2014-08-27 14:39:27 +09:00
Keisuke Kuroyanagi
7d47500357 Use word id to construct DicNode instead of isTerminal flag. 
Bug: 14425059
Change-Id: I8484d34756bd76668ece34211e7366a4758d7bf5
 2014-08-26 14:33:19 +09:00
Keisuke Kuroyanagi
8b4409f4b9 Use LanguageModelDictContent in getWordProperty(). 
Bug: 14425059
Change-Id: Ic230f764ff5570f24ce6ce930023798718f326df
 2014-08-26 12:05:02 +09:00
Keisuke Kuroyanagi
1c14effab5 Use LanguageModelDictContent in iterateNgramEntries(). 
Bug: 14425059
Change-Id: I8a5028657ea5a4eeee8ef40db52a80f09b878972
 2014-08-26 12:03:14 +09:00
Keisuke Kuroyanagi
07b3b41c25 Add a method to iterate entries in LanguageModelDictContent. 
Bug: 14425059
Change-Id: I4e9c3a97891c020f762fa709f806d333c067f496
 2014-08-26 12:01:08 +09:00
Keisuke Kuroyanagi
30e6b21af0 Add SparseTableTest. 
Change-Id: I5684a24f9584cd326e014274c2298773aa3a91ca
 2014-08-25 22:27:01 +09:00
Keisuke Kuroyanagi
c04ae77583 Add ByteArrayUtilsTest. 
Change-Id: I4695a2573b4d2d8331fc9ce1e9ff83397791a586
 2014-08-25 16:52:12 +09:00
Keisuke Kuroyanagi
295e60234c Get bigram probability using language model dict content. 
Bug: 14425059
Change-Id: Ia0493ed94e9bd47e9396d8cda94511b47820db0d
 2014-08-22 20:13:06 +09:00
Keisuke Kuroyanagi
063f86d40f Truncate entries in language model dict content. 
Bug: 14425059

Change-Id: I023c1d5109a2c43fcea3bb11a0fd7198c82891ba
 2014-08-22 20:13:04 +09:00
Keisuke Kuroyanagi
9aa6699107 Update probabilities in language model dict content for GC. 
Bug: 14425059
Change-Id: I354408afd8e5c1955ff0acea3d0243d628fe3843
 2014-08-22 20:07:54 +09:00
Keisuke Kuroyanagi
9c9f2d06bc Fix TrieMap: Cannot create next level map of small value entry. 
Bug: 14425059
Change-Id: I864f81ea7dd1d847ef2b016366ce046b1c43d5e5
 2014-08-20 20:48:25 +09:00
Keisuke Kuroyanagi
ace03d7919 Merge "Add BoS flag in probability entry." 2014-08-16 04:15:21 +00:00
Keisuke Kuroyanagi
623067a183 Add BoS flag in probability entry. 
Bug: 14425059

Change-Id: I50439630034ada0280c44cbbb308aa0b95b72048
 2014-08-19 11:49:05 +09:00
Keisuke Kuroyanagi
bfcd5efd50 Merge "Use byte array view in ver4 dict contents." 2014-08-16 04:15:21 +00:00
Keisuke Kuroyanagi
1f6e52ef02 Use byte array view in ver4 dict contents. 
Change-Id: Icf79a51a200f7ccd775264d1a83dd61e7dcfbab2
 2014-08-18 22:46:10 +09:00
Keisuke Kuroyanagi
2f34f0d1a8 Merge "Remove entry from language model dict content." 2014-08-16 04:15:21 +00:00