 | Run 7285 |
| Creator | tberg |
| Program | word-segmentation-phonetic-features |
| Dataset | br-phono |
| Task type | WordSegmentation |
| Created | 2y228d ago |
| Download | Login required! |
Done! 
| 35m25s | |
| 1509M | |
| WordSegmentation | |
| 0.873 | |
| 0.887 | |
| 0.880 |
Log file
... (lines omitted) ...
Lowest weights:
[ind|mo : -1.06789, ind|N9 : -1.06876, ind|rQ : -1.06883, ind|wo : -1.06893, ind|gQ : -1.06902, ind|LQ : -1.06911, ind|~o : -1.0694, ind|~Q : -1.06943, ind|ze : -1.06952, ind|yo : -1.06975, ind|v7 : -1.07012, ind|No : -1.0702, ind|n7 : -1.07131, phonocvrpresuf4gram|^vcv : -1.0753, ind|a : -1.07614, ind|u : -1.07792, ind|h9# : -1.08627, ind|O : -1.08634, ind|sR : -1.10446, ind|U : -1.11656, ind|tR# : -1.11833, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.13595, ind|h# : -1.15776, phonocvrpresuf4gram|^crc : -1.1618, ind|cR : -1.16304, ind|pR : -1.16965, ind|s( : -1.17421, phonocvrpresuf3gram|rc^ : -1.17645, ind|s# : -1.18017, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.18326, ind|t9R : -1.18384, ind|t% : -1.19199, ind|k* : -1.19336, ind|t# : -1.19896, ind|S% : -1.20411, phonocvrpresuf4gram|rvc^ : -1.20721, ind|T# : -1.20779, ind|c( : -1.20837, ind|kR : -1.20871, ind|S* : -1.20872, ind|k% : -1.20923, ind|p% : -1.20973, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21589, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.22063, phonocvrpresuf2gram|^r : -1.23845, ind|pe : -1.25935, phonofeatpresuf2gram|(vX)(^^) : -1.26038, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.26489, ind|lR# : -1.26704, ind|y)# : -1.27106, ind|f9 : -1.27655, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.27842, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28194, ind|k9 : -1.28644, ind|( : -1.2909, phonocvrpresuf4gram|^ccr : -1.30014, ind|s9 : -1.31366, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33213, phonocvrpresuf3gram|vv^ : -1.33566, ind|fo : -1.34404, ind|tQ : -1.34638, ind|fe : -1.34865, ind|sQ : -1.34876, ind|c9 : -1.35216, ind|ho : -1.35363, ind|p9 : -1.3539, ind|po : -1.35435, ind|Se : -1.35499, ind|We : -1.3567, ind|fQ : -1.3578, ind|ce : -1.35923, ind|cQ : -1.35925, ind|TQ : -1.35929, ind|pQ : -1.35937, ind|) : -1.36631, phonocvrpresuf3gram|^vv : -1.38452, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38594, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.42736, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46516, phonocvrpresuf4gram|ccv^ : -1.47986, phonocvrpresuf3gram|^cc : -1.49402, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51325, phonocvrpresuf4gram|^vcc : -1.51946, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.6356, ind|Q : -1.66177, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.67042, ind|7 : -1.69786, len|lenraw7 : -1.789, numphonov|numv5 : -1.92381, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.94313, phonocvrpresuf3gram|^rc : -1.97889, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.14081, phonocvrpresuf4gram|vvc^ : -2.16597, phonocvrpresuf4gram|^vcr : -2.17924, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.22444, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48053, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.81001, len|lenraw8 : -4.65293, numphonov|numv4 : -5.09303, len|lenraw9 : -5.44116, len|lenraw10 : -5.50286]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.169, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.838)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.0s, cum. 34m3s]
Iteration 839/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage1 calc 274: 402159.659749
Line search init: value: 402159.659749, deriv: -51.720989
Highest weights:
[ind|op~ : 9.20197, ind|&nd : 9.15156, ind|9TINk : 9.03071, ind|Els : 8.85331, ind|prIti : 8.81761, ind|oke : 8.65829, ind|Its : 8.53285, ind|kreanz : 8.47442, ind|pik6bu : 8.46098, ind|hAmpti : 8.39122, ind|&pL : 8.25186, ind|yu : 8.18453, ind|6bQt : 8.13565, ind|6gEn : 8.05293, ind|#Doz : 8.04183, ind|hANgri : 7.98353, ind|&n6mL : 7.89294, ind|D6 : 7.78893, ind|hQmEni : 7.78223, ind|dr&g~ : 7.72395, ind|&lIs : 7.72108, ind|wan6 : 7.68116, ind|v*i : 7.61433, ind|mANki : 7.57981, ind|ovR : 7.5377, ind|It : 7.51957, ind|6nADR : 7.50949, ind|D&t : 7.44798, ind|want : 7.36079, ind|dOgi : 7.30046, ind|k9nd6v : 7.29997, ind|n9tn9t : 7.24945, ind|kIti : 7.17515, ind|Iz : 7.16815, ind|WAts : 7.14104, ind|lUk&t : 7.10423, ind|g6n6 : 7.09349, ind|go6hEd : 7.05412, ind|b6lunz : 7.03988, ind|sIndi : 7.0061, ind|DIs : 6.99665, ind|hElo : 6.9712, ind|du : 6.97014, ind|dAmpti : 6.96431, ind|b9b9 : 6.95364, ind|mamiz : 6.95225, ind|lItL : 6.90563, ind|IN : 6.8796, ind|WAt : 6.82765, ind|bAni : 6.82636, ind|dont : 6.79049, ind|6 : 6.76797, ind|tu : 6.75509, ind|d&di : 6.74636, ind|Tri : 6.73364, ind|In : 6.71795, ind|D&ts : 6.70007, ind|Qt : 6.68669, ind|lUk : 6.67112, ind|k&n : 6.65176, ind|zskr& : 6.6274, ind|brAS : 6.61529, ind|blaks : 6.59815, ind|mami : 6.52408, ind|Iz~t : 6.48863, ind|si : 6.47048, ind|wAn : 6.45077, ind|tEl6 : 6.41304, ind|D*z : 6.39414, ind|%InG : 6.38707, ind|smEl : 6.37271, ind|y& : 6.35561, ind|Olr9t : 6.31946, ind|T&Nk : 6.28467, ind|l9k : 6.28081, ind|pliz : 6.2303, ind|bebi : 6.21235, ind|an : 6.13781, ind|W*z : 6.12898, ind|cifes : 6.12773, ind|9dont : 6.12612, ind|r9t : 6.11184, ind|Gudi : 6.10948, ind|mebi : 6.0914, ind|Eni : 6.0912, ind|h&nd : 6.06025, ind|&ni : 6.03832, ind|slip : 6.01323, ind|mi : 5.9754, ind|dAz~t : 5.9662, ind|sAmT : 5.94114, ind|dIgbi : 5.94078, ind|D* : 5.93328, ind|bUk : 5.92605, ind|ADR : 5.91913, ind|blak : 5.9116, ind|t6de : 5.89777, ind|b6lun : 5.89053, ind|m6ri : 5.88153, ind|ple : 5.87082, ind|snikRz : 5.85925]
Lowest weights:
[ind|s% : -1.07062, ind|N9 : -1.07115, ind|rQ : -1.07122, ind|wo : -1.0713, ind|gQ : -1.0714, ind|LQ : -1.07149, ind|~o : -1.07177, ind|~Q : -1.0718, ind|ze : -1.07186, ind|yo : -1.07212, phonocvrpresuf4gram|^vcv : -1.07228, ind|v7 : -1.07246, ind|No : -1.07255, ind|n7 : -1.07363, ind|a : -1.08048, ind|u : -1.0824, ind|O : -1.09076, ind|h9# : -1.09421, ind|sR : -1.10801, ind|U : -1.12065, ind|tR# : -1.12325, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14442, ind|h# : -1.16336, ind|cR : -1.16908, phonocvrpresuf4gram|^crc : -1.17002, ind|pR : -1.17682, phonocvrpresuf3gram|rc^ : -1.18027, ind|s( : -1.18053, ind|s# : -1.18613, phonocvrpresuf4gram|rvc^ : -1.18632, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.19142, ind|t9R : -1.19401, ind|t% : -1.19818, ind|k* : -1.19934, ind|t# : -1.20518, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.20983, ind|S% : -1.21011, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21114, ind|T# : -1.21364, ind|c( : -1.2142, ind|S* : -1.21442, ind|kR : -1.2145, ind|k% : -1.21504, ind|p% : -1.2155, phonocvrpresuf2gram|^r : -1.24588, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25824, phonocvrpresuf4gram|^ccr : -1.26302, ind|pe : -1.26799, phonofeatpresuf2gram|(vX)(^^) : -1.26874, ind|lR# : -1.27193, ind|y)# : -1.27583, ind|f9 : -1.28241, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28449, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.29126, ind|k9 : -1.29619, ind|( : -1.2984, ind|s9 : -1.32053, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3332, phonocvrpresuf3gram|vv^ : -1.33471, ind|fo : -1.35165, ind|tQ : -1.35351, ind|fe : -1.35564, ind|sQ : -1.35597, ind|c9 : -1.35886, ind|ho : -1.36062, ind|p9 : -1.36083, ind|po : -1.36117, ind|Se : -1.36188, ind|We : -1.36352, ind|fQ : -1.36463, ind|ce : -1.366, ind|cQ : -1.36602, ind|TQ : -1.36606, ind|pQ : -1.36614, ind|) : -1.37461, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38164, phonocvrpresuf3gram|^vv : -1.38522, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.42053, phonocvrpresuf4gram|ccv^ : -1.44881, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46604, phonocvrpresuf3gram|^cc : -1.49057, phonocvrpresuf4gram|^vcc : -1.50644, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51166, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63165, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64021, ind|Q : -1.67277, ind|7 : -1.70762, len|lenraw7 : -1.80973, numphonov|numv5 : -1.90847, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93118, phonocvrpresuf3gram|^rc : -1.95708, phonocvrpresuf4gram|vvc^ : -2.13885, phonocvrpresuf4gram|^vcr : -2.15849, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.16101, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23895, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.4812, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.8049, len|lenraw8 : -4.61657, numphonov|numv4 : -5.05234, len|lenraw9 : -5.39797, len|lenraw10 : -5.45907]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.169, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.839)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m5s]
Iteration 840/99999: temperature = 1 {
E-step [1.1s, cum. 1.1s]
M-step {
Line search iter: value: 402145.896250, suff decrease: 402159.654577
Highest weights:
[ind|op~ : 9.20197, ind|&nd : 9.15156, ind|9TINk : 9.03071, ind|Els : 8.85331, ind|prIti : 8.81761, ind|oke : 8.65829, ind|Its : 8.53285, ind|kreanz : 8.47442, ind|pik6bu : 8.46098, ind|hAmpti : 8.39122, ind|&pL : 8.25186, ind|yu : 8.18453, ind|6bQt : 8.13565, ind|6gEn : 8.05293, ind|#Doz : 8.04183, ind|hANgri : 7.98353, ind|&n6mL : 7.89294, ind|D6 : 7.78893, ind|hQmEni : 7.78223, ind|dr&g~ : 7.72395, ind|&lIs : 7.72108, ind|wan6 : 7.68116, ind|v*i : 7.61433, ind|mANki : 7.57981, ind|ovR : 7.5377, ind|It : 7.51957, ind|6nADR : 7.50949, ind|D&t : 7.44798, ind|want : 7.36079, ind|dOgi : 7.30046, ind|k9nd6v : 7.29997, ind|n9tn9t : 7.24945, ind|kIti : 7.17515, ind|Iz : 7.16815, ind|WAts : 7.14104, ind|lUk&t : 7.10423, ind|g6n6 : 7.09349, ind|go6hEd : 7.05412, ind|b6lunz : 7.03988, ind|sIndi : 7.0061, ind|DIs : 6.99665, ind|hElo : 6.9712, ind|du : 6.97014, ind|dAmpti : 6.96431, ind|b9b9 : 6.95364, ind|mamiz : 6.95225, ind|lItL : 6.90563, ind|IN : 6.8796, ind|WAt : 6.82765, ind|bAni : 6.82636, ind|dont : 6.79049, ind|6 : 6.76797, ind|tu : 6.75509, ind|d&di : 6.74636, ind|Tri : 6.73364, ind|In : 6.71795, ind|D&ts : 6.70007, ind|Qt : 6.68669, ind|lUk : 6.67112, ind|k&n : 6.65176, ind|zskr& : 6.6274, ind|brAS : 6.61529, ind|blaks : 6.59815, ind|mami : 6.52408, ind|Iz~t : 6.48863, ind|si : 6.47048, ind|wAn : 6.45077, ind|tEl6 : 6.41304, ind|D*z : 6.39414, ind|%InG : 6.38707, ind|smEl : 6.37271, ind|y& : 6.35561, ind|Olr9t : 6.31946, ind|T&Nk : 6.28467, ind|l9k : 6.28081, ind|pliz : 6.2303, ind|bebi : 6.21235, ind|an : 6.13781, ind|W*z : 6.12898, ind|cifes : 6.12773, ind|9dont : 6.12612, ind|r9t : 6.11184, ind|Gudi : 6.10948, ind|mebi : 6.0914, ind|Eni : 6.0912, ind|h&nd : 6.06025, ind|&ni : 6.03832, ind|slip : 6.01323, ind|mi : 5.9754, ind|dAz~t : 5.9662, ind|sAmT : 5.94114, ind|dIgbi : 5.94078, ind|D* : 5.93328, ind|bUk : 5.92605, ind|ADR : 5.91913, ind|blak : 5.9116, ind|t6de : 5.89777, ind|b6lun : 5.89053, ind|m6ri : 5.88153, ind|ple : 5.87082, ind|snikRz : 5.85925]
Lowest weights:
[ind|s% : -1.07062, ind|N9 : -1.07115, ind|rQ : -1.07122, ind|wo : -1.0713, ind|gQ : -1.0714, ind|LQ : -1.07149, ind|~o : -1.07177, ind|~Q : -1.0718, ind|ze : -1.07186, ind|yo : -1.07212, phonocvrpresuf4gram|^vcv : -1.07228, ind|v7 : -1.07246, ind|No : -1.07255, ind|n7 : -1.07363, ind|a : -1.08048, ind|u : -1.0824, ind|O : -1.09076, ind|h9# : -1.09421, ind|sR : -1.10801, ind|U : -1.12065, ind|tR# : -1.12325, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14442, ind|h# : -1.16336, ind|cR : -1.16908, phonocvrpresuf4gram|^crc : -1.17002, ind|pR : -1.17682, phonocvrpresuf3gram|rc^ : -1.18027, ind|s( : -1.18053, ind|s# : -1.18613, phonocvrpresuf4gram|rvc^ : -1.18632, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.19142, ind|t9R : -1.19401, ind|t% : -1.19818, ind|k* : -1.19934, ind|t# : -1.20518, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.20983, ind|S% : -1.21011, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21114, ind|T# : -1.21364, ind|c( : -1.2142, ind|S* : -1.21442, ind|kR : -1.2145, ind|k% : -1.21504, ind|p% : -1.2155, phonocvrpresuf2gram|^r : -1.24588, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25824, phonocvrpresuf4gram|^ccr : -1.26302, ind|pe : -1.26799, phonofeatpresuf2gram|(vX)(^^) : -1.26874, ind|lR# : -1.27193, ind|y)# : -1.27583, ind|f9 : -1.28241, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28449, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.29126, ind|k9 : -1.29619, ind|( : -1.2984, ind|s9 : -1.32053, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3332, phonocvrpresuf3gram|vv^ : -1.33471, ind|fo : -1.35165, ind|tQ : -1.35351, ind|fe : -1.35564, ind|sQ : -1.35597, ind|c9 : -1.35886, ind|ho : -1.36062, ind|p9 : -1.36083, ind|po : -1.36117, ind|Se : -1.36188, ind|We : -1.36352, ind|fQ : -1.36463, ind|ce : -1.366, ind|cQ : -1.36602, ind|TQ : -1.36606, ind|pQ : -1.36614, ind|) : -1.37461, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38164, phonocvrpresuf3gram|^vv : -1.38522, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.42053, phonocvrpresuf4gram|ccv^ : -1.44881, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46604, phonocvrpresuf3gram|^cc : -1.49057, phonocvrpresuf4gram|^vcc : -1.50644, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51166, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63165, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64021, ind|Q : -1.67277, ind|7 : -1.70762, len|lenraw7 : -1.80973, numphonov|numv5 : -1.90847, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93118, phonocvrpresuf3gram|^rc : -1.95708, phonocvrpresuf4gram|vvc^ : -2.13885, phonocvrpresuf4gram|^vcr : -2.15849, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.16101, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23895, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.4812, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.8049, len|lenraw8 : -4.61657, numphonov|numv4 : -5.05234, len|lenraw9 : -5.39797, len|lenraw10 : -5.45907]
} [1.2s, cum. 2.4s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.007, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.840)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.5s, cum. 34m8s]
Iteration 841/99999: temperature = 1 {
E-step [1.1s, cum. 1.1s]
M-step {
LFGS stage3 calc 274: 402145.896250
[LBFGSMinimizer.minimize] Iteration 274 ended with value 402145.896250
Highest weights:
[ind|op~ : 9.20197, ind|&nd : 9.15156, ind|9TINk : 9.03071, ind|Els : 8.85331, ind|prIti : 8.81761, ind|oke : 8.65829, ind|Its : 8.53285, ind|kreanz : 8.47442, ind|pik6bu : 8.46098, ind|hAmpti : 8.39122, ind|&pL : 8.25186, ind|yu : 8.18453, ind|6bQt : 8.13565, ind|6gEn : 8.05293, ind|#Doz : 8.04183, ind|hANgri : 7.98353, ind|&n6mL : 7.89294, ind|D6 : 7.78893, ind|hQmEni : 7.78223, ind|dr&g~ : 7.72395, ind|&lIs : 7.72108, ind|wan6 : 7.68116, ind|v*i : 7.61433, ind|mANki : 7.57981, ind|ovR : 7.5377, ind|It : 7.51957, ind|6nADR : 7.50949, ind|D&t : 7.44798, ind|want : 7.36079, ind|dOgi : 7.30046, ind|k9nd6v : 7.29997, ind|n9tn9t : 7.24945, ind|kIti : 7.17515, ind|Iz : 7.16815, ind|WAts : 7.14104, ind|lUk&t : 7.10423, ind|g6n6 : 7.09349, ind|go6hEd : 7.05412, ind|b6lunz : 7.03988, ind|sIndi : 7.0061, ind|DIs : 6.99665, ind|hElo : 6.9712, ind|du : 6.97014, ind|dAmpti : 6.96431, ind|b9b9 : 6.95364, ind|mamiz : 6.95225, ind|lItL : 6.90563, ind|IN : 6.8796, ind|WAt : 6.82765, ind|bAni : 6.82636, ind|dont : 6.79049, ind|6 : 6.76797, ind|tu : 6.75509, ind|d&di : 6.74636, ind|Tri : 6.73364, ind|In : 6.71795, ind|D&ts : 6.70007, ind|Qt : 6.68669, ind|lUk : 6.67112, ind|k&n : 6.65176, ind|zskr& : 6.6274, ind|brAS : 6.61529, ind|blaks : 6.59815, ind|mami : 6.52408, ind|Iz~t : 6.48863, ind|si : 6.47048, ind|wAn : 6.45077, ind|tEl6 : 6.41304, ind|D*z : 6.39414, ind|%InG : 6.38707, ind|smEl : 6.37271, ind|y& : 6.35561, ind|Olr9t : 6.31946, ind|T&Nk : 6.28467, ind|l9k : 6.28081, ind|pliz : 6.2303, ind|bebi : 6.21235, ind|an : 6.13781, ind|W*z : 6.12898, ind|cifes : 6.12773, ind|9dont : 6.12612, ind|r9t : 6.11184, ind|Gudi : 6.10948, ind|mebi : 6.0914, ind|Eni : 6.0912, ind|h&nd : 6.06025, ind|&ni : 6.03832, ind|slip : 6.01323, ind|mi : 5.9754, ind|dAz~t : 5.9662, ind|sAmT : 5.94114, ind|dIgbi : 5.94078, ind|D* : 5.93328, ind|bUk : 5.92605, ind|ADR : 5.91913, ind|blak : 5.9116, ind|t6de : 5.89777, ind|b6lun : 5.89053, ind|m6ri : 5.88153, ind|ple : 5.87082, ind|snikRz : 5.85925]
Lowest weights:
[ind|s% : -1.07062, ind|N9 : -1.07115, ind|rQ : -1.07122, ind|wo : -1.0713, ind|gQ : -1.0714, ind|LQ : -1.07149, ind|~o : -1.07177, ind|~Q : -1.0718, ind|ze : -1.07186, ind|yo : -1.07212, phonocvrpresuf4gram|^vcv : -1.07228, ind|v7 : -1.07246, ind|No : -1.07255, ind|n7 : -1.07363, ind|a : -1.08048, ind|u : -1.0824, ind|O : -1.09076, ind|h9# : -1.09421, ind|sR : -1.10801, ind|U : -1.12065, ind|tR# : -1.12325, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14442, ind|h# : -1.16336, ind|cR : -1.16908, phonocvrpresuf4gram|^crc : -1.17002, ind|pR : -1.17682, phonocvrpresuf3gram|rc^ : -1.18027, ind|s( : -1.18053, ind|s# : -1.18613, phonocvrpresuf4gram|rvc^ : -1.18632, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.19142, ind|t9R : -1.19401, ind|t% : -1.19818, ind|k* : -1.19934, ind|t# : -1.20518, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.20983, ind|S% : -1.21011, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21114, ind|T# : -1.21364, ind|c( : -1.2142, ind|S* : -1.21442, ind|kR : -1.2145, ind|k% : -1.21504, ind|p% : -1.2155, phonocvrpresuf2gram|^r : -1.24588, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25824, phonocvrpresuf4gram|^ccr : -1.26302, ind|pe : -1.26799, phonofeatpresuf2gram|(vX)(^^) : -1.26874, ind|lR# : -1.27193, ind|y)# : -1.27583, ind|f9 : -1.28241, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28449, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.29126, ind|k9 : -1.29619, ind|( : -1.2984, ind|s9 : -1.32053, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3332, phonocvrpresuf3gram|vv^ : -1.33471, ind|fo : -1.35165, ind|tQ : -1.35351, ind|fe : -1.35564, ind|sQ : -1.35597, ind|c9 : -1.35886, ind|ho : -1.36062, ind|p9 : -1.36083, ind|po : -1.36117, ind|Se : -1.36188, ind|We : -1.36352, ind|fQ : -1.36463, ind|ce : -1.366, ind|cQ : -1.36602, ind|TQ : -1.36606, ind|pQ : -1.36614, ind|) : -1.37461, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38164, phonocvrpresuf3gram|^vv : -1.38522, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.42053, phonocvrpresuf4gram|ccv^ : -1.44881, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46604, phonocvrpresuf3gram|^cc : -1.49057, phonocvrpresuf4gram|^vcc : -1.50644, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51166, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63165, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64021, ind|Q : -1.67277, ind|7 : -1.70762, len|lenraw7 : -1.80973, numphonov|numv5 : -1.90847, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93118, phonocvrpresuf3gram|^rc : -1.95708, phonocvrpresuf4gram|vvc^ : -2.13885, phonocvrpresuf4gram|^vcr : -2.15849, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.16101, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23895, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.4812, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.8049, len|lenraw8 : -4.61657, numphonov|numv4 : -5.05234, len|lenraw9 : -5.39797, len|lenraw10 : -5.45907]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.007, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.841)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m10s]
Iteration 842/99999: temperature = 1 {
E-step [2.0s, cum. 2.0s]
M-step {
LFGS stage1 calc 275: 402145.896250
Line search init: value: 402145.896250, deriv: -50.846163
Highest weights:
[ind|op~ : 9.20915, ind|&nd : 9.16245, ind|9TINk : 9.02818, ind|Els : 8.88508, ind|prIti : 8.78922, ind|oke : 8.66744, ind|Its : 8.54963, ind|pik6bu : 8.46255, ind|kreanz : 8.45488, ind|hAmpti : 8.36251, ind|&pL : 8.21007, ind|yu : 8.16051, ind|6bQt : 8.14699, ind|6gEn : 8.03871, ind|hANgri : 7.99621, ind|#Doz : 7.99471, ind|&n6mL : 7.81249, ind|D6 : 7.79735, ind|&lIs : 7.74733, ind|hQmEni : 7.74672, ind|dr&g~ : 7.71607, ind|wan6 : 7.65289, ind|v*i : 7.59807, ind|mANki : 7.56958, ind|6nADR : 7.52669, ind|ovR : 7.52131, ind|It : 7.52081, ind|D&t : 7.44179, ind|want : 7.36981, ind|k9nd6v : 7.30717, ind|dOgi : 7.29488, ind|n9tn9t : 7.24885, ind|Iz : 7.17305, ind|kIti : 7.15489, ind|WAts : 7.14347, ind|g6n6 : 7.10233, ind|lUk&t : 7.10131, ind|b6lunz : 7.09241, ind|sIndi : 7.079, ind|go6hEd : 7.03863, ind|du : 7.00214, ind|hElo : 6.99063, ind|DIs : 6.9843, ind|b9b9 : 6.97269, ind|mamiz : 6.92876, ind|lItL : 6.91874, ind|IN : 6.89086, ind|dAmpti : 6.86955, ind|bAni : 6.83987, ind|WAt : 6.80544, ind|dont : 6.78494, ind|d&di : 6.76209, ind|tu : 6.75362, ind|6 : 6.75039, ind|Tri : 6.7324, ind|In : 6.72646, ind|D&ts : 6.69688, ind|Qt : 6.68879, ind|lUk : 6.64858, ind|k&n : 6.62653, ind|brAS : 6.58379, ind|blaks : 6.57938, ind|mami : 6.54963, ind|zskr& : 6.54522, ind|si : 6.47381, ind|Iz~t : 6.47353, ind|wAn : 6.42111, ind|y& : 6.41402, ind|tEl6 : 6.41362, ind|D*z : 6.37959, ind|smEl : 6.36547, ind|Olr9t : 6.34414, ind|%InG : 6.34154, ind|l9k : 6.27328, ind|T&Nk : 6.26782, ind|pliz : 6.2257, ind|bebi : 6.19812, ind|an : 6.14852, ind|Gudi : 6.14384, ind|cifes : 6.13484, ind|W*z : 6.13405, ind|9dont : 6.13241, ind|r9t : 6.11615, ind|Eni : 6.10191, ind|mebi : 6.08781, ind|h&nd : 6.05176, ind|slip : 6.02069, ind|&ni : 6.00044, ind|dAz~t : 5.97819, ind|mi : 5.95276, ind|bUk : 5.94115, ind|b6lun : 5.9347, ind|ADR : 5.92449, ind|D* : 5.90452, ind|ple : 5.89922, ind|blak : 5.89699, ind|t6de : 5.89324, ind|sAmT : 5.88933, ind|dIgbi : 5.86826, ind|hi : 5.85536, ind|m6ri : 5.84935]
Lowest weights:
[ind|NQ : -1.06867, ind|mo : -1.06878, ind|N9 : -1.06963, ind|rQ : -1.0697, ind|wo : -1.0698, ind|gQ : -1.0699, ind|LQ : -1.06999, ind|~o : -1.07027, ind|~Q : -1.0703, ind|ze : -1.07038, ind|yo : -1.07062, ind|v7 : -1.07098, ind|No : -1.07106, ind|n7 : -1.07216, ind|a : -1.07766, ind|u : -1.07949, ind|O : -1.08789, ind|h9# : -1.08936, ind|sR : -1.10575, ind|U : -1.11797, ind|tR# : -1.12016, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.13912, phonocvrpresuf4gram|^crc : -1.15387, ind|h# : -1.15989, phonocvrpresuf3gram|rc^ : -1.16414, ind|cR : -1.16534, ind|pR : -1.17237, ind|s( : -1.17662, ind|s# : -1.18242, ind|t9R : -1.18783, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.18804, ind|t% : -1.19433, ind|k* : -1.19562, phonocvrpresuf4gram|rvc^ : -1.19738, ind|t# : -1.20131, ind|S% : -1.20637, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.20787, ind|T# : -1.20999, ind|c( : -1.21057, ind|S* : -1.21086, ind|kR : -1.21089, ind|k% : -1.21142, ind|p% : -1.2119, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21376, phonocvrpresuf2gram|^r : -1.25127, phonofeatpresuf2gram|(vX)(^^) : -1.25784, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.26176, ind|pe : -1.26266, ind|lR# : -1.2688, ind|y)# : -1.27278, ind|f9 : -1.27877, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.27898, phonocvrpresuf4gram|^ccr : -1.28324, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28363, ind|k9 : -1.29014, ind|( : -1.29367, ind|s9 : -1.31623, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33219, phonocvrpresuf3gram|vv^ : -1.33939, ind|fo : -1.34689, ind|tQ : -1.34905, ind|fe : -1.35127, ind|sQ : -1.35146, ind|c9 : -1.35466, ind|ho : -1.35624, ind|p9 : -1.35648, ind|po : -1.35689, ind|Se : -1.35756, ind|We : -1.35925, ind|fQ : -1.36035, ind|ce : -1.36175, ind|cQ : -1.36177, ind|TQ : -1.36181, ind|pQ : -1.36189, ind|) : -1.36938, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38419, phonocvrpresuf3gram|^vv : -1.38482, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41404, phonocvrpresuf4gram|ccv^ : -1.45753, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46546, phonocvrpresuf3gram|^cc : -1.48907, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51231, phonocvrpresuf4gram|^vcc : -1.51771, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63357, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.6515, ind|Q : -1.66618, ind|7 : -1.70176, len|lenraw7 : -1.79732, numphonov|numv5 : -1.91734, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93644, phonocvrpresuf3gram|^rc : -1.97173, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.14816, phonocvrpresuf4gram|vvc^ : -2.15445, phonocvrpresuf4gram|^vcr : -2.17499, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.22959, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48021, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80792, len|lenraw8 : -4.63762, numphonov|numv4 : -5.07586, len|lenraw9 : -5.42294, len|lenraw10 : -5.48439]
} [1.0s, cum. 3.0s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.007, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.842)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [3.2s, cum. 34m13s]
Iteration 843/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
Line search iter: value: 402132.986041, suff decrease: 402145.891166
Highest weights:
[ind|op~ : 9.20915, ind|&nd : 9.16245, ind|9TINk : 9.02818, ind|Els : 8.88508, ind|prIti : 8.78922, ind|oke : 8.66744, ind|Its : 8.54963, ind|pik6bu : 8.46255, ind|kreanz : 8.45488, ind|hAmpti : 8.36251, ind|&pL : 8.21007, ind|yu : 8.16051, ind|6bQt : 8.14699, ind|6gEn : 8.03871, ind|hANgri : 7.99621, ind|#Doz : 7.99471, ind|&n6mL : 7.81249, ind|D6 : 7.79735, ind|&lIs : 7.74733, ind|hQmEni : 7.74672, ind|dr&g~ : 7.71607, ind|wan6 : 7.65289, ind|v*i : 7.59807, ind|mANki : 7.56958, ind|6nADR : 7.52669, ind|ovR : 7.52131, ind|It : 7.52081, ind|D&t : 7.44179, ind|want : 7.36981, ind|k9nd6v : 7.30717, ind|dOgi : 7.29488, ind|n9tn9t : 7.24885, ind|Iz : 7.17305, ind|kIti : 7.15489, ind|WAts : 7.14347, ind|g6n6 : 7.10233, ind|lUk&t : 7.10131, ind|b6lunz : 7.09241, ind|sIndi : 7.079, ind|go6hEd : 7.03863, ind|du : 7.00214, ind|hElo : 6.99063, ind|DIs : 6.9843, ind|b9b9 : 6.97269, ind|mamiz : 6.92876, ind|lItL : 6.91874, ind|IN : 6.89086, ind|dAmpti : 6.86955, ind|bAni : 6.83987, ind|WAt : 6.80544, ind|dont : 6.78494, ind|d&di : 6.76209, ind|tu : 6.75362, ind|6 : 6.75039, ind|Tri : 6.7324, ind|In : 6.72646, ind|D&ts : 6.69688, ind|Qt : 6.68879, ind|lUk : 6.64858, ind|k&n : 6.62653, ind|brAS : 6.58379, ind|blaks : 6.57938, ind|mami : 6.54963, ind|zskr& : 6.54522, ind|si : 6.47381, ind|Iz~t : 6.47353, ind|wAn : 6.42111, ind|y& : 6.41402, ind|tEl6 : 6.41362, ind|D*z : 6.37959, ind|smEl : 6.36547, ind|Olr9t : 6.34414, ind|%InG : 6.34154, ind|l9k : 6.27328, ind|T&Nk : 6.26782, ind|pliz : 6.2257, ind|bebi : 6.19812, ind|an : 6.14852, ind|Gudi : 6.14384, ind|cifes : 6.13484, ind|W*z : 6.13405, ind|9dont : 6.13241, ind|r9t : 6.11615, ind|Eni : 6.10191, ind|mebi : 6.08781, ind|h&nd : 6.05176, ind|slip : 6.02069, ind|&ni : 6.00044, ind|dAz~t : 5.97819, ind|mi : 5.95276, ind|bUk : 5.94115, ind|b6lun : 5.9347, ind|ADR : 5.92449, ind|D* : 5.90452, ind|ple : 5.89922, ind|blak : 5.89699, ind|t6de : 5.89324, ind|sAmT : 5.88933, ind|dIgbi : 5.86826, ind|hi : 5.85536, ind|m6ri : 5.84935]
Lowest weights:
[ind|NQ : -1.06867, ind|mo : -1.06878, ind|N9 : -1.06963, ind|rQ : -1.0697, ind|wo : -1.0698, ind|gQ : -1.0699, ind|LQ : -1.06999, ind|~o : -1.07027, ind|~Q : -1.0703, ind|ze : -1.07038, ind|yo : -1.07062, ind|v7 : -1.07098, ind|No : -1.07106, ind|n7 : -1.07216, ind|a : -1.07766, ind|u : -1.07949, ind|O : -1.08789, ind|h9# : -1.08936, ind|sR : -1.10575, ind|U : -1.11797, ind|tR# : -1.12016, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.13912, phonocvrpresuf4gram|^crc : -1.15387, ind|h# : -1.15989, phonocvrpresuf3gram|rc^ : -1.16414, ind|cR : -1.16534, ind|pR : -1.17237, ind|s( : -1.17662, ind|s# : -1.18242, ind|t9R : -1.18783, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.18804, ind|t% : -1.19433, ind|k* : -1.19562, phonocvrpresuf4gram|rvc^ : -1.19738, ind|t# : -1.20131, ind|S% : -1.20637, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.20787, ind|T# : -1.20999, ind|c( : -1.21057, ind|S* : -1.21086, ind|kR : -1.21089, ind|k% : -1.21142, ind|p% : -1.2119, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21376, phonocvrpresuf2gram|^r : -1.25127, phonofeatpresuf2gram|(vX)(^^) : -1.25784, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.26176, ind|pe : -1.26266, ind|lR# : -1.2688, ind|y)# : -1.27278, ind|f9 : -1.27877, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.27898, phonocvrpresuf4gram|^ccr : -1.28324, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28363, ind|k9 : -1.29014, ind|( : -1.29367, ind|s9 : -1.31623, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33219, phonocvrpresuf3gram|vv^ : -1.33939, ind|fo : -1.34689, ind|tQ : -1.34905, ind|fe : -1.35127, ind|sQ : -1.35146, ind|c9 : -1.35466, ind|ho : -1.35624, ind|p9 : -1.35648, ind|po : -1.35689, ind|Se : -1.35756, ind|We : -1.35925, ind|fQ : -1.36035, ind|ce : -1.36175, ind|cQ : -1.36177, ind|TQ : -1.36181, ind|pQ : -1.36189, ind|) : -1.36938, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38419, phonocvrpresuf3gram|^vv : -1.38482, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41404, phonocvrpresuf4gram|ccv^ : -1.45753, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46546, phonocvrpresuf3gram|^cc : -1.48907, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51231, phonocvrpresuf4gram|^vcc : -1.51771, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63357, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.6515, ind|Q : -1.66618, ind|7 : -1.70176, len|lenraw7 : -1.79732, numphonov|numv5 : -1.91734, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93644, phonocvrpresuf3gram|^rc : -1.97173, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.14816, phonocvrpresuf4gram|vvc^ : -2.15445, phonocvrpresuf4gram|^vcr : -2.17499, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.22959, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48021, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80792, len|lenraw8 : -4.63762, numphonov|numv4 : -5.07586, len|lenraw9 : -5.42294, len|lenraw10 : -5.48439]
} [1.3s, cum. 2.4s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.843)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.4s, cum. 34m15s]
Iteration 844/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage3 calc 275: 402132.986041
[LBFGSMinimizer.minimize] Iteration 275 ended with value 402132.986041
Highest weights:
[ind|op~ : 9.20915, ind|&nd : 9.16245, ind|9TINk : 9.02818, ind|Els : 8.88508, ind|prIti : 8.78922, ind|oke : 8.66744, ind|Its : 8.54963, ind|pik6bu : 8.46255, ind|kreanz : 8.45488, ind|hAmpti : 8.36251, ind|&pL : 8.21007, ind|yu : 8.16051, ind|6bQt : 8.14699, ind|6gEn : 8.03871, ind|hANgri : 7.99621, ind|#Doz : 7.99471, ind|&n6mL : 7.81249, ind|D6 : 7.79735, ind|&lIs : 7.74733, ind|hQmEni : 7.74672, ind|dr&g~ : 7.71607, ind|wan6 : 7.65289, ind|v*i : 7.59807, ind|mANki : 7.56958, ind|6nADR : 7.52669, ind|ovR : 7.52131, ind|It : 7.52081, ind|D&t : 7.44179, ind|want : 7.36981, ind|k9nd6v : 7.30717, ind|dOgi : 7.29488, ind|n9tn9t : 7.24885, ind|Iz : 7.17305, ind|kIti : 7.15489, ind|WAts : 7.14347, ind|g6n6 : 7.10233, ind|lUk&t : 7.10131, ind|b6lunz : 7.09241, ind|sIndi : 7.079, ind|go6hEd : 7.03863, ind|du : 7.00214, ind|hElo : 6.99063, ind|DIs : 6.9843, ind|b9b9 : 6.97269, ind|mamiz : 6.92876, ind|lItL : 6.91874, ind|IN : 6.89086, ind|dAmpti : 6.86955, ind|bAni : 6.83987, ind|WAt : 6.80544, ind|dont : 6.78494, ind|d&di : 6.76209, ind|tu : 6.75362, ind|6 : 6.75039, ind|Tri : 6.7324, ind|In : 6.72646, ind|D&ts : 6.69688, ind|Qt : 6.68879, ind|lUk : 6.64858, ind|k&n : 6.62653, ind|brAS : 6.58379, ind|blaks : 6.57938, ind|mami : 6.54963, ind|zskr& : 6.54522, ind|si : 6.47381, ind|Iz~t : 6.47353, ind|wAn : 6.42111, ind|y& : 6.41402, ind|tEl6 : 6.41362, ind|D*z : 6.37959, ind|smEl : 6.36547, ind|Olr9t : 6.34414, ind|%InG : 6.34154, ind|l9k : 6.27328, ind|T&Nk : 6.26782, ind|pliz : 6.2257, ind|bebi : 6.19812, ind|an : 6.14852, ind|Gudi : 6.14384, ind|cifes : 6.13484, ind|W*z : 6.13405, ind|9dont : 6.13241, ind|r9t : 6.11615, ind|Eni : 6.10191, ind|mebi : 6.08781, ind|h&nd : 6.05176, ind|slip : 6.02069, ind|&ni : 6.00044, ind|dAz~t : 5.97819, ind|mi : 5.95276, ind|bUk : 5.94115, ind|b6lun : 5.9347, ind|ADR : 5.92449, ind|D* : 5.90452, ind|ple : 5.89922, ind|blak : 5.89699, ind|t6de : 5.89324, ind|sAmT : 5.88933, ind|dIgbi : 5.86826, ind|hi : 5.85536, ind|m6ri : 5.84935]
Lowest weights:
[ind|NQ : -1.06867, ind|mo : -1.06878, ind|N9 : -1.06963, ind|rQ : -1.0697, ind|wo : -1.0698, ind|gQ : -1.0699, ind|LQ : -1.06999, ind|~o : -1.07027, ind|~Q : -1.0703, ind|ze : -1.07038, ind|yo : -1.07062, ind|v7 : -1.07098, ind|No : -1.07106, ind|n7 : -1.07216, ind|a : -1.07766, ind|u : -1.07949, ind|O : -1.08789, ind|h9# : -1.08936, ind|sR : -1.10575, ind|U : -1.11797, ind|tR# : -1.12016, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.13912, phonocvrpresuf4gram|^crc : -1.15387, ind|h# : -1.15989, phonocvrpresuf3gram|rc^ : -1.16414, ind|cR : -1.16534, ind|pR : -1.17237, ind|s( : -1.17662, ind|s# : -1.18242, ind|t9R : -1.18783, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.18804, ind|t% : -1.19433, ind|k* : -1.19562, phonocvrpresuf4gram|rvc^ : -1.19738, ind|t# : -1.20131, ind|S% : -1.20637, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.20787, ind|T# : -1.20999, ind|c( : -1.21057, ind|S* : -1.21086, ind|kR : -1.21089, ind|k% : -1.21142, ind|p% : -1.2119, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21376, phonocvrpresuf2gram|^r : -1.25127, phonofeatpresuf2gram|(vX)(^^) : -1.25784, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.26176, ind|pe : -1.26266, ind|lR# : -1.2688, ind|y)# : -1.27278, ind|f9 : -1.27877, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.27898, phonocvrpresuf4gram|^ccr : -1.28324, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28363, ind|k9 : -1.29014, ind|( : -1.29367, ind|s9 : -1.31623, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33219, phonocvrpresuf3gram|vv^ : -1.33939, ind|fo : -1.34689, ind|tQ : -1.34905, ind|fe : -1.35127, ind|sQ : -1.35146, ind|c9 : -1.35466, ind|ho : -1.35624, ind|p9 : -1.35648, ind|po : -1.35689, ind|Se : -1.35756, ind|We : -1.35925, ind|fQ : -1.36035, ind|ce : -1.36175, ind|cQ : -1.36177, ind|TQ : -1.36181, ind|pQ : -1.36189, ind|) : -1.36938, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38419, phonocvrpresuf3gram|^vv : -1.38482, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41404, phonocvrpresuf4gram|ccv^ : -1.45753, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46546, phonocvrpresuf3gram|^cc : -1.48907, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51231, phonocvrpresuf4gram|^vcc : -1.51771, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63357, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.6515, ind|Q : -1.66618, ind|7 : -1.70176, len|lenraw7 : -1.79732, numphonov|numv5 : -1.91734, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93644, phonocvrpresuf3gram|^rc : -1.97173, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.14816, phonocvrpresuf4gram|vvc^ : -2.15445, phonocvrpresuf4gram|^vcr : -2.17499, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.22959, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48021, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80792, len|lenraw8 : -4.63762, numphonov|numv4 : -5.07586, len|lenraw9 : -5.42294, len|lenraw10 : -5.48439]
} [1.0s, cum. 2.0s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.844)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.2s, cum. 34m18s]
Iteration 845/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage1 calc 276: 402132.986041
Line search init: value: 402132.986041, deriv: -20.243509
Highest weights:
[ind|op~ : 9.20756, ind|&nd : 9.15349, ind|9TINk : 9.03044, ind|Els : 8.86752, ind|prIti : 8.79941, ind|oke : 8.66602, ind|Its : 8.53774, ind|kreanz : 8.46049, ind|pik6bu : 8.45899, ind|hAmpti : 8.37752, ind|&pL : 8.22962, ind|yu : 8.15729, ind|6bQt : 8.13972, ind|6gEn : 8.04352, ind|#Doz : 8.01756, ind|hANgri : 7.99144, ind|&n6mL : 7.85185, ind|D6 : 7.79155, ind|hQmEni : 7.76575, ind|&lIs : 7.73562, ind|dr&g~ : 7.72208, ind|wan6 : 7.66831, ind|v*i : 7.60699, ind|mANki : 7.57591, ind|ovR : 7.53103, ind|It : 7.523, ind|6nADR : 7.5177, ind|D&t : 7.44659, ind|want : 7.36944, ind|k9nd6v : 7.30038, ind|dOgi : 7.29658, ind|n9tn9t : 7.25023, ind|Iz : 7.16859, ind|kIti : 7.16199, ind|WAts : 7.14322, ind|lUk&t : 7.10144, ind|g6n6 : 7.09867, ind|b6lunz : 7.0676, ind|go6hEd : 7.04438, ind|sIndi : 7.04112, ind|du : 6.99417, ind|DIs : 6.98859, ind|hElo : 6.98416, ind|b9b9 : 6.96371, ind|mamiz : 6.94187, ind|dAmpti : 6.92078, ind|lItL : 6.91135, ind|IN : 6.88441, ind|bAni : 6.83384, ind|WAt : 6.81009, ind|dont : 6.78786, ind|6 : 6.76176, ind|d&di : 6.75593, ind|tu : 6.75238, ind|Tri : 6.72795, ind|In : 6.71994, ind|D&ts : 6.70183, ind|Qt : 6.68065, ind|lUk : 6.65485, ind|k&n : 6.64075, ind|brAS : 6.59884, ind|blaks : 6.59448, ind|zskr& : 6.5878, ind|mami : 6.53605, ind|Iz~t : 6.482, ind|si : 6.46855, ind|wAn : 6.4301, ind|tEl6 : 6.41015, ind|y& : 6.39401, ind|D*z : 6.38656, ind|smEl : 6.36815, ind|%InG : 6.36602, ind|Olr9t : 6.33058, ind|T&Nk : 6.27647, ind|l9k : 6.27645, ind|pliz : 6.22682, ind|bebi : 6.21152, ind|an : 6.14442, ind|cifes : 6.13016, ind|9dont : 6.12887, ind|W*z : 6.12742, ind|Gudi : 6.12262, ind|r9t : 6.11292, ind|Eni : 6.09915, ind|mebi : 6.08483, ind|h&nd : 6.05361, ind|slip : 6.01736, ind|&ni : 6.0166, ind|dAz~t : 5.96869, ind|mi : 5.9625, ind|bUk : 5.93737, ind|ADR : 5.91675, ind|sAmT : 5.9152, ind|b6lun : 5.91412, ind|D* : 5.91334, ind|blak : 5.90841, ind|dIgbi : 5.90556, ind|t6de : 5.89423, ind|ple : 5.88354, ind|m6ri : 5.8629, ind|hi : 5.8494]
Lowest weights:
[ind|NQ : -1.06945, ind|mo : -1.06956, ind|N9 : -1.07041, ind|rQ : -1.07048, ind|wo : -1.07056, ind|gQ : -1.07067, ind|LQ : -1.07076, ind|~o : -1.07103, ind|~Q : -1.07107, ind|ze : -1.07114, ind|yo : -1.07139, ind|v7 : -1.07174, ind|No : -1.07182, ind|n7 : -1.07291, ind|a : -1.07907, ind|u : -1.08095, ind|O : -1.08933, ind|h9# : -1.0919, ind|sR : -1.1069, ind|U : -1.1193, ind|tR# : -1.12175, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14185, phonocvrpresuf4gram|^crc : -1.15578, ind|h# : -1.16169, phonocvrpresuf3gram|rc^ : -1.16411, ind|cR : -1.16728, ind|pR : -1.17468, ind|s( : -1.17865, ind|s# : -1.18434, phonocvrpresuf4gram|rvc^ : -1.19095, ind|t9R : -1.19108, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19427, ind|t% : -1.19632, ind|k* : -1.19754, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.19873, ind|t# : -1.2033, ind|S% : -1.2083, ind|T# : -1.21187, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21228, ind|c( : -1.21244, ind|S* : -1.2127, ind|kR : -1.21275, ind|k% : -1.21328, ind|p% : -1.21375, phonocvrpresuf2gram|^r : -1.25097, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25972, phonofeatpresuf2gram|(vX)(^^) : -1.26295, ind|pe : -1.26543, ind|lR# : -1.27039, phonocvrpresuf4gram|^ccr : -1.27177, ind|y)# : -1.27433, ind|f9 : -1.28066, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28083, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28771, ind|k9 : -1.29327, ind|( : -1.29609, ind|s9 : -1.31844, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33259, phonocvrpresuf3gram|vv^ : -1.33841, ind|fo : -1.34934, ind|tQ : -1.35134, ind|fe : -1.35352, ind|sQ : -1.35378, ind|c9 : -1.35682, ind|ho : -1.3585, ind|p9 : -1.35872, ind|po : -1.35909, ind|Se : -1.35978, ind|We : -1.36144, ind|fQ : -1.36255, ind|ce : -1.36393, ind|cQ : -1.36396, ind|TQ : -1.36399, ind|pQ : -1.36407, ind|) : -1.37206, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38282, phonocvrpresuf3gram|^vv : -1.38504, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41363, phonocvrpresuf4gram|ccv^ : -1.45302, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46575, phonocvrpresuf3gram|^cc : -1.4893, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51185, phonocvrpresuf4gram|^vcc : -1.51464, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63238, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64353, ind|Q : -1.66967, ind|7 : -1.70486, len|lenraw7 : -1.80391, numphonov|numv5 : -1.9125, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93292, phonocvrpresuf3gram|^rc : -1.96478, phonocvrpresuf4gram|vvc^ : -2.14592, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.1547, phonocvrpresuf4gram|^vcr : -2.1678, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23431, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48051, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.8063, len|lenraw8 : -4.62616, numphonov|numv4 : -5.06304, len|lenraw9 : -5.40934, len|lenraw10 : -5.47059]
} [1.0s, cum. 2.1s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.845)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.2s, cum. 34m20s]
Iteration 846/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
Line search iter: value: 402118.921941, suff decrease: 402132.984016
Highest weights:
[ind|op~ : 9.20756, ind|&nd : 9.15349, ind|9TINk : 9.03044, ind|Els : 8.86752, ind|prIti : 8.79941, ind|oke : 8.66602, ind|Its : 8.53774, ind|kreanz : 8.46049, ind|pik6bu : 8.45899, ind|hAmpti : 8.37752, ind|&pL : 8.22962, ind|yu : 8.15729, ind|6bQt : 8.13972, ind|6gEn : 8.04352, ind|#Doz : 8.01756, ind|hANgri : 7.99144, ind|&n6mL : 7.85185, ind|D6 : 7.79155, ind|hQmEni : 7.76575, ind|&lIs : 7.73562, ind|dr&g~ : 7.72208, ind|wan6 : 7.66831, ind|v*i : 7.60699, ind|mANki : 7.57591, ind|ovR : 7.53103, ind|It : 7.523, ind|6nADR : 7.5177, ind|D&t : 7.44659, ind|want : 7.36944, ind|k9nd6v : 7.30038, ind|dOgi : 7.29658, ind|n9tn9t : 7.25023, ind|Iz : 7.16859, ind|kIti : 7.16199, ind|WAts : 7.14322, ind|lUk&t : 7.10144, ind|g6n6 : 7.09867, ind|b6lunz : 7.0676, ind|go6hEd : 7.04438, ind|sIndi : 7.04112, ind|du : 6.99417, ind|DIs : 6.98859, ind|hElo : 6.98416, ind|b9b9 : 6.96371, ind|mamiz : 6.94187, ind|dAmpti : 6.92078, ind|lItL : 6.91135, ind|IN : 6.88441, ind|bAni : 6.83384, ind|WAt : 6.81009, ind|dont : 6.78786, ind|6 : 6.76176, ind|d&di : 6.75593, ind|tu : 6.75238, ind|Tri : 6.72795, ind|In : 6.71994, ind|D&ts : 6.70183, ind|Qt : 6.68065, ind|lUk : 6.65485, ind|k&n : 6.64075, ind|brAS : 6.59884, ind|blaks : 6.59448, ind|zskr& : 6.5878, ind|mami : 6.53605, ind|Iz~t : 6.482, ind|si : 6.46855, ind|wAn : 6.4301, ind|tEl6 : 6.41015, ind|y& : 6.39401, ind|D*z : 6.38656, ind|smEl : 6.36815, ind|%InG : 6.36602, ind|Olr9t : 6.33058, ind|T&Nk : 6.27647, ind|l9k : 6.27645, ind|pliz : 6.22682, ind|bebi : 6.21152, ind|an : 6.14442, ind|cifes : 6.13016, ind|9dont : 6.12887, ind|W*z : 6.12742, ind|Gudi : 6.12262, ind|r9t : 6.11292, ind|Eni : 6.09915, ind|mebi : 6.08483, ind|h&nd : 6.05361, ind|slip : 6.01736, ind|&ni : 6.0166, ind|dAz~t : 5.96869, ind|mi : 5.9625, ind|bUk : 5.93737, ind|ADR : 5.91675, ind|sAmT : 5.9152, ind|b6lun : 5.91412, ind|D* : 5.91334, ind|blak : 5.90841, ind|dIgbi : 5.90556, ind|t6de : 5.89423, ind|ple : 5.88354, ind|m6ri : 5.8629, ind|hi : 5.8494]
Lowest weights:
[ind|NQ : -1.06945, ind|mo : -1.06956, ind|N9 : -1.07041, ind|rQ : -1.07048, ind|wo : -1.07056, ind|gQ : -1.07067, ind|LQ : -1.07076, ind|~o : -1.07103, ind|~Q : -1.07107, ind|ze : -1.07114, ind|yo : -1.07139, ind|v7 : -1.07174, ind|No : -1.07182, ind|n7 : -1.07291, ind|a : -1.07907, ind|u : -1.08095, ind|O : -1.08933, ind|h9# : -1.0919, ind|sR : -1.1069, ind|U : -1.1193, ind|tR# : -1.12175, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14185, phonocvrpresuf4gram|^crc : -1.15578, ind|h# : -1.16169, phonocvrpresuf3gram|rc^ : -1.16411, ind|cR : -1.16728, ind|pR : -1.17468, ind|s( : -1.17865, ind|s# : -1.18434, phonocvrpresuf4gram|rvc^ : -1.19095, ind|t9R : -1.19108, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19427, ind|t% : -1.19632, ind|k* : -1.19754, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.19873, ind|t# : -1.2033, ind|S% : -1.2083, ind|T# : -1.21187, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21228, ind|c( : -1.21244, ind|S* : -1.2127, ind|kR : -1.21275, ind|k% : -1.21328, ind|p% : -1.21375, phonocvrpresuf2gram|^r : -1.25097, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25972, phonofeatpresuf2gram|(vX)(^^) : -1.26295, ind|pe : -1.26543, ind|lR# : -1.27039, phonocvrpresuf4gram|^ccr : -1.27177, ind|y)# : -1.27433, ind|f9 : -1.28066, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28083, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28771, ind|k9 : -1.29327, ind|( : -1.29609, ind|s9 : -1.31844, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33259, phonocvrpresuf3gram|vv^ : -1.33841, ind|fo : -1.34934, ind|tQ : -1.35134, ind|fe : -1.35352, ind|sQ : -1.35378, ind|c9 : -1.35682, ind|ho : -1.3585, ind|p9 : -1.35872, ind|po : -1.35909, ind|Se : -1.35978, ind|We : -1.36144, ind|fQ : -1.36255, ind|ce : -1.36393, ind|cQ : -1.36396, ind|TQ : -1.36399, ind|pQ : -1.36407, ind|) : -1.37206, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38282, phonocvrpresuf3gram|^vv : -1.38504, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41363, phonocvrpresuf4gram|ccv^ : -1.45302, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46575, phonocvrpresuf3gram|^cc : -1.4893, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51185, phonocvrpresuf4gram|^vcc : -1.51464, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63238, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64353, ind|Q : -1.66967, ind|7 : -1.70486, len|lenraw7 : -1.80391, numphonov|numv5 : -1.9125, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93292, phonocvrpresuf3gram|^rc : -1.96478, phonocvrpresuf4gram|vvc^ : -2.14592, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.1547, phonocvrpresuf4gram|^vcr : -2.1678, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23431, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48051, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.8063, len|lenraw8 : -4.62616, numphonov|numv4 : -5.06304, len|lenraw9 : -5.40934, len|lenraw10 : -5.47059]
} [1.3s, cum. 2.4s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.007, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.846)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.5s, cum. 34m22s]
Iteration 847/99999: temperature = 1 {
E-step [1.1s, cum. 1.1s]
M-step {
LFGS stage3 calc 276: 402118.921941
[LBFGSMinimizer.minimize] Iteration 276 ended with value 402118.921941
Highest weights:
[ind|op~ : 9.20756, ind|&nd : 9.15349, ind|9TINk : 9.03044, ind|Els : 8.86752, ind|prIti : 8.79941, ind|oke : 8.66602, ind|Its : 8.53774, ind|kreanz : 8.46049, ind|pik6bu : 8.45899, ind|hAmpti : 8.37752, ind|&pL : 8.22962, ind|yu : 8.15729, ind|6bQt : 8.13972, ind|6gEn : 8.04352, ind|#Doz : 8.01756, ind|hANgri : 7.99144, ind|&n6mL : 7.85185, ind|D6 : 7.79155, ind|hQmEni : 7.76575, ind|&lIs : 7.73562, ind|dr&g~ : 7.72208, ind|wan6 : 7.66831, ind|v*i : 7.60699, ind|mANki : 7.57591, ind|ovR : 7.53103, ind|It : 7.523, ind|6nADR : 7.5177, ind|D&t : 7.44659, ind|want : 7.36944, ind|k9nd6v : 7.30038, ind|dOgi : 7.29658, ind|n9tn9t : 7.25023, ind|Iz : 7.16859, ind|kIti : 7.16199, ind|WAts : 7.14322, ind|lUk&t : 7.10144, ind|g6n6 : 7.09867, ind|b6lunz : 7.0676, ind|go6hEd : 7.04438, ind|sIndi : 7.04112, ind|du : 6.99417, ind|DIs : 6.98859, ind|hElo : 6.98416, ind|b9b9 : 6.96371, ind|mamiz : 6.94187, ind|dAmpti : 6.92078, ind|lItL : 6.91135, ind|IN : 6.88441, ind|bAni : 6.83384, ind|WAt : 6.81009, ind|dont : 6.78786, ind|6 : 6.76176, ind|d&di : 6.75593, ind|tu : 6.75238, ind|Tri : 6.72795, ind|In : 6.71994, ind|D&ts : 6.70183, ind|Qt : 6.68065, ind|lUk : 6.65485, ind|k&n : 6.64075, ind|brAS : 6.59884, ind|blaks : 6.59448, ind|zskr& : 6.5878, ind|mami : 6.53605, ind|Iz~t : 6.482, ind|si : 6.46855, ind|wAn : 6.4301, ind|tEl6 : 6.41015, ind|y& : 6.39401, ind|D*z : 6.38656, ind|smEl : 6.36815, ind|%InG : 6.36602, ind|Olr9t : 6.33058, ind|T&Nk : 6.27647, ind|l9k : 6.27645, ind|pliz : 6.22682, ind|bebi : 6.21152, ind|an : 6.14442, ind|cifes : 6.13016, ind|9dont : 6.12887, ind|W*z : 6.12742, ind|Gudi : 6.12262, ind|r9t : 6.11292, ind|Eni : 6.09915, ind|mebi : 6.08483, ind|h&nd : 6.05361, ind|slip : 6.01736, ind|&ni : 6.0166, ind|dAz~t : 5.96869, ind|mi : 5.9625, ind|bUk : 5.93737, ind|ADR : 5.91675, ind|sAmT : 5.9152, ind|b6lun : 5.91412, ind|D* : 5.91334, ind|blak : 5.90841, ind|dIgbi : 5.90556, ind|t6de : 5.89423, ind|ple : 5.88354, ind|m6ri : 5.8629, ind|hi : 5.8494]
Lowest weights:
[ind|NQ : -1.06945, ind|mo : -1.06956, ind|N9 : -1.07041, ind|rQ : -1.07048, ind|wo : -1.07056, ind|gQ : -1.07067, ind|LQ : -1.07076, ind|~o : -1.07103, ind|~Q : -1.07107, ind|ze : -1.07114, ind|yo : -1.07139, ind|v7 : -1.07174, ind|No : -1.07182, ind|n7 : -1.07291, ind|a : -1.07907, ind|u : -1.08095, ind|O : -1.08933, ind|h9# : -1.0919, ind|sR : -1.1069, ind|U : -1.1193, ind|tR# : -1.12175, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14185, phonocvrpresuf4gram|^crc : -1.15578, ind|h# : -1.16169, phonocvrpresuf3gram|rc^ : -1.16411, ind|cR : -1.16728, ind|pR : -1.17468, ind|s( : -1.17865, ind|s# : -1.18434, phonocvrpresuf4gram|rvc^ : -1.19095, ind|t9R : -1.19108, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19427, ind|t% : -1.19632, ind|k* : -1.19754, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.19873, ind|t# : -1.2033, ind|S% : -1.2083, ind|T# : -1.21187, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21228, ind|c( : -1.21244, ind|S* : -1.2127, ind|kR : -1.21275, ind|k% : -1.21328, ind|p% : -1.21375, phonocvrpresuf2gram|^r : -1.25097, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25972, phonofeatpresuf2gram|(vX)(^^) : -1.26295, ind|pe : -1.26543, ind|lR# : -1.27039, phonocvrpresuf4gram|^ccr : -1.27177, ind|y)# : -1.27433, ind|f9 : -1.28066, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28083, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28771, ind|k9 : -1.29327, ind|( : -1.29609, ind|s9 : -1.31844, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33259, phonocvrpresuf3gram|vv^ : -1.33841, ind|fo : -1.34934, ind|tQ : -1.35134, ind|fe : -1.35352, ind|sQ : -1.35378, ind|c9 : -1.35682, ind|ho : -1.3585, ind|p9 : -1.35872, ind|po : -1.35909, ind|Se : -1.35978, ind|We : -1.36144, ind|fQ : -1.36255, ind|ce : -1.36393, ind|cQ : -1.36396, ind|TQ : -1.36399, ind|pQ : -1.36407, ind|) : -1.37206, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38282, phonocvrpresuf3gram|^vv : -1.38504, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41363, phonocvrpresuf4gram|ccv^ : -1.45302, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46575, phonocvrpresuf3gram|^cc : -1.4893, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51185, phonocvrpresuf4gram|^vcc : -1.51464, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63238, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64353, ind|Q : -1.66967, ind|7 : -1.70486, len|lenraw7 : -1.80391, numphonov|numv5 : -1.9125, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.93292, phonocvrpresuf3gram|^rc : -1.96478, phonocvrpresuf4gram|vvc^ : -2.14592, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.1547, phonocvrpresuf4gram|^vcr : -2.1678, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23431, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48051, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.8063, len|lenraw8 : -4.62616, numphonov|numv4 : -5.06304, len|lenraw9 : -5.40934, len|lenraw10 : -5.47059]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.007, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.847)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m25s]
Iteration 848/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage1 calc 277: 402118.921941
Line search init: value: 402118.921941, deriv: -11.877891
Highest weights:
[ind|op~ : 9.20847, ind|&nd : 9.14921, ind|9TINk : 9.03157, ind|Els : 8.86197, ind|prIti : 8.79878, ind|oke : 8.66678, ind|Its : 8.53248, ind|kreanz : 8.45889, ind|pik6bu : 8.4564, ind|hAmpti : 8.38127, ind|&pL : 8.23314, ind|yu : 8.1471, ind|6bQt : 8.1371, ind|6gEn : 8.04304, ind|#Doz : 8.02233, ind|hANgri : 7.99112, ind|&n6mL : 7.86022, ind|D6 : 7.78955, ind|hQmEni : 7.77078, ind|&lIs : 7.73417, ind|dr&g~ : 7.72537, ind|wan6 : 7.67244, ind|v*i : 7.60932, ind|mANki : 7.57822, ind|ovR : 7.53426, ind|It : 7.52504, ind|6nADR : 7.51597, ind|D&t : 7.44853, ind|want : 7.37132, ind|k9nd6v : 7.29656, ind|dOgi : 7.29653, ind|n9tn9t : 7.25132, ind|Iz : 7.16547, ind|kIti : 7.16144, ind|WAts : 7.14442, ind|lUk&t : 7.10051, ind|g6n6 : 7.09875, ind|b6lunz : 7.063, ind|go6hEd : 7.04446, ind|sIndi : 7.03145, ind|du : 6.99773, ind|DIs : 6.9885, ind|hElo : 6.9849, ind|b9b9 : 6.96205, ind|mamiz : 6.94586, ind|dAmpti : 6.93515, ind|lItL : 6.90933, ind|IN : 6.88207, ind|bAni : 6.83332, ind|WAt : 6.80614, ind|dont : 6.7883, ind|6 : 6.76635, ind|d&di : 6.75602, ind|tu : 6.75061, ind|Tri : 6.72324, ind|In : 6.71671, ind|D&ts : 6.7046, ind|Qt : 6.67437, ind|lUk : 6.65301, ind|k&n : 6.64418, ind|brAS : 6.60196, ind|blaks : 6.60188, ind|zskr& : 6.59854, ind|mami : 6.53278, ind|Iz~t : 6.48454, ind|si : 6.46526, ind|wAn : 6.42761, ind|tEl6 : 6.4072, ind|y& : 6.39658, ind|D*z : 6.38801, ind|%InG : 6.37285, ind|smEl : 6.36808, ind|Olr9t : 6.32664, ind|T&Nk : 6.27815, ind|l9k : 6.2768, ind|pliz : 6.22625, ind|bebi : 6.21883, ind|an : 6.14404, ind|cifes : 6.12849, ind|9dont : 6.12778, ind|W*z : 6.12369, ind|Gudi : 6.1153, ind|r9t : 6.1118, ind|Eni : 6.10035, ind|mebi : 6.0808, ind|h&nd : 6.05239, ind|&ni : 6.01831, ind|slip : 6.01703, ind|dAz~t : 5.96436, ind|mi : 5.96303, ind|bUk : 5.93948, ind|sAmT : 5.92065, ind|dIgbi : 5.91473, ind|blak : 5.914, ind|ADR : 5.91147, ind|b6lun : 5.91055, ind|D* : 5.91048, ind|t6de : 5.89351, ind|ple : 5.87864, ind|m6ri : 5.86421, ind|hi : 5.84891]
Lowest weights:
[ind|NQ : -1.06964, ind|mo : -1.06975, ind|N9 : -1.07059, ind|rQ : -1.07066, ind|wo : -1.07075, ind|gQ : -1.07085, ind|LQ : -1.07094, ind|~o : -1.07122, ind|~Q : -1.07125, ind|ze : -1.07132, ind|yo : -1.07157, ind|v7 : -1.07192, ind|No : -1.072, ind|n7 : -1.0731, ind|a : -1.07939, ind|u : -1.08129, ind|O : -1.08966, ind|h9# : -1.09256, ind|sR : -1.10718, ind|U : -1.1196, ind|tR# : -1.12214, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14252, phonocvrpresuf4gram|^crc : -1.15111, phonocvrpresuf3gram|rc^ : -1.15717, ind|h# : -1.16214, ind|cR : -1.16777, ind|pR : -1.17526, ind|s( : -1.17916, ind|s# : -1.18482, phonocvrpresuf4gram|rvc^ : -1.18885, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19148, ind|t9R : -1.19193, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.196, ind|t% : -1.19682, ind|k* : -1.19802, ind|t# : -1.20381, ind|S% : -1.20878, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21182, ind|T# : -1.21235, ind|c( : -1.21291, ind|S* : -1.21315, ind|kR : -1.21322, ind|k% : -1.21375, ind|p% : -1.21422, phonocvrpresuf2gram|^r : -1.25173, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25905, phonofeatpresuf2gram|(vX)(^^) : -1.26297, ind|pe : -1.26614, phonocvrpresuf4gram|^ccr : -1.26822, ind|lR# : -1.27077, ind|y)# : -1.2747, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28098, ind|f9 : -1.28113, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28884, ind|k9 : -1.29406, ind|( : -1.29667, ind|s9 : -1.31899, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3326, phonocvrpresuf3gram|vv^ : -1.33909, ind|fo : -1.34995, ind|tQ : -1.35191, ind|fe : -1.35408, ind|sQ : -1.35436, ind|c9 : -1.35735, ind|ho : -1.35906, ind|p9 : -1.35927, ind|po : -1.35964, ind|Se : -1.36033, ind|We : -1.36199, ind|fQ : -1.36309, ind|ce : -1.36448, ind|cQ : -1.3645, ind|TQ : -1.36453, ind|pQ : -1.36461, ind|) : -1.37271, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38245, phonocvrpresuf3gram|^vv : -1.3851, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41112, phonocvrpresuf4gram|ccv^ : -1.45454, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46582, phonocvrpresuf3gram|^cc : -1.48938, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51165, phonocvrpresuf4gram|^vcc : -1.5162, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63194, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64044, ind|Q : -1.6706, ind|7 : -1.70567, len|lenraw7 : -1.80569, numphonov|numv5 : -1.91112, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.9315, phonocvrpresuf3gram|^rc : -1.96357, phonocvrpresuf4gram|vvc^ : -2.14345, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.15628, phonocvrpresuf4gram|^vcr : -2.16693, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23541, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48044, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80585, len|lenraw8 : -4.62288, numphonov|numv4 : -5.05937, len|lenraw9 : -5.40544, len|lenraw10 : -5.46664]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.007, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.848)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m27s]
Iteration 849/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
Line search iter: value: 402108.754468, suff decrease: 402118.920754
Highest weights:
[ind|op~ : 9.20847, ind|&nd : 9.14921, ind|9TINk : 9.03157, ind|Els : 8.86197, ind|prIti : 8.79878, ind|oke : 8.66678, ind|Its : 8.53248, ind|kreanz : 8.45889, ind|pik6bu : 8.4564, ind|hAmpti : 8.38127, ind|&pL : 8.23314, ind|yu : 8.1471, ind|6bQt : 8.1371, ind|6gEn : 8.04304, ind|#Doz : 8.02233, ind|hANgri : 7.99112, ind|&n6mL : 7.86022, ind|D6 : 7.78955, ind|hQmEni : 7.77078, ind|&lIs : 7.73417, ind|dr&g~ : 7.72537, ind|wan6 : 7.67244, ind|v*i : 7.60932, ind|mANki : 7.57822, ind|ovR : 7.53426, ind|It : 7.52504, ind|6nADR : 7.51597, ind|D&t : 7.44853, ind|want : 7.37132, ind|k9nd6v : 7.29656, ind|dOgi : 7.29653, ind|n9tn9t : 7.25132, ind|Iz : 7.16547, ind|kIti : 7.16144, ind|WAts : 7.14442, ind|lUk&t : 7.10051, ind|g6n6 : 7.09875, ind|b6lunz : 7.063, ind|go6hEd : 7.04446, ind|sIndi : 7.03145, ind|du : 6.99773, ind|DIs : 6.9885, ind|hElo : 6.9849, ind|b9b9 : 6.96205, ind|mamiz : 6.94586, ind|dAmpti : 6.93515, ind|lItL : 6.90933, ind|IN : 6.88207, ind|bAni : 6.83332, ind|WAt : 6.80614, ind|dont : 6.7883, ind|6 : 6.76635, ind|d&di : 6.75602, ind|tu : 6.75061, ind|Tri : 6.72324, ind|In : 6.71671, ind|D&ts : 6.7046, ind|Qt : 6.67437, ind|lUk : 6.65301, ind|k&n : 6.64418, ind|brAS : 6.60196, ind|blaks : 6.60188, ind|zskr& : 6.59854, ind|mami : 6.53278, ind|Iz~t : 6.48454, ind|si : 6.46526, ind|wAn : 6.42761, ind|tEl6 : 6.4072, ind|y& : 6.39658, ind|D*z : 6.38801, ind|%InG : 6.37285, ind|smEl : 6.36808, ind|Olr9t : 6.32664, ind|T&Nk : 6.27815, ind|l9k : 6.2768, ind|pliz : 6.22625, ind|bebi : 6.21883, ind|an : 6.14404, ind|cifes : 6.12849, ind|9dont : 6.12778, ind|W*z : 6.12369, ind|Gudi : 6.1153, ind|r9t : 6.1118, ind|Eni : 6.10035, ind|mebi : 6.0808, ind|h&nd : 6.05239, ind|&ni : 6.01831, ind|slip : 6.01703, ind|dAz~t : 5.96436, ind|mi : 5.96303, ind|bUk : 5.93948, ind|sAmT : 5.92065, ind|dIgbi : 5.91473, ind|blak : 5.914, ind|ADR : 5.91147, ind|b6lun : 5.91055, ind|D* : 5.91048, ind|t6de : 5.89351, ind|ple : 5.87864, ind|m6ri : 5.86421, ind|hi : 5.84891]
Lowest weights:
[ind|NQ : -1.06964, ind|mo : -1.06975, ind|N9 : -1.07059, ind|rQ : -1.07066, ind|wo : -1.07075, ind|gQ : -1.07085, ind|LQ : -1.07094, ind|~o : -1.07122, ind|~Q : -1.07125, ind|ze : -1.07132, ind|yo : -1.07157, ind|v7 : -1.07192, ind|No : -1.072, ind|n7 : -1.0731, ind|a : -1.07939, ind|u : -1.08129, ind|O : -1.08966, ind|h9# : -1.09256, ind|sR : -1.10718, ind|U : -1.1196, ind|tR# : -1.12214, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14252, phonocvrpresuf4gram|^crc : -1.15111, phonocvrpresuf3gram|rc^ : -1.15717, ind|h# : -1.16214, ind|cR : -1.16777, ind|pR : -1.17526, ind|s( : -1.17916, ind|s# : -1.18482, phonocvrpresuf4gram|rvc^ : -1.18885, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19148, ind|t9R : -1.19193, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.196, ind|t% : -1.19682, ind|k* : -1.19802, ind|t# : -1.20381, ind|S% : -1.20878, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21182, ind|T# : -1.21235, ind|c( : -1.21291, ind|S* : -1.21315, ind|kR : -1.21322, ind|k% : -1.21375, ind|p% : -1.21422, phonocvrpresuf2gram|^r : -1.25173, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25905, phonofeatpresuf2gram|(vX)(^^) : -1.26297, ind|pe : -1.26614, phonocvrpresuf4gram|^ccr : -1.26822, ind|lR# : -1.27077, ind|y)# : -1.2747, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28098, ind|f9 : -1.28113, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28884, ind|k9 : -1.29406, ind|( : -1.29667, ind|s9 : -1.31899, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3326, phonocvrpresuf3gram|vv^ : -1.33909, ind|fo : -1.34995, ind|tQ : -1.35191, ind|fe : -1.35408, ind|sQ : -1.35436, ind|c9 : -1.35735, ind|ho : -1.35906, ind|p9 : -1.35927, ind|po : -1.35964, ind|Se : -1.36033, ind|We : -1.36199, ind|fQ : -1.36309, ind|ce : -1.36448, ind|cQ : -1.3645, ind|TQ : -1.36453, ind|pQ : -1.36461, ind|) : -1.37271, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38245, phonocvrpresuf3gram|^vv : -1.3851, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41112, phonocvrpresuf4gram|ccv^ : -1.45454, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46582, phonocvrpresuf3gram|^cc : -1.48938, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51165, phonocvrpresuf4gram|^vcc : -1.5162, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63194, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64044, ind|Q : -1.6706, ind|7 : -1.70567, len|lenraw7 : -1.80569, numphonov|numv5 : -1.91112, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.9315, phonocvrpresuf3gram|^rc : -1.96357, phonocvrpresuf4gram|vvc^ : -2.14345, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.15628, phonocvrpresuf4gram|^vcr : -2.16693, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23541, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48044, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80585, len|lenraw8 : -4.62288, numphonov|numv4 : -5.05937, len|lenraw9 : -5.40544, len|lenraw10 : -5.46664]
} [2.3s, cum. 3.4s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.849)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [3.5s, cum. 34m30s]
Iteration 850/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage3 calc 277: 402108.754468
[LBFGSMinimizer.minimize] Iteration 277 ended with value 402108.754468
Highest weights:
[ind|op~ : 9.20847, ind|&nd : 9.14921, ind|9TINk : 9.03157, ind|Els : 8.86197, ind|prIti : 8.79878, ind|oke : 8.66678, ind|Its : 8.53248, ind|kreanz : 8.45889, ind|pik6bu : 8.4564, ind|hAmpti : 8.38127, ind|&pL : 8.23314, ind|yu : 8.1471, ind|6bQt : 8.1371, ind|6gEn : 8.04304, ind|#Doz : 8.02233, ind|hANgri : 7.99112, ind|&n6mL : 7.86022, ind|D6 : 7.78955, ind|hQmEni : 7.77078, ind|&lIs : 7.73417, ind|dr&g~ : 7.72537, ind|wan6 : 7.67244, ind|v*i : 7.60932, ind|mANki : 7.57822, ind|ovR : 7.53426, ind|It : 7.52504, ind|6nADR : 7.51597, ind|D&t : 7.44853, ind|want : 7.37132, ind|k9nd6v : 7.29656, ind|dOgi : 7.29653, ind|n9tn9t : 7.25132, ind|Iz : 7.16547, ind|kIti : 7.16144, ind|WAts : 7.14442, ind|lUk&t : 7.10051, ind|g6n6 : 7.09875, ind|b6lunz : 7.063, ind|go6hEd : 7.04446, ind|sIndi : 7.03145, ind|du : 6.99773, ind|DIs : 6.9885, ind|hElo : 6.9849, ind|b9b9 : 6.96205, ind|mamiz : 6.94586, ind|dAmpti : 6.93515, ind|lItL : 6.90933, ind|IN : 6.88207, ind|bAni : 6.83332, ind|WAt : 6.80614, ind|dont : 6.7883, ind|6 : 6.76635, ind|d&di : 6.75602, ind|tu : 6.75061, ind|Tri : 6.72324, ind|In : 6.71671, ind|D&ts : 6.7046, ind|Qt : 6.67437, ind|lUk : 6.65301, ind|k&n : 6.64418, ind|brAS : 6.60196, ind|blaks : 6.60188, ind|zskr& : 6.59854, ind|mami : 6.53278, ind|Iz~t : 6.48454, ind|si : 6.46526, ind|wAn : 6.42761, ind|tEl6 : 6.4072, ind|y& : 6.39658, ind|D*z : 6.38801, ind|%InG : 6.37285, ind|smEl : 6.36808, ind|Olr9t : 6.32664, ind|T&Nk : 6.27815, ind|l9k : 6.2768, ind|pliz : 6.22625, ind|bebi : 6.21883, ind|an : 6.14404, ind|cifes : 6.12849, ind|9dont : 6.12778, ind|W*z : 6.12369, ind|Gudi : 6.1153, ind|r9t : 6.1118, ind|Eni : 6.10035, ind|mebi : 6.0808, ind|h&nd : 6.05239, ind|&ni : 6.01831, ind|slip : 6.01703, ind|dAz~t : 5.96436, ind|mi : 5.96303, ind|bUk : 5.93948, ind|sAmT : 5.92065, ind|dIgbi : 5.91473, ind|blak : 5.914, ind|ADR : 5.91147, ind|b6lun : 5.91055, ind|D* : 5.91048, ind|t6de : 5.89351, ind|ple : 5.87864, ind|m6ri : 5.86421, ind|hi : 5.84891]
Lowest weights:
[ind|NQ : -1.06964, ind|mo : -1.06975, ind|N9 : -1.07059, ind|rQ : -1.07066, ind|wo : -1.07075, ind|gQ : -1.07085, ind|LQ : -1.07094, ind|~o : -1.07122, ind|~Q : -1.07125, ind|ze : -1.07132, ind|yo : -1.07157, ind|v7 : -1.07192, ind|No : -1.072, ind|n7 : -1.0731, ind|a : -1.07939, ind|u : -1.08129, ind|O : -1.08966, ind|h9# : -1.09256, ind|sR : -1.10718, ind|U : -1.1196, ind|tR# : -1.12214, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14252, phonocvrpresuf4gram|^crc : -1.15111, phonocvrpresuf3gram|rc^ : -1.15717, ind|h# : -1.16214, ind|cR : -1.16777, ind|pR : -1.17526, ind|s( : -1.17916, ind|s# : -1.18482, phonocvrpresuf4gram|rvc^ : -1.18885, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19148, ind|t9R : -1.19193, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.196, ind|t% : -1.19682, ind|k* : -1.19802, ind|t# : -1.20381, ind|S% : -1.20878, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.21182, ind|T# : -1.21235, ind|c( : -1.21291, ind|S* : -1.21315, ind|kR : -1.21322, ind|k% : -1.21375, ind|p% : -1.21422, phonocvrpresuf2gram|^r : -1.25173, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25905, phonofeatpresuf2gram|(vX)(^^) : -1.26297, ind|pe : -1.26614, phonocvrpresuf4gram|^ccr : -1.26822, ind|lR# : -1.27077, ind|y)# : -1.2747, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28098, ind|f9 : -1.28113, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.28884, ind|k9 : -1.29406, ind|( : -1.29667, ind|s9 : -1.31899, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3326, phonocvrpresuf3gram|vv^ : -1.33909, ind|fo : -1.34995, ind|tQ : -1.35191, ind|fe : -1.35408, ind|sQ : -1.35436, ind|c9 : -1.35735, ind|ho : -1.35906, ind|p9 : -1.35927, ind|po : -1.35964, ind|Se : -1.36033, ind|We : -1.36199, ind|fQ : -1.36309, ind|ce : -1.36448, ind|cQ : -1.3645, ind|TQ : -1.36453, ind|pQ : -1.36461, ind|) : -1.37271, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.38245, phonocvrpresuf3gram|^vv : -1.3851, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.41112, phonocvrpresuf4gram|ccv^ : -1.45454, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46582, phonocvrpresuf3gram|^cc : -1.48938, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51165, phonocvrpresuf4gram|^vcc : -1.5162, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.63194, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.64044, ind|Q : -1.6706, ind|7 : -1.70567, len|lenraw7 : -1.80569, numphonov|numv5 : -1.91112, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.9315, phonocvrpresuf3gram|^rc : -1.96357, phonocvrpresuf4gram|vvc^ : -2.14345, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.15628, phonocvrpresuf4gram|^vcr : -2.16693, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.23541, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48044, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80585, len|lenraw8 : -4.62288, numphonov|numv4 : -5.05937, len|lenraw9 : -5.40544, len|lenraw10 : -5.46664]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.850)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m32s]
Iteration 851/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage1 calc 278: 402108.754468
Line search init: value: 402108.754468, deriv: -46.621333
Highest weights:
[ind|op~ : 9.21103, ind|&nd : 9.12187, ind|9TINk : 9.03946, ind|Els : 8.81535, ind|prIti : 8.80766, ind|oke : 8.66373, ind|Its : 8.4943, ind|kreanz : 8.45765, ind|pik6bu : 8.43987, ind|hAmpti : 8.41665, ind|&pL : 8.27295, ind|6bQt : 8.11583, ind|yu : 8.10159, ind|#Doz : 8.07193, ind|6gEn : 8.04605, ind|hANgri : 7.98378, ind|&n6mL : 7.94603, ind|hQmEni : 7.81703, ind|D6 : 7.77214, ind|dr&g~ : 7.74842, ind|&lIs : 7.71346, ind|wan6 : 7.70921, ind|v*i : 7.63049, ind|mANki : 7.59664, ind|ovR : 7.56093, ind|It : 7.53416, ind|6nADR : 7.49773, ind|D&t : 7.46285, ind|want : 7.38091, ind|dOgi : 7.29794, ind|k9nd6v : 7.27012, ind|n9tn9t : 7.25806, ind|kIti : 7.16696, ind|WAts : 7.15091, ind|Iz : 7.14577, ind|lUk&t : 7.09587, ind|g6n6 : 7.0947, ind|dAmpti : 7.06383, ind|go6hEd : 7.05156, ind|b6lunz : 7.01214, ind|du : 7.00364, ind|DIs : 6.99343, ind|hElo : 6.98063, ind|mamiz : 6.98002, ind|b9b9 : 6.94362, ind|sIndi : 6.94091, ind|lItL : 6.89205, ind|IN : 6.86354, ind|bAni : 6.8237, ind|6 : 6.79832, ind|dont : 6.79562, ind|WAt : 6.78926, ind|d&di : 6.74924, ind|tu : 6.74212, ind|D&ts : 6.72462, ind|zskr& : 6.69962, ind|Tri : 6.69563, ind|In : 6.69399, ind|k&n : 6.67817, ind|blaks : 6.65493, ind|lUk : 6.65179, ind|Qt : 6.63411, ind|brAS : 6.63399, ind|Iz~t : 6.50668, ind|mami : 6.50129, ind|si : 6.44478, ind|%InG : 6.4342, ind|wAn : 6.42568, ind|D*z : 6.40187, ind|tEl6 : 6.38901, ind|y& : 6.38522, ind|smEl : 6.3711, ind|T&Nk : 6.29672, ind|Olr9t : 6.29196, ind|l9k : 6.2827, ind|bebi : 6.26964, ind|pliz : 6.22499, ind|an : 6.13735, ind|9dont : 6.1184, ind|cifes : 6.11492, ind|r9t : 6.10329, ind|Eni : 6.10299, ind|W*z : 6.096, ind|mebi : 6.05783, ind|Gudi : 6.05545, ind|h&nd : 6.04897, ind|&ni : 6.04512, ind|slip : 6.01168, ind|dIgbi : 6.00199, ind|sAmT : 5.97708, ind|mi : 5.97631, ind|blak : 5.95403, ind|bUk : 5.94532, ind|dAz~t : 5.93253, ind|D* : 5.9095, ind|snikRz : 5.89676, ind|t6de : 5.891, ind|m6ri : 5.88601, ind|ADR : 5.8771, ind|b6lun : 5.86956, ind|hi : 5.84017]
Lowest weights:
[ind|N9 : -1.0724, ind|rQ : -1.07246, ind|wo : -1.07253, ind|gQ : -1.07265, ind|LQ : -1.07274, ind|~o : -1.073, ind|~Q : -1.07304, ind|ze : -1.07308, ind|yo : -1.07335, ind|v7 : -1.07368, ind|No : -1.07378, ind|n7 : -1.07484, ind|ko : -1.07486, ind|s% : -1.07521, ind|a : -1.08259, ind|u : -1.08459, ind|O : -1.09292, ind|h9# : -1.09867, ind|sR : -1.10985, ind|U : -1.12259, ind|tR# : -1.12588, phonocvrpresuf3gram|rc^ : -1.13329, phonocvrpresuf4gram|^crc : -1.13892, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14894, ind|h# : -1.16642, phonocvrpresuf4gram|rvc^ : -1.17141, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.17224, ind|cR : -1.17239, ind|pR : -1.18074, ind|s( : -1.18399, ind|s# : -1.18936, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19462, ind|t9R : -1.19981, ind|t% : -1.20154, ind|k* : -1.20258, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20788, ind|t# : -1.20855, ind|S% : -1.21335, ind|T# : -1.2168, ind|c( : -1.21734, ind|S* : -1.21748, ind|kR : -1.21763, ind|k% : -1.21817, ind|p% : -1.2186, phonocvrpresuf4gram|^ccr : -1.23792, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25348, phonocvrpresuf2gram|^r : -1.25455, phonofeatpresuf2gram|(vX)(^^) : -1.26907, ind|pe : -1.27276, ind|lR# : -1.27447, ind|y)# : -1.27831, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28445, ind|f9 : -1.28562, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.29903, ind|k9 : -1.3015, ind|( : -1.3023, ind|s9 : -1.32419, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33312, phonocvrpresuf3gram|vv^ : -1.34134, ind|fo : -1.35573, ind|tQ : -1.35732, ind|fe : -1.35938, ind|sQ : -1.35984, ind|c9 : -1.36244, ind|ho : -1.36436, ind|p9 : -1.36453, ind|po : -1.36481, ind|Se : -1.36555, ind|We : -1.36716, ind|fQ : -1.36827, ind|ce : -1.3696, ind|cQ : -1.36963, ind|TQ : -1.36966, ind|pQ : -1.36974, ind|) : -1.37895, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37907, phonocvrpresuf3gram|^vv : -1.38563, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39842, phonocvrpresuf4gram|ccv^ : -1.45735, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46648, phonocvrpresuf3gram|^cc : -1.48918, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51013, phonocvrpresuf4gram|^vcc : -1.5146, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.61571, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62845, ind|Q : -1.67912, ind|7 : -1.71322, len|lenraw7 : -1.82191, numphonov|numv5 : -1.89883, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.92055, phonocvrpresuf3gram|^rc : -1.94953, phonocvrpresuf4gram|vvc^ : -2.12168, phonocvrpresuf4gram|^vcr : -2.15445, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17144, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.24617, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48045, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80179, len|lenraw8 : -4.59378, numphonov|numv4 : -5.02676, len|lenraw9 : -5.37083, len|lenraw10 : -5.43155]
} [1.0s, cum. 2.1s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.176, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.851)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m35s]
Iteration 852/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
Line search iter: value: 402087.118330, suff decrease: 402108.749806
Highest weights:
[ind|op~ : 9.21103, ind|&nd : 9.12187, ind|9TINk : 9.03946, ind|Els : 8.81535, ind|prIti : 8.80766, ind|oke : 8.66373, ind|Its : 8.4943, ind|kreanz : 8.45765, ind|pik6bu : 8.43987, ind|hAmpti : 8.41665, ind|&pL : 8.27295, ind|6bQt : 8.11583, ind|yu : 8.10159, ind|#Doz : 8.07193, ind|6gEn : 8.04605, ind|hANgri : 7.98378, ind|&n6mL : 7.94603, ind|hQmEni : 7.81703, ind|D6 : 7.77214, ind|dr&g~ : 7.74842, ind|&lIs : 7.71346, ind|wan6 : 7.70921, ind|v*i : 7.63049, ind|mANki : 7.59664, ind|ovR : 7.56093, ind|It : 7.53416, ind|6nADR : 7.49773, ind|D&t : 7.46285, ind|want : 7.38091, ind|dOgi : 7.29794, ind|k9nd6v : 7.27012, ind|n9tn9t : 7.25806, ind|kIti : 7.16696, ind|WAts : 7.15091, ind|Iz : 7.14577, ind|lUk&t : 7.09587, ind|g6n6 : 7.0947, ind|dAmpti : 7.06383, ind|go6hEd : 7.05156, ind|b6lunz : 7.01214, ind|du : 7.00364, ind|DIs : 6.99343, ind|hElo : 6.98063, ind|mamiz : 6.98002, ind|b9b9 : 6.94362, ind|sIndi : 6.94091, ind|lItL : 6.89205, ind|IN : 6.86354, ind|bAni : 6.8237, ind|6 : 6.79832, ind|dont : 6.79562, ind|WAt : 6.78926, ind|d&di : 6.74924, ind|tu : 6.74212, ind|D&ts : 6.72462, ind|zskr& : 6.69962, ind|Tri : 6.69563, ind|In : 6.69399, ind|k&n : 6.67817, ind|blaks : 6.65493, ind|lUk : 6.65179, ind|Qt : 6.63411, ind|brAS : 6.63399, ind|Iz~t : 6.50668, ind|mami : 6.50129, ind|si : 6.44478, ind|%InG : 6.4342, ind|wAn : 6.42568, ind|D*z : 6.40187, ind|tEl6 : 6.38901, ind|y& : 6.38522, ind|smEl : 6.3711, ind|T&Nk : 6.29672, ind|Olr9t : 6.29196, ind|l9k : 6.2827, ind|bebi : 6.26964, ind|pliz : 6.22499, ind|an : 6.13735, ind|9dont : 6.1184, ind|cifes : 6.11492, ind|r9t : 6.10329, ind|Eni : 6.10299, ind|W*z : 6.096, ind|mebi : 6.05783, ind|Gudi : 6.05545, ind|h&nd : 6.04897, ind|&ni : 6.04512, ind|slip : 6.01168, ind|dIgbi : 6.00199, ind|sAmT : 5.97708, ind|mi : 5.97631, ind|blak : 5.95403, ind|bUk : 5.94532, ind|dAz~t : 5.93253, ind|D* : 5.9095, ind|snikRz : 5.89676, ind|t6de : 5.891, ind|m6ri : 5.88601, ind|ADR : 5.8771, ind|b6lun : 5.86956, ind|hi : 5.84017]
Lowest weights:
[ind|N9 : -1.0724, ind|rQ : -1.07246, ind|wo : -1.07253, ind|gQ : -1.07265, ind|LQ : -1.07274, ind|~o : -1.073, ind|~Q : -1.07304, ind|ze : -1.07308, ind|yo : -1.07335, ind|v7 : -1.07368, ind|No : -1.07378, ind|n7 : -1.07484, ind|ko : -1.07486, ind|s% : -1.07521, ind|a : -1.08259, ind|u : -1.08459, ind|O : -1.09292, ind|h9# : -1.09867, ind|sR : -1.10985, ind|U : -1.12259, ind|tR# : -1.12588, phonocvrpresuf3gram|rc^ : -1.13329, phonocvrpresuf4gram|^crc : -1.13892, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14894, ind|h# : -1.16642, phonocvrpresuf4gram|rvc^ : -1.17141, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.17224, ind|cR : -1.17239, ind|pR : -1.18074, ind|s( : -1.18399, ind|s# : -1.18936, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19462, ind|t9R : -1.19981, ind|t% : -1.20154, ind|k* : -1.20258, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20788, ind|t# : -1.20855, ind|S% : -1.21335, ind|T# : -1.2168, ind|c( : -1.21734, ind|S* : -1.21748, ind|kR : -1.21763, ind|k% : -1.21817, ind|p% : -1.2186, phonocvrpresuf4gram|^ccr : -1.23792, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25348, phonocvrpresuf2gram|^r : -1.25455, phonofeatpresuf2gram|(vX)(^^) : -1.26907, ind|pe : -1.27276, ind|lR# : -1.27447, ind|y)# : -1.27831, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28445, ind|f9 : -1.28562, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.29903, ind|k9 : -1.3015, ind|( : -1.3023, ind|s9 : -1.32419, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33312, phonocvrpresuf3gram|vv^ : -1.34134, ind|fo : -1.35573, ind|tQ : -1.35732, ind|fe : -1.35938, ind|sQ : -1.35984, ind|c9 : -1.36244, ind|ho : -1.36436, ind|p9 : -1.36453, ind|po : -1.36481, ind|Se : -1.36555, ind|We : -1.36716, ind|fQ : -1.36827, ind|ce : -1.3696, ind|cQ : -1.36963, ind|TQ : -1.36966, ind|pQ : -1.36974, ind|) : -1.37895, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37907, phonocvrpresuf3gram|^vv : -1.38563, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39842, phonocvrpresuf4gram|ccv^ : -1.45735, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46648, phonocvrpresuf3gram|^cc : -1.48918, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51013, phonocvrpresuf4gram|^vcc : -1.5146, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.61571, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62845, ind|Q : -1.67912, ind|7 : -1.71322, len|lenraw7 : -1.82191, numphonov|numv5 : -1.89883, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.92055, phonocvrpresuf3gram|^rc : -1.94953, phonocvrpresuf4gram|vvc^ : -2.12168, phonocvrpresuf4gram|^vcr : -2.15445, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17144, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.24617, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48045, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80179, len|lenraw8 : -4.59378, numphonov|numv4 : -5.02676, len|lenraw9 : -5.37083, len|lenraw10 : -5.43155]
} [1.2s, cum. 2.3s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.852)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.4s, cum. 34m37s]
Iteration 853/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage3 calc 278: 402087.118330
[LBFGSMinimizer.minimize] Iteration 278 ended with value 402087.118330
Highest weights:
[ind|op~ : 9.21103, ind|&nd : 9.12187, ind|9TINk : 9.03946, ind|Els : 8.81535, ind|prIti : 8.80766, ind|oke : 8.66373, ind|Its : 8.4943, ind|kreanz : 8.45765, ind|pik6bu : 8.43987, ind|hAmpti : 8.41665, ind|&pL : 8.27295, ind|6bQt : 8.11583, ind|yu : 8.10159, ind|#Doz : 8.07193, ind|6gEn : 8.04605, ind|hANgri : 7.98378, ind|&n6mL : 7.94603, ind|hQmEni : 7.81703, ind|D6 : 7.77214, ind|dr&g~ : 7.74842, ind|&lIs : 7.71346, ind|wan6 : 7.70921, ind|v*i : 7.63049, ind|mANki : 7.59664, ind|ovR : 7.56093, ind|It : 7.53416, ind|6nADR : 7.49773, ind|D&t : 7.46285, ind|want : 7.38091, ind|dOgi : 7.29794, ind|k9nd6v : 7.27012, ind|n9tn9t : 7.25806, ind|kIti : 7.16696, ind|WAts : 7.15091, ind|Iz : 7.14577, ind|lUk&t : 7.09587, ind|g6n6 : 7.0947, ind|dAmpti : 7.06383, ind|go6hEd : 7.05156, ind|b6lunz : 7.01214, ind|du : 7.00364, ind|DIs : 6.99343, ind|hElo : 6.98063, ind|mamiz : 6.98002, ind|b9b9 : 6.94362, ind|sIndi : 6.94091, ind|lItL : 6.89205, ind|IN : 6.86354, ind|bAni : 6.8237, ind|6 : 6.79832, ind|dont : 6.79562, ind|WAt : 6.78926, ind|d&di : 6.74924, ind|tu : 6.74212, ind|D&ts : 6.72462, ind|zskr& : 6.69962, ind|Tri : 6.69563, ind|In : 6.69399, ind|k&n : 6.67817, ind|blaks : 6.65493, ind|lUk : 6.65179, ind|Qt : 6.63411, ind|brAS : 6.63399, ind|Iz~t : 6.50668, ind|mami : 6.50129, ind|si : 6.44478, ind|%InG : 6.4342, ind|wAn : 6.42568, ind|D*z : 6.40187, ind|tEl6 : 6.38901, ind|y& : 6.38522, ind|smEl : 6.3711, ind|T&Nk : 6.29672, ind|Olr9t : 6.29196, ind|l9k : 6.2827, ind|bebi : 6.26964, ind|pliz : 6.22499, ind|an : 6.13735, ind|9dont : 6.1184, ind|cifes : 6.11492, ind|r9t : 6.10329, ind|Eni : 6.10299, ind|W*z : 6.096, ind|mebi : 6.05783, ind|Gudi : 6.05545, ind|h&nd : 6.04897, ind|&ni : 6.04512, ind|slip : 6.01168, ind|dIgbi : 6.00199, ind|sAmT : 5.97708, ind|mi : 5.97631, ind|blak : 5.95403, ind|bUk : 5.94532, ind|dAz~t : 5.93253, ind|D* : 5.9095, ind|snikRz : 5.89676, ind|t6de : 5.891, ind|m6ri : 5.88601, ind|ADR : 5.8771, ind|b6lun : 5.86956, ind|hi : 5.84017]
Lowest weights:
[ind|N9 : -1.0724, ind|rQ : -1.07246, ind|wo : -1.07253, ind|gQ : -1.07265, ind|LQ : -1.07274, ind|~o : -1.073, ind|~Q : -1.07304, ind|ze : -1.07308, ind|yo : -1.07335, ind|v7 : -1.07368, ind|No : -1.07378, ind|n7 : -1.07484, ind|ko : -1.07486, ind|s% : -1.07521, ind|a : -1.08259, ind|u : -1.08459, ind|O : -1.09292, ind|h9# : -1.09867, ind|sR : -1.10985, ind|U : -1.12259, ind|tR# : -1.12588, phonocvrpresuf3gram|rc^ : -1.13329, phonocvrpresuf4gram|^crc : -1.13892, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14894, ind|h# : -1.16642, phonocvrpresuf4gram|rvc^ : -1.17141, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.17224, ind|cR : -1.17239, ind|pR : -1.18074, ind|s( : -1.18399, ind|s# : -1.18936, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19462, ind|t9R : -1.19981, ind|t% : -1.20154, ind|k* : -1.20258, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20788, ind|t# : -1.20855, ind|S% : -1.21335, ind|T# : -1.2168, ind|c( : -1.21734, ind|S* : -1.21748, ind|kR : -1.21763, ind|k% : -1.21817, ind|p% : -1.2186, phonocvrpresuf4gram|^ccr : -1.23792, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25348, phonocvrpresuf2gram|^r : -1.25455, phonofeatpresuf2gram|(vX)(^^) : -1.26907, ind|pe : -1.27276, ind|lR# : -1.27447, ind|y)# : -1.27831, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28445, ind|f9 : -1.28562, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.29903, ind|k9 : -1.3015, ind|( : -1.3023, ind|s9 : -1.32419, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.33312, phonocvrpresuf3gram|vv^ : -1.34134, ind|fo : -1.35573, ind|tQ : -1.35732, ind|fe : -1.35938, ind|sQ : -1.35984, ind|c9 : -1.36244, ind|ho : -1.36436, ind|p9 : -1.36453, ind|po : -1.36481, ind|Se : -1.36555, ind|We : -1.36716, ind|fQ : -1.36827, ind|ce : -1.3696, ind|cQ : -1.36963, ind|TQ : -1.36966, ind|pQ : -1.36974, ind|) : -1.37895, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37907, phonocvrpresuf3gram|^vv : -1.38563, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39842, phonocvrpresuf4gram|ccv^ : -1.45735, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46648, phonocvrpresuf3gram|^cc : -1.48918, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.51013, phonocvrpresuf4gram|^vcc : -1.5146, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.61571, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62845, ind|Q : -1.67912, ind|7 : -1.71322, len|lenraw7 : -1.82191, numphonov|numv5 : -1.89883, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.92055, phonocvrpresuf3gram|^rc : -1.94953, phonocvrpresuf4gram|vvc^ : -2.12168, phonocvrpresuf4gram|^vcr : -2.15445, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17144, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.24617, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48045, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80179, len|lenraw8 : -4.59378, numphonov|numv4 : -5.02676, len|lenraw9 : -5.37083, len|lenraw10 : -5.43155]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.853)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.0s, cum. 34m39s]
Iteration 854/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage1 calc 279: 402087.118330
Line search init: value: 402087.118330, deriv: -34.109007
Highest weights:
[ind|op~ : 9.21273, ind|&nd : 9.11974, ind|9TINk : 9.04102, ind|Els : 8.80774, ind|prIti : 8.80559, ind|oke : 8.66073, ind|Its : 8.48766, ind|kreanz : 8.45417, ind|pik6bu : 8.43609, ind|hAmpti : 8.42137, ind|&pL : 8.27728, ind|6bQt : 8.11204, ind|yu : 8.09401, ind|#Doz : 8.07804, ind|6gEn : 8.04449, ind|hANgri : 7.98306, ind|&n6mL : 7.95631, ind|hQmEni : 7.8236, ind|D6 : 7.76864, ind|dr&g~ : 7.75405, ind|wan6 : 7.71349, ind|&lIs : 7.71235, ind|v*i : 7.63297, ind|mANki : 7.60002, ind|ovR : 7.56545, ind|It : 7.53548, ind|6nADR : 7.49709, ind|D&t : 7.46374, ind|want : 7.38392, ind|dOgi : 7.2978, ind|k9nd6v : 7.26383, ind|n9tn9t : 7.25968, ind|kIti : 7.1652, ind|WAts : 7.15351, ind|Iz : 7.14117, ind|g6n6 : 7.09558, ind|lUk&t : 7.09387, ind|dAmpti : 7.08364, ind|go6hEd : 7.05128, ind|du : 7.00809, ind|b6lunz : 7.00682, ind|DIs : 6.99302, ind|mamiz : 6.98524, ind|hElo : 6.98239, ind|b9b9 : 6.94177, ind|sIndi : 6.92793, ind|lItL : 6.89052, ind|IN : 6.86048, ind|bAni : 6.82379, ind|6 : 6.80317, ind|dont : 6.79754, ind|WAt : 6.77801, ind|d&di : 6.7504, ind|tu : 6.74118, ind|D&ts : 6.72848, ind|zskr& : 6.71388, ind|In : 6.68968, ind|Tri : 6.68808, ind|k&n : 6.68175, ind|blaks : 6.66603, ind|lUk : 6.64813, ind|brAS : 6.63745, ind|Qt : 6.62426, ind|Iz~t : 6.5103, ind|mami : 6.49752, ind|%InG : 6.44369, ind|si : 6.44209, ind|wAn : 6.41884, ind|D*z : 6.40236, ind|y& : 6.39198, ind|tEl6 : 6.38437, ind|smEl : 6.37089, ind|T&Nk : 6.29867, ind|Olr9t : 6.28649, ind|l9k : 6.28334, ind|bebi : 6.28102, ind|pliz : 6.22405, ind|an : 6.13681, ind|9dont : 6.11683, ind|cifes : 6.11258, ind|Eni : 6.10563, ind|r9t : 6.10256, ind|W*z : 6.08859, ind|mebi : 6.05093, ind|h&nd : 6.04679, ind|&ni : 6.04627, ind|Gudi : 6.04531, ind|dIgbi : 6.01381, ind|slip : 6.01177, ind|sAmT : 5.98352, ind|mi : 5.97483, ind|blak : 5.96257, ind|bUk : 5.94969, ind|dAz~t : 5.9262, ind|D* : 5.90589, ind|snikRz : 5.90405, ind|t6de : 5.88943, ind|m6ri : 5.88664, ind|ADR : 5.86884, ind|b6lun : 5.86561, ind|hi : 5.84089]
Lowest weights:
[ind|N9 : -1.07264, ind|rQ : -1.07271, ind|wo : -1.07278, ind|gQ : -1.0729, ind|LQ : -1.07299, ind|~o : -1.07325, ind|~Q : -1.07328, ind|ze : -1.07332, ind|yo : -1.0736, ind|v7 : -1.07392, ind|No : -1.07402, ind|n7 : -1.07509, ind|s% : -1.07613, ind|ko : -1.07626, ind|a : -1.083, ind|u : -1.08503, ind|O : -1.09334, ind|h9# : -1.09956, ind|sR : -1.11022, ind|U : -1.12297, ind|tR# : -1.12641, phonocvrpresuf3gram|rc^ : -1.13101, phonocvrpresuf4gram|^crc : -1.13903, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14983, ind|h# : -1.16703, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.16839, phonocvrpresuf4gram|rvc^ : -1.16852, ind|cR : -1.17306, ind|pR : -1.18152, ind|s( : -1.18468, ind|s# : -1.19, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19788, ind|t9R : -1.20097, ind|t% : -1.20221, ind|k* : -1.20323, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20722, ind|t# : -1.20922, ind|S% : -1.21399, ind|T# : -1.21744, ind|c( : -1.21797, ind|S* : -1.2181, ind|kR : -1.21825, ind|k% : -1.21879, ind|p% : -1.21922, phonocvrpresuf4gram|^ccr : -1.23307, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25255, phonocvrpresuf2gram|^r : -1.25431, phonofeatpresuf2gram|(vX)(^^) : -1.2619, ind|pe : -1.27371, ind|lR# : -1.27498, ind|y)# : -1.27881, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.2855, ind|f9 : -1.28626, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.30062, ind|k9 : -1.30257, ind|( : -1.30307, ind|s9 : -1.32492, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3331, phonocvrpresuf3gram|vv^ : -1.34266, ind|fo : -1.35654, ind|tQ : -1.35808, ind|fe : -1.36013, ind|sQ : -1.3606, ind|c9 : -1.36316, ind|ho : -1.3651, ind|p9 : -1.36527, ind|po : -1.36554, ind|Se : -1.36628, ind|We : -1.36788, ind|fQ : -1.36899, ind|ce : -1.37032, ind|cQ : -1.37035, ind|TQ : -1.37038, ind|pQ : -1.37046, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37855, ind|) : -1.37981, phonocvrpresuf3gram|^vv : -1.3857, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39403, phonocvrpresuf4gram|ccv^ : -1.46329, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46658, phonocvrpresuf3gram|^cc : -1.48888, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.50982, phonocvrpresuf4gram|^vcc : -1.51117, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.61068, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62781, ind|Q : -1.68038, ind|7 : -1.71433, len|lenraw7 : -1.82435, numphonov|numv5 : -1.89689, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.9184, phonocvrpresuf3gram|^rc : -1.9481, phonocvrpresuf4gram|vvc^ : -2.11823, phonocvrpresuf4gram|^vcr : -2.1535, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17352, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.2476, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48028, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80116, len|lenraw8 : -4.5892, numphonov|numv4 : -5.02161, len|lenraw9 : -5.36538, len|lenraw10 : -5.42601]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.854)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.0s, cum. 34m41s]
Iteration 855/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
Line search iter: value: 402074.989602, suff decrease: 402087.114919
Highest weights:
[ind|op~ : 9.21273, ind|&nd : 9.11974, ind|9TINk : 9.04102, ind|Els : 8.80774, ind|prIti : 8.80559, ind|oke : 8.66073, ind|Its : 8.48766, ind|kreanz : 8.45417, ind|pik6bu : 8.43609, ind|hAmpti : 8.42137, ind|&pL : 8.27728, ind|6bQt : 8.11204, ind|yu : 8.09401, ind|#Doz : 8.07804, ind|6gEn : 8.04449, ind|hANgri : 7.98306, ind|&n6mL : 7.95631, ind|hQmEni : 7.8236, ind|D6 : 7.76864, ind|dr&g~ : 7.75405, ind|wan6 : 7.71349, ind|&lIs : 7.71235, ind|v*i : 7.63297, ind|mANki : 7.60002, ind|ovR : 7.56545, ind|It : 7.53548, ind|6nADR : 7.49709, ind|D&t : 7.46374, ind|want : 7.38392, ind|dOgi : 7.2978, ind|k9nd6v : 7.26383, ind|n9tn9t : 7.25968, ind|kIti : 7.1652, ind|WAts : 7.15351, ind|Iz : 7.14117, ind|g6n6 : 7.09558, ind|lUk&t : 7.09387, ind|dAmpti : 7.08364, ind|go6hEd : 7.05128, ind|du : 7.00809, ind|b6lunz : 7.00682, ind|DIs : 6.99302, ind|mamiz : 6.98524, ind|hElo : 6.98239, ind|b9b9 : 6.94177, ind|sIndi : 6.92793, ind|lItL : 6.89052, ind|IN : 6.86048, ind|bAni : 6.82379, ind|6 : 6.80317, ind|dont : 6.79754, ind|WAt : 6.77801, ind|d&di : 6.7504, ind|tu : 6.74118, ind|D&ts : 6.72848, ind|zskr& : 6.71388, ind|In : 6.68968, ind|Tri : 6.68808, ind|k&n : 6.68175, ind|blaks : 6.66603, ind|lUk : 6.64813, ind|brAS : 6.63745, ind|Qt : 6.62426, ind|Iz~t : 6.5103, ind|mami : 6.49752, ind|%InG : 6.44369, ind|si : 6.44209, ind|wAn : 6.41884, ind|D*z : 6.40236, ind|y& : 6.39198, ind|tEl6 : 6.38437, ind|smEl : 6.37089, ind|T&Nk : 6.29867, ind|Olr9t : 6.28649, ind|l9k : 6.28334, ind|bebi : 6.28102, ind|pliz : 6.22405, ind|an : 6.13681, ind|9dont : 6.11683, ind|cifes : 6.11258, ind|Eni : 6.10563, ind|r9t : 6.10256, ind|W*z : 6.08859, ind|mebi : 6.05093, ind|h&nd : 6.04679, ind|&ni : 6.04627, ind|Gudi : 6.04531, ind|dIgbi : 6.01381, ind|slip : 6.01177, ind|sAmT : 5.98352, ind|mi : 5.97483, ind|blak : 5.96257, ind|bUk : 5.94969, ind|dAz~t : 5.9262, ind|D* : 5.90589, ind|snikRz : 5.90405, ind|t6de : 5.88943, ind|m6ri : 5.88664, ind|ADR : 5.86884, ind|b6lun : 5.86561, ind|hi : 5.84089]
Lowest weights:
[ind|N9 : -1.07264, ind|rQ : -1.07271, ind|wo : -1.07278, ind|gQ : -1.0729, ind|LQ : -1.07299, ind|~o : -1.07325, ind|~Q : -1.07328, ind|ze : -1.07332, ind|yo : -1.0736, ind|v7 : -1.07392, ind|No : -1.07402, ind|n7 : -1.07509, ind|s% : -1.07613, ind|ko : -1.07626, ind|a : -1.083, ind|u : -1.08503, ind|O : -1.09334, ind|h9# : -1.09956, ind|sR : -1.11022, ind|U : -1.12297, ind|tR# : -1.12641, phonocvrpresuf3gram|rc^ : -1.13101, phonocvrpresuf4gram|^crc : -1.13903, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14983, ind|h# : -1.16703, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.16839, phonocvrpresuf4gram|rvc^ : -1.16852, ind|cR : -1.17306, ind|pR : -1.18152, ind|s( : -1.18468, ind|s# : -1.19, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19788, ind|t9R : -1.20097, ind|t% : -1.20221, ind|k* : -1.20323, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20722, ind|t# : -1.20922, ind|S% : -1.21399, ind|T# : -1.21744, ind|c( : -1.21797, ind|S* : -1.2181, ind|kR : -1.21825, ind|k% : -1.21879, ind|p% : -1.21922, phonocvrpresuf4gram|^ccr : -1.23307, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25255, phonocvrpresuf2gram|^r : -1.25431, phonofeatpresuf2gram|(vX)(^^) : -1.2619, ind|pe : -1.27371, ind|lR# : -1.27498, ind|y)# : -1.27881, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.2855, ind|f9 : -1.28626, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.30062, ind|k9 : -1.30257, ind|( : -1.30307, ind|s9 : -1.32492, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3331, phonocvrpresuf3gram|vv^ : -1.34266, ind|fo : -1.35654, ind|tQ : -1.35808, ind|fe : -1.36013, ind|sQ : -1.3606, ind|c9 : -1.36316, ind|ho : -1.3651, ind|p9 : -1.36527, ind|po : -1.36554, ind|Se : -1.36628, ind|We : -1.36788, ind|fQ : -1.36899, ind|ce : -1.37032, ind|cQ : -1.37035, ind|TQ : -1.37038, ind|pQ : -1.37046, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37855, ind|) : -1.37981, phonocvrpresuf3gram|^vv : -1.3857, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39403, phonocvrpresuf4gram|ccv^ : -1.46329, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46658, phonocvrpresuf3gram|^cc : -1.48888, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.50982, phonocvrpresuf4gram|^vcc : -1.51117, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.61068, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62781, ind|Q : -1.68038, ind|7 : -1.71433, len|lenraw7 : -1.82435, numphonov|numv5 : -1.89689, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.9184, phonocvrpresuf3gram|^rc : -1.9481, phonocvrpresuf4gram|vvc^ : -2.11823, phonocvrpresuf4gram|^vcr : -2.1535, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17352, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.2476, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48028, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80116, len|lenraw8 : -4.5892, numphonov|numv4 : -5.02161, len|lenraw9 : -5.36538, len|lenraw10 : -5.42601]
} [1.3s, cum. 2.4s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.855)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.5s, cum. 34m44s]
Iteration 856/99999: temperature = 1 {
E-step [1.0s, cum. 1.1s]
M-step {
LFGS stage3 calc 279: 402074.989602
[LBFGSMinimizer.minimize] Iteration 279 ended with value 402074.989602
Highest weights:
[ind|op~ : 9.21273, ind|&nd : 9.11974, ind|9TINk : 9.04102, ind|Els : 8.80774, ind|prIti : 8.80559, ind|oke : 8.66073, ind|Its : 8.48766, ind|kreanz : 8.45417, ind|pik6bu : 8.43609, ind|hAmpti : 8.42137, ind|&pL : 8.27728, ind|6bQt : 8.11204, ind|yu : 8.09401, ind|#Doz : 8.07804, ind|6gEn : 8.04449, ind|hANgri : 7.98306, ind|&n6mL : 7.95631, ind|hQmEni : 7.8236, ind|D6 : 7.76864, ind|dr&g~ : 7.75405, ind|wan6 : 7.71349, ind|&lIs : 7.71235, ind|v*i : 7.63297, ind|mANki : 7.60002, ind|ovR : 7.56545, ind|It : 7.53548, ind|6nADR : 7.49709, ind|D&t : 7.46374, ind|want : 7.38392, ind|dOgi : 7.2978, ind|k9nd6v : 7.26383, ind|n9tn9t : 7.25968, ind|kIti : 7.1652, ind|WAts : 7.15351, ind|Iz : 7.14117, ind|g6n6 : 7.09558, ind|lUk&t : 7.09387, ind|dAmpti : 7.08364, ind|go6hEd : 7.05128, ind|du : 7.00809, ind|b6lunz : 7.00682, ind|DIs : 6.99302, ind|mamiz : 6.98524, ind|hElo : 6.98239, ind|b9b9 : 6.94177, ind|sIndi : 6.92793, ind|lItL : 6.89052, ind|IN : 6.86048, ind|bAni : 6.82379, ind|6 : 6.80317, ind|dont : 6.79754, ind|WAt : 6.77801, ind|d&di : 6.7504, ind|tu : 6.74118, ind|D&ts : 6.72848, ind|zskr& : 6.71388, ind|In : 6.68968, ind|Tri : 6.68808, ind|k&n : 6.68175, ind|blaks : 6.66603, ind|lUk : 6.64813, ind|brAS : 6.63745, ind|Qt : 6.62426, ind|Iz~t : 6.5103, ind|mami : 6.49752, ind|%InG : 6.44369, ind|si : 6.44209, ind|wAn : 6.41884, ind|D*z : 6.40236, ind|y& : 6.39198, ind|tEl6 : 6.38437, ind|smEl : 6.37089, ind|T&Nk : 6.29867, ind|Olr9t : 6.28649, ind|l9k : 6.28334, ind|bebi : 6.28102, ind|pliz : 6.22405, ind|an : 6.13681, ind|9dont : 6.11683, ind|cifes : 6.11258, ind|Eni : 6.10563, ind|r9t : 6.10256, ind|W*z : 6.08859, ind|mebi : 6.05093, ind|h&nd : 6.04679, ind|&ni : 6.04627, ind|Gudi : 6.04531, ind|dIgbi : 6.01381, ind|slip : 6.01177, ind|sAmT : 5.98352, ind|mi : 5.97483, ind|blak : 5.96257, ind|bUk : 5.94969, ind|dAz~t : 5.9262, ind|D* : 5.90589, ind|snikRz : 5.90405, ind|t6de : 5.88943, ind|m6ri : 5.88664, ind|ADR : 5.86884, ind|b6lun : 5.86561, ind|hi : 5.84089]
Lowest weights:
[ind|N9 : -1.07264, ind|rQ : -1.07271, ind|wo : -1.07278, ind|gQ : -1.0729, ind|LQ : -1.07299, ind|~o : -1.07325, ind|~Q : -1.07328, ind|ze : -1.07332, ind|yo : -1.0736, ind|v7 : -1.07392, ind|No : -1.07402, ind|n7 : -1.07509, ind|s% : -1.07613, ind|ko : -1.07626, ind|a : -1.083, ind|u : -1.08503, ind|O : -1.09334, ind|h9# : -1.09956, ind|sR : -1.11022, ind|U : -1.12297, ind|tR# : -1.12641, phonocvrpresuf3gram|rc^ : -1.13101, phonocvrpresuf4gram|^crc : -1.13903, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.14983, ind|h# : -1.16703, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.16839, phonocvrpresuf4gram|rvc^ : -1.16852, ind|cR : -1.17306, ind|pR : -1.18152, ind|s( : -1.18468, ind|s# : -1.19, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.19788, ind|t9R : -1.20097, ind|t% : -1.20221, ind|k* : -1.20323, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20722, ind|t# : -1.20922, ind|S% : -1.21399, ind|T# : -1.21744, ind|c( : -1.21797, ind|S* : -1.2181, ind|kR : -1.21825, ind|k% : -1.21879, ind|p% : -1.21922, phonocvrpresuf4gram|^ccr : -1.23307, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.25255, phonocvrpresuf2gram|^r : -1.25431, phonofeatpresuf2gram|(vX)(^^) : -1.2619, ind|pe : -1.27371, ind|lR# : -1.27498, ind|y)# : -1.27881, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.2855, ind|f9 : -1.28626, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.30062, ind|k9 : -1.30257, ind|( : -1.30307, ind|s9 : -1.32492, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3331, phonocvrpresuf3gram|vv^ : -1.34266, ind|fo : -1.35654, ind|tQ : -1.35808, ind|fe : -1.36013, ind|sQ : -1.3606, ind|c9 : -1.36316, ind|ho : -1.3651, ind|p9 : -1.36527, ind|po : -1.36554, ind|Se : -1.36628, ind|We : -1.36788, ind|fQ : -1.36899, ind|ce : -1.37032, ind|cQ : -1.37035, ind|TQ : -1.37038, ind|pQ : -1.37046, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37855, ind|) : -1.37981, phonocvrpresuf3gram|^vv : -1.3857, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39403, phonocvrpresuf4gram|ccv^ : -1.46329, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.46658, phonocvrpresuf3gram|^cc : -1.48888, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.50982, phonocvrpresuf4gram|^vcc : -1.51117, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.61068, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62781, ind|Q : -1.68038, ind|7 : -1.71433, len|lenraw7 : -1.82435, numphonov|numv5 : -1.89689, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.9184, phonocvrpresuf3gram|^rc : -1.9481, phonocvrpresuf4gram|vvc^ : -2.11823, phonocvrpresuf4gram|^vcr : -2.1535, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17352, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.2476, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48028, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.80116, len|lenraw8 : -4.5892, numphonov|numv4 : -5.02161, len|lenraw9 : -5.36538, len|lenraw10 : -5.42601]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.856)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.2s, cum. 34m46s]
Iteration 857/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage1 calc 280: 402074.989602
Line search init: value: 402074.989602, deriv: -11.012983
Highest weights:
[ind|op~ : 9.21296, ind|&nd : 9.113, ind|9TINk : 9.04329, ind|prIti : 8.80986, ind|Els : 8.79312, ind|oke : 8.65816, ind|Its : 8.47671, ind|kreanz : 8.45499, ind|hAmpti : 8.43278, ind|pik6bu : 8.43159, ind|&pL : 8.29092, ind|6bQt : 8.10547, ind|#Doz : 8.09465, ind|yu : 8.08625, ind|6gEn : 8.0461, ind|&n6mL : 7.9848, ind|hANgri : 7.98, ind|hQmEni : 7.83846, ind|D6 : 7.76266, ind|dr&g~ : 7.76096, ind|wan6 : 7.72487, ind|&lIs : 7.70508, ind|v*i : 7.63958, ind|mANki : 7.60573, ind|ovR : 7.57372, ind|It : 7.53713, ind|6nADR : 7.49143, ind|D&t : 7.46804, ind|want : 7.38612, ind|dOgi : 7.29859, ind|n9tn9t : 7.26151, ind|k9nd6v : 7.25598, ind|kIti : 7.16796, ind|WAts : 7.15519, ind|Iz : 7.13513, ind|dAmpti : 7.12496, ind|g6n6 : 7.09406, ind|lUk&t : 7.09266, ind|go6hEd : 7.05425, ind|du : 7.00645, ind|mamiz : 6.99593, ind|DIs : 6.99568, ind|b6lunz : 6.9896, ind|hElo : 6.97998, ind|b9b9 : 6.93558, ind|sIndi : 6.89847, ind|lItL : 6.8854, ind|IN : 6.85444, ind|bAni : 6.82045, ind|6 : 6.81178, ind|dont : 6.80057, ind|WAt : 6.77413, ind|d&di : 6.7477, ind|zskr& : 6.74678, ind|tu : 6.73957, ind|D&ts : 6.73407, ind|k&n : 6.69231, ind|In : 6.68282, ind|blaks : 6.68167, ind|Tri : 6.68072, ind|lUk : 6.6496, ind|brAS : 6.64805, ind|Qt : 6.61306, ind|Iz~t : 6.51736, ind|mami : 6.48747, ind|%InG : 6.46344, ind|si : 6.43709, ind|wAn : 6.41975, ind|D*z : 6.4066, ind|y& : 6.38511, ind|tEl6 : 6.37938, ind|smEl : 6.37225, ind|T&Nk : 6.30486, ind|bebi : 6.29591, ind|l9k : 6.28563, ind|Olr9t : 6.2754, ind|pliz : 6.22406, ind|an : 6.13399, ind|9dont : 6.11385, ind|cifes : 6.10843, ind|Eni : 6.10581, ind|r9t : 6.10034, ind|W*z : 6.08005, ind|&ni : 6.05595, ind|h&nd : 6.04637, ind|mebi : 6.04477, ind|dIgbi : 6.04221, ind|Gudi : 6.02687, ind|slip : 6.00998, ind|sAmT : 6.00215, ind|mi : 5.97927, ind|blak : 5.97448, ind|bUk : 5.95061, ind|snikRz : 5.92206, ind|dAz~t : 5.91677, ind|D* : 5.90827, ind|m6ri : 5.89454, ind|t6de : 5.88896, ind|ADR : 5.85909, ind|b6lun : 5.85162, ind|hi : 5.83791]
Lowest weights:
[ind|N9 : -1.07323, ind|rQ : -1.0733, ind|wo : -1.07336, ind|gQ : -1.07349, ind|LQ : -1.07358, ind|~o : -1.07383, ind|~Q : -1.07387, ind|ze : -1.0739, ind|yo : -1.07418, ind|v7 : -1.0745, ind|No : -1.0746, ind|n7 : -1.07566, ind|s% : -1.07817, ind|ko : -1.07929, ind|a : -1.08406, ind|u : -1.08612, ind|O : -1.09442, ind|h9# : -1.10154, ind|sR : -1.1111, ind|U : -1.12396, ind|tR# : -1.12763, phonocvrpresuf3gram|rc^ : -1.12931, phonocvrpresuf4gram|^crc : -1.13987, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.15193, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.16081, phonocvrpresuf4gram|rvc^ : -1.16308, ind|h# : -1.16843, ind|cR : -1.17456, ind|pR : -1.18331, ind|s( : -1.18626, ind|s# : -1.19149, ind|t9R : -1.20352, ind|t% : -1.20375, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.20393, ind|k* : -1.20472, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20596, ind|t# : -1.21077, ind|S% : -1.21548, ind|T# : -1.21889, ind|c( : -1.21942, ind|S* : -1.21951, ind|kR : -1.21969, ind|k% : -1.22024, ind|p% : -1.22066, phonocvrpresuf4gram|^ccr : -1.22354, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.2508, phonocvrpresuf2gram|^r : -1.25435, phonofeatpresuf2gram|(vX)(^^) : -1.26399, ind|pe : -1.27587, ind|lR# : -1.2762, ind|y)# : -1.27999, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28712, ind|f9 : -1.28772, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.30391, ind|( : -1.30491, ind|k9 : -1.30499, ind|s9 : -1.32662, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3333, phonocvrpresuf3gram|vv^ : -1.343, ind|fo : -1.35843, ind|tQ : -1.35985, ind|fe : -1.36186, ind|sQ : -1.36239, ind|c9 : -1.36482, ind|ho : -1.36684, ind|p9 : -1.36699, ind|po : -1.36723, ind|Se : -1.36799, ind|We : -1.36957, ind|fQ : -1.37068, ind|ce : -1.372, ind|cQ : -1.37203, ind|TQ : -1.37205, ind|pQ : -1.37214, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37746, ind|) : -1.38185, phonocvrpresuf3gram|^vv : -1.38587, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39092, phonocvrpresuf4gram|ccv^ : -1.46411, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.4668, phonocvrpresuf3gram|^cc : -1.48846, phonocvrpresuf4gram|^vcc : -1.50764, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.50936, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.6029, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62672, ind|Q : -1.68314, ind|7 : -1.71678, len|lenraw7 : -1.8296, numphonov|numv5 : -1.89295, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.91504, phonocvrpresuf3gram|^rc : -1.94333, phonocvrpresuf4gram|vvc^ : -2.11126, phonocvrpresuf4gram|^vcr : -2.14904, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17849, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.25115, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48034, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.79985, len|lenraw8 : -4.57986, numphonov|numv4 : -5.01115, len|lenraw9 : -5.35428, len|lenraw10 : -5.41476]
}
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.168, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.857)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.1s, cum. 34m48s]
Iteration 858/99999: temperature = 1 {
E-step [1.1s, cum. 1.1s]
M-step {
Line search iter: value: 402066.785041, suff decrease: 402074.988501
Highest weights:
[ind|op~ : 9.21296, ind|&nd : 9.113, ind|9TINk : 9.04329, ind|prIti : 8.80986, ind|Els : 8.79312, ind|oke : 8.65816, ind|Its : 8.47671, ind|kreanz : 8.45499, ind|hAmpti : 8.43278, ind|pik6bu : 8.43159, ind|&pL : 8.29092, ind|6bQt : 8.10547, ind|#Doz : 8.09465, ind|yu : 8.08625, ind|6gEn : 8.0461, ind|&n6mL : 7.9848, ind|hANgri : 7.98, ind|hQmEni : 7.83846, ind|D6 : 7.76266, ind|dr&g~ : 7.76096, ind|wan6 : 7.72487, ind|&lIs : 7.70508, ind|v*i : 7.63958, ind|mANki : 7.60573, ind|ovR : 7.57372, ind|It : 7.53713, ind|6nADR : 7.49143, ind|D&t : 7.46804, ind|want : 7.38612, ind|dOgi : 7.29859, ind|n9tn9t : 7.26151, ind|k9nd6v : 7.25598, ind|kIti : 7.16796, ind|WAts : 7.15519, ind|Iz : 7.13513, ind|dAmpti : 7.12496, ind|g6n6 : 7.09406, ind|lUk&t : 7.09266, ind|go6hEd : 7.05425, ind|du : 7.00645, ind|mamiz : 6.99593, ind|DIs : 6.99568, ind|b6lunz : 6.9896, ind|hElo : 6.97998, ind|b9b9 : 6.93558, ind|sIndi : 6.89847, ind|lItL : 6.8854, ind|IN : 6.85444, ind|bAni : 6.82045, ind|6 : 6.81178, ind|dont : 6.80057, ind|WAt : 6.77413, ind|d&di : 6.7477, ind|zskr& : 6.74678, ind|tu : 6.73957, ind|D&ts : 6.73407, ind|k&n : 6.69231, ind|In : 6.68282, ind|blaks : 6.68167, ind|Tri : 6.68072, ind|lUk : 6.6496, ind|brAS : 6.64805, ind|Qt : 6.61306, ind|Iz~t : 6.51736, ind|mami : 6.48747, ind|%InG : 6.46344, ind|si : 6.43709, ind|wAn : 6.41975, ind|D*z : 6.4066, ind|y& : 6.38511, ind|tEl6 : 6.37938, ind|smEl : 6.37225, ind|T&Nk : 6.30486, ind|bebi : 6.29591, ind|l9k : 6.28563, ind|Olr9t : 6.2754, ind|pliz : 6.22406, ind|an : 6.13399, ind|9dont : 6.11385, ind|cifes : 6.10843, ind|Eni : 6.10581, ind|r9t : 6.10034, ind|W*z : 6.08005, ind|&ni : 6.05595, ind|h&nd : 6.04637, ind|mebi : 6.04477, ind|dIgbi : 6.04221, ind|Gudi : 6.02687, ind|slip : 6.00998, ind|sAmT : 6.00215, ind|mi : 5.97927, ind|blak : 5.97448, ind|bUk : 5.95061, ind|snikRz : 5.92206, ind|dAz~t : 5.91677, ind|D* : 5.90827, ind|m6ri : 5.89454, ind|t6de : 5.88896, ind|ADR : 5.85909, ind|b6lun : 5.85162, ind|hi : 5.83791]
Lowest weights:
[ind|N9 : -1.07323, ind|rQ : -1.0733, ind|wo : -1.07336, ind|gQ : -1.07349, ind|LQ : -1.07358, ind|~o : -1.07383, ind|~Q : -1.07387, ind|ze : -1.0739, ind|yo : -1.07418, ind|v7 : -1.0745, ind|No : -1.0746, ind|n7 : -1.07566, ind|s% : -1.07817, ind|ko : -1.07929, ind|a : -1.08406, ind|u : -1.08612, ind|O : -1.09442, ind|h9# : -1.10154, ind|sR : -1.1111, ind|U : -1.12396, ind|tR# : -1.12763, phonocvrpresuf3gram|rc^ : -1.12931, phonocvrpresuf4gram|^crc : -1.13987, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.15193, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.16081, phonocvrpresuf4gram|rvc^ : -1.16308, ind|h# : -1.16843, ind|cR : -1.17456, ind|pR : -1.18331, ind|s( : -1.18626, ind|s# : -1.19149, ind|t9R : -1.20352, ind|t% : -1.20375, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.20393, ind|k* : -1.20472, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20596, ind|t# : -1.21077, ind|S% : -1.21548, ind|T# : -1.21889, ind|c( : -1.21942, ind|S* : -1.21951, ind|kR : -1.21969, ind|k% : -1.22024, ind|p% : -1.22066, phonocvrpresuf4gram|^ccr : -1.22354, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.2508, phonocvrpresuf2gram|^r : -1.25435, phonofeatpresuf2gram|(vX)(^^) : -1.26399, ind|pe : -1.27587, ind|lR# : -1.2762, ind|y)# : -1.27999, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28712, ind|f9 : -1.28772, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.30391, ind|( : -1.30491, ind|k9 : -1.30499, ind|s9 : -1.32662, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3333, phonocvrpresuf3gram|vv^ : -1.343, ind|fo : -1.35843, ind|tQ : -1.35985, ind|fe : -1.36186, ind|sQ : -1.36239, ind|c9 : -1.36482, ind|ho : -1.36684, ind|p9 : -1.36699, ind|po : -1.36723, ind|Se : -1.36799, ind|We : -1.36957, ind|fQ : -1.37068, ind|ce : -1.372, ind|cQ : -1.37203, ind|TQ : -1.37205, ind|pQ : -1.37214, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37746, ind|) : -1.38185, phonocvrpresuf3gram|^vv : -1.38587, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39092, phonocvrpresuf4gram|ccv^ : -1.46411, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.4668, phonocvrpresuf3gram|^cc : -1.48846, phonocvrpresuf4gram|^vcc : -1.50764, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.50936, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.6029, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62672, ind|Q : -1.68314, ind|7 : -1.71678, len|lenraw7 : -1.8296, numphonov|numv5 : -1.89295, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.91504, phonocvrpresuf3gram|^rc : -1.94333, phonocvrpresuf4gram|vvc^ : -2.11126, phonocvrpresuf4gram|^vcr : -2.14904, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17849, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.25115, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48034, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.79985, len|lenraw8 : -4.57986, numphonov|numv4 : -5.01115, len|lenraw9 : -5.35428, len|lenraw10 : -5.41476]
} [1.3s, cum. 2.4s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.167, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.858)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [2.4s, cum. 34m51s]
Iteration 859/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
M-step {
LFGS stage3 calc 280: 402066.785041
[LBFGSMinimizer.minimize] Iteration 280 ended with value 402066.785041
Highest weights:
[ind|op~ : 9.21296, ind|&nd : 9.113, ind|9TINk : 9.04329, ind|prIti : 8.80986, ind|Els : 8.79312, ind|oke : 8.65816, ind|Its : 8.47671, ind|kreanz : 8.45499, ind|hAmpti : 8.43278, ind|pik6bu : 8.43159, ind|&pL : 8.29092, ind|6bQt : 8.10547, ind|#Doz : 8.09465, ind|yu : 8.08625, ind|6gEn : 8.0461, ind|&n6mL : 7.9848, ind|hANgri : 7.98, ind|hQmEni : 7.83846, ind|D6 : 7.76266, ind|dr&g~ : 7.76096, ind|wan6 : 7.72487, ind|&lIs : 7.70508, ind|v*i : 7.63958, ind|mANki : 7.60573, ind|ovR : 7.57372, ind|It : 7.53713, ind|6nADR : 7.49143, ind|D&t : 7.46804, ind|want : 7.38612, ind|dOgi : 7.29859, ind|n9tn9t : 7.26151, ind|k9nd6v : 7.25598, ind|kIti : 7.16796, ind|WAts : 7.15519, ind|Iz : 7.13513, ind|dAmpti : 7.12496, ind|g6n6 : 7.09406, ind|lUk&t : 7.09266, ind|go6hEd : 7.05425, ind|du : 7.00645, ind|mamiz : 6.99593, ind|DIs : 6.99568, ind|b6lunz : 6.9896, ind|hElo : 6.97998, ind|b9b9 : 6.93558, ind|sIndi : 6.89847, ind|lItL : 6.8854, ind|IN : 6.85444, ind|bAni : 6.82045, ind|6 : 6.81178, ind|dont : 6.80057, ind|WAt : 6.77413, ind|d&di : 6.7477, ind|zskr& : 6.74678, ind|tu : 6.73957, ind|D&ts : 6.73407, ind|k&n : 6.69231, ind|In : 6.68282, ind|blaks : 6.68167, ind|Tri : 6.68072, ind|lUk : 6.6496, ind|brAS : 6.64805, ind|Qt : 6.61306, ind|Iz~t : 6.51736, ind|mami : 6.48747, ind|%InG : 6.46344, ind|si : 6.43709, ind|wAn : 6.41975, ind|D*z : 6.4066, ind|y& : 6.38511, ind|tEl6 : 6.37938, ind|smEl : 6.37225, ind|T&Nk : 6.30486, ind|bebi : 6.29591, ind|l9k : 6.28563, ind|Olr9t : 6.2754, ind|pliz : 6.22406, ind|an : 6.13399, ind|9dont : 6.11385, ind|cifes : 6.10843, ind|Eni : 6.10581, ind|r9t : 6.10034, ind|W*z : 6.08005, ind|&ni : 6.05595, ind|h&nd : 6.04637, ind|mebi : 6.04477, ind|dIgbi : 6.04221, ind|Gudi : 6.02687, ind|slip : 6.00998, ind|sAmT : 6.00215, ind|mi : 5.97927, ind|blak : 5.97448, ind|bUk : 5.95061, ind|snikRz : 5.92206, ind|dAz~t : 5.91677, ind|D* : 5.90827, ind|m6ri : 5.89454, ind|t6de : 5.88896, ind|ADR : 5.85909, ind|b6lun : 5.85162, ind|hi : 5.83791]
Lowest weights:
[ind|N9 : -1.07323, ind|rQ : -1.0733, ind|wo : -1.07336, ind|gQ : -1.07349, ind|LQ : -1.07358, ind|~o : -1.07383, ind|~Q : -1.07387, ind|ze : -1.0739, ind|yo : -1.07418, ind|v7 : -1.0745, ind|No : -1.0746, ind|n7 : -1.07566, ind|s% : -1.07817, ind|ko : -1.07929, ind|a : -1.08406, ind|u : -1.08612, ind|O : -1.09442, ind|h9# : -1.10154, ind|sR : -1.1111, ind|U : -1.12396, ind|tR# : -1.12763, phonocvrpresuf3gram|rc^ : -1.12931, phonocvrpresuf4gram|^crc : -1.13987, phonofeatpresuf4gram|(^^)(cv)(cv)(cu) : -1.15193, phonofeatpresuf4gram|(vr)(cv)(cv)(^^) : -1.16081, phonocvrpresuf4gram|rvc^ : -1.16308, ind|h# : -1.16843, ind|cR : -1.17456, ind|pR : -1.18331, ind|s( : -1.18626, ind|s# : -1.19149, ind|t9R : -1.20352, ind|t% : -1.20375, phonofeatpresuf3gram|(^^)(cu)(vr) : -1.20393, ind|k* : -1.20472, phonofeatpresuf4gram|(^^)(cv)(vX)(vX) : -1.20596, ind|t# : -1.21077, ind|S% : -1.21548, ind|T# : -1.21889, ind|c( : -1.21942, ind|S* : -1.21951, ind|kR : -1.21969, ind|k% : -1.22024, ind|p% : -1.22066, phonocvrpresuf4gram|^ccr : -1.22354, phonofeatpresuf4gram|(cv)(vr)(cu)(^^) : -1.2508, phonocvrpresuf2gram|^r : -1.25435, phonofeatpresuf2gram|(vX)(^^) : -1.26399, ind|pe : -1.27587, ind|lR# : -1.2762, ind|y)# : -1.27999, phonofeatpresuf3gram|(vr)(vX)(^^) : -1.28712, ind|f9 : -1.28772, phonofeatpresuf4gram|(vr)(cv)(vX)(^^) : -1.30391, ind|( : -1.30491, ind|k9 : -1.30499, ind|s9 : -1.32662, phonofeatpresuf4gram|(^^)(vr)(cv)(vX) : -1.3333, phonocvrpresuf3gram|vv^ : -1.343, ind|fo : -1.35843, ind|tQ : -1.35985, ind|fe : -1.36186, ind|sQ : -1.36239, ind|c9 : -1.36482, ind|ho : -1.36684, ind|p9 : -1.36699, ind|po : -1.36723, ind|Se : -1.36799, ind|We : -1.36957, ind|fQ : -1.37068, ind|ce : -1.372, ind|cQ : -1.37203, ind|TQ : -1.37205, ind|pQ : -1.37214, phonofeatpresuf4gram|(^^)(vd)(cu)(cu) : -1.37746, ind|) : -1.38185, phonocvrpresuf3gram|^vv : -1.38587, phonofeatpresuf4gram|(vd)(cu)(cv)(^^) : -1.39092, phonocvrpresuf4gram|ccv^ : -1.46411, phonofeatpresuf4gram|(cv)(cu)(vd)(^^) : -1.4668, phonocvrpresuf3gram|^cc : -1.48846, phonocvrpresuf4gram|^vcc : -1.50764, phonofeatpresuf4gram|(vd)(vX)(cu)(^^) : -1.50936, phonofeatpresuf4gram|(^^)(vX)(cv)(cu) : -1.6029, phonofeatpresuf4gram|(^^)(vX)(cu)(vr) : -1.62672, ind|Q : -1.68314, ind|7 : -1.71678, len|lenraw7 : -1.8296, numphonov|numv5 : -1.89295, phonofeatpresuf4gram|(^^)(cv)(cu)(vX) : -1.91504, phonocvrpresuf3gram|^rc : -1.94333, phonocvrpresuf4gram|vvc^ : -2.11126, phonocvrpresuf4gram|^vcr : -2.14904, phonofeatpresuf4gram|(vd)(cu)(vX)(^^) : -2.17849, phonofeatpresuf4gram|(^^)(cu)(cu)(cu) : -2.25115, phonofeatpresuf4gram|(^^)(vX)(cu)(vX) : -2.48034, phonofeatpresuf4gram|(vX)(cu)(vd)(^^) : -2.79985, len|lenraw8 : -4.57986, numphonov|numv4 : -5.01115, len|lenraw9 : -5.35428, len|lenraw10 : -5.41476]
} [1.9s, cum. 3.0s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.167, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.859)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [3.1s, cum. 34m54s]
Iteration 860/99999: temperature = 1 {
E-step [1.0s, cum. 1.0s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.167, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage1.params.860)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [1.1s, cum. 34m55s]
Final {
train: logZ = -4.167, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [34m55s, cum. 35m25s]
Train: stage2 {
Iteration 0/0: temperature = 1 {
E-step [1.0s, cum. 1.0s]
Inference complexity: 3/ << 11.786~6.137 >> /55 (9790)
train: logZ = -4.167, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
AParams.output(expers/TMP/0.exec/stage2.params.0)
Output test predictions on current parameters {
current.test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [1.1s, cum. 1.1s]
Final {
train: logZ = -4.167, logVZ = -4.175, logCZ = -0.008, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = 0.094
test: logZ = NaN, logVZ = NaN, logCZ = NaN, elogZ = NaN, entropy = NaN, objective = NaN, accuracy = NaN
}
} [1.1s, cum. 35m27s]
Execution directory: expers/TMP/0.exec
} [35m27s]
=== END program1: ./run perform ../program0/input ../program0/output --- OK [2129s]
===== MAIN: evaluate performance =====
=== START program4: ./run evaluate ../dataset2/raw ../program0/output
=== END program4: ./run evaluate ../dataset2/raw ../program0/output --- OK [1s]
real 35m29.334s
user 33m20.705s
sys 0m21.265s
Run specification 
Results
Must be logged in to post comments.