MLcomp version alpha Statistics: 2040 users, 637 datasets, 389 programs, 18661 runs (0 queued, 2 running), 0 workers

Run 16357

Creator	internal
Program	BerkeleyParser WSJ OntoNotes
Dataset	Google Web Treebank Emails Constituency Dev Set
Task type	ConstituencyParsingTest
Created	1y30d ago

Status: Failed!

Note: this page autoupdates while a run is in progress

Reason	(see end of log file)
Total Time	10m0s
Max Memory Usage	418M
Domain	ConstituencyParsingTest
Time
F1
LP
LR
POS

Log file

... (lines omitted) ...
2087   22    0   53.33  57.14     8     15   14      4     22    14    63.64
2088    9    0   44.44  80.00     4      9    5      1      9     6    66.67
2089    7    0   25.00  20.00     1      4    5      1      7     5    71.43
2090    6    0   50.00  40.00     2      4    5      0      6     6   100.00
2091    4    0   66.67  66.67     2      3    3      0      4     2    50.00
2092   18    0  100.00 100.00    11     11   11      0     18    17    94.44
2093   13    0  100.00 100.00    11     11   11      0     13    12    92.31
2094   13    0  100.00 100.00    13     13   13      0     13    13   100.00
2095    3    0    0.00   0.00     0      1    4      0      3     1    33.33
2096    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2097   16    0   33.33  40.00     4     12   10      4     16     9    56.25
2098    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2099   15    0   80.00  72.73     8     10   11      0     15    11    73.33
2100    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2101    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2102    2    0  100.00 100.00     1      1    1      0      2     1    50.00
2103   12    0  100.00 100.00    11     11   11      0     12    12   100.00
2104    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2105    2    0  100.00 100.00     1      1    1      0      2     1    50.00
2106   12    0   90.00  90.00     9     10   10      0     12    11    91.67
2107   32    0   95.83 100.00    23     24   23      0     32    30    93.75
2108   20    0   95.00 100.00    19     20   19      0     20    19    95.00
2109   50    0   96.15  96.15    50     52   52      0     50    49    98.00
2110   19    0  100.00 100.00    16     16   16      0     19    18    94.74
2111    6    0  100.00 100.00     5      5    5      0      6     6   100.00
2112    6    0   33.33  50.00     3      9    6      0      6     4    66.67
2113    2    0    0.00   0.00     0      3    1      0      2     0     0.00
2114    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2115    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2116    8    0  100.00 100.00     7      7    7      0      8     8   100.00
2117   14    0  100.00 100.00    13     13   13      0     14    14   100.00
2118   12    0   77.78  87.50     7      9    8      1     12    11    91.67
2119    9    0  100.00 100.00     7      7    7      0      9     9   100.00
2120    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2121    5    0    0.00   0.00     0      1    3      0      5     4    80.00
2122    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2123    5    0  100.00 100.00     5      5    5      0      5     5   100.00
2124   11    0   91.67 100.00    11     12   11      0     11    11   100.00
2125   14    0   90.91  90.91    10     11   11      0     14    14   100.00
2126    6    0  100.00 100.00     5      5    5      0      6     5    83.33
2127   14    0   75.00  75.00     9     12   12      3     14    12    85.71
2128   16    0   60.00  64.29     9     15   14      5     16    14    87.50
2129    8    0  100.00 100.00     9      9    9      0      8     8   100.00
2130   31    0   82.35  84.85    28     34   33      1     31    27    87.10
2131   15    0   80.00  85.71    12     15   14      2     15    15   100.00
2132    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2133    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2134   31    0   15.38  23.53     4     26   17      7     31    20    64.52
2135    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2136    7    0    0.00   0.00     0      5    4      2      7     1    14.29
2137    7    0    0.00   0.00     0      5    4      2      7     1    14.29
2138    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2139    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2140   12    0   50.00  55.56     5     10    9      2     12    10    83.33
2141    3    0  100.00 100.00     1      1    1      0      3     0     0.00
2142    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2143   31    0   43.33  46.43    13     30   28     11     31    28    90.32
2144   32    0   57.58  73.08    19     33   26      6     32    32   100.00
2145   16    0  100.00 100.00    17     17   17      0     16    16   100.00
2146    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2147    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2148   14    0   46.67  58.33     7     15   12      1     14    11    78.57
2149   15    0   64.29  56.25     9     14   16      2     15    14    93.33
2150    8    0   85.71  85.71     6      7    7      0      8     7    87.50
2151   28    0   80.00  83.33    20     25   24      0     28    25    89.29
2152    9    0  100.00 100.00     6      6    6      0      9     9   100.00
2153   17    0   47.06  44.44     8     17   18      6     17    16    94.12
2154    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2155    5    0   50.00  50.00     2      4    4      0      5     5   100.00
2156    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2157    7    0  100.00 100.00     8      8    8      0      7     6    85.71
2158   20    0   78.95  78.95    15     19   19      2     20    18    90.00
2159    8    0   87.50  87.50     7      8    8      0      8     7    87.50
2160   17    0   73.33  55.00    11     15   20      4     17    16    94.12
2161    2    0    0.00   0.00     0      2    3      0      2     1    50.00
2162    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2163   22    0   94.74 100.00    18     19   18      0     22    22   100.00
2164   21    0   95.65 100.00    22     23   22      0     21    21   100.00
2165    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2166    5    0   50.00  50.00     2      4    4      0      5     5   100.00
2167    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2168   50    0   87.50  87.50    42     48   48      5     50    47    94.00
2169    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2170    3    0  100.00 100.00     3      3    3      0      3     3   100.00
2171   10    0  100.00 100.00     7      7    7      0     10    10   100.00
2172    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2173    3    0   66.67  50.00     2      3    4      0      3     2    66.67
2174    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2175   23    0   94.44 100.00    17     18   17      0     23    19    82.61
2176    9    0  100.00  85.71     6      6    7      0      9     9   100.00
2177   11    0  100.00 100.00    11     11   11      0     11    10    90.91
2178   25    0   95.00 100.00    19     20   19      0     25    25   100.00
2179   27    0   80.95  80.95    17     21   21      4     27    27   100.00
2180   15    0  100.00 100.00    13     13   13      0     15    15   100.00
2181   25    0   95.45  95.45    21     22   22      0     25    24    96.00
2182   14    0  100.00 100.00    17     17   17      0     14    13    92.86
2183   33    0   85.19  92.00    23     27   25      2     33    32    96.97
2184   40    0   78.05  74.42    32     41   43      6     40    39    97.50
2185   32    0   76.67  71.88    23     30   32      7     32    31    96.88
2186   21    0   82.35  82.35    14     17   17      3     21    20    95.24
2187   27    0   96.67  96.67    29     30   30      0     27    26    96.30
2188   10    0   90.91  83.33    10     11   12      0     10     9    90.00
2189    2    0    0.00   0.00     0      1    3      0      2     0     0.00
2190    3    0  100.00 100.00     1      1    1      0      3     3   100.00
2191    3    0   66.67  50.00     2      3    4      0      3     2    66.67
2192   22    0   73.91  73.91    17     23   23      3     22    22   100.00
2193   18    0   81.25 100.00    13     16   13      0     18    17    94.44
2194    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2195    3    0   66.67  50.00     2      3    4      0      3     2    66.67
2196    4    0  100.00  33.33     1      1    3      0      4     3    75.00
2197   20    0   81.82  81.82    18     22   22      2     20    20   100.00
2198   14    0  100.00 100.00    11     11   11      0     14    12    85.71
2199    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2200    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2201    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2202    2    0  100.00 100.00     1      1    1      0      2     0     0.00
2203    5    0   50.00  50.00     2      4    4      0      5     3    60.00
2204    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2205   23    0  100.00 100.00    22     22   22      0     23    22    95.65
2206   12    0   30.77  28.57     4     13   14      7     12    11    91.67
2207    6    0   20.00  20.00     1      5    5      1      6     6   100.00
2208   12    0   70.00  53.85     7     10   13      5     12     7    58.33
2209    5    0   50.00  33.33     2      4    6      1      5     2    40.00
2210    4    0   66.67  66.67     2      3    3      0      4     3    75.00
2211    8    0   62.50  83.33     5      8    6      0      8     5    62.50
2212   10    0   66.67  75.00     6      9    8      0     10     7    70.00
2213    6    0   33.33  50.00     2      6    4      1      6     5    83.33
2214    2    0  100.00 100.00     1      1    1      0      2     0     0.00
2215    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2216   20    0   90.91  86.96    20     22   23      0     20    19    95.00
2217   37    0   75.00  77.78    21     28   27      4     37    35    94.59
2218   20    0   83.33  86.96    20     24   23      1     20    20   100.00
2219   31    0  100.00 100.00    27     27   27      0     31    30    96.77
2220   26    0   86.96  83.33    20     23   24      1     26    25    96.15
2221    3    0  100.00 100.00     3      3    3      0      3     3   100.00
2222    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2223   25    0   78.95  65.22    15     19   23      2     25    21    84.00
2224    9    0   77.78  77.78     7      9    9      0      9     7    77.78
2225    7    0   50.00  60.00     3      6    5      1      7     3    42.86
2226    6    0  100.00  33.33     1      1    3      0      6     5    83.33
2227   23    0   36.00  36.00     9     25   25     13     23    22    95.65
2228    8    0   87.50 100.00     7      8    7      0      8     8   100.00
2229    9    0   81.82 100.00     9     11    9      0      9     9   100.00
2230    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2231    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2232   17    0    0.00   0.00     0      7   12      7     17    14    82.35
2233    8    0  100.00 100.00     5      5    5      0      8     8   100.00
2234    9    0  100.00 100.00     8      8    8      0      9     8    88.89
2235   19    0    9.09  14.29     1     11    7      0     19    10    52.63
2236    4    0    0.00   0.00     0      1    2      0      4     3    75.00
2237   34    0   86.21  92.59    25     29   27      2     34    31    91.18
2238   19    0    9.09  14.29     1     11    7      0     19    10    52.63
2239    3    0  100.00 100.00     3      3    3      0      3     3   100.00
2240    3    0    0.00   0.00     0      3    4      0      3     1    33.33
2241   18    0   88.89  88.89    16     18   18      0     18    18   100.00
2242    6    0   50.00  66.67     4      8    6      0      6     5    83.33
2243    7    0  100.00 100.00     8      8    8      0      7     7   100.00
2244    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2245    3    0   75.00  60.00     3      4    5      0      3     2    66.67
2246    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2247   13    0  100.00  78.57    11     11   14      0     13    13   100.00
2248    6    0    0.00   0.00     0      6    3      0      6     1    16.67
2249    6    0   75.00  60.00     3      4    5      0      6     6   100.00
2250    5    0   75.00  60.00     3      4    5      0      5     5   100.00
2251    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2252    5    0   75.00  60.00     3      4    5      0      5     4    80.00
2253   11    0   90.91  83.33    10     11   12      0     11    10    90.91
2254    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2255   13    0  100.00 100.00    13     13   13      0     13    13   100.00
2256   13    0  100.00  93.33    14     14   15      0     13    13   100.00
2257    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2258    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2259    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2260   10    0  100.00  83.33     5      5    6      0     10    10   100.00
2261   25    0   80.00  80.00    20     25   25      5     25    25   100.00
2262   20    0   66.67  63.16    12     18   19      4     20    19    95.00
2263    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2264    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2265    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2266   10    0  100.00 100.00    11     11   11      0     10    10   100.00
2267   10    0  100.00 100.00     8      8    8      0     10    10   100.00
2268    7    0  100.00 100.00     9      9    9      0      7     7   100.00
2269   10    0  100.00 100.00     8      8    8      0     10     9    90.00
2270   13    0   53.85  53.85     7     13   13      4     13    13   100.00
2271    5    0   80.00  80.00     4      5    5      0      5     4    80.00
2272    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2273    3    0    0.00   0.00     0      3    4      0      3     2    66.67
2274   25    0  100.00 100.00    24     24   24      0     25    25   100.00
2275   23    0   90.00  85.71    18     20   21      0     23    22    95.65
2276   16    0   88.24  88.24    15     17   17      0     16    13    81.25
2277    5    0  100.00  80.00     4      4    5      0      5     4    80.00
2278    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2279    6    0  100.00 100.00     5      5    5      0      6     6   100.00
2280    9    0  100.00 100.00     4      4    4      0      9     9   100.00
2281   20    0   90.00  90.00    18     20   20      0     20    19    95.00
2282    6    0  100.00 100.00     5      5    5      0      6     6   100.00
2283    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2284    8    0   28.57  33.33     2      7    6      0      8     3    37.50
2285    7    0   14.29  20.00     1      7    5      0      7     3    42.86
2286    7    0   14.29  20.00     1      7    5      0      7     4    57.14
2287    9    0   14.29  16.67     1      7    6      0      9     4    44.44
2288    9    0   14.29  16.67     1      7    6      0      9     4    44.44
2289    8    0   28.57  33.33     2      7    6      0      8     4    50.00
2290    7    0   14.29  20.00     1      7    5      0      7     3    42.86
2291    8    0   28.57  33.33     2      7    6      0      8     3    37.50
2292    7    0   14.29  20.00     1      7    5      0      7     3    42.86
2293    9    0   14.29  16.67     1      7    6      0      9     3    33.33
2294    9    0   14.29  16.67     1      7    6      0      9     3    33.33
2295    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2296    4    0   50.00  50.00     2      4    4      0      4     4   100.00
2297   20    0   70.59  70.59    12     17   17      0     20    15    75.00
2298   11    0   63.64  77.78     7     11    9      0     11     8    72.73
2299    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2300    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2301   13    0   66.67  88.89     8     12    9      0     13    11    84.62
2302   27    0   95.65  91.67    22     23   24      1     27    26    96.30
2303   19    0   73.33  73.33    11     15   15      2     19    16    84.21
2304   13    0  100.00 100.00     9      9    9      0     13    12    92.31
2305   11    0   85.71  85.71     6      7    7      0     11     8    72.73
2306   20    0  100.00 100.00    20     20   20      0     20    19    95.00
2307    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2308   14    0   12.50  14.29     1      8    7      1     14     4    28.57
2309    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2310   10    0   28.57  28.57     2      7    7      1     10     9    90.00
2311   17    0   92.86  92.86    13     14   14      0     17    16    94.12
2312   14    0  100.00 100.00    11     11   11      0     14    13    92.86
2313   26    0   75.00  75.00    18     24   24      5     26    26   100.00
2314    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2315    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2316    2    0    0.00   0.00     0      1    3      0      2     2   100.00
2317   15    0   86.67  86.67    13     15   15      2     15    15   100.00
2318   29    0   92.31  92.31    24     26   26      1     29    28    96.55
2319   11    0   92.31  92.31    12     13   13      0     11    10    90.91
2320    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2321    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2322    4    0   75.00 100.00     3      4    3      0      4     3    75.00
2323    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2324    2    0    0.00   0.00     0      1    3      0      2     1    50.00
2325   15    0   78.57  84.62    11     14   13      1     15    15   100.00
2326   38    0   56.41  57.89    22     39   38     11     38    33    86.84
2327   10    0  100.00 100.00    12     12   12      0     10    10   100.00
2328    1    0  100.00 100.00     1      1    1      0      1     0     0.00
2329    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2330    3    0    0.00   0.00     0      3    1      0      3     2    66.67
2331   14    0  100.00 100.00    12     12   12      0     14    14   100.00
2332   10    0  100.00 100.00     9      9    9      0     10    10   100.00
2333    6    0  100.00 100.00     5      5    5      0      6     6   100.00
2334   26    0   95.45  95.45    21     22   22      0     26    26   100.00
2335   26    0   95.24  95.24    20     21   21      0     26    26   100.00
2336   11    0   90.00  90.00     9     10   10      0     11    10    90.91
2337    7    0  100.00 100.00     5      5    5      0      7     7   100.00
2338   17    0   94.44  94.44    17     18   18      0     17    16    94.12
2339   31    0   90.00  84.38    27     30   32      0     31    31   100.00
2340   26    0  100.00 100.00    18     18   18      0     26    25    96.15
2341   16    0   85.71  75.00    12     14   16      2     16    14    87.50
2342   21    0   85.00  80.95    17     20   21      1     21    20    95.24
2343   10    0  100.00 100.00     5      5    5      0     10    10   100.00
2344   12    0   66.67 100.00     8     12    8      0     12    12   100.00
2345   14    0   62.50  62.50     5      8    8      0     14    14   100.00
2346   23    0   73.68  77.78    14     19   18      2     23    20    86.96
2347    8    0  100.00 100.00     7      7    7      0      8     8   100.00
2348    6    0  100.00 100.00     5      5    5      0      6     6   100.00
2349   17    0  100.00 100.00    16     16   16      0     17    15    88.24
2350   21    0   50.00  52.17    12     24   23      9     21    21   100.00
2351    8    0  100.00 100.00     8      8    8      0      8     8   100.00
2352   15    0  100.00  92.31    12     12   13      0     15    14    93.33
2353   16    0   91.67  68.75    11     12   16      2     16    15    93.75
2354    4    0   75.00  60.00     3      4    5      0      4     3    75.00
2355    5    0   66.67  66.67     2      3    3      0      5     3    60.00
2356    2    0    0.00   0.00     0      1    1      0      2     0     0.00
2357   14    0   43.75  43.75     7     16   16      9     14    14   100.00
2358   10    0  100.00 100.00    11     11   11      0     10    10   100.00
2359    2    0  100.00 100.00     1      1    1      0      2     1    50.00
2360    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2361    3    0    0.00   0.00     0      1    3      0      3     2    66.67
2362   19    0   82.35  87.50    14     17   16      2     19    18    94.74
2363   43    0   83.72  87.80    36     43   41      1     43    41    95.35
2364   37    0   92.50  90.24    37     40   41      2     37    37   100.00
2365   44    0   65.85  65.85    27     41   41     12     44    41    93.18
2366    5    0  100.00 100.00     4      4    4      0      5     5   100.00
2367   15    0   83.33  78.95    15     18   19      0     15    14    93.33
2368    9    0   50.00  50.00     4      8    8      1      9     8    88.89
2369    9    0   50.00  50.00     4      8    8      1      9     8    88.89
2370    9    0   50.00  50.00     4      8    8      1      9     8    88.89
2371    3    0  100.00 100.00     1      1    1      0      3     3   100.00
2372    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2373    5    0   33.33  33.33     1      3    3      0      5     4    80.00
2374   23    0   43.75  41.18     7     16   17      6     23    19    82.61
2375   16    0  100.00  95.45    21     21   22      0     16    16   100.00
2376   12    0   93.75  88.24    15     16   17      0     12    11    91.67
2377    4    0    0.00   0.00     0      3    1      0      4     3    75.00
2378    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2379   22    0   88.89  94.12    16     18   17      1     22    22   100.00
2380   18    0   50.00  50.00     7     14   14      5     18    18   100.00
2381    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2382    5    0    0.00   0.00     0      1    3      0      5     0     0.00
2383    4    0    0.00   0.00     0      1    3      0      4     0     0.00
2384   26    0   59.09  59.09    13     22   22      8     26    26   100.00
2385    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2386    3    0    0.00   0.00     0      2    3      0      3     1    33.33
2387    3    0   50.00 100.00     1      2    1      0      3     2    66.67
2388   32    0   75.00  85.71    24     32   28      4     32    31    96.88
2389   12    0  100.00 100.00    13     13   13      0     12    12   100.00
2390   22    0   84.21  76.19    16     19   21      2     22    20    90.91
2391   20    0   94.74 100.00    18     19   18      0     20    20   100.00
2392   29    0   76.92  90.91    20     26   22      1     29    27    93.10
2393   13    0  100.00 100.00    12     12   12      0     13    12    92.31
2394    2    0  100.00 100.00     1      1    1      0      2     2   100.00
2395    4    0    0.00   0.00     0      3    3      1      4     3    75.00
2396    1    2    0.00   0.00     0      0    0      0      0     0     0.00
2397   26    0   84.00  91.30    21     25   23      1     26    24    92.31
2398   17    0   80.00  61.54     8     10   13      2     17    14    82.35
2399   28    0   80.00  82.76    24     30   29      2     28    25    89.29
2400    3    0  100.00 100.00     3      3    3      0      3     2    66.67
2401    8    0    0.00   0.00     0      7    6      4      8     6    75.00
2402    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2403   15    0  100.00 100.00    13     13   13      0     15    15   100.00
2404   19    0  100.00  90.91    10     10   11      0     19    18    94.74
2405   71    0   83.33  85.94    55     66   64      8     71    70    98.59
2406    1    0  100.00 100.00     1      1    1      0      1     1   100.00
2407   12    0  100.00 100.00     8      8    8      0     12    12   100.00
2408    4    0    0.00   0.00     0      3    1      0      4     2    50.00
2409   28    0   89.66  92.86    26     29   28      1     28    28   100.00
2410    2    0   50.00  50.00     1      2    2      0      2     1    50.00
2411    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2412    5    0   80.00  66.67     4      5    6      0      5     4    80.00
2413    7    0   75.00  75.00     6      8    8      1      7     6    85.71
2414    6    0  100.00 100.00     6      6    6      0      6     6   100.00
2415    3    0   33.33  33.33     1      3    3      0      3     2    66.67
2416    7    0  100.00 100.00     6      6    6      0      7     6    85.71
2417   13    0   57.14  61.54     8     14   13      4     13    11    84.62
2418    9    0   60.00  75.00     6     10    8      0      9     8    88.89
2419   10    0   55.56  71.43     5      9    7      0     10     6    60.00
2420    7    0  100.00 100.00     6      6    6      0      7     7   100.00
2421    5    0  100.00 100.00     5      5    5      0      5     5   100.00
2422    6    0   57.14  80.00     4      7    5      0      6     5    83.33
2423    3    0    0.00   0.00     0      1    3      0      3     2    66.67
2424    6    0  100.00 100.00     8      8    8      0      6     5    83.33
2425   15    0  100.00 100.00    13     13   13      0     15    14    93.33
2426    6    0  100.00 100.00     6      6    6      0      6     6   100.00
2427    7    0  100.00 100.00     6      6    6      0      7     7   100.00
2428    8    0   75.00  75.00     6      8    8      0      8     8   100.00
2429   17    0   66.67  62.50    10     15   16      3     17    15    88.24
2430   12    0  100.00 100.00    13     13   13      0     12    12   100.00
2431   11    0  100.00 100.00    10     10   10      0     11    11   100.00
2432   11    0  100.00 100.00    13     13   13      0     11    11   100.00
2433    5    0   75.00  75.00     3      4    4      0      5     2    40.00
2434    4    0   75.00  75.00     3      4    4      0      4     3    75.00
2435   22    0   60.00  65.22    15     25   23      5     22    17    77.27
2436   22    0   95.45  91.30    21     22   23      1     22    21    95.45
2437   14    0   90.91  71.43    10     11   14      2     14    13    92.86
2438   15    0  100.00  90.91    10     10   11      0     15    12    80.00
2439   41    0  100.00  93.94    31     31   33      0     41    38    92.68
2440   24    0   57.14  60.00    12     21   20      7     24    21    87.50
2441    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2442    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2443    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2444    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2445    1    0    0.00   0.00     0      1    1      0      1     0     0.00
2446    8    0  100.00 100.00     9      9    9      0      8     7    87.50
2447    7    0   75.00  75.00     6      8    8      0      7     4    57.14
2448   14    0  100.00 100.00    16     16   16      0     14    12    85.71
2449    6    0   83.33  71.43     5      6    7      0      6     5    83.33
2450    8    0  100.00 100.00     8      8    8      0      8     7    87.50
============================================================================
                 76.67  75.32  19064 24864 25311   2357  29091 25644    88.15
=== Summary ===

-- All --
Number of sentence        =   2450
Number of Error sentence  =      0
Number of Skip  sentence  =      4
Number of Valid sentence  =   2446
Bracketing Recall         =  76.67
Bracketing Precision      =  75.32
Bracketing FMeasure       =  75.99
Complete match            =  31.60
Average crossing          =   0.96
No crossing               =  72.00
2 or less crossing        =  87.29
Tagging accuracy          =  88.15

-- len<=40 --
Number of sentence        =   2396
Number of Error sentence  =      0
Number of Skip  sentence  =      4
Number of Valid sentence  =   2392
Bracketing Recall         =  77.25
Bracketing Precision      =  75.80
Bracketing FMeasure       =  76.52
Complete match            =  32.32
Average crossing          =   0.82
No crossing               =  73.29
2 or less crossing        =  88.63
Tagging accuracy          =  87.88
=== END program4: ./run evaluate ../dataset2/raw ../program0/output --- OK [0s]

real	10m11.848s
user	5m49.414s
sys	0m2.112s

Run specification

• performing: Main entry for performing tasks (unsupervised learning, solving optimization problems), where is one phase.
  • (performer:Program) BerkeleyParser WSJ OntoNotes: BerkeleyParser trained on the WSJ portion of OntoNotes (not from the PennTreebank). See the following site for a description of the training data: http://sites.google.com/site/sancl2012/home/shared-task The parser was trained only on the labeled training data, without making use of any of the unlabeled data. The latent variable grammar was trained for 5 split-merge rounds using the publicly available code using the default parameters (-accurate is not set at inference time).
  • (dataset:Dataset) Google Web Treebank Emails Constituency Dev Set: This is the development set for the Email domain of the Google Web Treebank.
  • (stripper:Program[Strip]) constituency-parsing-test-utils: Inspects ConstituencyParsingTest datasets and evaluates performance.
  • (evaluator:Program[Evaluate]) constituency-parsing-test-utils: Inspects ConstituencyParsingTest datasets and evaluates performance.

Results

• evaluate:
  • success: false
  • time: 0
• exitCode: 1
• perform:
  • success: true
  • time: 602
• strip:
  • success: true
  • time: 0
• success: false

Comments: