MLcomp version alpha Statistics: 2050 users, 665 datasets, 389 programs, 18920 runs (0 queued, 4 running), 0 workers

Run 14841

Creator	internal
Program	self-reflective-multi-task-GP-r
Dataset	movielens100k
Task type	CollaborativeFiltering
Created	1y315d ago

Status: Done!

Total Time	1h20m
Max Memory Usage	481M
Domain	CollaborativeFiltering
Learn time
Train RMSE	0.590
Train MAE	0.458
Predict train time
Test RMSE	0.928
Test MAE	0.732
Predict test time

Log file

Usage: "run learn trainingFileName" OR "run predict testFileName predictionFileName"
===== MAIN: learn based on training data =====
=== START program1: ./run learn ../dataset2/train
[1] "SMGP.train with tr = 2"
[1] 0.001 0.001 0.500
[1] "1: 1312950.091561"
[1] "2: 541394.905574"
[1] "3: 1781254.658593"
[1] "4: 3025963.593933"
[1] "5: 2597260.187527"
[1] "6: 1963352.694467"
[1] "7: 1150690.087686"
[1] "8: 1034452.188287"
[1] "9: 45021349.243902"
[1] "10: 669485.612393"
[1] "11: 476967.418869"
[1] "12: 475979.581388"
[1] "13: 371048.955472"
[1] "14: 305072.359218"
[1] "15: 292464.222959"
[1] "16: 11593133.508767"
[1] "17: 285912.071999"
[1] "18: 244981.132381"
[1] "19: 143866.529998"
[1] "20: 100052.285185"
[1] "21: 84281.171485"
[1] "22: 65477.486111"
[1] "23: 8570371.834564"
[1] "24: 55816.792187"
[1] "25: 66339.300401"
[1] "26: 163221.962143"
[1] "27: 49838.665407"
[1] "28: 42313.125102"
[1] "29: 71681.315253"
[1] "30: 1626777.017230"
[1] "31: 42868.083717"
[1] "32: 25004.226289"
[1] "33: 23343.177750"
[1] "34: 17724.811057"
[1] "35: 15163.473402"
[1] "36: 20747.688228"
[1] "37: 200579.494184"
[1] "38: 27884.317676"
[1] "39: 12813.946788"
[1] "40: 9750.465779"
[1] "41: 8286.833918"
[1] "42: 6319.846847"
[1] "43: 16322.165434"
[1] "44: 7717.133351"
[1] "45: 3692.800580"
[1] "46: 4239.674161"
[1] "47: 5861.920905"
[1] "48: 8683.803029"
[1] "49: 3053.147237"
[1] "50: 2834.459570"
[1] "51: 9128.717470"
[1] "52: 3309.109738"
[1] "53: 4014.362431"
[1] "54: 1612.650782"
[1] "55: 1405.542835"
[1] "56: 2115.214841"
[1] "57: 2496.349838"
[1] "58: 2371.753902"
[1] "59: 770.368584"
[1] "60: 787.391743"
[1] "61: 922.112619"
[1] "62: 533.862245"
[1] "63: 445.858396"
[1] "64: 75681.961710"
[1] "65: 394.125144"
[1] "66: 787.531705"
[1] "67: 292.946783"
[1] "68: 417.271721"
[1] "69: 497.586077"
[1] "70: 257.162724"
[1] "71: 1166.387223"
[1] "72: 237.685576"
[1] "73: 141.720635"
[1] "74: 114.074707"
[1] "75: 125.741442"
[1] "76: 410.865187"
[1] "77: 101.667261"
[1] "78: 2996.468237"
[1] "79: 75.735856"
[1] "80: 91.419731"
[1] "81: 57.631955"
[1] "82: 39.485395"
[1] "83: 35.579523"
[1] "84: 50.531174"
[1] "85: 2659.332322"
[1] "86: 27.354457"
[1] "87: 20.085344"
[1] "88: 91.894872"
[1] "89: 16.146375"
[1] "90: 13.155669"
[1] "91: 12.523886"
[1] "92: 398.348277"
[1] "93: 10.161024"
[1] "94: 20.443839"
[1] "95: 9.638663"
[1] "96: 6.231104"
[1] "97: 8.097899"
[1] "98: 9.521803"
[1] "99: 381.874584"
[1] "100: 8.506645"
[1] "101: 4.766375"
[1] "102: 5.368205"
[1] "103: 3.146996"
[1] "104: 8.234768"
[1] "105: 3.450772"
[1] "106: 2.080114"
[1] "107: 4.416747"
[1] "108: 2.956174"
[1] "109: 2.233136"
[1] "110: 38.517664"
[1] "111: 1.871383"
[1] "112: 1.236469"
[1] "113: 0.751551"
[1] "114: 0.636758"
[1] "115: 1.024449"
[1] "116: 1.061945"
[1] "117: 0.751402"
[1] "118: 0.802877"
[1] "119: 0.519629"
[1] "120: 0.440341"
[1] "121: 4.376100"
[1] "122: 0.698977"
[1] "123: 0.313003"
[1] "124: 0.321940"
[1] "125: 0.170976"
[1] "126: 0.480596"
[1] "127: 11.035629"
[1] "128: 0.138703"
[1] "129: 0.332018"
[1] "130: 0.160726"
[1] "CG: converged at 131"
[1] 0.001 0.001 0.500
[1] "1: 350092.789148"
[1] "2: 2126670.661165"
[1] "3: 1732285.790595"
[1] "4: 2337840.891922"
[1] "5: 3978325.411479"
[1] "6: 2270529.609377"
[1] "7: 3759139.730999"
[1] "8: 1308817.665421"
[1] "9: 1518345.007824"
[1] "10: 851296.456081"
[1] "11: 3019011.286395"
[1] "12: 33182987.928839"
[1] "13: 1050813.176234"
[1] "14: 888649.797538"
[1] "15: 1101928.797710"
[1] "16: 415266.973231"
[1] "17: 1849404.479184"
[1] "18: 327300.710234"
[1] "19: 334846.157943"
[1] "20: 574434.763595"
[1] "21: 244835.730079"
[1] "22: 569030.084497"
[1] "23: 144804.290090"
[1] "24: 153436.574425"
[1] "25: 171862.029117"
[1] "26: 118775.011326"
[1] "27: 118581.954746"
[1] "28: 101968.210221"
[1] "29: 275733.222566"
[1] "30: 170315.881795"
[1] "31: 284010.981291"
[1] "32: 72667.534630"
[1] "33: 294014.332649"
[1] "34: 177260.229347"
[1] "35: 74124.499816"
[1] "36: 57049.609463"
[1] "37: 178822.440642"
[1] "38: 52820.749211"
[1] "39: 146843.826080"
[1] "40: 666804.861053"
[1] "41: 41045.229540"
[1] "42: 26352.484636"
[1] "43: 20233.436534"
[1] "44: 16675.660142"
[1] "45: 150519.151750"
[1] "46: 16576.150411"
[1] "47: 43932.610290"
[1] "48: 197317.572340"
[1] "49: 27831.487688"
[1] "50: 25135.938942"
[1] "51: 11886.009643"
[1] "52: 8515.960740"
[1] "53: 7260.305289"
[1] "54: 10017.614802"
[1] "55: 8649.432886"
[1] "56: 9124.936812"
[1] "57: 11873.915150"
[1] "58: 83426.835065"
[1] "59: 14525.158065"
[1] "60: 7135.762180"
[1] "61: 17408.105287"
[1] "62: 38919.204286"
[1] "63: 4258.602142"
[1] "64: 18374.557601"
[1] "65: 2705.703018"
[1] "66: 155153.418195"
[1] "67: 4672.518694"
[1] "68: 3287.839335"
[1] "69: 1533.159904"
[1] "70: 1259.302350"
[1] "71: 1061.971417"
[1] "72: 26544.128418"
[1] "73: 869.240509"
[1] "74: 49658.793093"
[1] "75: 19805.535443"
[1] "76: 1638.152045"
[1] "77: 807.051768"
[1] "78: 1850.921947"
[1] "79: 656.512651"
[1] "80: 441.828194"
[1] "81: 699.815221"
[1] "82: 13211.266955"
[1] "83: 475.379245"
[1] "84: 304.454481"
[1] "85: 1146.128569"
[1] "86: 1010.044600"
[1] "87: 406.240316"
[1] "88: 2760.400253"
[1] "89: 361.801989"
[1] "90: 420.054520"
[1] "91: 559.865873"
[1] "92: 247.291253"
[1] "93: 1204.815291"
[1] "94: 133.715622"
[1] "95: 144.400131"
[1] "96: 163.340160"
[1] "97: 131.751444"
[1] "98: 98.316700"
[1] "99: 8366.977159"
[1] "100: 354.980361"
[1] "101: 83.649006"
[1] "102: 415.074447"
[1] "103: 238.782733"
[1] "104: 46.954405"
[1] "105: 80.313052"
[1] "106: 37.814124"
[1] "107: 833.117460"
[1] "108: 29.179849"
[1] "109: 74.979318"
[1] "110: 40.788877"
[1] "111: 37.713337"
[1] "112: 52.495983"
[1] "113: 58.008248"
[1] "114: 41.944754"
[1] "115: 616.094365"
[1] "116: 64.987574"
[1] "117: 18.812309"
[1] "118: 59.131929"
[1] "119: 19.919182"
[1] "120: 14.567107"
[1] "121: 26.747712"
[1] "122: 12.909283"
[1] "123: 61.701829"
[1] "124: 12.754956"
[1] "125: 9.929983"
[1] "126: 4.968823"
[1] "127: 95.906036"
[1] "128: 3.862451"
[1] "129: 64.564682"
[1] "130: 5.354888"
[1] "131: 89.394491"
[1] "132: 3.789019"
[1] "133: 2.748088"
[1] "134: 5.357032"
[1] "135: 2.026280"
[1] "136: 5.701486"
[1] "137: 1.556438"
[1] "138: 53.649231"
[1] "139: 7.362623"
[1] "140: 25.493799"
[1] "141: 1.995878"
[1] "142: 2.591962"
[1] "143: 5.291937"
[1] "144: 2.774524"
[1] "145: 1.967054"
[1] "146: 2.450911"
[1] "147: 2.755619"
[1] "148: 1.567299"
[1] "149: 0.568742"
[1] "150: 2.817413"
[1] "151: 1.367136"
[1] "152: 0.459496"
[1] "153: 0.435893"
[1] "154: 2.023360"
[1] "155: 42.871042"
[1] "156: 0.369705"
[1] "157: 0.403178"
[1] "158: 4.659346"
[1] "159: 0.215810"
[1] "160: 0.181189"
[1] "161: 0.163593"
[1] "162: 17.098543"
[1] "163: 0.174806"
[1] "164: 0.213477"
[1] "165: 0.230870"
[1] "166: 1.184324"
[1] "167: 0.188092"
[1] "168: 0.332658"
[1] "CG: converged at 169"
=== END program1: ./run learn ../dataset2/train --- OK [4817s]

===== MAIN: predict/evaluate on train data =====
=== START program3: ./run stripLabels ../dataset2/train ../program0/evalTrain.in
=== END program3: ./run stripLabels ../dataset2/train ../program0/evalTrain.in --- OK [2s]
=== START program1: ./run predict ../program0/evalTrain.in ../program0/evalTrain.out
[1] "../program0/evalTrain.in"
[1] "../program0/evalTrain.out"
=== END program1: ./run predict ../program0/evalTrain.in ../program0/evalTrain.out --- OK [16s]
=== START program4: ./run evaluate ../dataset2/train ../program0/evalTrain.out
=== END program4: ./run evaluate ../dataset2/train ../program0/evalTrain.out --- OK [2s]

===== MAIN: predict/evaluate on test data =====
=== START program3: ./run stripLabels ../dataset2/test ../program0/evalTest.in
=== END program3: ./run stripLabels ../dataset2/test ../program0/evalTest.in --- OK [2s]
=== START program1: ./run predict ../program0/evalTest.in ../program0/evalTest.out
[1] "../program0/evalTest.in"
[1] "../program0/evalTest.out"
=== END program1: ./run predict ../program0/evalTest.in ../program0/evalTest.out --- OK [12s]
=== START program4: ./run evaluate ../dataset2/test ../program0/evalTest.out
=== END program4: ./run evaluate ../dataset2/test ../program0/evalTest.out --- OK [1s]


real	80m54.989s
user	70m13.427s
sys	9m38.628s

Run specification

• supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
  • (learner:Program) self-reflective-multi-task-GP-r: SMGP implemented in R. Hyperparameters are tuned for Movielens 100k.
  • (dataset:Dataset) movielens100k: 100K MovieLens movie ratings dataset from http://www.grouplens.org/. 100,000 ratings (1-5) from 943 users on 1682 movies. Test set contains exactly 10 ratings per user. See included README.txt for more information.
  • (stripper:Program[Strip]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
  • (evaluator:Program[Evaluate]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.

Results

• doTest:
  • evaluate:
    • meanAbsoluteError: 0.731724801908804
    • meanSquaredError: 0.860468518207556
    • numExamples: 9430
    • rootMeanSquaredError: 0.927614423242522
    • success: true
    • time: 1
  • predict:
    • success: true
    • time: 12
  • strip:
    • success: true
    • time: 2
• doTrain:
  • evaluate:
    • meanAbsoluteError: 0.458201286401676
    • meanSquaredError: 0.347588908200381
    • numExamples: 90570
    • rootMeanSquaredError: 0.589566712256027
    • success: true
    • time: 2
  • predict:
    • success: true
    • time: 16
  • strip:
    • success: true
    • time: 2
• exitCode: 0
• learn:
  • success: true
  • time: 4817
• success: true

Comments: