MLcomp version alpha Statistics: 2046 users, 665 datasets, 389 programs, 18920 runs (0 queued, 4 running), 0 workers

Run 1231

Creator	lester
Program	cberner-KNNImproved-r
Dataset	eachmovie
Task type	CollaborativeFiltering
Created	2y229d ago

Status: Done!

Total Time	1h28m
Max Memory Usage	1764M
Domain	CollaborativeFiltering
Learn time
Train RMSE	0.422
Train MAE	0.178
Predict train time
Test RMSE	1.20
Test MAE	0.926
Predict test time

Log file

Usage: "run learn trainingFileName" OR "run predict testFileName predictionFileName"
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train'
[1] "starting to build R"
   user  system elapsed 
  4.684   0.352   5.044 
[1] "done building R"
   user  system elapsed 
387.116   0.864 389.302 
[1] "done building B"
[1] "done building S"
[1] 2079628
[1] "building new R"
    user   system  elapsed 
1398.463    3.968 1425.390 
[1] "done building new R"
    user   system  elapsed 
1400.119    4.332 1430.053 
[1] "Starting search for best K"
[1] 1.178596
[1] 1.179427
[1] 1.181210
[1] 1.183033
[1] 1.18535
[1] 1.188530
[1] 1.190156
[1] 1.192876
[1] 1.194963
[1] 1.197751
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train' --- OK [4671s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in' --- OK [7s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.out"
[1] 4.074637
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [347s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [12s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in' --- OK [1s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.out"
[1] 4.145795
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [260s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [1s]

real	88m19.950s
user	86m52.422s
sys	0m29.698s

Run specification

• supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
  • (learner:Program) cberner-KNNImproved-r: I implemented KNN with learning to find the best K, using cosine similarity and similarity weighting for prediction. Also the prediction is clamped to the range [1,5] since we know that ratings are in that range.
  • (dataset:Dataset) eachmovie: EachMovie movie ratings dataset from HP/Compaq (more information on http://www.grouplens.org/). The original EachMovie dataset contained 2,811,983 ratings (1-6 stars) entered by 72,916 users for 1628 different movies. This sub-dataset includes the ratings of 30,000 randomly selected users with 20 or more ratings. A single rating from each user was withheld to form the test set. Ratings values outside of the 1-6 range have been discarded.
  • (stripper:Program[Strip]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
  • (evaluator:Program[Evaluate]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.

Results

• doTest:
  • evaluate:
    • meanAbsoluteError: 0.926273250916731
    • meanSquaredError: 1.42817196643853
    • numExamples: 29998
    • rootMeanSquaredError: 1.19506149065164
    • success: true
    • time: 1
  • predict:
    • success: true
    • time: 260
  • strip:
    • success: true
    • time: 1
• doTrain:
  • evaluate:
    • meanAbsoluteError: 0.177904894529214
    • meanSquaredError: 0.177904894529214
    • numExamples: 2079628
    • rootMeanSquaredError: 0.421787736342836
    • success: true
    • time: 12
  • predict:
    • success: true
    • time: 347
  • strip:
    • success: true
    • time: 7
• exitCode: 0
• learn:
  • success: true
  • time: 4671
• success: true

Comments: