MLcomp version alpha Statistics: 2045 users, 665 datasets, 389 programs, 18920 runs (0 queued, 4 running), 0 workers

Run 1199

Creator	kenghaochang
Program	kenghao-matrix_em_k10_v2-r
Dataset	movielens1m
Task type	CollaborativeFiltering
Created	2y228d ago

Status: Done!

Total Time	2h15m
Max Memory Usage	2021M
Domain	CollaborativeFiltering
Learn time
Train RMSE	0
Train MAE	0
Predict train time
Test RMSE	0.906
Test MAE	0.711
Predict test time

Log file

Usage: "run learn trainingFileName" OR "run predict testFileName predictionFileName"
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train'
[1] 10
[1] "rms_train"
[1] 0.90044
[1] "diff ratio"
[1] 110.0568
[1] "rms_train"
[1] 0.8733102
[1] "diff ratio"
[1] 0.03106538
[1] "rms_train"
[1] 0.8574233
[1] "diff ratio"
[1] 0.01852871
[1] "rms_train"
[1] 0.8465064
[1] "diff ratio"
[1] 0.01289641
[1] "rms_train"
[1] 0.8383583
[1] "diff ratio"
[1] 0.009719088
[1] "rms_train"
[1] 0.8319552
[1] "diff ratio"
[1] 0.007696449
[1] "rms_train"
[1] 0.8267413
[1] "diff ratio"
[1] 0.006306545
[1] "rms_train"
[1] 0.8223834
[1] "diff ratio"
[1] 0.005299193
[1] "rms_train"
[1] 0.8186669
[1] "diff ratio"
[1] 0.004539706
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train' --- OK [7996s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in' --- OK [5s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.out"
[1] "rms"
[1] 3.750757
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [133s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [6s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in' --- OK [0s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.out"
[1] "rms"
[1] 3.76248
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [9s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [0s]

real	135m49.777s
user	127m23.022s
sys	0m59.368s

Run specification

• supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
  • (learner:Program) kenghao-matrix_em_k10_v2-r: matrix factorization with svd and EM, K=10, convergence difference ratio = 0.005
  • (dataset:Dataset) movielens1m: 1M MovieLens movie ratings dataset from http://www.grouplens.org/. The original dataset contains 1,000,209 anonymous ratings (1-5 stars) of approximately 3,900 movies made by 6,040 MovieLens users who joined MovieLens in 2000. This sub-dataset includes the ratings of 5,000 randomly selected users. A single rating from each user was withheld to form the test set. See included README.txt for more information.
  • (stripper:Program[Strip]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
  • (evaluator:Program[Evaluate]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.

Results

• doTest:
  • evaluate:
    • meanAbsoluteError: 0.710758356100001
    • meanSquaredError: 0.820573885774158
    • numExamples: 5000
    • rootMeanSquaredError: 0.905855333800137
    • success: true
    • time: 0
  • predict:
    • success: true
    • time: 9
  • strip:
    • success: true
    • time: 0
• doTrain:
  • evaluate:
    • meanAbsoluteError: 0.0
    • meanSquaredError: 0.0
    • numExamples: 830307
    • rootMeanSquaredError: 0.0
    • success: true
    • time: 6
  • predict:
    • success: true
    • time: 133
  • strip:
    • success: true
    • time: 5
• exitCode: 0
• learn:
  • success: true
  • time: 7996
• success: true

Comments: