===== MAIN: learn based on training data =====
=== START program1: ./run learn ../dataset3/train
===== One versus all: training label y=1 versus the rest =====
=== START _one-vs-all-learner1: ./run learn ../data1
Scanning examples...done
Reading examples into memory...OK. (63 examples read)
Setting default regularization parameter C=0.5000
Optimizing......................done. (23 iterations)
Optimization finished (21 misclassified, maxdiff=0.00036).
Runtime in cpu-seconds: 0.00
Number of SV: 60 (including 25 at upper bound)
L1 loss: loss=30.37506
Norm of weight vector: |w|=2.41096
Norm of longest example vector: |x|=1.00000
Estimated VCdim of classifier: VCdim<=12.62549
Computing XiAlpha-estimates...done
Runtime for XiAlpha-estimates in cpu-seconds: 0.00
XiAlpha-estimate of the error: error<=39.68% (rho=1.00,depth=0)
XiAlpha-estimate of the recall: recall=>90.48% (rho=1.00,depth=0)
XiAlpha-estimate of the precision: precision=>64.41% (rho=1.00,depth=0)
Number of kernel evaluations: 4035
Writing model file...done
=== END _one-vs-all-learner1: ./run learn ../data1 --- OK [0s]
===== One versus all: training label y=2 versus the rest =====
=== START _one-vs-all-learner2: ./run learn ../data2
Scanning examples...done
Reading examples into memory...OK. (63 examples read)
Setting default regularization parameter C=0.5000
Optimizing.....................done. (22 iterations)
Optimization finished (1 misclassified, maxdiff=0.00066).
Runtime in cpu-seconds: 0.00
Number of SV: 51 (including 1 at upper bound)
L1 loss: loss=1.50178
Norm of weight vector: |w|=0.49896
Norm of longest example vector: |x|=1.00000
Estimated VCdim of classifier: VCdim<=1.49792
Computing XiAlpha-estimates...done
Runtime for XiAlpha-estimates in cpu-seconds: 0.00
XiAlpha-estimate of the error: error<=1.59% (rho=1.00,depth=0)
XiAlpha-estimate of the recall: recall=>0.00% (rho=1.00,depth=0)
XiAlpha-estimate of the precision: precision=>nan% (rho=1.00,depth=0)
Number of kernel evaluations: 3895
Writing model file...done
=== END _one-vs-all-learner2: ./run learn ../data2 --- OK [0s]
===== One versus all: training label y=3 versus the rest =====
=== START _one-vs-all-learner3: ./run learn ../data3
Scanning examples...done
Reading examples into memory...OK. (63 examples read)
Setting default regularization parameter C=0.5000
Optimizing.....................done. (22 iterations)
Optimization finished (20 misclassified, maxdiff=0.00092).
Runtime in cpu-seconds: 0.00
Number of SV: 58 (including 25 at upper bound)
L1 loss: loss=29.37874
Norm of weight vector: |w|=2.30439
Norm of longest example vector: |x|=1.00000
Estimated VCdim of classifier: VCdim<=11.62040
Computing XiAlpha-estimates...done
Runtime for XiAlpha-estimates in cpu-seconds: 0.00
XiAlpha-estimate of the error: error<=39.68% (rho=1.00,depth=0)
XiAlpha-estimate of the recall: recall=>0.00% (rho=1.00,depth=0)
XiAlpha-estimate of the precision: precision=>0.00% (rho=1.00,depth=0)
Number of kernel evaluations: 3974
Writing model file...done
=== END _one-vs-all-learner3: ./run learn ../data3 --- OK [0s]
=== END program1: ./run learn ../dataset3/train --- OK [0s]
===== MAIN: predict/evaluate on train data =====
=== START program4: ./run stripLabels ../dataset3/train ../program0/evalTrain.in
=== END program4: ./run stripLabels ../dataset3/train ../program0/evalTrain.in --- OK [0s]
=== START program1: ./run predict ../program0/evalTrain.in ../program0/evalTrain.out
=== START _one-vs-all-learner1: ./run predict ../../program0/evalTrain.in ../../program0/evalTrain.out-y1
Reading model...OK. (60 support vectors read)
Classifying test examples..done
Runtime (without IO) in cpu-seconds: 0.00
Accuracy on test set: 100.00% (63 correct, 0 incorrect, 63 total)
Precision/recall on test set: 100.00%/100.00%
=== END _one-vs-all-learner1: ./run predict ../../program0/evalTrain.in ../../program0/evalTrain.out-y1 --- OK [0s]
=== START _one-vs-all-learner2: ./run predict ../../program0/evalTrain.in ../../program0/evalTrain.out-y2
Reading model...OK. (51 support vectors read)
Classifying test examples..done
Runtime (without IO) in cpu-seconds: 0.00
Accuracy on test set: 0.00% (0 correct, 63 incorrect, 63 total)
Precision/recall on test set: nan%/0.00%
=== END _one-vs-all-learner2: ./run predict ../../program0/evalTrain.in ../../program0/evalTrain.out-y2 --- OK [0s]
=== START _one-vs-all-learner3: ./run predict ../../program0/evalTrain.in ../../program0/evalTrain.out-y3
Reading model...OK. (58 support vectors read)
Classifying test examples..done
Runtime (without IO) in cpu-seconds: 0.00
Accuracy on test set: 0.00% (0 correct, 63 incorrect, 63 total)
Precision/recall on test set: nan%/0.00%
=== END _one-vs-all-learner3: ./run predict ../../program0/evalTrain.in ../../program0/evalTrain.out-y3 --- OK [0s]
63 examples
=== END program1: ./run predict ../program0/evalTrain.in ../program0/evalTrain.out --- OK [0s]
=== START program5: ./run evaluate ../dataset3/train ../program0/evalTrain.out
=== END program5: ./run evaluate ../dataset3/train ../program0/evalTrain.out --- OK [0s]
===== MAIN: predict/evaluate on test data =====
=== START program4: ./run stripLabels ../dataset3/test ../program0/evalTest.in
=== END program4: ./run stripLabels ../dataset3/test ../program0/evalTest.in --- OK [0s]
=== START program1: ./run predict ../program0/evalTest.in ../program0/evalTest.out
=== START _one-vs-all-learner1: ./run predict ../../program0/evalTest.in ../../program0/evalTest.out-y1
Reading model...OK. (60 support vectors read)
Classifying test examples..done
Runtime (without IO) in cpu-seconds: 0.00
Accuracy on test set: 100.00% (27 correct, 0 incorrect, 27 total)
Precision/recall on test set: 100.00%/100.00%
=== END _one-vs-all-learner1: ./run predict ../../program0/evalTest.in ../../program0/evalTest.out-y1 --- OK [0s]
=== START _one-vs-all-learner2: ./run predict ../../program0/evalTest.in ../../program0/evalTest.out-y2
Reading model...OK. (51 support vectors read)
Classifying test examples..done
Runtime (without IO) in cpu-seconds: 0.00
Accuracy on test set: 0.00% (0 correct, 27 incorrect, 27 total)
Precision/recall on test set: nan%/0.00%
=== END _one-vs-all-learner2: ./run predict ../../program0/evalTest.in ../../program0/evalTest.out-y2 --- OK [0s]
=== START _one-vs-all-learner3: ./run predict ../../program0/evalTest.in ../../program0/evalTest.out-y3
Reading model...OK. (58 support vectors read)
Classifying test examples..done
Runtime (without IO) in cpu-seconds: 0.00
Accuracy on test set: 0.00% (0 correct, 27 incorrect, 27 total)
Precision/recall on test set: nan%/0.00%
=== END _one-vs-all-learner3: ./run predict ../../program0/evalTest.in ../../program0/evalTest.out-y3 --- OK [0s]
27 examples
=== END program1: ./run predict ../program0/evalTest.in ../program0/evalTest.out --- OK [0s]
=== START program5: ./run evaluate ../dataset3/test ../program0/evalTest.out
=== END program5: ./run evaluate ../dataset3/test ../program0/evalTest.out --- OK [0s]
real 0m0.739s
user 0m0.268s
sys 0m0.160s
Run specification
supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
(learner:Program) one-vs-all: Reduction from multiclass classification to binary classification.
(binaryLearner:Program[BinaryClassification]) svmlight-rbf: SVMlight for binary classification using a RBF kernel (http://svmlight.joachims.org)
When you generate a run, you can set a time limit for the run (no more than 24 hours). After that point, we will terminate the program.
Your program can use 1.5GB of memory. More information here.
Go to the page for the run and look at the log file for signs of the responsible error.
You can also download the run and run it locally on your machine (a README file should
be included in the download which provides more information).
We said that a run was simply a program/dataset pair, but that's not the full story.
A run actually includes other helper programs such as the evaluation program and
various programs for reductions (e.g., one-versus-all, hyperparameter tuning).
More formally, a run is a given by a run specification,
which can be found on the page for any run.
A run specification is a tree where each internal node represents a program
and its children represents the arguments to be passed into its constructor.
For example, the one-versus-all program takes your binary classification program
as a constructor argument and behaves like a multiclass classification program.
Must be logged in to post comments.