weka.experiment
Class PairedCorrectedTTester

java.lang.Object
  weka.experiment.PairedTTester
      weka.experiment.PairedCorrectedTTester

All Implemented Interfaces:

OptionHandler

public class PairedCorrectedTTester

extends PairedTTester

Behaves the same as PairedTTester, only it uses the corrected resampled t-test statistic.

For more information see:

Claude Nadeau and Yoshua Bengio, "Inference for the Generalization Error," Machine Learning, 2001.

Version:

$Revision: 1.3 $

Author:

Richard Kirkby (rkirkby@cs.waikato.ac.nz)

Nested Class Summary

Nested classes inherited from class weka.experiment.PairedTTester

PairedTTester.Dataset, PairedTTester.DatasetSpecifiers, PairedTTester.Resultset

Field Summary

Fields inherited from class weka.experiment.PairedTTester

m_DatasetKeyColumns, m_DatasetKeyColumnsRange, m_DatasetSpecifiers, m_FoldColumn, m_Instances, m_latexOutput, m_ResultsetKeyColumns, m_ResultsetKeyColumnsRange, m_Resultsets, m_ResultsetsValid, m_RunColumn, m_RunColumnSet, m_ShowStdDevs, m_SignificanceLevel

Constructor Summary

PairedCorrectedTTester()

Method Summary

PairedStats	calculateStatistics(Instance datasetSpecifier, int resultset1Index, int resultset2Index, int comparisonColumn) Computes a paired t-test comparison for a specified dataset between two resultsets.
static void	main(java.lang.String[] args) Test the class from the command line.

Methods inherited from class weka.experiment.PairedTTester

getDatasetKeyColumns, getFoldColumn, getInstances, getNumDatasets, getNumResultsets, getOptions, getProduceLatex, getResultsetKeyColumns, getResultsetName, getRunColumn, getShowStdDevs, getSignificanceLevel, header, listOptions, multiResultsetFull, multiResultsetRanking, multiResultsetSummary, multiResultsetWins, prepareData, resultsetKey, setDatasetKeyColumns, setFoldColumn, setInstances, setOptions, setProduceLatex, setResultsetKeyColumns, setRunColumn, setShowStdDevs, setSignificanceLevel, templateString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PairedCorrectedTTester

public PairedCorrectedTTester()

Method Detail

calculateStatistics

public PairedStats calculateStatistics(Instance datasetSpecifier,
                                       int resultset1Index,
                                       int resultset2Index,
                                       int comparisonColumn)
                                throws java.lang.Exception

Computes a paired t-test comparison for a specified dataset between two resultsets.

Overrides:

calculateStatistics in class PairedTTester

Parameters:

datasetSpecifier - the dataset specifier

resultset1Index - the index of the first resultset

resultset2Index - the index of the second resultset

comparisonColumn - the column containing values to compare

Returns:

the results of the paired comparison

Throws:

java.lang.Exception - if an error occurs

main

public static void main(java.lang.String[] args)

Test the class from the command line.

Parameters:

args - contains options for the instance ttests