Class Stacking

  • All Implemented Interfaces:
    java.io.Serializable, java.lang.Cloneable, Classifier, BatchPredictor, CapabilitiesHandler, CapabilitiesIgnorer, CommandlineRunnable, OptionHandler, Randomizable, RevisionHandler, TechnicalInformationHandler

    public class Stacking
    extends RandomizableParallelMultipleClassifiersCombiner
    implements TechnicalInformationHandler
    Combines several classifiers using the stacking method. Can do classification or regression.

    For more information, see

    David H. Wolpert (1992). Stacked generalization. Neural Networks. 5:241-259.

    BibTeX:

     @article{Wolpert1992,
        author = {David H. Wolpert},
        journal = {Neural Networks},
        pages = {241-259},
        publisher = {Pergamon Press},
        title = {Stacked generalization},
        volume = {5},
        year = {1992}
     }
     

    Valid options are:

     -M <scheme specification>
      Full name of meta classifier, followed by options.
      (default: "weka.classifiers.rules.Zero")
     -X <number of folds>
      Sets the number of cross-validation folds.
     -S <num>
      Random number seed.
      (default 1)
     -B <classifier specification>
      Full class name of classifier to include, followed
      by scheme options. May be specified multiple times.
      (default: "weka.classifiers.rules.ZeroR")
     -D
      If set, classifier is run in debug mode and
      may output additional info to the console
    Version:
    $Revision: 15033 $
    Author:
    Eibe Frank (eibe@cs.waikato.ac.nz)
    See Also:
    Serialized Form
    • Constructor Detail

      • Stacking

        public Stacking()
    • Method Detail

      • globalInfo

        public java.lang.String globalInfo()
        Returns a string describing classifier
        Returns:
        a description suitable for displaying in the explorer/experimenter gui
      • getTechnicalInformation

        public TechnicalInformation getTechnicalInformation()
        Returns an instance of a TechnicalInformation object, containing detailed information about the technical background of this class, e.g., paper reference or book this class is based on.
        Specified by:
        getTechnicalInformation in interface TechnicalInformationHandler
        Returns:
        the technical information about this class
      • setOptions

        public void setOptions​(java.lang.String[] options)
                        throws java.lang.Exception
        Parses a given list of options.

        Valid options are:

         -M <scheme specification>
          Full name of meta classifier, followed by options.
          (default: "weka.classifiers.rules.Zero")

         -X <number of folds>
          Sets the number of cross-validation folds.

         -S <num>
          Random number seed.
          (default 1)

         -B <classifier specification>
          Full class name of classifier to include, followed
          by scheme options. May be specified multiple times.
          (default: "weka.classifiers.rules.ZeroR")

         -D
          If set, classifier is run in debug mode and
          may output additional info to the console

        Specified by:
        setOptions in interface OptionHandler
        Overrides:
        setOptions in class RandomizableParallelMultipleClassifiersCombiner
        Parameters:
        options - the list of options as an array of strings
        Throws:
        java.lang.Exception - if an option is not supported
      • numFoldsTipText

        public java.lang.String numFoldsTipText()
        Returns the tip text for this property
        Returns:
        tip text for this property suitable for displaying in the explorer/experimenter gui
      • getNumFolds

        public int getNumFolds()
        Gets the number of folds for the cross-validation.
        Returns:
        the number of folds for the cross-validation
      • setNumFolds

        public void setNumFolds​(int numFolds)
                         throws java.lang.Exception
        Sets the number of folds for the cross-validation.
        Parameters:
        numFolds - the number of folds for the cross-validation
        Throws:
        java.lang.Exception - if parameter illegal
      • metaClassifierTipText

        public java.lang.String metaClassifierTipText()
        Returns the tip text for this property
        Returns:
        tip text for this property suitable for displaying in the explorer/experimenter gui
      • setMetaClassifier

        public void setMetaClassifier​(Classifier classifier)
        Adds meta classifier
        Parameters:
        classifier - the classifier with all options set.
      • getMetaClassifier

        public Classifier getMetaClassifier()
        Gets the meta classifier.
        Returns:
        the meta classifier
      • baseClassifiersImplementMoreEfficientBatchPrediction

        public boolean baseClassifiersImplementMoreEfficientBatchPrediction()
        Returns true if any of the base classifiers are able to generate batch predictions efficiently and all of them implement BatchPredictor.
        Returns:
        true if the base classifiers can do batch prediction efficiently
      • buildClassifier

        public void buildClassifier​(Instances data)
                             throws java.lang.Exception
        Builds a classifier using stacking. The base classifiers' output is fed into the meta classifier to make the final decision. The training data for the meta classifier is generated using (stratified) cross-validation.
        Specified by:
        buildClassifier in interface Classifier
        Overrides:
        buildClassifier in class ParallelMultipleClassifiersCombiner
        Parameters:
        data - the training data to be used for generating the stacked classifier.
        Throws:
        java.lang.Exception - if the classifier could not be built successfully
      • distributionForInstance

        public double[] distributionForInstance​(Instance instance)
                                         throws java.lang.Exception
        Returns estimated class probabilities for the given instance if the class is nominal and a one-element array containing the numeric prediction if the class is numeric.
        Specified by:
        distributionForInstance in interface Classifier
        Overrides:
        distributionForInstance in class AbstractClassifier
        Parameters:
        instance - the instance to be classified
        Returns:
        the distribution
        Throws:
        java.lang.Exception - if instance could not be classified successfully
      • distributionsForInstances

        public double[][] distributionsForInstances​(Instances instances)
                                             throws java.lang.Exception
        Returns class probabilities for all given instances if the class is nominal or corresponding predicted numeric values if the class is numeric. The meta classifier must implement BatchPredictor, otherwise an exception will be thrown.
        Specified by:
        distributionsForInstances in interface BatchPredictor
        Overrides:
        distributionsForInstances in class AbstractClassifier
        Parameters:
        instances - the instance sto be classified
        Returns:
        the distributions
        Throws:
        java.lang.Exception - if instances could not be classified successfully
      • toString

        public java.lang.String toString()
        Output a representation of this classifier
        Overrides:
        toString in class java.lang.Object
        Returns:
        a string representation of the classifier
      • preExecution

        public void preExecution()
                          throws java.lang.Exception
        Description copied from class: AbstractClassifier
        Perform any setup stuff that might need to happen before commandline execution. Subclasses should override if they need to do something here
        Specified by:
        preExecution in interface CommandlineRunnable
        Overrides:
        preExecution in class MultipleClassifiersCombiner
        Throws:
        java.lang.Exception - if a problem occurs during setup
      • main

        public static void main​(java.lang.String[] argv)
        Main method for testing this class.
        Parameters:
        argv - should contain the following arguments: -t training file [-T test file] [-c class index]