Last data update: 2014.03.03

R: Summary Function
summary,FDatFitLogit-methodR Documentation

Summary Function

Description

This function summarizes the Ensemble models that have been fit previously by the user.

Usage

## S4 method for signature 'FDatFitLogit'
summary(object, period = "calibration",
  fitStatistics = c("brier", "auc", "perCorrect", "pre"), threshold = 0.5,
  baseModel = 0, showCoefs = TRUE, ...)

Arguments

object

An object of the subclass "FDatFitLogit" or "FDatFitNormal"

period

The period for which the summary should be provided, either "calibration" or "test".

fitStatistics

A vector naming statistics that should be calculated. Possible values for objects in the "FDatFitLogit" subclass include "auc", "brier", "percCorrect", "pre". Possible values for objects in the "FDatFitNormal" subclass include "rmse" and "mae." Additional metrics will be made available in a future release of this package.

threshold

The threshold used to calculate when a "positive" prediction is made for a model. Not used for objects of the "FDatFitNormal" subclass.

baseModel

A vector containing predictions used to calculate proportional reduction of error ("pre"). Not used for objects of the "FDatFitNormal" subclass.

showCoefs

A logical indicating whether model coefficients from the ensemble should be shown.

...

Not implemented

Value

A data object of the class 'SummaryForecastData' with the following slots:

summaryData

Under the default, the function produces a matrix containing one row for each model plus one row for the EBMA forecast. The first column is always the model weights assigned to the component models. The second and third columns display the model parameters for the transformation of the component models. The remaining columns are the requested fit statistics for all models, as calculated by the copareModels function. If showCoefs=FALSE, then the model parameters will not be shown.

Author(s)

Michael D. Ward <michael.d.ward@duke.edu> and Jacob M. Montgomery <jacob.montgomery@wustl.edu> and Florian M. Hollenbach <florian.hollenbach@tamu.edu>

Examples

## Not run:  data(calibrationSample)

data(testSample) 

this.ForecastData <- makeForecastData(.predCalibration=calibrationSample[,c("LMER", "SAE", "GLM")],
.outcomeCalibration=calibrationSample[,"Insurgency"],.predTest=testSample[,c("LMER", "SAE", "GLM")],
.outcomeTest=testSample[,"Insurgency"], .modelNames=c("LMER", "SAE", "GLM"))

this.ensemble <- calibrateEnsemble(this.ForecastData, model="logit", tol=0.001,exp=3)

summary(this.ensemble, period="calibration") 

summary(this.ensemble, period="test",showCoefs=FALSE)

## End(Not run)

Results