R Graphical Manual

Browse All

Last data update: 2014.03.03

R: Estimation of misclassification error by cross-validation

MCRestimate

R Documentation

Estimation of misclassification error by cross-validation

Description

Several repetitions of a cross-validation are performed to get 'votes' how stable a method is against different partitions into training and test set

Usage

MCRestimate(eset,
            class.column,
            reference.class=NULL,
            classification.fun,
            variableSel.fun="identity",
            cluster.fun="identity",
            poss.parameters=list(),
            cross.outer=10,
            cross.repeat=3,
            cross.inner=cross.outer,
            plot.label=NULL,
            rand=123,
            stratify=FALSE,
            information=TRUE,
            block.column=NULL,
            thePreprocessingMethods=c(variableSel.fun,cluster.fun))

Arguments

`eset`	an object of class `ExpressionSet`
`class.column`	a number or a character string which indicates the column of the expression set's phenodata containing the class label
`reference.class`	a character string - the name of one class - if specified, the class will form the first class and all the other classes will form the second class
`classification.fun`	character string which names the function that should be used for the classification
`variableSel.fun`	character string which names the function that should be used for the variable selection
`cluster.fun`	character string which names the function that should be used for the clustering of variables
`thePreprocessingMethods`	vector of character with the names of all preprocessing functions - can be used instead of 'variableSel.fun' and 'cluster.fun' - see details
`poss.parameters`	a list of possible values for the parameter of the classification, variable selection, and cluster methods
`cross.outer`	integer - the number of nearly equal sized parts the sample set should be divided into (outer cross-validation)
`cross.repeat`	integer - the number of repetitions of the cross-validation procedure
`cross.inner`	integer - the number of nearly equal sized parts the train set should be divided into (inner cross-validation)
`plot.label`	name of one column of the phenodata- if specified, the content of this column will form the labels of the x-axis if the 'votematrix' will be plotted with plot.MCRestimate
`rand`	integer - the random number generator will be put in a reproducible state
`stratify`	should a stratified version be used for the cross validation?
`block.column`	a character string which indicates the column of the expression set's phenodata containing the blocking covariate, which sets a constrain on the cross-validation splits: each block is either completely assigned to the test or to the training set
`information`	information - should classifier specific data be given(depends on the wrapper for the classification method)

Details

The argument 'thePreprocessingMethods' can be used instead of 'variableSel.fun' and 'cluster.fun'. In the first versions of MCRestimate it was only possible to have one variable selection and one cluster functions. Now it is possible to have more than two functions and the ordering is arbitrary, e.g. you can have a variable selection function, then a cluster function and then a second variable selection function.

If MCRestimate is used with an object of class exprSetRG-class, the preprocessing steps can use the green and the red channel separately but the classification methods works with green channel - red channel.

Note: 'correct prediction' means that a sample was predicted to be a member of the correct class at least as often as it was predicted to be a member of each other class. So in the two class problem a sample is also 'correct' if it has been predicted correctly half of the time.

Value

an object of class MCRestimate which is a list with fourteen arguments:

`votes`	a matrix consisting of the different votes for each sample
`classes`	the class of each sample
`table`	a 'confusion' table, shows the number of 'correct prediction' for each class
`correct.prediction`	a logical vector - indicates if a sample was predicted to be a member of the correct class at least as often as it was predicted to be a member of each other class.
`correct.class.vote`	vector that contains for every sample the vote for it's correct class
`parameter`	a list consisting of the estimated 'best' parameter for each cross-validation part
`class.method`	string which names the function used for the classification
`thePreprocessingMethods`	character string - name of the preprocessing functions that have been used
`cross.outer`	number of blocks for a the outer cross-validation
`cross.repeat`	number of outer cross-validation repetitions
`cross.inner`	number of blocks for a the inner cross-validation
`sample.names`	names of the sample
`information`	classifier specific data (if information is TRUE)

Author(s)

Markus Ruschhaupt mailto:m.ruschhaupt@dkfz.de, contributions from Andreas Buness and Patrick Warnat

Examples

library(golubEsets)
data(Golub_Test)
G2 <- Golub_Test[1:500,]
result <- MCRestimate(G2, "ALL.AML", classification.fun="RF.wrap",
                      cross.outer=4, cross.repeat=3)
result
if (interactive()) {
  x11(width=9, height=4)}
plot(result)

Results


R version 3.3.1 (2016-06-21) -- "Bug in Your Hair"
Copyright (C) 2016 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library(MCRestimate)
Loading required package: golubEsets
Loading required package: Biobase
Loading required package: BiocGenerics
Loading required package: parallel

Attaching package: 'BiocGenerics'

The following objects are masked from 'package:parallel':

    clusterApply, clusterApplyLB, clusterCall, clusterEvalQ,
    clusterExport, clusterMap, parApply, parCapply, parLapply,
    parLapplyLB, parRapply, parSapply, parSapplyLB

The following objects are masked from 'package:stats':

    IQR, mad, xtabs

The following objects are masked from 'package:base':

    Filter, Find, Map, Position, Reduce, anyDuplicated, append,
    as.data.frame, cbind, colnames, do.call, duplicated, eval, evalq,
    get, grep, grepl, intersect, is.unsorted, lapply, lengths, mapply,
    match, mget, order, paste, pmax, pmax.int, pmin, pmin.int, rank,
    rbind, rownames, sapply, setdiff, sort, table, tapply, union,
    unique, unsplit

Welcome to Bioconductor

    Vignettes contain introductory material; view with
    'browseVignettes()'. To cite Bioconductor, see
    'citation("Biobase")', and for packages 'citation("pkgname")'.


Attaching package: 'MCRestimate'

The following object is masked from 'package:base':

    identity

> png(filename="/home/ddbj/snapshot/RGM3/R_BC/result/MCRestimate/MCRestimate.Rd_%03d_medium.png", width=480, height=480)
> ### Name: MCRestimate
> ### Title: Estimation of misclassification error by cross-validation
> ### Aliases: MCRestimate MCRestimate.default print.MCRestimate
> ### Keywords: file
> 
> ### ** Examples
> 
> library(golubEsets)
> data(Golub_Test)
> G2 <- Golub_Test[1:500,]
> result <- MCRestimate(G2, "ALL.AML", classification.fun="RF.wrap",
+                       cross.outer=4, cross.repeat=3)
> result
$votes
          ALL       AML
ALL 0.6666667 0.3333333
ALL 0.3333333 0.6666667
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 0.6666667 0.3333333
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
ALL 0.6666667 0.3333333
ALL 1.0000000 0.0000000
ALL 1.0000000 0.0000000
AML 0.0000000 1.0000000
AML 0.0000000 1.0000000
AML 0.3333333 0.6666667
AML 0.0000000 1.0000000
AML 1.0000000 0.0000000
AML 0.6666667 0.3333333
AML 0.0000000 1.0000000
AML 0.3333333 0.6666667
AML 0.3333333 0.6666667
AML 0.6666667 0.3333333
AML 1.0000000 0.0000000
AML 0.3333333 0.6666667
AML 0.0000000 1.0000000
AML 0.0000000 1.0000000

$classes
 [1] ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL
[20] ALL AML AML AML AML AML AML AML AML AML AML AML AML AML AML
Levels: ALL AML

$table
    ALL AML class error
ALL  19   1   0.0500000
AML   4  10   0.2857143

$correct.prediction
 [1]  TRUE FALSE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE
[13]  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE
[25] FALSE FALSE  TRUE  TRUE  TRUE FALSE FALSE  TRUE  TRUE  TRUE

$correct.class.vote
 [1] 0.6666667 0.3333333 1.0000000 1.0000000 1.0000000 0.6666667 1.0000000
 [8] 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000 1.0000000
[15] 1.0000000 1.0000000 1.0000000 0.6666667 1.0000000 1.0000000 1.0000000
[22] 1.0000000 0.6666667 1.0000000 0.0000000 0.3333333 1.0000000 0.6666667
[29] 0.6666667 0.3333333 0.0000000 0.6666667 1.0000000 1.0000000

$parameter
list()

$class.method
[1] "RF.wrap"

$thePreprocessingMethods
[1] "identity" "identity"

$cross.outer
[1] 4

$cross.inner
[1] 4

$cross.repeat
[1] 3

$sample.names
 [1]  1  2  3  4  5  6  7  8  9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
[26] 26 27 28 29 30 31 32 33 34

$information
$information[[1]]
                                                  ALL                    
D28423_at               "D28423_at"               "0.0104428571428571"   
AC002077_at             "AC002077_at"             "0.00703174603174603"  
D14664_at               "D14664_at"               "0.00807142857142857"  
D13988_at               "D13988_at"               "0.00336349206349206"  
D26579_at               "D26579_at"               "0.00518809523809524"  
AF000234_at             "AF000234_at"             "0.0052"               
D10495_at               "D10495_at"               "0.00393333333333333"  
D21852_at               "D21852_at"               "0.00384523809523809"  
D31846_at               "D31846_at"               "0.0032"               
D21261_at               "D21261_at"               "0.00436666666666667"  
D30742_at               "D30742_at"               "0.00295238095238095"  
D13628_at               "D13628_at"               "0.00266666666666667"  
AFFX-BioDn-3_st         "AFFX-BioDn-3_st"         "0.00465714285714286"  
D31764_at               "D31764_at"               "0.00291904761904762"  
D43947_at               "D43947_at"               "0.00296666666666667"  
D10202_at               "D10202_at"               "0.0016"               
D28532_at               "D28532_at"               "0.00211904761904762"  
D26443_at               "D26443_at"               "0.0026"               
D16581_at               "D16581_at"               "0.00253333333333333"  
D49958_at               "D49958_at"               "0.00232380952380952"  
D50920_at               "D50920_at"               "0.00123809523809524"  
D14660_at               "D14660_at"               "0.00163333333333333"  
D38293_at               "D38293_at"               "0.00157142857142857"  
AC000064_cds1_at        "AC000064_cds1_at"        "0.00106666666666667"  
AB000115_at             "AB000115_at"             "0.0015"               
D50914_at               "D50914_at"               "0.0014"               
D17400_at               "D17400_at"               "0.000923809523809524" 
D49400_at               "D49400_at"               "0.00100476190476191"  
D50919_at               "D50919_at"               "0.000833333333333333" 
D50525_at               "D50525_at"               "0.00121428571428571"  
D00760_at               "D00760_at"               "9e-04"                
D26135_at               "D26135_at"               "0.00188333333333333"  
D30655_at               "D30655_at"               "0.00116666666666667"  
AFFX-HUMRGE/M10098_M_at "AFFX-HUMRGE/M10098_M_at" "0.0012"               
D13627_at               "D13627_at"               "0.0025"               
D30755_at               "D30755_at"               "0.000833333333333333" 
D26018_at               "D26018_at"               "9e-04"                
D29643_at               "D29643_at"               "0.0014"               
D14689_at               "D14689_at"               "0.00123809523809524"  
AF006084_at             "AF006084_at"             "0.000447619047619048" 
D29677_at               "D29677_at"               "9e-04"                
AF015913_at             "AF015913_at"             "0.000952380952380952" 
AC002115_cds4_at        "AC002115_cds4_at"        "0.00108333333333333"  
AB000449_at             "AB000449_at"             "0.00025"              
AFFX-M27830_5_at        "AFFX-M27830_5_at"        "0.0014"               
AB002559_at             "AB002559_at"             "5e-04"                
AF002700_at             "AF002700_at"             "8e-04"                
D13637_at               "D13637_at"               "0.000233333333333333" 
D25539_at               "D25539_at"               "0.000238095238095238" 
D16626_at               "D16626_at"               "0.000766666666666667" 
D23673_at               "D23673_at"               "2e-04"                
D14678_at               "D14678_at"               "0.000733333333333333" 
D43772_at               "D43772_at"               "0.000952380952380952" 
D21063_at               "D21063_at"               "0.000333333333333333" 
D38583_at               "D38583_at"               "0.00111428571428571"  
D42046_at               "D42046_at"               "8e-04"                
D50582_at               "D50582_at"               "0.000333333333333333" 
D16469_at               "D16469_at"               "0.000285714285714286" 
D29963_at               "D29963_at"               "0"                    
AF000562_at             "AF000562_at"             "0.000333333333333333" 
AB000897_at             "AB000897_at"             "0.001"                
AF009426_at             "AF009426_at"             "0.000666666666666667" 
D29958_at               "D29958_at"               "9e-04"                
D14889_at               "D14889_at"               "0.000833333333333333" 
D37965_at               "D37965_at"               "0.0014"               
D42063_at               "D42063_at"               "0.000571428571428571" 
D49677_at               "D49677_at"               "8e-04"                
D28124_at               "D28124_at"               "0.0015"               
D50683_at               "D50683_at"               "0.000780952380952381" 
D14658_at               "D14658_at"               "0"                    
D00596_at               "D00596_at"               "0.000571428571428571" 
D30758_at               "D30758_at"               "-0.000452380952380952"
AB002409_at             "AB002409_at"             "5e-04"                
AC002464_at             "AC002464_at"             "0.000333333333333333" 
D00017_at               "D00017_at"               "0.000666666666666667" 
D28416_at               "D28416_at"               "5e-04"                
D49738_at               "D49738_at"               "0.000857142857142857" 
AFFX-HSAC07/X00351_3_at "AFFX-HSAC07/X00351_3_at" "0.00128571428571429"  
D28118_at               "D28118_at"               "5e-04"                
D10923_at               "D10923_at"               "4e-04"                
D28137_at               "D28137_at"               "0.000333333333333333" 
D50857_at               "D50857_at"               "4e-04"                
D29810_at               "D29810_at"               "0.000333333333333333" 
D13315_at               "D13315_at"               "0.000914285714285714" 
D00591_at               "D00591_at"               "4e-04"                
D26068_at               "D26068_at"               "5e-04"                
D26528_at               "D26528_at"               "4e-04"                
D29833_at               "D29833_at"               "8e-04"                
D43638_at               "D43638_at"               "0.000333333333333333" 
D49489_at               "D49489_at"               "0.000285714285714286" 
D29954_at               "D29954_at"               "0.000285714285714286" 
D14811_at               "D14811_at"               "0.000333333333333333" 
D42043_at               "D42043_at"               "-0.00025"             
AFFX-BioC-3_at          "AFFX-BioC-3_at"          "0.000233333333333333" 
AFFX-CreX-3_at          "AFFX-CreX-3_at"          "0.000333333333333333" 
AF007875_at             "AF007875_at"             "5e-04"                
AF015950_at             "AF015950_at"             "0.000785714285714286" 
AFFX-TrpnX-3_at         "AFFX-TrpnX-3_at"         "0"                    
AFFX-M27830_M_at        "AFFX-M27830_M_at"        "0"                    
AFFX-HSAC07/X00351_5_st "AFFX-HSAC07/X00351_5_st" "0"                    
AC002115_cds1_at        "AC002115_cds1_at"        "0.000666666666666667" 
AC002486_at             "AC002486_at"             "0.001"                
AF006609_at             "AF006609_at"             "0"                    
D16294_at               "D16294_at"               "5e-04"                
D25217_at               "D25217_at"               "0.000733333333333333" 
AFFX-DapX-5_at          "AFFX-DapX-5_at"          "0"                    
AF014958_at             "AF014958_at"             "4e-04"                
D14686_at               "D14686_at"               "0.000333333333333333" 
D21260_at               "D21260_at"               "0"                    
D31767_at               "D31767_at"               "0"                    
D45248_at               "D45248_at"               "5e-04"                
AFFX-BioB-M_st          "AFFX-BioB-M_st"          "0"                    
AFFX-CreX-3_st          "AFFX-CreX-3_st"          "0"                    
AFFX-HSAC07/X00351_M_at "AFFX-HSAC07/X00351_M_at" "5e-04"                
A28102_at               "A28102_at"               "0"                    
D14827_at               "D14827_at"               "0.000666666666666667" 
D21851_at               "D21851_at"               "0.000333333333333333" 
D31797_at               "D31797_at"               "0"                    
D50310_at               "D50310_at"               "0.000333333333333333" 
D50495_at               "D50495_at"               "0"                    
AF005361_at             "AF005361_at"             "0"                    
D10523_at               "D10523_at"               "0"                    
D13634_at               "D13634_at"               "0"                    
D31890_at               "D31890_at"               "0.000333333333333333" 
D38535_at               "D38535_at"               "0"                    
AB000220_at             "AB000220_at"             "0.000333333333333333" 
AC002450_at             "AC002450_at"             "0.000333333333333333" 
AF002020_at             "AF002020_at"             "4e-04"                
D38524_at               "D38524_at"               "0"                    
D50640_at               "D50640_at"               "0"                    
D50916_at               "D50916_at"               "0.00025"              
D21878_at               "D21878_at"               "6.66666666666667e-05" 
AFFX-ThrX-M_at          "AFFX-ThrX-M_at"          "0"                    
D50925_at               "D50925_at"               "0"                    
AB000464_at             "AB000464_at"             "0"                    
D17390_at               "D17390_at"               "0.000266666666666667" 
D50312_at               "D50312_at"               "0.000222222222222222" 
AFFX-HUMRGE/M10098_5_at "AFFX-HUMRGE/M10098_5_at" "0.000833333333333333" 
D30037_at               "D30037_at"               "0"                    
AF009368_at             "AF009368_at"             "1e-04"                
D14533_at               "D14533_at"               "0.000464285714285714" 
D13630_at               "D13630_at"               "-4e-04"               
D45371_at               "D45371_at"               "-4e-04"               
D50928_at               "D50928_at"               "4e-04"                
D29642_at               "D29642_at"               "-4.76190476190476e-05"
AFFX-BioC-3_st          "AFFX-BioC-3_st"          "-0.000285714285714286"
D26561_cds3_at          "D26561_cds3_at"          "0"                    
                        AML                     MeanDecreaseAccuracy  
D28423_at               "0.0135333333333333"    "0.011341847041847"   
AC002077_at             "0.0134666666666667"    "0.0088982683982684"  
D14664_at               "0.0078"                "0.00777380952380952" 
D13988_at               "0.0100666666666667"    "0.00522786657786658" 
D26579_at               "0.00563333333333333"   "0.00507137862137862" 
AF000234_at             "0.00576666666666667"   "0.00496904761904762" 
D10495_at               "0.00506666666666667"   "0.00442539682539683" 
D21852_at               "0.00563333333333333"   "0.00416955266955267" 
D31846_at               "0.00533333333333333"   "0.00405476190476191" 
D21261_at               "0.00397142857142857"   "0.00384920634920635" 
D30742_at               "0.00486666666666667"   "0.00354054834054834" 
D13628_at               "0.00563333333333333"   "0.00350613275613276" 
AFFX-BioDn-3_st         "0.0027"                "0.00321839826839827" 
D31764_at               "0.0025"                "0.00279545454545454" 
D43947_at               "0.0025"                "0.00258333333333333" 
D10202_at               "0.0038"                "0.00246031746031746" 
D28532_at               "0.003"                 "0.00237460317460317" 
D26443_at               "0.00183333333333333"   "0.00218492063492064" 
D16581_at               "0.0017"                "0.00196587301587302" 
D49958_at               "0.0013"                "0.00194920634920635" 
D50920_at               "0.00313333333333333"   "0.0017979797979798"  
D14660_at               "0.002"                 "0.00176666666666667" 
D38293_at               "0.0014"                "0.00168760683760684" 
AC000064_cds1_at        "0.00196666666666667"   "0.00145"             
AB000115_at             "0.00145238095238095"   "0.0014493006993007"  
D50914_at               "0.0014"                "0.0014"              
D17400_at               "0.00266666666666667"   "0.00139393939393939" 
D49400_at               "0.00116666666666667"   "0.00139278499278499" 
D50919_at               "0.00233333333333333"   "0.00133116883116883" 
D50525_at               "0.0024"                "0.00130555555555556" 
D00760_at               "0.002"                 "0.00128888888888889" 
D26135_at               "5e-04"                 "0.00127222222222222" 
D30655_at               "0.00166666666666667"   "0.00123571428571429" 
AFFX-HUMRGE/M10098_M_at "0.000952380952380952"  "0.00122222222222222" 
D13627_at               "-0.000866666666666667" "0.00119242424242424" 
D30755_at               "0.00206666666666667"   "0.00116666666666667" 
D26018_at               "0.00123333333333333"   "0.00114285714285714" 
D29643_at               "0.000733333333333333"  "0.00113181818181818" 
D14689_at               "0.000738095238095238"  "0.00108405483405483" 
AF006084_at             "0.002"                 "0.00101839826839827" 
D29677_at               "0.00116666666666667"   "0.00101587301587302" 
AF015913_at             "0.00113333333333333"   "0.000977777777777778"
AC002115_cds4_at        "0.00107142857142857"   "0.000966666666666667"
AB000449_at             "0.0025"                "0.000952380952380952"
AFFX-M27830_5_at        "0.000233333333333333"  "0.000949494949494949"
AB002559_at             "0.00216666666666667"   "0.000944444444444444"
AF002700_at             "0.001"                 "0.000916666666666667"
D13637_at               "0.00166666666666667"   "0.000892857142857143"
D25539_at               "0.00206666666666667"   "0.00089040404040404" 
D16626_at               "0.001"                 "0.000888888888888889"
D23673_at               "0.00163333333333333"   "0.000885714285714286"
D14678_at               "0.00173333333333333"   "0.000872222222222222"
D43772_at               "0.000666666666666667"  "0.000848484848484848"
D21063_at               "0.0015"                "0.000821428571428571"
D38583_at               "-6.66666666666667e-05" "0.000805555555555556"
D42046_at               "0.000766666666666666"  "0.000767676767676768"
D50582_at               "0.0024"                "0.000738095238095238"
D16469_at               "0.00166666666666667"   "0.000733333333333333"
D29963_at               "0.0025"                "7e-04"               
AF000562_at             "0.000966666666666667"  "0.000694444444444444"
AB000897_at             "5e-04"                 "0.000666666666666667"
AF009426_at             "0.000666666666666667"  "0.000666666666666667"
D29958_at               "0.000333333333333333"  "0.00065"             
D14889_at               "0.000566666666666667"  "0.000638888888888889"
D37965_at               "0.000166666666666667"  "0.000616666666666667"
D42063_at               "0.000666666666666667"  "6e-04"               
D49677_at               "4e-04"                 "6e-04"               
D28124_at               "-4e-04"                "0.000585858585858586"
D50683_at               "5e-04"                 "0.000577777777777778"
D14658_at               "0.00146666666666667"   "0.000555555555555556"
D00596_at               "0.000433333333333333"  "0.000550649350649351"
D30758_at               "0.00266666666666667"   "0.000533333333333333"
AB002409_at             "5e-04"                 "5e-04"               
AC002464_at             "0.001"                 "5e-04"               
D00017_at               "0"                     "5e-04"               
D28416_at               "5e-04"                 "5e-04"               
D49738_at               "0"                     "5e-04"               
AFFX-HSAC07/X00351_3_at "0"                     "0.000485714285714286"
D28118_at               "0.000333333333333333"  "0.000477777777777778"
D10923_at               "5e-04"                 "0.000444444444444444"
D28137_at               "0.000666666666666667"  "0.000444444444444444"
D50857_at               "5e-04"                 "0.000444444444444444"
D29810_at               "5e-04"                 "0.000422222222222222"
D13315_at               "-0.000366666666666667" "4e-04"               
D00591_at               "4e-04"                 "4e-04"               
D26068_at               "0.000333333333333333"  "4e-04"               
D26528_at               "4e-04"                 "4e-04"               
D29833_at               "0"                     "4e-04"               
D43638_at               "5e-04"                 "4e-04"               
D49489_at               "0.000666666666666667"  "4e-04"               
D29954_at               "0.000666666666666667"  "0.000394444444444444"
D14811_at               "4e-04"                 "0.000363636363636364"
D42043_at               "0.00183333333333333"   "0.000349350649350649"
AFFX-BioC-3_at          "4e-04"                 "0.000344444444444444"
AFFX-CreX-3_at          "0.000333333333333333"  "0.000333333333333333"
AF007875_at             "0"                     "0.000333333333333333"
AF015950_at             "-0.000333333333333333" "0.000288888888888889"
AFFX-TrpnX-3_at         "5e-04"                 "0.000285714285714286"
AFFX-M27830_M_at        "0.001"                 "0.000285714285714286"
AFFX-HSAC07/X00351_5_st "0.002"                 "0.000285714285714286"
AC002115_cds1_at        "0"                     "0.000285714285714286"
AC002486_at             "0"                     "0.000285714285714286"
AF006609_at             "0.000666666666666667"  "0.000285714285714286"
D16294_at               "0"                     "0.000285714285714286"
D25217_at               "0"                     "0.000285714285714286"
AFFX-DapX-5_at          "5e-04"                 "0.00025"             
AF014958_at             "0"                     "0.00025"             
D14686_at               "0"                     "0.00025"             
D21260_at               "0.000666666666666667"  "0.00025"             
D31767_at               "0.000666666666666667"  "0.00025"             
D45248_at               "0"                     "0.00025"             
AFFX-BioB-M_st          "5e-04"                 "0.000222222222222222"
AFFX-CreX-3_st          "0.000666666666666667"  "0.000222222222222222"
AFFX-HSAC07/X00351_M_at "0"                     "0.000222222222222222"
A28102_at               "0.000666666666666667"  "0.000222222222222222"
D14827_at               "-0.000114285714285714" "0.000222222222222222"
D21851_at               "0"                     "0.000222222222222222"
D31797_at               "0.001"                 "0.000222222222222222"
D50310_at               "0"                     "0.000222222222222222"
D50495_at               "5e-04"                 "0.000222222222222222"
AF005361_at             "0.000666666666666667"  "2e-04"               
D10523_at               "0.000333333333333333"  "2e-04"               
D13634_at               "4e-04"                 "2e-04"               
D31890_at               "0"                     "2e-04"               
D38535_at               "0.001"                 "2e-04"               
AB000220_at             "0"                     "0.000181818181818182"
AC002450_at             "0"                     "0.000181818181818182"
AF002020_at             "0"                     "0.000181818181818182"
D38524_at               "0.000333333333333333"  "0.000181818181818182"
D50640_at               "0.000333333333333333"  "0.000181818181818182"
D50916_at               "0"                     "0.000181818181818182"
D21878_at               "4e-04"                 "0.000177777777777778"
AFFX-ThrX-M_at          "0.000333333333333333"  "0.000166666666666667"
D50925_at               "0.000666666666666667"  "0.000166666666666667"
AB000464_at             "8e-04"                 "0.000155844155844156"
D17390_at               "-2e-04"                "0.000155844155844156"
D50312_at               "0"                     "0.000153846153846154"
AFFX-HUMRGE/M10098_5_at "-0.000666666666666667" "0.000138888888888889"
D30037_at               "0.000233333333333333"  "0.000122222222222222"
AF009368_at             "5e-04"                 "0.000113492063492063"
D14533_at               "-5e-04"                "0.000103896103896104"
D13630_at               "0.00166666666666667"   "8.63636363636364e-05"
D45371_at               "0.000833333333333333"  "8.63636363636364e-05"
D50928_at               "-0.000666666666666667" "8.57142857142857e-05"
D29642_at               "0"                     "5.55555555555556e-05"
AFFX-BioC-3_st          "0.001"                 "5e-05"               
D26561_cds3_at          "-1e-04"                "4.04040404040404e-05"
                        MeanDecreaseGini     
D28423_at               "0.364679018759019"  
AC002077_at             "0.333154977636742"  
D14664_at               "0.229628646616541"  
D13988_at               "0.23146454630337"   
D26579_at               "0.188181687902741"  
AF000234_at             "0.224761970121382"  
D10495_at               "0.239789588320176"  
D21852_at               "0.158556834733894"  
D31846_at               "0.212366678728908"  
D21261_at               "0.181696726431463"  
D30742_at               "0.144083886677478"  
D13628_at               "0.114940608875129"  
AFFX-BioDn-3_st         "0.125547287827412"  
D31764_at               "0.128161383851786"  
D43947_at               "0.149543478946234"  
D10202_at               "0.144578345864662"  
D28532_at               "0.0977589477189477" 
D26443_at               "0.0688419607843137" 
D16581_at               "0.0701639340776183" 
D49958_at               "0.0557576470588235" 
D50920_at               "0.0971725568549098" 
D14660_at               "0.080842481962482"  
D38293_at               "0.116814544165844"  
AC000064_cds1_at        "0.104948534798535"  
AB000115_at             "0.0183681246857717" 
D50914_at               "0.0394925101214575" 
D17400_at               "0.0652403418803419" 
D49400_at               "0.129609645995559"  
D50919_at               "0.0311970382558618" 
D50525_at               "0.0726114860303096" 
D00760_at               "0.101521800552389"  
D26135_at               "0.0892974667437825" 
D30655_at               "0.116326954418131"  
AFFX-HUMRGE/M10098_M_at "0.0347047619047619" 
D13627_at               "0.136803640456551"  
D30755_at               "0.0836722222222222" 
D26018_at               "0.0497268111455108" 
D29643_at               "0.0850120353021591" 
D14689_at               "0.0932607692307692" 
AF006084_at             "0.0904360173160173" 
D29677_at               "0.0434835294117647" 
AF015913_at             "0.0469584642979999" 
AC002115_cds4_at        "0.0799843274853801" 
AB000449_at             "0.031392673992674"  
AFFX-M27830_5_at        "0.144860856865872"  
AB002559_at             "0.0681041722329958" 
AF002700_at             "0.0316187581699346" 
D13637_at               "0.0729280213903743" 
D25539_at               "0.0282735042735043" 
D16626_at               "0.057041124871001"  
D23673_at               "0.0549181436657598" 
D14678_at               "0.0625858925388337" 
D43772_at               "0.0342"             
D21063_at               "0.0603604626092861" 
D38583_at               "0.165653515689677"  
D42046_at               "0.0382203751803752" 
D50582_at               "0.0320406349206349" 
D16469_at               "0.02753"            
D29963_at               "0.0548937995337995" 
AF000562_at             "0.075269494949495"  
AB000897_at             "0.00375"            
AF009426_at             "0.0299822222222222" 
D29958_at               "0.00747899159663866"
D14889_at               "0.0394105263157895" 
D37965_at               "0.0131356725146199" 
D42063_at               "0.00923076923076923"
D49677_at               "0.0422618487394958" 
D28124_at               "0.028574358974359"  
D50683_at               "0.035768354978355"  
D14658_at               "0.109635075773899"  
D00596_at               "0.131057777777778"  
D30758_at               "0.10420682878525"   
AB002409_at             "0.007"              
AC002464_at             "0.0183247863247863" 
D00017_at               "0.0246010256410256" 
D28416_at               "0.0425169590643275" 
D49738_at               "0.0217695238095238" 
AFFX-HSAC07/X00351_3_at "0.0183698701298701" 
D28118_at               "0.0404444444444444" 
D10923_at               "0.0512266666666667" 
D28137_at               "0.0142698412698413" 
D50857_at               "0.00375"            
D29810_at               "0.0183940106951872" 
D13315_at               "0.121689962651727"  
D00591_at               "0.0113333333333333" 
D26068_at               "0.02744"            
D26528_at               "0.0101052631578947" 
D29833_at               "0.0038"             
D43638_at