Last data update: 2014.03.03

R: Compares two RRHO maps to a third
RRHOComparisonR Documentation

Compares two RRHO maps to a third

Description

Comparing two RRHO maps where one of the lists is shared between the two maps as in {RRHO map 1: list1 vs list3} vs {RRHO map 2: list2 vs list3}.

Usage

  RRHOComparison(list1, list2, list3, 
    stepsize, plots = FALSE, 
    labels, outputdir = NULL,
    log10.ind)

Arguments

list1

A data.frame from experiment 1 with two columns, column 1 is the ‘Gene Identifier’, column 2 is the signed ranking value (e.g. signed -log10 of p-value, or fold change).

list2

Same as list1.

list3

Same as list1.

stepsize

Integer indicating how many genes to increase by in each algorithm iteration.

labels

Character vector carrying the labels for the outputted plots.

plots

Logical. Should comparisons be plotted?

outputdir

Plot destination directory.

log10.ind

Logical. Should pvalues be reported and plotted in -log10 scale and not -log scale?

Details

The difference in {overlap between list1 and list3} compared to the {overlap between list2 and list3}. This is useful for determining if there is a statistically significant difference between two RRHO maps. In other words, this is useful for determining if the overlap between list1 and list3 is statistically different between the overlap between list2 and list3.

RRHO Difference maps are produced by calculating for each pixel the normal approximation of difference in log odds ratio and standard error of overlap between the two RRHO maps. This Z score is then converted to a P-value and corrected for multiple comparisons across pixels [3].

The function will return a RRHO of the significance of overlap between list1 and list3 and list2 and list3. A third RRHO gives the significance of the difference between these two overlap maps.

Note that by default all pvalues are outputted in -log scale. This can be changed with the log10.ind argument.

Value

A oject including:

hypermat1

Pvalues of comparing list1 to list3.

hypermat2

Pvalues of comparing list2 to list3.

Pdiff

The pvalue of the test for a difference in difference between lists 1-3 and 2-3.

Pdiff.by

Pvalues, corrected for the search over all of the list using Benjamini-Yekutieli.

Author(s)

Jason Stein and Jonathan Rosenblatt

References

[1] Plaisier, Seema B., Richard Taschereau, Justin A. Wong, and Thomas G. Graeber. "Rank-rank Hypergeometric Overlap: Identification of Statistically Significant Overlap between Gene-Expression Signatures." Nucleic Acids Research 38, no. 17 (September 1, 2010): e169-e169.

[2] Benjamini, Y., and D. Yekutieli. "The Control of the False Discovery Rate in Multiple Testing under Dependency." ANNALS OF STATISTICS 29, no. 4 (2001): 1165-88.

[3] Stein JL*, de la Torre-Ubieta L*, Tian Y, Parikshak NN, Hernandez IA, Marchetto MC, Baker DK, Lu D, Lowe JK, Wexler EM, Muotri AR, Gage FH, Kosik KS, Geschwind DH. "A quantitative framework to evaluate modeling of cortical development by neural stem cells." Manuscript in press at Neuron. (*) Authors contributed equally to this work.

See Also

RRHO

Examples

  size<- 500
  list1<- data.frame(GeneIdentifier=paste('gen',1:size, sep=''), 
  RankingVal=-log(runif(size)))
  list2<- data.frame(GeneIdentifier=paste('gen',1:size, sep=''), 
  RankingVal=-log(runif(size)))
  list3<- data.frame(GeneIdentifier=paste('gen',1:size, sep=''), 
  RankingVal=-log(runif(size)))
  (temp.dir<- tempdir())
  RRHOComparison(list1,list2,list3,
                  stepsize=10,
                  labels=c("list1","list2","list3"),
                  plots=TRUE,
                  outputdir=temp.dir,
                  log10.ind=FALSE)

Results


R version 3.3.1 (2016-06-21) -- "Bug in Your Hair"
Copyright (C) 2016 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library(RRHO)
Loading required package: grid
> png(filename="/home/ddbj/snapshot/RGM3/R_BC/result/RRHO/RRHOComparison.Rd_%03d_medium.png", width=480, height=480)
> ### Name: RRHOComparison
> ### Title: Compares two RRHO maps to a third
> ### Aliases: RRHOComparison
> 
> ### ** Examples
> 
>   size<- 500
>   list1<- data.frame(GeneIdentifier=paste('gen',1:size, sep=''), 
+   RankingVal=-log(runif(size)))
>   list2<- data.frame(GeneIdentifier=paste('gen',1:size, sep=''), 
+   RankingVal=-log(runif(size)))
>   list3<- data.frame(GeneIdentifier=paste('gen',1:size, sep=''), 
+   RankingVal=-log(runif(size)))
>   (temp.dir<- tempdir())
[1] "/tmp/RtmpCQNF7k"
>   RRHOComparison(list1,list2,list3,
+                   stepsize=10,
+                   labels=c("list1","list2","list3"),
+                   plots=TRUE,
+                   outputdir=temp.dir,
+                   log10.ind=FALSE)
$hypermat1
            [,1]       [,2]       [,3]       [,4]       [,5]       [,6]
 [1,] 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000
 [2,] 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000
 [3,] 0.00000000 0.00000000 0.50835912 0.29226075 0.17382903 1.01120162
 [4,] 0.00000000 0.00000000 0.29226075 0.13805340 0.29586261 0.93852840
 [5,] 0.00000000 0.00000000 0.17382903 0.06681333 0.13760658 0.47444195
 [6,] 0.00000000 0.00000000 0.10471430 0.03240677 0.06284724 0.23289028
 [7,] 0.00000000 0.00000000 0.28582251 0.09104712 0.10393244 0.25377323
 [8,] 0.00000000 0.00000000 0.19048361 0.04929748 0.14648551 0.26977271
 [9,] 0.00000000 0.00000000 0.12591275 0.09922291 0.18935424 0.28227837
[10,] 0.00000000 0.00000000 0.26205649 0.16292485 0.23208026 0.29217348
[11,] 0.00000000 0.00000000 0.18297839 0.09976855 0.27452251 0.30004923
[12,] 0.00000000 0.00000000 0.12604348 0.15349106 0.31669131 0.30631749
[13,] 0.00000000 0.00000000 0.08550780 0.09622431 0.19771074 0.17856500
[14,] 0.00000000 0.00000000 0.05704349 0.05860147 0.11883511 0.09884021
[15,] 0.00000000 0.02533822 0.11789485 0.09034539 0.14187478 0.10382945
[16,] 0.00000000 0.36384622 1.27123596 0.75839881 0.74352730 0.49755649
[17,] 0.00000000 0.29629230 1.03796634 0.88928765 0.79448266 0.49556830
[18,] 0.00000000 0.23962255 0.83952100 1.02980922 0.84620953 0.49329127
[19,] 0.00000000 0.19230173 0.67171530 0.79581676 0.61449701 0.32266602
[20,] 0.00000000 0.87425712 1.40096407 1.34280228 0.95307112 0.48794053
[21,] 0.00000000 0.74908707 1.74688338 1.51734288 1.00877656 0.48488773
[22,] 0.00000000 0.63802954 1.47536461 1.70570669 1.06640868 0.48158978
[23,] 0.00000000 0.53981308 1.23506404 1.38569176 0.80156092 0.31867275
[24,] 0.00000000 0.45330668 1.02353528 1.10950852 0.58699446 0.20122079
[25,] 0.00000000 0.79654026 1.31185952 1.76464225 0.90527832 0.31404844
[26,] 0.00000000 0.68226862 1.09298785 1.44203053 0.67193851 0.19807301
[27,] 0.00000000 1.12642248 1.39751768 1.63428290 0.71728979 0.19582853
[28,] 0.00000000 0.98129966 1.16945739 1.84735886 1.08075978 0.30400501
[29,] 0.00000000 0.84880738 0.96675762 1.51535575 0.81527164 0.19001143
[30,] 0.00000000 0.72831386 0.78809325 1.22300038 0.59691372 0.11161552
[31,] 0.00000000 0.61924613 0.63219365 1.40533255 0.63881601 0.10868070
[32,] 0.00000000 0.52107672 0.49780205 1.12411707 0.45330128 0.05874434
[33,] 0.00000000 0.43331124 0.38363528 1.30210734 0.48665553 0.05620703
[34,] 0.00000000 0.35547614 0.28834476 1.02983121 0.78271378 0.09751168
[35,] 0.00000000 0.66100064 0.41403535 1.20381875 0.83864935 0.09298673
[36,] 0.00000000 0.55252288 0.58206407 1.40767668 0.89990957 0.08805202
[37,] 0.00000000 0.45486265 0.44603435 1.10868772 0.64655094 0.04335171
[38,] 0.00000000 0.36779325 0.33138643 0.84829845 0.44232844 0.07693446
[39,] 0.00000000 0.70988442 0.48044994 1.01483107 0.47562464 0.13128321
[40,] 0.00000000 0.58481922 0.35286385 0.75738956 0.51218503 0.12206556
[41,] 0.00000000 0.47141352 0.24785525 0.54027288 0.32596088 0.11207361
[42,] 0.00000000 0.36984866 0.16451978 0.36345880 0.18930066 0.04978259
[43,] 0.00000000 0.28035553 0.10149799 0.22623557 0.09721520 0.01806602
[44,] 0.14850001 0.62074431 0.16192351 0.28134371 0.09888174 0.03421031
[45,] 0.12556322 0.47752735 0.25760782 0.35247668 0.21767636 0.13868486
[46,] 0.10314076 0.34817126 0.41450721 0.44786897 0.46820411 0.24899307
[47,] 0.08121006 0.23429996 0.69216636 0.58395047 0.51057794 0.21699349
[48,] 0.05975000 0.66412222 1.28136246 0.80065078 0.56409538 0.17699015
[49,] 0.03874083 0.43055727 0.83062526 1.23929987 1.65695964 0.90588920
[50,] 0.01816397 0.20184892 0.38936113 0.58086349 0.77652954 0.97654436
            [,7]       [,8]       [,9]      [,10]      [,11]      [,12]
 [1,] 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000
 [2,] 0.00000000 0.00000000 0.00000000 0.11319772 0.08472524 0.06317839
 [3,] 0.72612287 0.52056558 0.37101665 0.59593536 0.44202628 0.32434143
 [4,] 0.61996200 0.40464826 0.53689093 0.67548479 0.47262679 0.32422638
 [5,] 0.26773735 0.14648551 0.18935424 0.23208026 0.13546598 0.07597212
 [6,] 0.10930081 0.04863997 0.05983863 0.06981083 0.03259680 0.01432259
 [7,] 0.11045097 0.04467566 0.04615130 0.04644930 0.04588445 0.01906584
 [8,] 0.10907064 0.04009815 0.03542441 0.06845197 0.05819734 0.02286489
 [9,] 0.21120740 0.08020937 0.06067630 0.09162176 0.06933428 0.02574684
[10,] 0.19779352 0.06845197 0.04580938 0.06208364 0.07928143 0.02780944
[11,] 0.18489829 0.11369081 0.06933428 0.07928143 0.08809875 0.02916563
[12,] 0.29476319 0.28274541 0.16763070 0.16319494 0.15798037 0.09383480
[13,] 0.16068195 0.23977729 0.12910540 0.11529831 0.10268731 0.09117801
[14,] 0.08191612 0.20317888 0.09887892 0.13376972 0.10863111 0.08804835
[15,] 0.07652105 0.27274610 0.12737280 0.23433717 0.17696614 0.13316539
[16,] 0.33866039 0.71693030 0.51754818 0.70535586 0.52347118 0.52521291
[17,] 0.31243841 0.85292571 0.58702032 0.96765909 0.90443318 1.07730557
[18,] 0.43263217 1.00035228 0.65981797 1.00646081 0.89568003 1.01761979
[19,] 0.26522526 0.65790220 0.39312142 0.61687061 0.68680692 0.75639765
[20,] 0.53442741 1.03323797 0.61377424 0.84888773 0.88022345 0.91078830
[21,] 0.49504158 0.91874931 0.68533076 0.88595396 0.87334394 0.86245553
[22,] 0.45809917 1.06840487 0.76108511 0.92386665 0.86693840 0.81689105
[23,] 0.28755828 0.72065131 0.63842293 0.96282366 0.86095230 0.97570678
[24,] 0.26349074 0.63492455 0.53108725 0.78331278 0.66601224 0.73264329
[25,] 0.35946725 0.75253122 0.59429982 0.81901070 0.66193244 0.69337973
[26,] 0.21919716 0.48604937 0.35656010 0.49769243 0.37384794 0.38021830
[27,] 0.19879707 0.42164343 0.28688270 0.38700096 0.26937542 0.26022700
[28,] 0.27548668 0.50992612 0.32684267 0.40840856 0.26666635 0.24124432
[29,] 0.16117258 0.31042600 0.26066540 0.31197302 0.18545001 0.22280398
[30,] 0.08719078 0.17480085 0.20438344 0.23269180 0.18237451 0.20487556
[31,] 0.07612670 0.14349758 0.15713235 0.16880438 0.12119833 0.12926484
[32,] 0.03654831 0.11609436 0.11807811 0.11855155 0.11786716 0.11627967
[33,] 0.03061636 0.09234303 0.08640075 0.12503209 0.11409711 0.10373500
[34,] 0.14107108 0.28406090 0.23649661 0.28692588 0.24014492 0.20112027
[35,] 0.19935845 0.35041617 0.26900557 0.42432943 0.45830260 0.36166377
[36,] 0.17476538 0.29237770 0.20515668 0.31585245 0.32461716 0.23510642
[37,] 0.15135581 0.23974507 0.15165018 0.22647656 0.31646306 0.30244011
[38,] 0.21420666 0.29876733 0.26531086 0.34651070 0.43525282 0.53099795
[39,] 0.29894992 0.37093639 0.30119528 0.36267606 0.42596043 0.66712321
[40,] 0.26105112 0.30264376 0.22330131 0.25521959 0.28631022 0.45054250
[41,] 0.22412085 0.24026216 0.15799384 0.16907373 0.17858480 0.28159905
[42,] 0.10464607 0.10572199 0.10516048 0.10341298 0.25978228 0.36765137
[43,] 0.03972789 0.03659744 0.03312642 0.02956476 0.08900422 0.21053466
[44,] 0.05973370 0.04608713 0.03530357 0.02680501 0.07621375 0.17455686
[45,] 0.17880117 0.11675017 0.07599276 0.04899981 0.11666586 0.23452241
[46,] 0.26745772 0.14807249 0.16017675 0.08888256 0.17931483 0.31856164
[47,] 0.20290849 0.08749000 0.08325480 0.03443516 0.07330725 0.13743759
[48,] 0.13676516 0.04035242 0.03128399 0.02397311 0.04820866 0.08716249
[49,] 1.19833146 0.32521094 0.19736180 0.29077614 0.40550284 0.54185293
[50,] 1.18110566 0.46703362 0.18129020 0.24087859 0.30933129 0.38662960
           [,13]      [,14]       [,15]      [,16]      [,17]      [,18]
 [1,] 0.00000000 0.00000000 0.000000000 1.19732826 1.13320373 1.07294454
 [2,] 0.04688107 0.03458304 0.025338218 0.11395174 0.08798874 0.06735723
 [3,] 0.23497765 0.16778729 0.117894851 0.20747448 0.14957723 0.10590442
 [4,] 0.41949263 0.29095190 0.196985132 0.46541186 0.33302881 0.23262135
 [5,] 0.19771074 0.11883511 0.068516019 0.16579341 0.10067966 0.05853219
 [6,] 0.04312398 0.02027031 0.008945034 0.10806943 0.05832771 0.06095807
 [7,] 0.04302680 0.01851137 0.007348102 0.07115548 0.03394303 0.03141586
 [8,] 0.04150445 0.01632397 0.005814533 0.04693647 0.01966949 0.01601732
 [9,] 0.07378741 0.02911487 0.010228643 0.05669298 0.02261847 0.03123477
[10,] 0.06694145 0.02412246 0.015768572 0.06559030 0.02489563 0.05250179
[11,] 0.06031051 0.01979271 0.022252893 0.07361552 0.02655971 0.07983365
[12,] 0.14609922 0.05281664 0.051239263 0.19016578 0.07683280 0.16922237
[13,] 0.12889975 0.04250321 0.037367394 0.13374224 0.04740114 0.10193908
[14,] 0.11348413 0.03399626 0.026997489 0.09281434 0.02855645 0.05940623
[15,] 0.15244934 0.04570898 0.033125187 0.09775149 0.02843484 0.05327044
[16,] 0.69174460 0.28776067 0.209292065 0.39971788 0.15389333 0.22050159
[17,] 1.25956332 0.75507536 0.555204589 0.85437592 0.38117950 0.47426888
[18,] 1.40524519 0.82447120 0.582987225 0.84754082 0.47426888 0.55149507
[19,] 1.03710651 0.55240545 0.357605368 0.52474653 0.25633199 0.29144509
[20,] 1.16762232 0.77592109 0.496860704 0.66689652 0.32542939 0.34619269
[21,] 1.06392146 0.66922062 0.521572006 0.83000540 0.40487767 0.40621006
[22,] 0.96859869 0.57454508 0.422006200 0.66039901 0.29131860 0.27780198
[23,] 1.09332631 0.63102522 0.443609828 0.65715604 0.27497089 0.24765087
[24,] 0.99826729 0.54113998 0.465404109 0.65389710 0.34287739 0.38318018
[25,] 0.90986765 0.59468407 0.487468250 0.81152602 0.42123914 0.44408516
[26,] 0.50697622 0.29240211 0.297204066 0.51064715 0.22820014 0.23130318
[27,] 0.34082485 0.17448674 0.168449421 0.39337695 0.15565334 0.14899257
[28,] 0.29966309 0.19724340 0.178030351 0.39045970 0.14409930 0.12907937
[29,] 0.35487177 0.30212051 0.256884773 0.63684429 0.24979463 0.21179946
[30,] 0.31134166 0.24831708 0.197104459 0.49712487 0.17005382 0.33048522
[31,] 0.19483795 0.20118155 0.147749756 0.37926120 0.11071944 0.21814930
[32,] 0.16559628 0.16027513 0.107770618 0.28157515 0.06839028 0.13620504
[33,] 0.13901419 0.12518822 0.076126181 0.20237839 0.06052885 0.11496614
[34,] 0.33061837 0.27888680 0.167853720 0.36382022 0.16480976 0.26120369
[35,] 0.52226956 0.41832094 0.333701990 0.61227270 0.38108257 0.52552376
[36,] 0.33797890 0.34302159 0.253413834 0.46623601 0.26122013 0.35538410
[37,] 0.39987761 0.37991911 0.360963064 0.60209730 0.43560690 0.54123496
[38,] 0.83048155 0.74241637 0.665049296 0.98020784 0.69474026 0.80027768
[39,] 1.24043392 1.05701675 0.901895831 1.23613907 0.84450214 0.92210959
[40,] 0.87516787 0.69569114 0.950914648 1.25069240 1.02689464 1.06549528
[41,] 0.57676032 0.41758838 0.576406009 0.76541884 0.76084865 0.75658864
[42,] 0.68926331 0.46535196 0.604480937 1.00367722 0.94297711 0.88732856
[43,] 0.41711848 0.36212248 0.454318362 0.76198267 0.67185183 0.59207195
[44,] 0.34004550 0.26795508 0.321459786 0.54608702 0.44193692 0.35529911
[45,] 0.41514806 0.29618975 0.327615198 0.53238626 0.39182593 0.28344211
[46,] 0.51404318 0.51493784 0.515373049 0.75905416 0.51508982 0.51445031
[47,] 0.23333329 0.36637902 0.333696426 0.49337259 0.45028913 0.41080242
[48,] 0.14478622 0.22464864 0.175930798 0.26211819 0.20670831 0.16137899
[49,] 0.69993614 0.87976832 1.081346123 1.30469785 0.94450594 0.67292881
[50,] 0.47276264 0.56773975 0.671598848 0.78441245 0.90629227 1.03739308
           [,19]      [,20]      [,21]      [,22]      [,23]      [,24]
 [1,] 1.01611107 0.96233467 0.91130319 0.86274996 0.81644540 0.77219039
 [2,] 0.05107846 0.15301109 0.12060657 0.09408817 0.07257744 0.05530080
 [3,] 0.07352314 0.13016663 0.09205586 0.06369080 0.04303059 0.02833519
 [4,] 0.15817436 0.36830642 0.26242010 0.32640390 0.23102317 0.15876188
 [5,] 0.03246542 0.08260060 0.09573675 0.10955813 0.06538619 0.07502416
 [6,] 0.03131991 0.06493577 0.06631806 0.12072769 0.06794784 0.06822247
 [7,] 0.01382674 0.02636970 0.04609374 0.12755052 0.06775371 0.06077458
 [8,] 0.01292542 0.02089938 0.03197533 0.08048266 0.03768159 0.03004058
 [9,] 0.04159620 0.05378364 0.06787231 0.13305815 0.06295717 0.04643952
[10,] 0.06050948 0.06877345 0.07725375 0.13315953 0.05940879 0.04002460
[11,] 0.08221964 0.08415240 0.13107593 0.19409097 0.19425942 0.13266066
[12,] 0.15909334 0.14918981 0.20215899 0.26626473 0.24902472 0.16366151
[13,] 0.08844475 0.11532759 0.14683495 0.18326591 0.15944397 0.09402166
[14,] 0.04693676 0.05806206 0.15317265 0.17721095 0.14409385 0.07876201
[15,] 0.03851135 0.04378788 0.11063137 0.12026898 0.08970073 0.06566992
[16,] 0.15973627 0.16177975 0.30501931 0.30516818 0.30484488 0.22642002
[17,] 0.34331858 0.32542939 0.52186524 0.49530070 0.46976217 0.34287739
[18,] 0.38505838 0.34619269 0.52151686 0.47175487 0.42577039 0.29314598
[19,] 0.18086744 0.15065274 0.23505928 0.19709123 0.16400488 0.09623080
[20,] 0.20716991 0.16295655 0.23687811 0.25161510 0.19951523 0.11265249
[21,] 0.23505928 0.23687811 0.31442450 0.31469392 0.23912280 0.13030739
[22,] 0.14362582 0.13655302 0.23888342 0.22636002 0.15864730 0.14920511
[23,] 0.11814134 0.10495730 0.17825788 0.15864730 0.10129549 0.08860218
[24,] 0.24965771 0.28096768 0.40493866 0.34835972 0.22684904 0.19083468
[25,] 0.27840626 0.29563575 0.40337290 0.32979645 0.20178878 0.15915867
[26,] 0.12576185 0.17543032 0.23697776 0.17800906 0.09435660 0.06662065
[27,] 0.10168893 0.13532247 0.17563092 0.12135933 0.05661645 0.05279068
[28,] 0.08108397 0.10238244 0.12687056 0.11226332 0.09879256 0.08639051
[29,] 0.17873219 0.20393305 0.23063020 0.19457192 0.28870001 0.24495834
[30,] 0.26668283 0.28370066 0.30063441 0.31752151 0.42934357 0.35131613
[31,] 0.16201258 0.16408147 0.22398204 0.29731541 0.38542788 0.38455672
[32,] 0.12975789 0.17091330 0.21988202 0.27729778 0.34382755 0.42019497
[33,] 0.10192154 0.12790346 0.15768928 0.19150527 0.22960135 0.45854149
[34,] 0.21987718 0.25006438 0.28207132 0.31596636 0.35184329 0.63075071
[35,] 0.42766814 0.45086909 0.47411746 0.63135054 0.65843876 1.04029532
[36,] 0.35692839 0.35796021 0.35851326 0.46742235 0.46641160 0.74658761
[37,] 0.66016140 0.62675819 0.59507454 0.71702993 0.68188915 1.00554733
[38,] 0.91329123 0.82881431 0.94222366 1.06410151 0.97269122 1.33574836
[39,] 1.00258481 0.86822704 1.17342592 1.26453824 1.11067625 1.46038630
[40,] 1.37198420 1.14487664 1.45921722 1.50534401 1.27231204 1.60378330
[41,] 0.96848044 0.74881551 1.20173849 1.19286199 0.94394265 1.17850749
[42,] 1.07798397 1.01794396 1.52393736 1.44724017 1.09788708 1.30892807
[43,] 0.70672432 0.83300230 1.24629495 1.12251864 0.77604033 0.90656916
[44,] 0.41253960 0.47438910 0.73933549 0.61274467 0.50347918 0.57071688
[45,] 0.30978088 0.33679373 0.52758626 0.39305807 0.42244888 0.45279356
[46,] 0.74446549 1.03165653 1.37968498 1.01567283 1.00886684 1.00275478
[47,] 0.58354581 0.79792258 1.05689824 0.97834270 1.26855939 1.18086446
[48,] 0.23718233 0.33526561 0.45837555 0.37160934 0.50125563 0.40829086
[49,] 0.83142349 1.01056099 1.21109948 0.89706271 1.08072810 0.79733909
[50,] 1.17791643 1.32811447 1.48829431 0.85063456 0.97081758 1.10114627
           [,25]      [,26]      [,27]      [,28]      [,29]      [,30]
 [1,] 0.72981116 0.68915516 0.65008769 0.61248928 0.57625343 0.54128483
 [2,] 0.04157699 0.03080752 0.02246913 0.01610750 0.01133186 0.03775097
 [3,] 0.05293640 0.09089981 0.06265756 0.04196734 0.07197311 0.24483619
 [4,] 0.20164411 0.25157253 0.17401841 0.11619865 0.14798177 0.53791585
 [5,] 0.08517673 0.09582918 0.10697231 0.06336359 0.13072203 0.59691372
 [6,] 0.06815266 0.06774858 0.11807366 0.06597245 0.11415987 0.44571304
 [7,] 0.05419160 0.04800288 0.07468573 0.03680463 0.05772674 0.22610783
 [8,] 0.02366034 0.01838255 0.02650620 0.01057547 0.02874665 0.11158129
 [9,] 0.03362145 0.02383760 0.02972527 0.01113784 0.02550161 0.13568725
[10,] 0.04447314 0.02917116 0.05353467 0.02040272 0.03817325 0.15930947
[11,] 0.13229225 0.08713656 0.13027391 0.05434107 0.08356574 0.25985851
[12,] 0.15157857 0.09453140 0.18547955 0.11742165 0.15651683 0.38916954
[13,] 0.11852476 0.06734615 0.18019457 0.10683722 0.13189131 0.31134166
[14,] 0.09218250 0.07229494 0.17448674 0.09686805 0.11083102 0.33593194
[15,] 0.07119226 0.05105413 0.11921065 0.08749750 0.09277057 0.26935951
[16,] 0.22564534 0.16348788 0.29906635 0.22053659 0.21790045 0.49712487
[17,] 0.32340086 0.22820014 0.37542270 0.26764341 0.24979463 0.52274862
[18,] 0.44408516 0.51104199 0.72926055 0.52970919 0.60511689 1.04057473
[19,] 0.15365983 0.17334404 0.34137238 0.28828213 0.41268751 0.88170065
[20,] 0.16579954 0.23565062 0.41914564 0.33997383 0.45571105 0.91161709
[21,] 0.23816082 0.31122090 0.50664685 0.39645077 0.50055085 0.94203056
[22,] 0.25260170 0.31161255 0.48277085 0.35867986 0.43357632 0.79999049
[23,] 0.14953128 0.31153381 0.45970041 0.32363696 0.37371420 0.67508119
[24,] 0.28132800 0.50511117 0.68138977 0.47737711 0.64755994 1.03777568
[25,] 0.29566446 0.50320577 0.65087010 0.43313046 0.56650139 0.88865264
[26,] 0.13119259 0.23612953 0.30673852 0.17422452 0.22995638 0.38542998
[27,] 0.13858097 0.23454307 0.28933727 0.15315141 0.25523990 0.40272808
[28,] 0.19694499 0.30442953 0.35286242 0.18167621 0.36558564 0.53133175
[29,] 0.45102342 0.61556169 0.81809315 0.58420341 0.94925287 1.22324498
[30,] 0.58870373 0.75547702 1.14389007 0.81293845 1.22324498 1.75773389
[31,] 0.61165220 0.91830566 1.31563021 0.91255147 1.31213052 1.81840306
[32,] 0.63548990 0.91708249 1.27343067 1.22710170 1.65977641 2.18697272
[33,] 0.66038454 0.91628349 1.46528297 1.36670712 1.77855358 2.26897281
[34,] 0.84807468 1.11098630 1.68241281 1.52179915 1.90855681 2.35919877
[35,] 1.54505948 1.87383467 2.59366414 2.31166160 2.74410573 3.23179979
[36,] 1.12319874 1.60778409 2.21110899 2.20935612 2.56328265 3.37828165
[37,] 1.41691304 1.92415845 2.92454247 2.84232696 3.17746292 4.02122448
[38,] 1.77592755 2.29907860 3.34449160 3.16483072 3.43807548 4.23723250
[39,] 1.87325645 2.35374420 3.35186438 3.07762207 3.26071475 3.95276336
[40,] 1.98523270 2.42004168 3.37235155 2.99776246 3.09071689 3.67952103
[41,] 1.44776130 1.75420768 2.49373952 2.09767993 2.09778927 2.49654381
[42,] 1.54438592 1.80602069 2.50574576 2.01605257 1.94082148 2.25444723
[43,] 1.05064105 1.20928762 1.71807054 1.25967207 1.14370030 1.31644728
[44,] 0.64347416 0.72218726 1.06000176 0.67428610 0.75606769 0.84536801
[45,] 0.67852419 0.71967857 1.02453043 0.80745351 0.85458172 1.19944215
[46,] 1.33811638 1.33135798 1.73168455 1.32169553 1.31873789 1.72341093
[47,] 1.50526556 1.40927117 1.77190596 1.23427420 1.15381283 1.47926255
[48,] 0.54510033 0.44572943 0.59056260 0.48441205 0.63841423 0.82509481
[49,] 0.96647175 0.70760751 0.86391182 0.62518503 0.76987316 0.93729797
[50,] 1.24214608 1.39441379 1.55863031 1.73557579 1.92614786 2.13138388
           [,31]      [,32]      [,33]       [,34]       [,35]      [,36]
 [1,] 0.50749783 0.47481519 0.44316698 0.412489723 0.382725621 0.35382187
 [2,] 0.02735725 0.01939728 0.01342358 0.009041079 0.005906736 0.01983606
 [3,] 0.17966090 0.12816521 0.08853053 0.058941914 0.037622479 0.06269208
 [4,] 0.39581230 0.28196048 0.19338430 0.126874498 0.079020930 0.10011743
 [5,] 0.63881601 0.45330128 0.30823821 0.199180097 0.121091678 0.13034610
 [6,] 0.89658134 0.63322835 0.62675445 0.419569235 0.264451923 0.25652993
 [7,] 0.45291420 0.41506899 0.37857665 0.225118609 0.122538714 0.10510646
 [8,] 0.22015143 0.18210442 0.14844665 0.072006290 0.030574221 0.02183468
 [9,] 0.23417672 0.18090570 0.13650734 0.156993734 0.115556344 0.08219356
[10,] 0.24588684 0.25930454 0.18792356 0.197535267 0.137640097 0.14369554
[11,] 0.35538783 0.35036218 0.34482208 0.464726665 0.332010035 0.32461716
[12,] 0.48492601 0.45331474 0.42229196 0.526151628 0.361663771 0.33190781
[13,] 0.36780010 0.32168368 0.27881154 0.330618371 0.284837826 0.24224585
[14,] 0.49011037 0.41192524 0.34162889 0.378265992 0.309500052 0.24830220
[15,] 0.37621112 0.39285475 0.40992204 0.427494843 0.333701990 0.25341383
[16,] 0.62936077 0.62539660 0.62124924 0.616887082 0.472567020 0.35057328
[17,] 0.62771398 0.59507192 0.56284699 0.676930777 0.499143777 0.35328407
[18,] 1.16565293 1.07992597 0.99759197 1.361933066 1.040742301 0.76755955
[19,] 0.95283571 1.02965003 0.91257741 1.204185859 0.873321008 0.60333268
[20,] 0.94621068 0.98281864 0.83492067 1.063572735 0.905315096 0.75979815
[21,] 0.94024534 0.93891105 0.93804619 1.140226253 1.143867625 0.93861029
[22,] 0.76536391 0.73134092 0.86079015 1.009286297 0.971079631 1.14094152
[23,] 0.61620205 0.69808741 0.78919743 0.890960737 0.819272096 0.92842661
[24,] 0.92567821 0.99823240 1.07682793 1.162481746 1.040295316 1.12821309
[25,] 0.75580290 0.78489014 0.81555094 0.848074684 0.882813382 0.92020184
[26,] 0.29468803 0.29043052 0.28561547 0.280199643 0.361379921 0.46152805
[27,] 0.29290180 0.27327666 0.33385197 0.311106217 0.378970949 0.45927787
[28,] 0.48105865 0.43319652 0.49593061 0.445337946 0.645604077 0.73527698
[29,] 1.09902175 0.98235705 1.06043893 0.944991621 1.238703007 1.34165272
[30,] 1.55207225 1.36132685 1.41418199 1.471448746 1.812119069 1.89378875
[31,] 1.82416519 1.56083621 1.56836089 1.858873570 2.194252610 2.22497600
[32,] 2.13266642 2.08179052 2.03411695 2.315547765 2.633545833 2.59945271
[33,] 2.14870605 2.36025030 2.24341900 2.475213291 2.733444450 2.62171765
[34,] 2.16905889 2.31554776 2.13163766 2.287364011 2.459089817 2.27602391
[35,] 2.92267012 3.02494397 2.73344445 2.843642134 2.965937131 3.10258981
[36,] 3.39757405 3.42435297 3.02308921 3.058714077 3.102589814 3.15589207
[37,] 3.94648854 4.38932647 3.82273808 3.773525965 3.732913724 3.70127404
[38,] 4.05495941 4.40541743 4.23732902 4.080231883 3.933332675 3.79599810
[39,] 4.18556423 4.43868089 4.71530428 4.431950539 4.164049138 3.90996301
[40,] 4.34373130 4.49249361 4.65727078 4.249479806 3.865488903 4.04772123
[41,] 2.94735269 3.45608651 3.48775357 3.023340598 2.594766611 2.63240833
[42,] 2.60462705 2.99562554 2.92215351 2.854545553 2.333495817 2.27647533
[43,] 1.50875297 1.72297284 1.58703661 1.818053514 2.078353607 1.93382000
[44,] 0.94305802 1.05018493 0.88873574 0.994684832 1.112523797 0.94087873
[45,] 1.26483838 1.33468410 1.40967819 1.490664144 1.578671867 1.67497479
[46,] 1.72513694 1.72923364 2.22474775 2.240690146 2.261299524 2.28714694
[47,] 1.39156085 1.30771683 1.67200840 1.582507647 1.496314581 1.41291064
[48,] 0.68961811 0.56803794 0.74543881 0.614741884 0.496888392 0.66645913
[49,] 1.12967905 0.83892021 1.02169263 0.745232189 0.919147882 1.12368933
[50,] 2.35248856 2.59086867 2.84817721 3.126370357 3.427782113 3.75522359
           [,37]       [,38]       [,39]       [,40]      [,41]       [,42]
 [1,] 0.32573014 0.298406036 0.271808723 0.245900538 0.22064667 0.196014884
 [2,] 0.01319096 0.008437165 0.005157301 0.002988338 0.01029945 0.005895237
 [3,] 0.03930423 0.023285728 0.012905529 0.006607427 0.03815143 0.020445735
 [4,] 0.12564871 0.075331496 0.094746987 0.052882336 0.14715777 0.082662213
 [5,] 0.13981189 0.078092663 0.082704886 0.087061661 0.17927504 0.094502217
 [6,] 0.39432413 0.238439314 0.228096590 0.361662566 0.56088053 0.333604244
 [7,] 0.24477206 0.129167829 0.108263544 0.261051119 0.36533107 0.318144800
 [8,] 0.09249572 0.038370266 0.050003041 0.114004954 0.14505752 0.105721994
 [9,] 0.23350736 0.107902670 0.122877196 0.223301311 0.25354897 0.178668894
[10,] 0.33093163 0.155065959 0.160244013 0.255219591 0.26459506 0.172407768
[11,] 0.60499896 0.307447975 0.297448457 0.415616097 0.57576803 0.390841608
[12,] 0.57083074 0.273212431 0.244191928 0.316687670 0.57646359 0.367651374
[13,] 0.39987761 0.166608811 0.200270281 0.240259125 0.41398492 0.233060557
[14,] 0.37991911 0.147943544 0.338727443 0.375788566 0.57672497 0.325669947
[15,] 0.36096306 0.131036312 0.280690004 0.404750619 0.57640601 0.306421104
[16,] 0.45927571 0.169583235 0.324697374 0.583413108 0.76541884 0.410358188
[17,] 0.43560690 0.149736894 0.269505852 0.615869866 0.76084865 0.532806728
[18,] 0.87846265 0.360297242 0.557294513 1.065495279 1.23665998 0.887328558
[19,] 0.66016140 0.321080614 0.471987648 0.875245476 0.96848044 0.634502176
[20,] 0.79289084 0.384229042 0.526438531 0.912005319 0.96134723 0.597052864
[21,] 0.94003605 0.454142405 0.583796553 1.186038860 1.20173849 0.743194014
[22,] 1.10234227 0.531165169 0.644259382 1.228446472 1.19286199 0.700944115
[23,] 0.85353306 0.362815262 0.420318309 1.027149351 0.94394265 0.496313731
[24,] 1.00554733 0.427618523 0.468132488 1.067772822 1.17850749 0.813811626
[25,] 0.96078618 0.499622785 0.519121225 1.109860623 1.17286878 0.769414022
[26,] 0.45501407 0.251274915 0.241779458 0.567047223 0.55974310 0.294056706
[27,] 0.42959036 0.299747641 0.272744392 0.765127645 0.72637143 0.380877147
[28,] 0.66856467 0.467251478 0.411049092 1.007135805 0.92514593 0.485113055
[29,] 1.20807916 0.872736996 0.760956392 1.580914066 1.43324141 0.798007835
[30,] 1.67884768 1.474616380 1.280444327 2.338825430 2.10107920 1.230840240
[31,] 1.92716486 1.648105087 1.387157230 2.426279669 2.10766928 1.175966402
[32,] 2.20456169 1.839180748 1.502755129 2.521216703 2.11774460 1.408947088
[33,] 2.15063986 1.723514063 1.628588963 2.624790656 2.13156602 1.352220503
[34,] 2.10014213 1.612564302 1.458750250 2.320066715 1.77871578 1.020996745
[35,] 2.81806846 2.161914817 1.917955741 2.863808502 2.17196676 1.243798660
[36,] 2.77811598 2.043811384 1.733701446 2.548210974 1.81293735 0.922978233
[37,] 3.19144511 2.302706811 1.895085581 2.682027591 1.83609297 1.140163424
[38,] 3.17098781 2.187856520 1.711833412 2.377547048 1.50299419 0.826680761
[39,] 3.15976408 2.485587953 1.886913698 2.521648159 1.52428214 1.038980902
[40,] 3.15920003 2.377547048 1.703057635 2.224360373 1.21316727 0.729692619
[41,] 2.23323375 1.864192364 1.524282141 1.939446830 0.93128554 0.680014548
[42,] 2.22341045 1.761401464 1.349564405 1.665627498 0.68001455 0.628907103
[43,] 1.79468482 1.297691331 1.177827057 1.401778322 0.67554724 0.575733362
[44,] 0.78258053 0.439296376 0.333687308 0.385997611 0.28083699 0.326875266
[45,] 1.36665748 0.782654199 0.577120279 0.618541711 0.42935215 0.459497993
[46,] 1.79273811 0.977200511 0.980531707 0.985064992 0.99107181 0.998936466
[47,] 0.92908764 0.858437465 0.788506152 0.718849689 1.02017835 0.942605528
[48,] 0.87871974 0.725299229 0.962669824 0.794619580 1.06604042 0.880231530
[49,] 1.36328850 1.017963608 1.255033172 0.913268019 1.14977315 0.806040699
[50,] 4.11211745 2.922878449 3.250914370 3.617031694 4.02840662 2.852788248
           [,43]      [,44]      [,45]     [,46]      [,47]     [,48]
 [1,] 0.17197526 0.14850001 0.12556322 0.1031408 0.08121006 0.0597500
 [2,] 0.01863466 0.05288396 0.47752735 0.3481713 0.23429996 0.6641222
 [3,] 0.10149799 0.16192351 0.61678906 0.4145072 0.24823497 0.4268056
 [4,] 0.22623557 0.28134371 0.71258930 0.4478690 0.24228328 0.3074785
 [5,] 0.19919856 0.40167484 0.79002658 0.4682041 0.23058485 0.2310425
 [6,] 0.53613266 0.85628859 1.37969599 0.8609756 0.45458623 0.4178412
 [7,] 0.45031890 0.63951956 0.91938646 0.8411098 0.40900891 0.3174145
 [8,] 0.13456395 0.17128880 0.38223656 0.8254863 0.37039171 0.2442971
 [9,] 0.20192392 0.22831374 0.43243807 0.8127042 0.33677777 0.1891388
[10,] 0.17470192 0.17558119 0.29810151 0.5076432 0.30695390 0.1465983
[11,] 0.37573809 0.35814978 0.52864583 0.7926430 0.48719591 0.2384005
[12,] 0.32470641 0.28041558 0.37626467 0.5126089 0.44230293 0.1861993
[13,] 0.28086839 0.21896012 0.41514806 0.7771999 0.65191726 0.2850687
[14,] 0.36212248 0.26795508 0.45404799 0.7706188 0.59317914 0.2246486
[15,] 0.45431836 0.32145979 0.49308553 1.0911885 0.83072141 0.3297927
[16,] 0.55751847 0.54608702 0.75957308 1.4773693 1.11661655 0.4627198
[17,] 0.67185183 0.62380485 0.80609387 1.4522142 1.02458178 0.6254554
[18,] 1.04852835 0.95240262 1.15415022 1.8937132 1.33795818 0.8196533
[19,] 0.93486716 0.79347439 0.90114855 1.8623176 1.23534098 0.6794704
[20,] 0.83300230 0.65749653 0.69488837 1.8351865 1.14216166 0.8785815
[21,] 0.97139908 0.73933549 0.73755900 1.8117847 1.05689824 0.7338981
[22,] 0.86911692 0.61274467 1.05185238 2.2957827 1.36309350 0.9391678
[23,] 0.58276222 0.35636208 0.60064930 1.3557851 0.90552296 0.7896808
[24,] 0.90656916 0.57071688 0.87313972 1.7601977 1.18086446 1.0025185
[25,] 0.81183690 0.46733521 0.67852419 1.7483426 1.50526556 1.2497942
[26,] 0.27843223 0.26018958 0.51677834 1.3313580 1.02233430 0.7111503
[27,] 0.34215951 0.30120940 0.55067978 1.3258968 1.31920298 0.9093323
[28,] 0.41594513 0.34664125 0.58606365 1.3216955 1.66870792 1.1425855
[29,] 0.67600354 0.55638949 0.85458172 1.7239572 2.07504815 1.4139732
[30,] 1.03495887 0.84536801 1.19944215 2.2011285 2.54274147 1.7267727
[31,] 0.93273430 0.94305802 1.26483838 2.2052439 2.42361404 1.5105097
[32,] 1.08671232 1.05018493 1.33468410 2.2130398 2.31131947 1.3119853
[33,] 0.98098489 0.88873574 1.07284724 1.7358481 1.67200840 0.7454388
[34,] 0.65966039 0.7