Experimentwise Error
Contents |
the experimentwise error rate is: where αew experimentwise alpha is experimentwise error rate αpc is the per-comparison error rate, and c is the number of comparisons. For example, if 5 independent comparisons
Type 1 Error
were each to be done at the .05 level, then the probability that at least one of them would result in a Type I error is: 1 - (1 - .05)5 = 0.226. If the comparisons are not independent then the experimentwise error rate is less than . Finally, regardless of whether the comparisons are independent, αew ≤ (c)(αpc) For this example, .226 < (5)(.05) = 0.25.
Descriptive Statistics Hypothesis Testing General Properties of Distributions Distributions Normal Distribution Sampling Distributions Binomial and Related Distributions Student's
Comparisonwise Error Rate
t Distribution Chi-square and F Distributions Other Key Distributions Testing decision wise error rate for Normality and Symmetry ANOVA One-way ANOVA Factorial ANOVA ANOVA with Random or Nested Factors familywise error rate calculator Design of Experiments ANOVA with Repeated Measures Analysis of Covariance (ANCOVA) Miscellaneous Correlation Reliability Non-parametric Tests Time Series Analysis Survival Analysis Handling Missing Data http://davidmlane.com/hyperstat/A43646.html Regression Linear Regression Multiple Regression Logistic Regression Multinomial and Ordinal Logistic Regression Log-linear Regression Multivariate Descriptive Multivariate Statistics Multivariate Normal Distribution Hotelling’s T-square MANOVA Repeated Measures Tests Box’s Test Factor Analysis Cluster Analysis Appendix Mathematical Notation Excel Capabilities Matrices and Iterative Procedures Linear Algebra and Advanced Matrix Topics Other Mathematical http://www.real-statistics.com/one-way-analysis-of-variance-anova/experiment-wise-error-rate/ Topics Statistics Tables Bibliography Author Citation Blogs Tools Real Statistics Functions Multivariate Functions Time Series Analysis Functions Missing Data Functions Data Analysis Tools Contact Us Experiment-wise error rate We could have conducted the analysis for Example 1 of Basic Concepts for ANOVA by conducting multiple two sample tests. E.g. to decide whether or not to reject the following null hypothesis H0: μ1 = μ2 = μ3 We can use the following three separate null hypotheses: H0: μ1 = μ2 H0: μ2 = μ3 H0: μ1 = μ3 If any of these null hypotheses is rejected then the original null hypothesis is rejected. Note however that if you set α = .05 for each of the three sub-analyses then the overall alpha value is .14 since 1 – (1 – α)3 = 1 – (1 – .05)3 = 0.142525 (see Example 6 of Basic Probability Concepts). This means that the probability of rejecting the null hypothesis even when it is true (type I error)
the simple question posed by an analysis of variance - do at least two treatment means differ? It may be that embedded in a group of treatments there is only one "control" treatment to which every other treatment should be compared, http://online.sfsu.edu/efc/classes/biol458/multcomp/multcomp.htm and comparisons among the non-control treatments may be uninteresting. One may also, after performing an analysis of variance and rejecting the null hypothesis of equality of treatment means want to know exactly which treatments or groups of treatments differ. To answer these kinds of questions requires careful consideration of the hypotheses of interest both before and after an experiment is conducted, the Type I error rate selected for each hypothesis, the power of each hypothesis test, and wise error the Type I error rate acceptable for the group of hypotheses as a whole. Comparisons or Contrasts If we let represent a treatment mean and ci a weight associated with the ith treatment mean then a comparison or contrast can be represented as: , where It can be seen that this contrast is a linear combination of treatment means (other contrasts such as quadratic and cubic are also possible). All of the following are possible wise error rate comparisons: because they are weighted linear combinations of treatment means and the weights sum to zero. For example, previously we have performed comparisons between two treatment means using the t - statistic: with (n1 + n2) - 2 degrees of freedom. This statistic is a "contrast." The numerator of this expression follows the general form of the contrast outlined above with the weights c1 and c2 equal to 1 and -1, respectively: However, we also see that this contrast is divided by the pooled within cell or within group variation. So, a contrast is actually the ratio of a linear combination of weighted means to an estimate of the pooled within cell or error variation in the experiment: with degrees of freedom. For a non - directional null hypothesis t could be replaced by F: with 1, and degrees of freedom. In general, a contrast is the ratio of a linear combination of weighted means to the mean square within cells times the sum of the squares of the weights assigned to each mean divided by the sample size within cells: where the cI' s are the weights assigned to each treatment mean,, ni is the number of observations in each cell and MSerror is the within cell variation pooled from the entire experiment
be down. Please try the request again. Your cache administrator is webmaster. Generated Sat, 15 Oct 2016 09:54:03 GMT by s_wx1094 (squid/3.5.20)