Comparison-wise Type I Error Rate
Contents |
& Bioassays Resources...DNA & RNABLAST (Basic Local Alignment Search Tool)BLAST (Stand-alone)E-UtilitiesGenBankGenBank: BankItGenBank: experiment wise error rate SequinGenBank: tbl2asnGenome WorkbenchInfluenza VirusNucleotide DatabasePopSetPrimer-BLASTProSplignReference Sequence (RefSeq)RefSeqGeneSequence
Experiment Wise Type 1 Error
Read Archive (SRA)SplignTrace ArchiveUniGeneAll DNA & RNA Resources...Data & SoftwareBLAST (Basic type i error rate calculation Local Alignment Search Tool)BLAST (Stand-alone)Cn3DConserved Domain Search Service (CD Search)E-UtilitiesGenBank: BankItGenBank: SequinGenBank: tbl2asnGenome ProtMapGenome WorkbenchPrimer-BLASTProSplignPubChem Structure SearchSNP Submission
Comparisonwise Error Rate
ToolSplignVector Alignment Search Tool (VAST)All Data & Software Resources...Domains & StructuresBioSystemsCn3DConserved Domain Database (CDD)Conserved Domain Search Service (CD Search)Structure (Molecular Modeling Database)Vector Alignment Search Tool (VAST)All Domains & Structures Resources...Genes & ExpressionBioSystemsDatabase of Genotypes and Phenotypes experiment wise error anova (dbGaP)E-UtilitiesGeneGene Expression Omnibus (GEO) Database Gene Expression Omnibus (GEO) DatasetsGene Expression Omnibus (GEO) ProfilesGenome WorkbenchHomoloGeneMap ViewerOnline Mendelian Inheritance in Man (OMIM)RefSeqGeneUniGeneAll Genes & Expression Resources...Genetics & MedicineBookshelfDatabase of Genotypes and Phenotypes (dbGaP)Genetic Testing RegistryInfluenza VirusMap ViewerOnline Mendelian Inheritance in Man (OMIM)PubMedPubMed Central (PMC)PubMed Clinical QueriesRefSeqGeneAll Genetics & Medicine Resources...Genomes & MapsDatabase of Genomic Structural Variation (dbVar)GenBank: tbl2asnGenomeGenome ProjectGenome ProtMapGenome WorkbenchInfluenza VirusMap ViewerNucleotide DatabasePopSetProSplignSequence Read Archive (SRA)SplignTrace ArchiveAll Genomes & Maps Resources...HomologyBLAST (Basic Local Alignment Search Tool)BLAST (Stand-alone)BLAST Link (BLink)Conserved Domain Database (CDD)Conserved Domain Search Service (CD Search)Genome ProtMapHomoloGeneProtein ClustersAll Homology Resources...LiteratureBookshelfE-UtilitiesJournals in NCBI DatabasesMeSH DatabaseNCBI HandbookNCBI Help ManualNCBI NewsPubMedPubMed Central (PMC)PubMed Clinical QueriesPubMed HealthAll Literature Resources...ProteinsBioSyst
the experimentwise error rate is: where αew http://www.ncbi.nlm.nih.gov/pubmed/1184817 is experimentwise error rate αpc is the per-comparison error rate, and c is the number of comparisons. For example, if 5 independent comparisons http://davidmlane.com/hyperstat/A43646.html were each to be done at the .05 level, then the probability that at least one of them would result in a Type I error is: 1 - (1 - .05)5 = 0.226. If the comparisons are not independent then the experimentwise error rate is less than . Finally, regardless of whether the comparisons are independent, αew ≤ (c)(αpc) For this example, .226 < (5)(.05) = 0.25.
Descriptive Statistics Hypothesis Testing General Properties of Distributions Distributions Normal Distribution Sampling Distributions Binomial and Related Distributions Student's t Distribution Chi-square and F Distributions Other Key Distributions Testing for Normality and Symmetry ANOVA One-way ANOVA Factorial ANOVA ANOVA with http://www.real-statistics.com/one-way-analysis-of-variance-anova/experiment-wise-error-rate/ Random or Nested Factors Design of Experiments ANOVA with Repeated Measures Analysis of Covariance (ANCOVA) Miscellaneous Correlation Reliability Non-parametric Tests Time Series Analysis Survival Analysis Handling Missing Data Regression Linear Regression Multiple Regression Logistic Regression Multinomial and Ordinal Logistic Regression Log-linear Regression Multivariate Descriptive Multivariate Statistics Multivariate Normal Distribution Hotelling’s T-square MANOVA Repeated Measures Tests Box’s Test Factor Analysis Cluster Analysis Appendix Mathematical Notation Excel Capabilities Matrices and Iterative Procedures error rate Linear Algebra and Advanced Matrix Topics Other Mathematical Topics Statistics Tables Bibliography Author Citation Blogs Tools Real Statistics Functions Multivariate Functions Time Series Analysis Functions Missing Data Functions Data Analysis Tools Contact Us Experiment-wise error rate We could have conducted the analysis for Example 1 of Basic Concepts for ANOVA by conducting multiple two sample tests. E.g. to decide whether or not to reject the following null hypothesis H0: μ1 = μ2 = μ3 We wise error rate can use the following three separate null hypotheses: H0: μ1 = μ2 H0: μ2 = μ3 H0: μ1 = μ3 If any of these null hypotheses is rejected then the original null hypothesis is rejected. Note however that if you set α = .05 for each of the three sub-analyses then the overall alpha value is .14 since 1 – (1 – α)3 = 1 – (1 – .05)3 = 0.142525 (see Example 6 of Basic Probability Concepts). This means that the probability of rejecting the null hypothesis even when it is true (type I error) is 14.2525%. For k groups, you would need to run m = COMBIN(k, 2) such tests and so the resulting overall alpha would be 1 – (1 – α)m, a value which would get progressively higher as the number of samples increases. For example, if k = 6, then m = 15 and the probability of finding at least one significant t-test, purely by chance, even when the null hypothesis is true is over 50%. In fact, one of the reasons for performing ANOVA instead of separate t-tests is to reduce the type I error. The only problem is that once you have performed ANOVA if the null hypothesis is rejected you will naturally want to determine which groups have unequal variance, and so you will n