Decision Wise Error Rate
Contents |
the experimentwise error rate is: where αew
Per Comparison Error Rate
is experimentwise error rate αpc is the per-comparison error rate, and c is the number of comparisons. For example, if 5 independent comparisons experiment wise error anova were each to be done at the .05 level, then the probability that at least one of them would result in a Type I error is: 1 - (1 - .05)5 = 0.226. If the comparisons are not independent then the experimentwise error rate is less than . Finally, regardless of whether the comparisons are independent, αew ≤ (c)(αpc) For this example, .226 < (5)(.05) = 0.25.
Descriptive Statistics Hypothesis Testing General Properties of Distributions Distributions Normal Distribution Sampling Distributions Binomial and Related Distributions Student's t Distribution Chi-square and F Distributions Other Key Distributions
Familywise Error Rate Anova
Testing for Normality and Symmetry ANOVA One-way ANOVA Factorial ANOVA ANOVA with family wise error calculator Random or Nested Factors Design of Experiments ANOVA with Repeated Measures Analysis of Covariance (ANCOVA) Miscellaneous Correlation Reliability family wise error rate post hoc Non-parametric Tests Time Series Analysis Survival Analysis Handling Missing Data Regression Linear Regression Multiple Regression Logistic Regression Multinomial and Ordinal Logistic Regression Log-linear Regression Multivariate Descriptive Multivariate Statistics Multivariate http://davidmlane.com/hyperstat/A43646.html Normal Distribution Hotelling’s T-square MANOVA Repeated Measures Tests Box’s Test Factor Analysis Cluster Analysis Appendix Mathematical Notation Excel Capabilities Matrices and Iterative Procedures Linear Algebra and Advanced Matrix Topics Other Mathematical Topics Statistics Tables Bibliography Author Citation Blogs Tools Real Statistics Functions Multivariate Functions Time Series Analysis Functions Missing Data Functions Data Analysis Tools Contact Us Experiment-wise error rate We http://www.real-statistics.com/one-way-analysis-of-variance-anova/experiment-wise-error-rate/ could have conducted the analysis for Example 1 of Basic Concepts for ANOVA by conducting multiple two sample tests. E.g. to decide whether or not to reject the following null hypothesis H0: μ1 = μ2 = μ3 We can use the following three separate null hypotheses: H0: μ1 = μ2 H0: μ2 = μ3 H0: μ1 = μ3 If any of these null hypotheses is rejected then the original null hypothesis is rejected. Note however that if you set α = .05 for each of the three sub-analyses then the overall alpha value is .14 since 1 – (1 – α)3 = 1 – (1 – .05)3 = 0.142525 (see Example 6 of Basic Probability Concepts). This means that the probability of rejecting the null hypothesis even when it is true (type I error) is 14.2525%. For k groups, you would need to run m = COMBIN(k, 2) such tests and so the resulting overall alpha would be 1 – (1 – α)m, a value which would get progressively higher as the number of samples increases. For example, if k = 6, then m = 15 and the probability of finding
Google. Het beschrijft hoe wij gegevens gebruiken en welke opties je hebt. Je moet dit vandaag nog doen. Navigatie overslaan NLUploadenInloggenZoeken Laden... Kies je taal. Sluiten Meer informatie View this message https://www.youtube.com/watch?v=VO_0Rntic0s in English Je gebruikt YouTube in het Nederlands. Je kunt deze voorkeur hieronder http://www.psych.utoronto.ca/courses/c1/chap12/chap12.html wijzigen. Learn more You're viewing YouTube in Dutch. You can change this preference below. Sluiten Ja, nieuwe versie behouden Ongedaan maken Sluiten Deze video is niet beschikbaar. WeergavewachtrijWachtrijWeergavewachtrijWachtrij Alles verwijderenOntkoppelen Laden... Weergavewachtrij Wachtrij __count__/__total__ Experiment wise error rate Belinda Davey AbonnerenGeabonneerdAfmelden4141 Laden... Laden... Bezig... Toevoegen aan Wil je hier later nog een keer naar kijken? wise error Log in om deze video toe te voegen aan een afspeellijst. Inloggen Delen Meer Rapporteren Wil je een melding indienen over de video? Log in om ongepaste content te melden. Inloggen Transcript Statistieken 1.915 weergaven 7 Vind je dit een leuke video? Log in om je mening te geven. Inloggen 8 1 Vind je dit geen leuke video? Log in om je mening te geven. Inloggen 2 Laden... Laden... wise error rate Transcript Het interactieve transcript kan niet worden geladen. Laden... Laden... Beoordelingen zijn beschikbaar wanneer de video is verhuurd. Deze functie is momenteel niet beschikbaar. Probeer het later opnieuw. Gepubliceerd op 13 aug. 2013 Categorie Onderwijs Licentie Standaard YouTube-licentie Laden... Autoplay Wanneer autoplay is ingeschakeld, wordt een aanbevolen video automatisch als volgende afgespeeld. Volgende Wk 10 - Familywise error and analysis of factorial ANOVA - Duur: 10:50. UWSOnline 1.821 weergaven 10:50 Day 27: Different types of error rates - Duur: 12:15. mumfordbrainstats 424 weergaven 12:15 Multiple Comparisons - Duur: 11:59. Steve Grambow 6.424 weergaven 11:59 Planned and unplanned contrasts in SPSS - Duur: 11:25. Belinda Davey 2.929 weergaven 11:25 Multiple Comparisons - Duur: 2:56. mcleo19 1.619 weergaven 2:56 One-Way ANOVA: LSD confidence intervals - Duur: 8:38. jbstatistics 25.195 weergaven 8:38 Bonferroni correction - Duur: 5:22. Elizabeth Jacobs 41.134 weergaven 5:22 Type I and II Errors, Power, Effect Size, Significance and Power Analysis in Quantitative Research - Duur: 9:42. NurseKillam 44.839 weergaven 9:42 Post-Hoc Tests for One-Way ANOVA - Duur: 6:10. statslectures 65.870 weergaven 6:10 Estimating the Local False Discovery Rate in the Detection of Diferential expression... - Duur: 48:56. RCMI Program UPR Medical Sciences Campus 2.318 weergaven 48:56 Evaluating Classifiers: Understanding the ROC Curve
describe a number of different ways of testing which means are different Before describing the tests, it is necessary to consider two different ways of thinking about error and how they are relevant to doing multiple comparisons Error Rate per Comparison (PC) This is simply the Type I error that we have talked about all along. So far, we have been simply setting its value at .05, a 5% chance of making an error Familywise Error Rate (FW) Often, after an ANOVA, we want to do a number of comparisons, not just one The collection of comparisons we do is described as the "family" The familywise error rate is the probability that at least one of these comparisons will include a type I error Assuming that a ¢ is the per comparison error rate, then: The per comparison error: a = a ¢ but, the familywise error: a = 1 - (1-a ¢ )c Thus, if we do two comparisons, but keep a ¢ at 0.05, the FWerror will really be: a = 1 - (1 - 0.05)2 =1 - (0.95)2 = 1 - 0.9025 = 0.0975 Thus, there is almost a 10% chance of one of the comparisons being significant when we do two comparisons, even when the nulls are true. The basic problem then, is that if we are doing many comparisons, we want to somehow control our familywise error so that we don’t end up concluding that differences are there, when they really are not The various tests we will talk about differ in terms of how they do this They will also be categorized as being either "A priori" or "post hoc" A priori: A priori tests are comparisons that the experimenter clearly intended to test before collecting any data Post hoc: Post hoc tests are comparisons the experimenter has decided to test after collecting the data, looking at the means, and noting which means "seem" different. The probability of making a type I error is smaller for A priori tests because, when doing pos