Confidence Interval Error Bars
Contents |
in a publication or presentation, you may be tempted to draw conclusions about the statistical significance of differences between group means by looking at whether the error bars overlap. Let's look at two contrasting examples. What can you conclude when standard error bars do not overlap? When standard error confidence interval error bars excel (SE) bars do not overlap, you cannot be sure that the difference between two means is confidence interval matlab statistically significant. Even though the error bars do not overlap in experiment 1, the difference is not statistically significant (P=0.09 by unpaired t test).
95 Confidence Interval Error Bars
This is also true when you compare proportions with a chi-square test. What can you conclude when standard error bars do overlap? No surprises here. When SE bars overlap, (as in experiment 2) you can be sure the difference between the
What Do Error Bars Represent
two means is not statistically significant (P>0.05). What if you are comparing more than two groups? Post tests following one-way ANOVA account for multiple comparisons, so they yield higher P values than t tests comparing just two groups. So the same rules apply. If two SE error bars overlap, you can be sure that a post test comparing those two groups will find no statistical significance. However if two SE error bars do not overlap, you can't tell whether a post what do error bars represent on a graph test will, or will not, find a statistically significant difference. What if the error bars do not represent the SEM? Error bars that represent the 95% confidence interval (CI) of a mean are wider than SE error bars -- about twice as wide with large sample sizes and even wider with small sample sizes. If 95% CI error bars do not overlap, you can be sure the difference is statistically significant (P < 0.05). However, the converse is not true--you may or may not have statistical significance when the 95% confidence intervals overlap. Some graphs and tables show the mean with the standard deviation (SD) rather than the SEM. The SD quantifies variability, but does not account for sample size. To assess statistical significance, you must take into account sample size as well as variability. Therefore, observing whether SD error bars overlap or not tells you nothing about whether the difference is, or is not, statistically significant. What if the groups were matched and analyzed with a paired t test? All the comments above assume you are performing an unpaired t test. When you analyze matched data with a paired t test, it doesn't matter how much scatter each group has -- what matters is the consistency of the changes or differences. Whether or not the error bars for each group overlap tells you nothing about theP valueof a paired t test. What if the error bars represent the confidence interval
CatservEvolutionBlogGreg Laden's BlogLife LinesPage 3.14PharyngulaRespectful InsolenceSignificant Figures by Peter GleickStarts With A BangStoatThe Pump HandleThe Weizmann WaveUncertain PrinciplesUSA Science and Engineering
What Do Large Error Bars Mean
Festival: The BlogWorld's Fair2010 World Science Festival BlogA Blog how to understand error bars Around The ClockAdventures in Ethics and ScienceA Good PoopAll of My Faults Are Stress how to read standard error bars RelatedAngry ToxicologistApplied StatisticsArt of Science LearningA Vote For ScienceBasic Concepts in SciencebioephemeraBlogging the OriginBrookhaven Bits & BytesBuilt on FactsChaotic UtopiaChristina's LIS RantClass MCognitive https://egret.psychol.cam.ac.uk/statistics/local_copies_of_sources_Cardinal_and_Aitken_ANOVA/errorbars.htm DailyCommon KnowledgeCulture DishDean's CornerDeep Sea NewsDeveloping IntelligenceDispatches from the Creation WarsDot PhysicsDr. Joan Bushwell's Chimpanzee RefugeEffect MeasureEruptionsevolgenEvolution for EveryoneEvolving ThoughtsFraming ScienceGalactic InteractionsGene ExpressionGenetic FutureGood Math, Bad MathGreen GabbroGuilty PlanetIntegrity of ScienceIntel ISEFLaelapsLife at the SETI InstituteLive from ESOF 2014Living the Scientific Life (Scientist, Interrupted)Mike the Mad BiologistMixing http://scienceblogs.com/cognitivedaily/2008/07/31/most-researchers-dont-understa-1/ MemoryMolecule of the DayMyrmecosNeuron CultureNeuronticNeurophilosophyNeurotopiaNot Exactly Rocket ScienceObesity PanaceaObservations of a NerdOf Two MindsOmni BrainOn Becoming a Domestic and Laboratory GoddessOscillatorPhoto SynthesisPure PedantryRetrospectacle: A Neuroscience BlogRevolutionary Minds Think TankScience + SocietyScience After SunclipseScience is CultureScienceOnline 2010: The BlogSciencePunkScience To LifeSciencewomenSeed/MoMA SalonSee Jane ComputeShifting BaselinesSignoutSpeakeasy ScienceSpeaking Science 2.0Stranger FruitSuperbugTerra SigillataTetrapod ZoologyThe Blogger SAT ChallengeThe Book of TrogoolThe Cheerful OncologistThe Corpus CallosumThe Examining Room of Dr. CharlesThe Frontal CortexThe IntersectionThe Island of DoubtThe LoomThe Primate DiariesThe Quantum PontiffThe Questionable AuthorityThe Rightful Place ProjectThe ScienceBlogs Book ClubThe Scientific ActivistThe Scientific IndianThe Thoughtful AnimalThe Voltage GateThoughts from KansasThus Spake ZuskaTomorrow's TableTranscription and TranslationUniverseWalt at RandomWe BeastiesWhite Coat UndergroundZooillogix Search National Geographic Search nationalgeographic.com Submit Last 24 HrsLife SciencePhysical ScienceEnvironmentHumanitiesEducationPoliticsMedicineBrain & BehaviorTechnologyInformation ScienceJobs Cognitive Daily Most researchers don't understand error bars Posted by Dave Munger on July 31, 2008 (22) More »
Graphpad.com FAQs Find ANY word Find ALL words Find EXACT phrase What you can conclude when two error bars overlap (or don't)? FAQ# 1362 Last Modified 22-April-2010 It is tempting to look at whether two error bars overlap or not, and try to reach a http://www.graphpad.com/support/faqid/1362/ conclusion about whether the difference between means is statistically significant. Resist that temptation (Lanzante, 2005)! http://www.nature.com/nmeth/journal/v10/n10/full/nmeth.2659.html SD error bars SD error bars quantify the scatter among the values. Looking at whether the error bars overlap lets you compare the difference between the mean with the amount of scatter within the groups. But the t test also takes into account sample size. If the samples were larger with the same means and same standard deviations, the P value would error bars be much smaller. If the samples were smaller with the same means and same standard deviations, the P value would be larger. When the difference between two means is statistically significant (P < 0.05), the two SD error bars may or may not overlap. Likewise, when the difference between two means is not statistically significant (P > 0.05), the two SD error bars may or may not overlap. Knowing whether SD error bars overlap or not does confidence interval error not let you conclude whether difference between the means is statistically significant or not. SEM error bars SEM error bars quantify how precisely you know the mean, taking into account both the SD and sample size. Looking at whether the error bars overlap, therefore, lets you compare the difference between the mean with the precision of those means. This sounds promising. But in fact, you don’t learn much by looking at whether SEM error bars overlap. By taking into account sample size and considering how far apart two error bars are, Cumming (2007) came up with some rules for deciding when a difference is significant or not. But these rules are hard to remember and apply. Here is a simpler rule: If two SEM error bars do overlap, and the sample sizes are equal or nearly equal, then you know that the P value is (much) greater than 0.05, so the difference is not statistically significant. The opposite rule does not apply. If two SEM error bars do not overlap, the P value could be less than 0.05, or it could be greater than 0.05. If the sample sizes are very different, this rule of thumb does not always work. Confidence interval error bars Error bars that show the 95% confidence interval (CI) are wider than SE error bars. It doesn’t help to observe that two 95% CI error b
category Specials, focuses & supplements Authors & referees Guide to authors For referees Submit manuscript Reporting checklist About the journal About Nature Methods About the editors Press releases Contact the journal Subscribe For advertisers For librarians Methagora blog Home archive issue This Month full text Nature Methods | This Month Print Share/bookmark Cite U Like Facebook Twitter Delicious Digg Google+ LinkedIn Reddit StumbleUpon Previous article Nature Methods | This Month The Author File: Jeff Dangl Next article Nature Methods | Correspondence ExpressionBlast: mining large, unstructured expression databases Points of Significance: Error bars Martin Krzywinski1, Naomi Altman2, Affiliations Journal name: Nature Methods Volume: 10, Pages: 921–922 Year published: (2013) DOI: doi:10.1038/nmeth.2659 Published online 27 September 2013 Article tools PDF PDF Download as PDF (269 KB) View interactive PDF in ReadCube Citation Reprints Rights & permissions Article metrics The meaning of error bars is often misinterpreted, as is the statistical significance of their overlap. Subject terms: Publishing• Research data• Statistical methods At a glance Figures View all figures Figure 1: Error bar width and interpretation of spacing depends on the error bar type. (a,b) Example graphs are based on sample means of 0 and 1 (n = 10). (a) When bars are scaled to the same size and abut, P values span a wide range. When s.e.m. bars touch, P is large (P = 0.17). (b) Bar size and relative position vary greatly at the conventional P value significance cutoff of 0.05, at which bars may overlap or have a gap. Full size image View in article Figure 2: The size and position of confidence intervals depend on the sample. On average, CI% of intervals are expected to span the mean—about 19 in 20 times for 95% CI. (a) Means and 95% CIs of 20 samples (n = 10) drawn from a normal population with mean m and s.d. σ. By chance, two of the intervals (red) do not capture the mean. (b) Relationship between s.e.m. and 95% CI error bars with increasing n. Full size image View in article Figure