GraphPad Statistics Guide
Contents
Search
Learn about analyses with Prism
View the Prism 7 User or Regression Guide
How to cite these pages
PRINCIPLES OF STATISTICS
The big picture
When do you need statistical calculations?
The essential concepts of statistics
Extrapolating from 'sample' to 'population'
Why statistics can be hard to learn
Don't be a P-hacker
How to report statistical results
Ordinal, interval and ratio variables
The need for independent samples
Intuitive Biostatistics (the book)
Essential Biostatistics (the book)
The Gaussian distribution
Importance of the Gaussian distribution
Origin of the Gaussian distribution
The Central Limit Theorem of statistics
Standard Deviation and Standard Error of the Mean
Key concepts: SD
Computing the SD
How accurately does a SD quantify scatter?
Key concepts: SEM
Computing the SEM
The SD and SEM are not the same
Advice: When to plot SD vs. SEM
Alternatives to showing the SD or SEM
The lognormal distribution and geometric mean and SD
The lognormal distribution
The geometric mean and geometric SD factor
Confidence intervals
Key concepts: Confidence interval of a mean
Interpreting a confidence interval of a mean
Other confidence intervals
Advice: Emphasize confidence intervals over P values
One sided confidence intervals
Compare confidence intervals, prediction intervals, and tolerance intervals
Confidence interval of a standard deviation
P Values
What is a P value?
The most common misinterpretation of a P value
More misunderstandings of P values
One-tail vs. two-tail P values
Advice: Use two-tailed P values
Advice: How to interpret a small P value
Advice: How to interpret a large P value
Decimal formatting of P values
How Prism computes exact P values
Hypothesis testing and statistical significance
Statistical hypothesis testing
Asterisks
Advice: Avoid the concept of 'statistical significance' when possible
The false discovery rate and statistical signficance
A legal analogy: Guilty or not guilty?
Advice: Don't P-Hack
Advice: Don't keep adding subjects until you hit 'significance'.
Advice: Don't HARK
Statistical power
Key concepts: Statistical Power
An analogy to understand statistical power
Type I, II (and III) errors
Using power to evaluate 'not significant' results
Why doesn't Prism compute the power of tests
Advice: How to get more power
Choosing sample size
Overview of sample size determination
Why choose sample size in advance?
Choosing alpha and beta for sample size calculations
What's wrong with standard values for effect size?
Sample size for nonparametric tests
Multiple comparisons
The problem of multiple comparisons
The multiple comparisons problem
Lingo: Multiple comparisons
Three approaches to dealing with multiple comparisons
Approach 1: Don't correct for multiple comparisons
When it makes sense to not correct for multiple comparisons
Example: Planned comparisons
Fisher's Least Significant Difference (LSD)
Approach 2: Control the Type I error rate for the family of comparisons
What it means to control the Type I error for a family
Multiplicity adjusted P values
Bonferroni and Sidak methods
The Holm-Sidak method
Tukey and Dunnett methods
Dunn's multiple comparisons after nonparametric ANOVA
Newman-Keuls method
Approach 3: Control the False Discovery Rate (FDR)
What it means to control the FDR
Key facts about controlling the FDR
Pros and cons of the three methods used to control the FDR
Testing for equivalence
Key concepts: Equivalence
Testing for equivalence with confidence intervals or P values
Nonparametric tests
Key concepts: Nonparametric tests
Advice: Don't automate the decision to use a nonparametric test
The power of nonparametric tests
Nonparametric tests with small and large samples
Advice: When to choose a nonparametric test
Lingo: The term "nonparametric"
Outliers
An overview of outliers
Advice: Beware of identifying outliers manually
Advice: Beware of lognormal distributions
How it works: Grubb's test
How it works: ROUT method
The problem of masking
Simulations to compare the Grubbs' and ROUT methods
Analysis checklists
Unpaired t test
Paired t test
Ratio t test
Mann-Whitney test
Wilcoxon matched pairs test
One-way ANOVA
Repeated measures one-way ANOVA
Kruskal-Wallis test
Friedman's test
Two-way ANOVA
Repeated measures two-way ANOVA
Contingency tables
Survival analysis
Outliers
STATISTICS WITH PRISM 7
Getting started with statistics with Prism
Statistical analyses with Prism
Guided examples: Statistical analyses
Descriptive statistics and frequency distributions
Column statistics
How to: Column statistics
Analysis checklist: Column statistics
Interpreting results: Quartiles and the interquartile range
Interpreting results: Mean, SD, SEM
Interpreting results: Median and its CI
Interpreting results: Coefficent of Variation
Interpreting results: Geometric mean and median
Interpreting results: Skewness
Interpreting results: Kurtosis
Interpreting results: One-sample t test
Interpreting results: Wilcoxon signed rank test
Interpreting results: Normality tests
Trimmed, windsorized and harmonic mean
Frequency Distributions
Visualizing scatter and testing for normality without a frequency distribution
How to: Frequency distribution
Graphing tips: Frequency distributions
Fitting a Gaussian distribution to a frequency distribution
Describing curves
Smoothing, differentiating and integrating curves
Area under the curve
Row statistics
Overview: Side-by-side replicates
Row means and totals
Normality tests
How to: Normality test
Choosing a normality test
Interpreting results: Normality tests
Q&A: Normality tests
Identifying outliers
How to: Identify outliers
Analysis checklist: Outliers
One sample t test and Wilcoxon signed rank test
How to: One-sample t test and Wilcoxon signed rank test
Interpreting results: One-sample t test
Interpreting results: Wilcoxon signed rank test
t tests, Mann-Whitney and Wilcoxon matched pairs test
Paired or unpaired? Parametric or nonparametric?
Entering data for a t test
Choosing a test to compare two columns
Options for comparing two groups
What to do when the groups have different standard deviations?
Q&A: Choosing a test to compare two groups
The advantage of pairing
Unpaired t test
How to: Unpaired t test from raw data
How to: Unpaired t test from averaged data
Interpreting results: Unpaired t
The unequal variance Welch t test
Graphing tips: Unpaired t
Advice: Don't pay much attention to whether error bars overlap
Analysis checklist: Unpaired t test
Paired or ratio t test
How to: Paired t test
Testing if pairs follow a Gaussian distribution
Interpreting results: Paired t
Analysis checklist: Paired t test
Graphing tips: Paired t
Paired or ratio t test?
How to: Ratio t test
Interpreting results: Ratio t test
Analysis checklist: Ratio t test
Mann-Whitney or Kolmogorov-Smirnov test
Choosing between the Mann-Whitney and Kolmogorov-Smirnov tests
How to: MW or KS test
Interpreting results: Mann-Whitney test
The Mann-Whitney test doesn't really compare medians
Analysis checklist: Mann-Whitney test
Why the results of Mann-Whitney test can differ from prior versions of Prism
Interpreting results: Kolmogorov-Smirnov test
Analysis checklist: Kolmogorov-Smirnov test
Wilcoxon matched pairs test
"The Wilcoxon test" can refer to several statistical tests
How to: Wilcoxon matched pairs test
Results: Wilcoxon matched pairs test
Analysis checklist: Wilcoxon matched pairs test
How to handle rows where the before and after values are identical
Multiple t tests
How to: Multiple t tests
Options for multiple t tests
Interpreting results: Multiple t tests
Multiple comparisons after ANOVA
Overview on followup tests after ANOVA
Which multiple comparisons tests does Prism offer?
Relationship between overall ANOVA and multiple comparisons tests
Relationship between multiple comparisons tests and t tests
Correcting the main ANOVA P values for multiple comparisons
Interpreting results from multiple comparisons after ANOVA
Statistical significance from multiple comparisons
Confidence intervals from multiple comparisons tests
Exact P values from multiple comparisons tests
False Discovery Rate approach to multiple comparisons
Interpreting results: Test for trend
Overview: Test for trend
Results from test for trend
How the test for trend works
How the various multiple comparisons methods work
The pooled standard deviation
The SE of the difference between means
How the Tukey and Dunnett methods work
How the Fisher LSD method works
How the Holm-Sidak method works
How the Bonferroni and Sidak methods work
How the Dunn method for nonparametric comparisons works
How the methods used to control the FDR work
Mathematical details
One-way ANOVA, Kruskal-Wallis and Friedman tests
How to: One-way ANOVA
Entering data for one-way ANOVA and related tests
Experimental design tab: One-way ANOVA
Multiple comparisons tab: One-way ANOVA
Options tab: Multiple comparisons: One-way ANOVA
Options tab: Graphing and output: One-way ANOVA
Q&A: One-way ANOVA
One-way ANOVA results
Interpreting results: One-way ANOVA
Analysis checklist: One-way ANOVA
Repeated-measures one-way ANOVA
What is repeated measures?
Sphericity and compound symmetry
Quantifying violations of sphericity with epsilon
Multiple comparisons after repeated measures one-way ANOVA
Interpreting results: Repeated measures one-way ANOVA
Analysis checklist: Repeated-measures one way ANOVA
Kruskal-Wallis test
Interpreting results: Kruskal-Wallis test
Analysis checklist: Kruskal-Wallis test
Friedman's test
Interpreting results: Friedman test
Analysis checklist: Friedman's test
Two-way ANOVA
How to: Two-way ANOVA
Notes of caution for statistical novices
Deciding which factor defines rows and which defines columns?
Entering data for two-way ANOVA
Entering repeated measures data
Missing values and two-way ANOVA
Point of confusion: ANOVA with a quantitative factor
Experimental design tab: Two-way ANOVA
Multiple comparisons tab: Two-way ANOVA
Options tab: Multiple comparisons: Two-way ANOVA
Options tab: Graphing and output: Two-way ANOVA
Summary of multiple comparisons available (two-way)
Q&A: Two-way ANOVA
Ordinary (not repeated measures) two-way ANOVA
Interpreting results: Two-way ANOVA
Graphing tips: Two-way ANOVA
Beware of using multiple comparisons tests to compare dose-response curves or time courses
How Prism computes two-way ANOVA
When there are only two rows
Analysis checklist: Two-way ANOVA
Repeated measures two-way ANOVA
Interpreting results: Repeated measures two-way ANOVA
ANOVA table in two ways RM ANOVA
Graphing tips: Repeated measures two-way ANOVA
Analysis checklist: Repeated measures two-way ANOVA
Three-way ANOVA
How to: Three-way ANOVA
Note of caution for statistical novices
What is three-way ANOVA used for?
Three way ANOVA may not answer your scientific questions
Limitations of three-way ANOVA in Prism
Entering data for three-way ANOVA
Factor names tab: Three-way ANOVA
Multiple comparisons tab: Three-way ANOVA
Options tab: Multiple comparisons: Three-way ANOVA
Options tab: Graphing and output: Three-way ANOVA
Consolidate tab: Three-way ANOVA
Interpreting results: Three-way ANOVA
Interpreting results: Three-way ANOVA
Analysis checklist: Three-way ANOVA
Categorical outcomes
The Confidence Interval of a proportion
How Prism can compute a confidence interval of a proportion
Three methods for computing the CI of a proportion
The meaning of “95% confidence” when the numerator is zero
What are binomial variables
Contingency tables
Key concepts: Contingency tables
How to: Contingency table analysis
Fisher's test or chi-square test?
Interpreting results: P values from contingency tables
Interpreting results: Attributable risk
Interpreting results: Relative risk
Interpreting results: Odds ratio
Interpreting results: Sensitivity and specificity
Analysis checklist: Contingency tables
Graphing tips: Contingency tables
Compare observed and expected distributions
How to: Compare observed and expected distributions
How the chi-square goodness of fit test works
The binomial test
McNemar's test
Don't confuse with related analyses
Analysis Checklist: Comparing observed and expected distributions
Survival analysis
Key concepts. Survival curves
How to: Survival analysis
Q & A: Entering survival data
Example of survival data from a clinical study
Example of survival data from an animal study
Analysis choices for survival analysis
Interpreting results: Survival fractions
What determines how low a survival curve gets?
Interpreting results: Number at risk
Interpreting results: P Value
Interpreting results: The hazard ratio
Interpreting results: Ratio of median survival times
Interpreting results: Comparing >2 survival curves
The logrank test for trend
Multiple comparisons of survival curves
Analysis checklist: Survival analysis
Graphing tips: Survival curves
Q&A: Survival analysis
Determining the median followup time
Correlation
Key concepts: Correlation
How to: Correlation
Interpreting results: Correlation
Analysis checklist: Correlation
Correlation matrix
The difference between correlation and regression
Diagnostic lab analyses
ROC Curves
Key concepts: Receiver-operating characteristic (ROC) curves
How to: ROC curve
Interpreting results: ROC curves
Analysis checklist: ROC curves
Calculation details for ROC curves
Computing predictive values from a ROC curve
Comparing ROC curves
Comparing Methods with a Bland-Altman Plot
How to: Bland-Altman plot
Interpreting results: Bland-Altman
Analysis checklist: Bland-Altman results
Analyzing a stack of P values
Key concepts: Analyzing a stack P values
How to: Analyzing a stack of P values
Interpreting results: Analyzing a stack of P values
Simulating data and Monte Carlo simulations
Simulating a data table
How to: Monte Carlo analyses
Monte Carlo example: Power of unpaired t test
© 1995-2017 GraphPad Software, Inc.