﻿ Interpreting results: Unpaired t

# Interpreting results: Unpaired t

## Difference between means

The unpaired t test compares the means of two groups. Note that this test is often called independent samples t test.

The most useful result is the confidence interval for the difference between the means. The point of the experiment was to see how far apart the two means are. The confidence interval tells you how precisely you know that difference. If the assumptions of the analysis are true, you can be 95% confident that the 95% confidence interval contains the true difference between the means.

For many purposes, this confidence interval is all you need. Note that you can change the sign of the differences in the Options tab of the t test dialog, where you can tell Prism to subtract column B from A, or A from B.

Prism also reports the difference between the two means with the standard error of that difference.

P value

The P value is used to ask whether the difference between the mean of two groups is likely to be due to chance. It answers this question:

If the two populations really had the same mean, what is the chance that random sampling would result in means as far apart (or more so) than observed in this experiment?

It is traditional, but not necessary and often not useful, to use the P value to make a simple statement about whether or not the difference is “statistically significant”.

You will interpret the results differently depending on whether the P value is small or large.

t ratio

To calculate a P value for an unpaired t test, Prism first computes a t ratio. The t ratio is the difference between sample means divided by the standard error of the difference, calculated by combining the SEMs of the two groups. If the difference is large compared to the SE of the difference, then the t ratio will be large (or a large negative number), and the P value is small. The sign of the t ratio indicates only which group had the larger mean. The P value is derived from the absolute value of t. Prism reports the t ratio so you can compare with other programs, or examples in text books. In most cases, you'll want to focus on the confidence interval and P value, and can safely ignore the value of the t ratio.

For the unpaired t test, the number of degrees of freedom (df) equals the total sample size minus 2. Welch's t test (a modification of the t test which doesn't assume equal variances) calculates df from a complicated equation.

## F test for unequal variance

The unpaired t test depends on the assumption that the two samples come from populations that have identical standard deviations (and thus identical variances). Prism tests this assumption using an F test.

First compute the standard deviations of both groups, and square them both to obtain variances. The F ratio equals the larger variance divided by the smaller variance. So F is always greater than (or possibly equal to) 1.0.