﻿ Experimental design tab: t tests

# Experimental design tab: t tests

Prism offers seven related tests that compare two groups. To choose among these tests, answer three questions in the Experimental Design tab of the t test parameters dialog:

## Experimental design: unpaired or paired

Choose a paired test when the columns of data are matched. That means that values on the same row are related to each other.

Here are some examples:

You measure a variable in each subject before and after an intervention.

You recruit subjects as pairs, matched for variables such as age, ethnic group, and disease severity. One of the pair gets one treatment; the other gets an alternative treatment.

You run a laboratory experiment several times, each time with a control and treated preparation handled in parallel.

You measure a variable in twins or child/parent pairs.

Matching should be determined by the experimental design, and definitely should not be based on the variable you are comparing. If you are comparing blood pressures in two groups, it is OK to match based on age or postal code, but it is not OK to match based on blood pressure.

## Assume Gaussian distribution?

Nonparametric tests, unlike t tests, are not based on the assumption that the data are sampled from a Gaussian distribution. But nonparametric tests have less power. Deciding when to use a nonparametric test is not straightforward.

## Choose test

After defining the experimental design, and the general approach (parametric or nonparametric), you need to decide exactly what test you want Prism to perform.

### Parametric, not paired

Decide whether to accept the assumption that the two samples come from populations with the same standard deviations (same variances). This is a standard assumption of the unpaired t test. If don't wish to make this assumption, Prism will perform the unequal variance (Welch) unpaired t test.

### Parametric, paired

Choose the paired t test (which is standard in this situation) or the ratio t test (which is less standard). Choose the paired t test when you expect the differences between paired values to be a consistent measure of treatment effect. Choose the ratio paired t test when you expect the ratio of paired values to be a consistent measure of treatment effect.

### Nonparametric, not paired

Prism offers two choices: The Mann-Whitney test (which Prism has always offered) and the Kolmogorov-Smirnov test (which is new). It is hard to offer guidelines for choosing one test vs. the other except to follow the tradition of your lab or field. The main difference is that the Mann-Whitney test has more power to detect a difference in the median, but the Kolmogorov-Smirnov test has more power to detect differences in the shapes of the distributions.

 Mann-Whitney test Kolmogorov-Smirnov test Power to detect a shift in the median More power Less power Power to detect differences in the shape of the distributions Less power More power

### Nonparametric, paired

In this case there is no choice.  Prism will perform the Wilcoxon matched pairs test.