Mastering Sampling Distributions and the Central Limit Theorem

In A-Level Statistics, we often want to understand the characteristics of a large population, but measuring every individual is rarely practical. Instead, we take a sample and calculate a statistic, such as the sample mean. However, if you took a different sample, you would likely get a different mean. This variation is the foundation of sampling distributions.

By the end of this article, you will understand how the Central Limit Theorem (CLT) allows us to predict the behaviour of these sample means, even when the underlying population distribution is unknown. This is a cornerstone of inferential statistics and a frequent topic in your examinations.

Understanding Sampling Distributions

A sampling distribution is the probability distribution of a statistic (like the mean) obtained from a large number of samples drawn from a specific population. If we take every possible sample of size $n$ from a population with mean $\mu$ and standard deviation $\sigma$, the distribution of these sample means, denoted by $\overline{X}$, has its own properties:

1. The mean of the sampling distribution is equal to the population mean: $\mu_{\overline{X}} = \mu$.
2. The standard deviation of the sampling distribution (often called the standard error) is $\sigma_{\overline{X}} = \frac{\sigma}{\sqrt{n}}$.

The Central Limit Theorem Explained

The Central Limit Theorem is a powerful result in statistics. It states that for a sufficiently large sample size ($n \geq 30$ is a common rule of thumb), the sampling distribution of the sample mean will be approximately normally distributed, regardless of the shape of the original population distribution.

This is remarkable because it means that even if your population data is skewed or follows a non-normal distribution, the averages of samples taken from that population will cluster around the true mean in a bell-shaped curve. As $n$ increases, the approximation to the normal distribution becomes more accurate.

Worked Example 1: Calculating Probabilities for Sample Means

Suppose a population of test scores has a mean $\mu = 70$ and a standard deviation $\sigma = 12$. We take a random sample of $n = 36$ students. What is the probability that the sample mean $\overline{X}$ is greater than 74?

Step 1: Identify the parameters of the sampling distribution. $\mu_{\overline{X}} = 70$ $\sigma_{\overline{X}} = \frac{\sigma}{\sqrt{n}} = \frac{12}{\sqrt{36}} = \frac{12}{6} = 2$

Step 2: Standardise the value using the Z-score formula. $Z = \frac{\overline{X} - \mu_{\overline{X}}}{\sigma_{\overline{X}}} = \frac{74 - 70}{2} = \frac{4}{2} = 2$

Step 3: Find the probability. Using standard normal distribution tables, $P(Z > 2) = 1 - P(Z < 2) = 1 - 0.9772 = 0.0228$.

Sampling Distributions for Proportions

When dealing with categorical data, we look at the sample proportion $\hat{p}$. If we take a sample of size $n$ from a population with proportion $p$, the sampling distribution of $\hat{p}$ is approximately normal if $np \geq 10$ and $n(1-p) \geq 10$. The mean is $\mu_{\hat{p}} = p$ and the standard error is $\sigma_{\hat{p}} = \sqrt{\frac{p(1-p)}{n}}$.

Worked Example 2: Sample Proportions

A factory claims that 10% of its products are defective ($p = 0.1$). In a random sample of 100 products, what is the probability that the sample proportion $\hat{p}$ is less than 0.08?

Step 1: Check conditions. $np = 100 \times 0.1 = 10$ and $n(1-p) = 100 \times 0.9 = 90$. Both are $\geq 10$, so we can use the normal approximation.

Step 2: Calculate standard error. $\sigma_{\hat{p}} = \sqrt{\frac{0.1 \times 0.9}{100}} = \sqrt{0.0009} = 0.03$

Step 3: Calculate Z-score and probability. $Z = \frac{0.08 - 0.1}{0.03} = \frac{-0.02}{0.03} \approx -0.667$ $P(Z < -0.667) \approx 0.2525$.

Common Mistakes

• Confusing $\sigma$ with $\sigma_{\overline{X}}$: Always remember to divide the population standard deviation by $\sqrt{n}$ when working with sample means.
• Ignoring the sample size: The CLT only applies when the sample size is sufficiently large or the population is already normal.
• Misapplying the proportion formula: Ensure you use $\sqrt{\frac{p(1-p)}{n}}$ for proportions, not the formula for means.

Frequently Asked Questions

Does the CLT work if the population is not normal? Yes, that is the beauty of the theorem; it works for any distribution provided the sample size is large enough. What is the standard error? It is the standard deviation of the sampling distribution, representing how much the sample statistic varies from sample to sample. Why is $n=30$ often used? It is a general heuristic in statistics for when the normal approximation becomes reliable for most population shapes.

Conclusion

Understanding sampling distributions and the Central Limit Theorem is essential for mastering A-Level Statistics. By grasping how sample statistics behave, you can confidently tackle complex inferential problems. To see these concepts in motion, visit MathInstructor AI to generate a free, narrated animated lesson on this topic today.