Statistics · Unit 3: Collecting Data · 14 min read · Updated 2026-05-11
Sources of Bias in Sampling — AP Statistics
AP Statistics · Unit 3: Collecting Data · 14 min read
1. Core Definition of Sampling Bias★★☆☆☆⏱ 3 min
Bias in sampling is a systematic error that causes a sample statistic to consistently overestimate or underestimate the true population parameter, unlike random sampling error which fluctuates around the true value without consistent direction. The AP Statistics Course and Exam Description (CED) allocates 12-15% of total exam weight to Unit 3 (Collecting Data), and sources of bias is one of the most frequently tested subtopics, appearing in both multiple-choice (MCQ) and free-response (FRQ) sections.
2. Selection Bias: Undercoverage and Voluntary Response★★☆☆☆⏱ 4 min
Undercoverage bias occurs when the sampling frame leaves out entire groups of the population entirely, so those groups have no chance of being selected for the sample. For example, if you study average income of all city residents by only sampling people at a downtown grocery store on weekday mornings, you miss full-time workers who cannot shop during those hours and low-income residents without reliable transportation to downtown, leading to an overestimate of average city income.
Voluntary response bias is a common and heavily tested subtype where the entire sample consists only of people who choose to volunteer to participate. People with strong, often negative, opinions are much more likely to participate, so the sample consistently overrepresents extreme views.
Exam tip: On AP FRQs, you will never get full credit for only naming the type of bias. You must always connect the bias to the specific context of the problem to earn all points.
3. Nonresponse Bias★★★☆☆⏱ 3 min
This is a common point of confusion with selection bias subtypes: in nonresponse bias, you start with a properly selected random sample, but some selected people do not participate after selection. This differs from undercoverage, where groups are never given a chance to be selected at all, and voluntary response, where the entire sample is self-selected from the start.
Exam tip: Always ask: were missing groups excluded at the selection stage, or were they selected but did not respond? Exclusion at selection = undercoverage; selected but missing = nonresponse.
4. Response Bias★★★☆☆⏱ 4 min
Common causes of response bias tested on the AP exam include leading questions (wording that pushes respondents to answer a certain way), social desirability bias (people give answers that make them look good, even if untrue), and recall bias (people cannot accurately remember past behavior).
Exam tip: If the question asks about the wording of a survey question, it is almost always response bias, not a selection bias. Always state whether the parameter will be over- or underestimated in context to earn full credit.
5. AP-Style Concept Check★★★★☆⏱ 4 min
Common Pitfalls
Why: Students confuse the order of selection: in nonresponse, people are selected first then don't respond; in voluntary response, the entire sample is self-selected from the start
Why: Students confuse random sampling error (which decreases with larger sample size) with systematic bias (which is a design flaw)
Why: Both result in groups being missing from the final sample, but the stage at which they are excluded is different
Why: Students memorize bias names but forget AP requires context-specific reasoning for points
Why: Students group all biases together, but response bias occurs after the sample is selected, during data collection