What does confidence say about the population average?
You will be able to: Interpret coverage and evaluate a claimed mean without overstating certainty.
What does confidence say about the population average?
A 95% interval for average club travel time is (18,22) minutes. A claim of a 20-minute mean is compatible with that interval; a claim of 25 minutes is not.
A useful starting point: Why should before-and-after measurements stay paired? →
Words and symbols before equations
- Confidence level
- The method’s long-run fraction of intervals capturing the fixed parameter.
- Compatible value
- A parameter value inside the computed interval.
- Population mean
- The fixed average being estimated.
- Repeated sampling
- New random samples of the same size from the same population.
What this picture assumes
100 independent simulated samples from a normal population with μ=20 and σ=5 minutes. Each interval estimates σ with its own s and uses t with n−1 df. All 100 intervals enter the table and capture count; the picture shows the first 20. Finite simulation coverage need not equal the confidence level.
Read the picture in three steps
- Read the axes and labels first. Identify what each symbol and line represents. Read the units and fixed conditions before comparing quantities.
- 96 of 100 intervals capture μ=20 minutes at nominal 95% confidence. A finite run does not guarantee the nominal percentage.
- Check what the picture assumes below. Use the Explore task to predict one change before moving a control.
Connect the picture to the mathematics
A contextual interpretation is: we are 95% confident that the population mean travel time lies between 18 and 22 minutes. The parameter is fixed; endpoints vary across samples.
This is not a statement that 95% of individual travel times fall between 18 and 22. Individual outcomes are usually more variable than sample means.
For the same model, a two-sided 95% t interval excludes exactly the null values rejected by a two-sided 5% t test. Inclusion does not prove a null value true; many nearby values remain compatible.
A worked example, step by step
Interpret a 95% paired interval of (−4,−1) minutes for after−before travel time.
- The target is μd, the population mean after-minus-before difference.
- The entire interval is negative.
- We are 95% confident the mean difference lies between −4 and −1 minutes.
- This supports a lower average after time, but causation depends on the study design.
A fixed interval does not give a frequentist 95% probability that a fixed μ moves into it.
Does an interval containing zero prove no difference?
Compare with an explanation
No. It says zero remains compatible at this confidence level.
Predict. Change one thing. Explain.
Generate 100 intervals from a known normal population. Compare the observed capture percentage with the selected confidence level; explain why they need not match exactly.
On narrow screens, swipe or scroll diagrams sideways to read all labels.
96 of 100 intervals capture μ=20 minutes at nominal 95% confidence. A finite run does not guarantee the nominal percentage.
| Sample | Lower (min) | Upper (min) | Captures μ=20? |
|---|---|---|---|
| 1 | 18.8975 | 23.5126 | Yes |
| 2 | 18.7347 | 23.0804 | Yes |
| 3 | 17.8425 | 22.6883 | Yes |
| 4 | 18.0861 | 21.3421 | Yes |
| 5 | 17.7218 | 20.8553 | Yes |
| 6 | 17.0638 | 21.604 | Yes |
| 7 | 15.988 | 20.3875 | Yes |
| 8 | 16.1198 | 20.3819 | Yes |
| 9 | 18.1756 | 22.1905 | Yes |
| 10 | 15.9605 | 20.2365 | Yes |
| 11 | 17.8335 | 21.6735 | Yes |
| 12 | 17.0897 | 21.4468 | Yes |
| 13 | 18.4774 | 22.5961 | Yes |
| 14 | 19.4894 | 23.8458 | Yes |
| 15 | 18.7645 | 23.1272 | Yes |
| 16 | 17.7946 | 21.6868 | Yes |
| 17 | 18.5756 | 23.2333 | Yes |
| 18 | 17.3953 | 21.2206 | Yes |
| 19 | 16.8406 | 20.984 | Yes |
| 20 | 16.7925 | 20.9225 | Yes |
| 21 | 18.3597 | 22.8752 | Yes |
| 22 | 18.3518 | 21.991 | Yes |
| 23 | 17.2169 | 21.6704 | Yes |
| 24 | 18.0507 | 21.9466 | Yes |
| 25 | 18.4 | 22.8014 | Yes |
| 26 | 18.064 | 22.1571 | Yes |
| 27 | 18.2538 | 22.5797 | Yes |
| 28 | 19.3031 | 23.6066 | Yes |
| 29 | 15.0026 | 19.8986 | No |
| 30 | 17.7262 | 21.7713 | Yes |
| 31 | 17.0447 | 20.0354 | Yes |
| 32 | 18.2383 | 22.8216 | Yes |
| 33 | 17.7975 | 22.6704 | Yes |
| 34 | 19.7296 | 23.9763 | Yes |
| 35 | 18.6227 | 22.3499 | Yes |
| 36 | 18.4677 | 23.4572 | Yes |
| 37 | 19.6579 | 24.2105 | Yes |
| 38 | 16.9453 | 21.5821 | Yes |
| 39 | 18.5129 | 22.5069 | Yes |
| 40 | 18.027 | 21.6027 | Yes |
| 41 | 16.9845 | 20.7604 | Yes |
| 42 | 15.5328 | 19.3021 | No |
| 43 | 19.2746 | 23.5332 | Yes |
| 44 | 18.1637 | 22.8353 | Yes |
| 45 | 18.5973 | 22.8874 | Yes |
| 46 | 16.4467 | 21.1382 | Yes |
| 47 | 16.7948 | 21.7813 | Yes |
| 48 | 17.2166 | 22.6895 | Yes |
| 49 | 16.4758 | 21.0106 | Yes |
| 50 | 17.6524 | 22.0781 | Yes |
| 51 | 17.3816 | 21.6052 | Yes |
| 52 | 17.9719 | 21.0999 | Yes |
| 53 | 18.6395 | 22.3124 | Yes |
| 54 | 17.9558 | 20.9767 | Yes |
| 55 | 17.0836 | 20.9457 | Yes |
| 56 | 17.4015 | 21.2105 | Yes |
| 57 | 17.69 | 21.7659 | Yes |
| 58 | 15.6526 | 21.4663 | Yes |
| 59 | 19.5219 | 23.982 | Yes |
| 60 | 18.9004 | 22.5688 | Yes |
| 61 | 19.6134 | 23.6617 | Yes |
| 62 | 16.3496 | 21.8984 | Yes |
| 63 | 19.264 | 23.1745 | Yes |
| 64 | 16.487 | 21.2069 | Yes |
| 65 | 17.1175 | 21.4524 | Yes |
| 66 | 16.3869 | 20.7087 | Yes |
| 67 | 19.0229 | 22.608 | Yes |
| 68 | 17.6458 | 21.6084 | Yes |
| 69 | 17.7388 | 21.1978 | Yes |
| 70 | 17.2022 | 21.02 | Yes |
| 71 | 17.1758 | 20.7719 | Yes |
| 72 | 16.4862 | 21.2129 | Yes |
| 73 | 17.1136 | 21.7954 | Yes |
| 74 | 15.624 | 20.4296 | Yes |
| 75 | 15.8464 | 20.9263 | Yes |
| 76 | 19.1863 | 23.0146 | Yes |
| 77 | 18.2942 | 22.0542 | Yes |
| 78 | 16.8467 | 19.4962 | No |
| 79 | 18.0533 | 22.4398 | Yes |
| 80 | 19.7269 | 24.3421 | Yes |
| 81 | 17.9008 | 22.2198 | Yes |
| 82 | 17.8025 | 21.3578 | Yes |
| 83 | 17.7771 | 22.6215 | Yes |
| 84 | 16.5074 | 20.9143 | Yes |
| 85 | 17.9465 | 22.4297 | Yes |
| 86 | 18.528 | 23.0863 | Yes |
| 87 | 16.4319 | 20.3736 | Yes |
| 88 | 19.4577 | 22.6564 | Yes |
| 89 | 17.9069 | 22.9669 | Yes |
| 90 | 17.5261 | 21.6817 | Yes |
| 91 | 18.9772 | 22.4774 | Yes |
| 92 | 17.9627 | 23.3519 | Yes |
| 93 | 20.1718 | 23.7204 | No |
| 94 | 17.6272 | 21.1703 | Yes |
| 95 | 17.6792 | 22.0565 | Yes |
| 96 | 17.6332 | 22.3496 | Yes |
| 97 | 18.713 | 22.6021 | Yes |
| 98 | 17.0762 | 21.4552 | Yes |
| 99 | 18.6259 | 22.379 | Yes |
| 100 | 17.6688 | 21.0252 | Yes |
100 independent simulated samples from a normal population with μ=20 and σ=5 minutes. Each interval estimates σ with its own s and uses t with n−1 df. All 100 intervals enter the table and capture count; the picture shows the first 20. Finite simulation coverage need not equal the confidence level.
Explain what you noticed: Answer the investigation prompt above. State one observation and explain it using the means, standard errors, pairing, graph scales or model assumptions. Identify what the representation cannot tell you.
Apply the idea to a fresh problem Practice →Show what you understand.
Two original questions are a starting check, not proof of mastery. Explain your choice before revealing the answer.
Original written challenge
4 points · self-check · not an official AP questionA 90% interval for μ is (40,46) minutes. Assess claims μ=43 and μ=50 and state what 90% means.
This response is not submitted or saved. Copy it before leaving.
Compare with the answer and four-point rubric
- 1 point: 43 is inside the interval and compatible.
- 1 point: 50 is outside and not compatible with this interval.
- 1 point: 90% describes long-run coverage of the interval procedure.
- 1 point: Neither conclusion assigns probabilities to the fixed parameter or to individual observations.
Accept equivalent correct methods and explanations. This is a Refresh Kid teaching rubric, not an official AP scoring guideline.
Retrieve it before you reveal it.
RECALL 1Does every 95% interval capture μ?
No.
RECALL 2What changes over repeated samples?
The calculated endpoints.
RECALL 3What remains fixed?
The population parameter under the model.
Revisit these tomorrow and a week later. Try a fresh problem and explain why the method applies.
What does confidence say about the population average?
- Confidence refers to repeated-sample coverage.
- Interpret the parameter and units.
- Zero inside a difference interval is compatible with no mean difference.
Remember: A fixed interval does not give a frequentist 95% probability that a fixed μ moves into it.
Conditions: 100 independent simulated samples from a normal population with μ=20 and σ=5 minutes. Each interval estimates σ with its own s and uses t with n−1 df. All 100 intervals enter the table and capture count; the picture shows the first 20. Finite simulation coverage need not equal the confidence level.
Refresh Kid · AP Statistics Unit 4 · Objectives 4.3.A, 4.3.B · Review edition
Framework, scope and review status
Mapped to College Board, AP Statistics CED, Topic 4.3, objectives 4.3.A, 4.3.B. Framework effective Fall 2026, checked September 17, 2026. Unit 4 includes sampling distributions of means, one-sample and paired t inference, and independent two-sample t inference; it is part of the revised five-unit course.
Examples and datasets are synthetic, independently authored teaching material. Mean inference requires a justified design and suitable shape or sample size. Paired analysis uses one sample of differences. Independent two-sample inference uses separate variance estimates and technology-computed Welch degrees of freedom. Extreme skewness and influential observations need attention even in larger samples. This model conservatively withholds inference when those warnings are selected. Conclusions are limited by random sampling and/or assignment as appropriate.
The Organic Chemistry Tutor companion title and destination were located; the full video was not reviewed. Khan Academy’s destination was checked, but its lesson content was not fully readable by the research tool. OpenStax provides optional reference reading. No provider scripts, questions or graphics were copied. Refresh Kid is not affiliated with these providers.
GitHub’s 3D website collection informed optional spatial inspection. Our original paired-data display uses self-hosted Three.js with its MIT license. Two measurement columns are connected within each labeled student lane; horizontal position is before/after, vertical position is time, and depth separates identities rather than representing a numerical variable. Rotation can separate overlapping connectors. Exact values and differences always remain in the 2D table and labeled plot. The broken-matching option is an explicit counterexample, not a legitimate alternative analysis. No autoplay; complete teaching remains available without 3D.
Independent teacher review and observation of students remain pending. Technical checks do not certify statistical accuracy, accessibility or learning effectiveness. This is a review edition.
Released AP Statistics questions and scoring guides are optional. Older exams use the earlier framework, so check alignment before selecting parts. All practice on this page is original, not official AP material.
Learn → Explore → Practice → Review is informed by the IES learning guide. This implementation has not yet been evaluated with learners.
Want to work through this with a tutor?
Bring your question about What does confidence say about the population average? Your explanation and answers remain free to access.
