How far can a conclusion go?
You will be able to: Distinguish population generalization from causal inference and explain confounding.
How far can a conclusion go?
A school randomly surveys 100 students about music practice and grades. The sample may represent the school, but the researcher did not assign music practice.
A useful starting point: Should you observe, survey or experiment? →
Words and symbols before equations
- Random selection
- A chance mechanism chooses units from a population.
- Random assignment
- A chance mechanism assigns treatments to study units.
- Confounding variable
- A variable connected to both the explanatory variable and response that offers an alternative explanation.
- Generalization
- Extending findings beyond the observed sample.
What this picture assumes
This design map assumes competent implementation, suitable ethical safeguards and valid measurement. Random assignment supports causal analysis; a real effect still requires evidence beyond chance variation.
Read the picture in three steps
- Read the axes and labels first. Identify what each symbol and line represents. Read the units and fixed conditions before comparing quantities.
- Population scope: No representative selection: limit generalization. Causal scope: No random assignment: confounding remains. Still required: Valid measurements, ethics and chance-aware analysis.
- Check what the picture assumes below. Use the Explore task to predict one change before moving a control.
Connect the picture to the mathematics
Random selection supports inference to the population sampled, provided coverage, nonresponse and measurement are handled. It does not turn an association into causation.
Random assignment in a well-designed experiment reduces systematic confounding and supports causal conclusions when the analysis accounts for chance variation. It does not guarantee perfectly balanced groups or a real effect in every study.
With volunteers, a causal conclusion may apply to participants and people sufficiently similar to them, but it is not automatically representative of everyone. State both limits explicitly. In the music example, prior motivation could influence both practice and grades.
| Feature | Random selection | Random assignment |
|---|---|---|
| What chance chooses | Who enters the sample | Which treatment units receive |
| Main purpose | Population representation | Reduce confounding |
| Does not ensure | Causation | Population representation |
A worked example, step by step
A representative random sample is surveyed about exercise and mood; no exercise is assigned. Evaluate “Exercise caused improved mood in all adults.”
- The design is observational, since exercise is not imposed.
- Random selection supports population generalization to the actual sampling population, subject to collection quality.
- Health or work conditions could affect both exercise and mood, so confounding remains.
- Replace the causal assertion with an association in the sampled population; do not generalize to populations outside the frame.
“Random” must identify what was randomized: selection or assignment. Neither alone licenses every conclusion.
Can a large observational study alone remove confounding?
Compare with an explanation
No. A larger sample can estimate an association more precisely while leaving alternative explanations intact.
Predict. Change one thing. Explain.
Inspect all four combinations of selection and assignment. For each, write a defensible conclusion and one limitation.
On narrow screens, swipe or scroll diagrams sideways to read all labels.
Population scope: No representative selection: limit generalization. Causal scope: No random assignment: confounding remains. Still required: Valid measurements, ethics and chance-aware analysis.
| Question | Conclusion |
|---|---|
| Population scope | No representative selection: limit generalization. |
| Causal scope | No random assignment: confounding remains. |
| Still required | Valid measurements, ethics and chance-aware analysis. |
This design map assumes competent implementation, suitable ethical safeguards and valid measurement. Random assignment supports causal analysis; a real effect still requires evidence beyond chance variation.
Explain what you noticed: Answer the investigation prompt above. State one observation and explain it using the data values, graph scales, summary statistics or study-design conditions. Identify what the representation cannot tell you.
Apply the idea to a fresh problem Practice →Show what you understand.
Two original questions are a starting check, not proof of mastery. Explain your choice before revealing the answer.
Original written challenge
4 points · self-check · not an official AP questionEighty volunteers are randomized to two reminder formats. One format has a higher response rate. State what must be checked before a causal claim and its scope.
This response is not submitted or saved. Copy it before leaving.
Compare with the answer and four-point rubric
- 1 point: Identify random assignment as the basis for causal comparison.
- 1 point: Check that the design controls other conditions and measurements appropriately.
- 1 point: Assess whether the difference could reasonably result from chance; the observed difference alone is insufficient.
- 1 point: Limit generalization to participants or sufficiently similar people, not automatically the entire public.
Accept equivalent correct methods and explanations. This is a Refresh Kid teaching rubric, not an official AP scoring guideline.
Retrieve it before you reveal it.
RECALL 1What supports broad population inference?
An appropriate random selection process with sound implementation.
RECALL 2What supports causal inference?
Random assignment in a well-designed experiment with appropriate analysis.
RECALL 3What must a proposed confounder connect to?
Both the explanatory variable and the response.
Revisit these tomorrow and a week later. Try a fresh problem and explain why the method applies.
How far can a conclusion go?
- Random selection → population inference.
- Random assignment → causal inference with suitable analysis.
- Neither implies a guaranteed effect or unlimited generalization.
Remember: “Random” must identify what was randomized: selection or assignment. Neither alone licenses every conclusion.
Conditions: This design map assumes competent implementation, suitable ethical safeguards and valid measurement. Random assignment supports causal analysis; a real effect still requires evidence beyond chance variation.
Refresh Kid · AP Statistics Unit 1 · Objectives 1.10.E, 1.13.D · Review edition
Framework, scope and review status
Mapped to College Board, AP Statistics CED, Topic 1.10, objectives 1.10.E, 1.13.D. Framework effective Fall 2026, checked September 17, 2026. Unit 1 includes one-variable data and data collection; it is part of the revised five-unit course.
Examples and datasets are synthetic, independently authored teaching material. Quartile calculations state a median-of-halves convention. Outlier screens identify values to investigate, not data to discard. Random selection and random assignment have different inferential roles. These lessons introduce design and descriptive reasoning; formal inference comes in later units.
The Organic Chemistry Tutor companion title and destination were checked; the full video was not reviewed. Khan Academy’s destination was checked, but its lesson content was not fully readable by the research tool. OpenStax provides optional reference reading. No provider scripts, questions or graphics were copied. Refresh Kid is not affiliated with these providers.
GitHub’s 3D website collection informed optional spatial inspection. Our original sampling model uses self-hosted Three.js with its MIT license. It shows labeled units in four groups; camera rotation does not change the sampling procedure. Quantitative graphs remain 2D to avoid perspective distortion. Complete labeled diagrams, selected IDs and explanations remain available without 3D.
Independent teacher review and observation of students remain pending. Technical checks do not certify statistical accuracy, accessibility or learning effectiveness. This is a review edition.
Released AP Statistics questions and scoring guides are optional. Older exams use the earlier framework, so check alignment before selecting parts. All practice on this page is original, not official AP material.
Learn → Explore → Practice → Review is informed by the IES learning guide. This implementation has not yet been evaluated with learners.
Want to work through this with a tutor?
Bring your question about How far can a conclusion go? Your explanation and answers remain free to access.