What a natural experiment is
Natural experiment
An experiment in which the independent variable varies naturally and is not manipulated by the researcher, who simply records its effect on the dependent variable.
- In a natural experiment the independent variable changes on its own and nobody sets it.
- You find a difference or an event that already exists and measure its effect on the dependent variable.
- The independent variable is usually a real event, such as a school moving its start time, or an existing difference between people, such as which hand they write with.
Telling the three experiments apart
- In a laboratory experiment the researcher sets the independent variable in a controlled setting, and trades realism for confidence about cause.
- In a field experiment the researcher still sets the independent variable but does it in an everyday setting, and trades control for realism.
- In a natural experiment nobody sets the independent variable at all, whatever the setting, and the trade is access to the variable in exchange for any firm claim about cause.
- Do not describe the researcher as creating the conditions in a natural experiment, because those conditions already existed.
- Do not write that a natural experiment shows the independent variable caused the difference.
Why cause is harder to claim
- Because you did not set the independent variable, the groups you compare may differ in other ways you never measured.
- You also cannot allocate people to conditions, since the groups were formed long before you arrived.
- So you can report a difference and suggest a link, but a rival explanation always stays open.
- Suppose a school moves its start time from 8.45 to 9.30 and you compare pupils' concentration in the term before with the term after.
- The later start is an independent variable you could never have imposed yourself, so a natural experiment is the only way in.
- The trouble is that the timetable, the darker mornings and the pupils' own year all changed alongside it.
Strengths
- It reaches variables no other method can, because some independent variables cannot be manipulated for practical reasons and others must not be for ethical ones.
- The behaviour is genuinely real, because the event or difference is part of people's actual lives rather than something staged.
Weaknesses
- Control is almost absent, so any number of things besides the independent variable could be producing the result you see.
- The opportunities are rare, because you have to wait for the right event and cannot recreate it, which leaves the finding untested by replication.
When to choose a natural experiment
- Choose it when manipulating the independent variable is impossible, as with an existing difference between people.
- Choose it when manipulating the independent variable would be unethical, as it would be if you had to expose someone to something harmful.
- Word the conclusion as a link rather than a cause, because a link is all the design can support.
Turning this into marks
- Name the method by pointing out that the independent variable was not manipulated by anyone.
- Give a specific rival explanation drawn from the scenario, such as the darker mornings, rather than the phrase lack of control.
- The mark most often lost comes from writing that the study proved a cause.
- What makes an experiment a natural experiment?
- How does a natural experiment differ from a field experiment?
- Why can you not confidently claim cause from a natural experiment?
- Give an independent variable that would have to be studied naturally, and say why.