Applying Validity
- This skill asks you to judge how valid a study is and suggest improvements.
- Ask whether the study really measured what it set out to measure.
- Then suggest a change that would make the results more trustworthy.
- Improving validity means removing whatever stops the study measuring the real thing.
- A more realistic or more representative study is usually more valid.
A Worked Example
- A researcher measures Year 11 exam stress with a questionnaire, filled in weeks before any exam in a quiet, empty classroom.
- The setting is nothing like a real exam, so the scores may not reflect genuine exam stress.
- Students may also answer how they think they should feel, a subjective, biased response.
- Both problems mean the study may not really be measuring exam stress at all.
- Measure stress just before a real mock exam, so the situation actually triggers exam stress.
- Use a wider sample and a clear, objective measure so the results reflect real stress more accurately.
Ways to Raise Validity
- Use a more realistic task or setting so the behaviour you measure is genuine.
- Use a clear, objective measure so the results are not shaped by personal opinion.
- Reduce threats, for example by hiding the aim so people cannot change their behaviour.
- Do not suggest a fix that improves consistency instead of accuracy.
- Do not just say "make it more valid"; say exactly what you would change.
A Step-by-Step Routine
- Decide whether the study measured what its aim claimed, not something else.
- Name the exact thing in the scenario threatening accuracy (unrealistic setting, subjective measure, or a guessed aim).
- Suggest a specific fix matched to that threat; the fix linked to the named problem scores separately from saying "validity".
- How can you tell a study might not be measuring the real thing?
- How would you make a study's setting more realistic?
- Suggest one way to make a stress study more valid.
- Why is improving validity different from improving reliability?