Skip to content

Course home

Revision guidesยท7.6.4 Application of reliability
Sign up

7.6.4 Application of reliability

Applying Reliability

  1. This skill asks you to judge how reliable a described study is and suggest improvements.
  2. Ask whether the study would give the same results if it were run again in the same way.
  3. Then suggest a change that would make it more consistent.
Key Idea
  • Reliability improves when everything is kept the same each time.
  • Standardising the procedure is usually the strongest fix.

A Worked Example

  1. Two observers sit in a busy UK shopping centre and rate how helpful passers-by are when someone drops their bags.
  2. They score helpfulness from 1 to 5, but their scores often differ by two or three points.
  3. That gap shows low inter-observer reliability.
  4. The likely cause is that "helpful" has not been clearly defined, so each observer judges it differently.
Example
  • Replace the vague 1-to-5 scale with observable actions, such as "stops", "picks up a bag" or "speaks to the person".
  • With clear categories, the two observers now agree far more often.

Ways to Improve Reliability

  1. Standardise the procedure so every participant is treated in exactly the same way.
  2. Operationalise the categories or scoring so they are applied consistently.
  3. Train the observers or raters together first, so they record in the same way.
Common Mistake
  • Do not suggest an improvement that does not actually target consistency.
  • Do not confuse improving reliability with improving validity.

A Step-by-Step Routine

  1. Decide whether the study would give the same results if repeated the same way.
  2. Name the exact source of inconsistency in the scenario, such as a vague rating observers judge differently.
  3. Suggest a matched fix (standardise the procedure, operationalise the categories, or train the observers); the fix tied to the problem is a separate mark.
Self review
  • How can you tell a study has low reliability?
  • Name two ways to improve the reliability of an observation.
  • Why does standardising a procedure improve reliability?
  • If two observers disagree a lot, what should you improve?
PreviousNext

How was this guide?

Teach Genie

Review 7.6.4 Application of reliability by teaching Genie

Teach it back in your own words, spot gaps, and remember it better.

Start teaching
Genie and Baby Genie

Lesson

Recap your knowledge with an interactive lesson

8 minute activity

Start lesson

Reliability is the consistency of a study's findings. Ask whether the study would produce similar results if it were repeated in the same way.

A reliable method keeps important features constant, such as the instructions, treatment of participants, timing, recording method, and scoring system.

When judging reliability, identify the source of inconsistency and suggest a change that would make the procedure or measurements more consistent.

Questions

Put it into practice with exam-style questions

52 exam-style questions

Practice questions

Question 1

4 marks

A research team checks the consistency of two pilot studies. In Study A, two assessors use the same 8-mark scoring guide to mark the same 20 written explanations from a driving-theory test. Their scores differ by at least 3 marks for 18 of the explanations. In Study B, two researchers independently record whether each of the same 50 visitors pauses at the hand sanitiser near a museum entrance. Their records match for 47 visitors.

Explain what the contrast between these findings shows about inter-rater reliability in Study A and inter-observer reliability in Study B.

Flashcards

Remember key concepts with flashcards

23 flashcards

Practice flashcards

What question should you ask when judging a study's reliability?

7.6.4 Application of reliability Revision Guide

  1. IGCSE
  2. /Psychology
  3. /7.6.4 Application of reliability

Revision notes for CIE IGCSE Psychology 7.6.4 Application of reliability: explanations and worked examples.

More revision guides