What you'll learn

• What peer review is and where it fits into the scientific process.
• How reviewers judge psychological research before publication or funding.
• Why peer review improves quality, validity and credibility.
• Key AO3 evaluation points: bias, fraud detection, publication bias and conservatism.

Why science needs checks

Psychology aims to be a science: it tries to produce knowledge based on systematic observation, evidence and careful reasoning.

A single research study is not automatically “scientific truth”. Researchers can make mistakes, use weak methods, misinterpret statistics, or overclaim what their findings show. This is why scientific work needs quality control before it is treated as credible.

In A-Level Psychology, peer review sits inside this wider process. It is one way the scientific community tries to check whether research is trustworthy before it becomes part of the published literature.

What is peer review?

The word peer means someone of similar professional status. In psychology, a peer reviewer might be another researcher who understands the topic, the research methods, the statistical analysis and the ethical issues.

Peer review usually happens when:

• a researcher submits a manuscript — a written report of a study — to an academic journal
• a researcher applies for a research grant — money to fund future research
• an academic book chapter or conference paper is being considered

The basic peer-review process

The process varies between journals, but the main stages are usually similar.

Stage 1: The researcher submits work

A psychologist writes up their study, including:

• the aim and hypotheses
• the method and sample
• the procedure and controls
• the results and statistical analysis
• the conclusion and implications
• ethical safeguards such as consent, confidentiality and debriefing

Stage 2: The editor screens it

The editor is the person responsible for deciding whether a journal should consider the paper. They may reject it immediately if it is irrelevant, obviously flawed, or not original enough.

Stage 3: Expert reviewers assess it

The editor sends the paper to two or more expert reviewers. These reviewers read it closely and comment on its strengths and weaknesses.

They may ask:

• Is the research question important?
• Are the variables clearly operationalised — defined in measurable terms?
• Is the sample appropriate?
• Are there enough controls to reduce extraneous variables — unwanted variables that could affect the results?
• Are the statistical tests suitable?
• Do the conclusions follow from the evidence?
• Were ethical guidelines followed?

Stage 4: A decision is made

The editor then makes a decision. The paper may be:

• accepted — published as it is, although this is relatively rare
• accepted with revisions — published if the author makes changes
• revise and resubmit — sent back for major improvements and checked again
• rejected — not published in that journal

What reviewers are looking for

Peer reviewers do not just check spelling or presentation. Their job is to judge the quality of the science.

Methodological quality

In psychology, reviewers may question whether a study has good internal validity — whether it really measures the effect it claims to measure — and external validity — whether the findings can be generalised beyond the study.

For example, if a memory study only uses 12 psychology students, reviewers might question whether the sample is too small and unrepresentative.

Ethics

Reviewers also check whether the study appears ethically acceptable.

Relevant ethical issues include:

• informed consent — participants know enough to agree freely
• deception — participants are misled, which must be justified
• right to withdraw — participants can leave without penalty
• protection from harm — participants are not exposed to unnecessary distress
• confidentiality — personal data is protected
• debriefing — participants are told the true aims afterwards, especially if deception was used

Data analysis and conclusions

Reviewers check whether the correct analysis has been used and whether the authors have overinterpreted their findings.

For example, a study might find a statistically significant result at $p<0.05$, but that does not automatically mean the effect is large, important or applicable to real life.

Why peer review matters: AO1 roles

1. Allocation of research funding

Peer review helps decide which research projects receive funding. Grant proposals are reviewed before money is awarded.

This matters because research funding is limited. Peer review helps prioritise studies that are:

• original
• ethically acceptable
• methodologically strong
• likely to contribute useful knowledge

2. Publication in scientific journals

Peer review helps journals decide what to publish. This protects the quality of the academic record.

When a psychology textbook or exam answer cites published research, it is usually relying on the assumption that the work has passed some form of expert scrutiny.

3. Quality control

Peer review can identify problems before publication, such as:

• unclear hypotheses
• poor sampling
• weak controls
• unsuitable statistical tests
• unsupported conclusions
• missing ethical information

Authors may then improve the paper before it is published.

4. Detecting fraud or plagiarism

Peer review can sometimes detect suspicious claims, copied material or results that seem implausible. However, this is not foolproof, because reviewers usually do not repeat the whole study or inspect every raw data point.

Types of peer review

Different journals use different systems.

Single-blind review

In single-blind review, the reviewers know who the author is, but the author does not know who the reviewers are.

This may encourage honest criticism, but it can allow bias because reviewers know the author’s name, university, gender or reputation.

Double-blind review

In double-blind review, the author and reviewers do not know each other’s identities.

This is intended to reduce personal bias, although complete anonymity can be difficult if the topic, writing style or references reveal who the author is.

Open review

In open review, identities may be known, and sometimes reviewer comments are published.

This can increase transparency, but reviewers may become less critical if they know their comments will be linked to their name.

AO3 evaluation: strengths of peer review

It improves scientific credibility

A major strength is that peer review gives research extra credibility. If several experts have checked a study, readers can have more confidence that the design, analysis and conclusions are reasonable.

This is especially important in psychology because research may influence therapy, education, policing, parenting advice and mental health policy.

It helps improve research before publication

Peer reviewers often ask authors to clarify procedures, justify sample sizes, report ethical safeguards, or tone down exaggerated claims.

This means peer review is not only a filter; it can also improve the final quality of published research.

It supports replication and debate

Once research is published, other psychologists can try to replicate it — repeat the study to see whether similar results are found.

Peer review therefore contributes to a wider scientific conversation. Research becomes open to criticism, comparison and further testing.

AO3 evaluation: limitations of peer review

Peer review may be biased

Reviewers are human. They may be influenced by the author’s reputation, institution, country, gender, theoretical approach or whether the findings support their own work.

For example, a famous researcher from a prestigious university may be treated more favourably than an unknown early-career researcher.

Publication bias

This creates a distorted picture of psychology. If studies showing “no effect” are less likely to be published, students and researchers may wrongly believe an effect is stronger or more reliable than it really is.

This is sometimes called the file drawer problem, because non-significant studies may remain unpublished in researchers’ files.

It may slow down scientific progress

Peer review can take months or even years. Reviewers are often unpaid academics with many other responsibilities.

This delay can be a problem when research has urgent real-world relevance, such as mental health interventions or public health behaviour.

It may be conservative

Peer review can protect science from weak research, but it can also discourage innovative ideas. Reviewers may be more comfortable with familiar theories and methods.

This means unusual, creative or controversial research may be rejected even if it is potentially valuable.

It does not always detect fraud

Peer reviewers usually judge the written report, not the full reality of how the study was conducted.

They may not see all raw data, and they usually do not directly observe the research taking place. As a result, fraud can still pass peer review.

Applying peer review in AO2 scenarios

In an exam scenario, you may be given a description of a study and asked how peer review might be involved.

Look for issues such as:

• weak sampling
• lack of controls
• unclear operationalisation
• inappropriate conclusions
• ethical concerns
• whether the work should be revised before publication
• whether funding should be awarded

For example, if a researcher proposes a study involving deception and possible distress, reviewers might ask whether the deception is necessary, whether participants can withdraw, and how they will be debriefed and protected from harm.

Peer review and ethical responsibility

Although peer review is mainly a scientific quality-control process, it also has an ethical dimension.

Psychological research can affect real people. Poor-quality research might lead to harmful advice, ineffective treatments, unfair policies or inaccurate media claims. Peer review helps reduce this risk by challenging weak evidence before it gains authority.

However, reviewers also have ethical duties. They should:

• keep manuscripts confidential
• declare conflicts of interest
• avoid stealing ideas from unpublished work
• provide fair and constructive feedback

How to write about peer review in essays

For AO1, describe what peer review is and what it does.

For AO3, evaluate both sides. A balanced paragraph might say:

• Peer review improves credibility because experts check methods and conclusions.
• However, it is not completely objective because reviewers may be biased.
• Therefore, peer review is useful but should be supported by replication, transparency and open data.