7.2.11

Reliability (A2 only)

Test yourself

Assessing Reliability: Internal and External

Reliability is how consistent a test or study is. Reliability can be assessed in several ways: test-retest, the split-half method and correlating inter-observer reliability.

Illustrative background for ReliabilityIllustrative background for Reliability ?? "content

Reliability

  • Reliability is how consistent a test or study is.
  • In other words, does the test, when repeated in identical conditions or with similar participants, come up with the same results?
Illustrative background for Test-retest Illustrative background for Test-retest  ?? "content

Test-retest

  • Test-retest is when a study is repeated.
  • If the results are similar both times, the test is said to have external reliability.
    • External reliability is when a test or study should consistently produce the same results no matter the time given.
Illustrative background for Examples of external reliabilityIllustrative background for Examples of external reliability ?? "content

Examples of external reliability

  • A simple example would be if a doctor gave two pregnancy tests to a woman and the results came back positive both times. This means the test is reliable.
  • Another example would be a maths test. If a student took a maths test twice and got similar results, the test is said to have external reliability.
Illustrative background for Split-half methodIllustrative background for Split-half method ?? "content

Split-half method

  • The split-half is used to assess the internal reliability of a test.
  • The split-half method takes one test and divides it into two sections.
    • This can be even/odd numbered questions or first half/second half.
Illustrative background for Internal reliability Illustrative background for Internal reliability  ?? "content

Internal reliability

  • If there is a strong positive correlation between both halves, the test is said to have internal reliability.
  • In other words, a participant scores similar results in both sections of the tests.
  • Internal reliability is looking at the same test - do all parts of the test have consistent results?

Assessing Reliability: Inter-Observer Reliability

Reliability is how consistent a test or study is. Reliability can be assessed in several ways: test-retest, the split-half method and correlating inter-observer reliability.

Illustrative background for Inter-observer reliability Illustrative background for Inter-observer reliability  ?? "content

Inter-observer reliability

  • In a highly idealised study, the exact same researcher would administer the test to all participants.
  • This is to avoid inconsistent results due to the extraneous variable of different researchers.
  • Obviously, this can be challenging to do. So researchers must follow a specific and standardised procedure to avoid this.
Illustrative background for Correlated Illustrative background for Correlated  ?? "content

Correlated

  • To make sure the tests have inter-observer reliability, tests from different researchers are correlated to check if the results have high positive correlation.
Illustrative background for Example - aggressive five-year-oldsIllustrative background for Example - aggressive five-year-olds ?? "content

Example - aggressive five-year-olds

  • For example, if two separate researchers are observing aggressive behaviour in five-year-olds, they should give the same score (1-10) for the same level of aggression.
  • A five-year-old who hits another child would receive a score of 10.
  • If both researchers observed the behaviour and gave the same score of 10, then the test is said to have inter-observer reliability.

Improving Reliability and Validity

Reliability and validity are essential for making sure that psychological tests are accurate, fair and meaningful. Standardising research and operationalising variables improve both validity and reliability.

Illustrative background for Standardising research Illustrative background for Standardising research  ?? "content

Standardising research

  • Standardising research is crucial for having reliable and valid results.
  • Scientific studies follow strict guidelines and specific procedures.
    • An example of this would be a study on short-term memory recall. The aim of this study is to look at the effect of age on short-term memory.
Illustrative background for Conditions and procedureIllustrative background for Conditions and procedure ?? "content

Conditions and procedure

  • Psychologists would decide on the conditions of the study.
    • For example: a well-lit room, started at 9:00AM, have same race, same-gendered participants and one researcher in the room.
  • The study would follow a set procedure of handing out papers, giving instructions from a set script, and setting a certain time limit on memory questions.
Illustrative background for Extraneous variables Illustrative background for Extraneous variables  ?? "content

Extraneous variables

  • The procedures must be as specific as possible to make sure that there are as few extraneous variables as possible.
    • Extraneous variables are anything that could affect your results.
  • These set procedures make sure that external reliability and inter-observer reliability are improved.
Illustrative background for Operationalising variablesIllustrative background for Operationalising variables ?? "content

Operationalising variables

  • When setting up a study, psychologists determine their aim and from there, establish their independent and dependent variables.
  • They will also try to minimise extraneous variables which could affect their results.
  • The variables must be clearly defined (to operationalise).
Illustrative background for GuidelinesIllustrative background for Guidelines ?? "content

Guidelines

  • In the Kanner et al. (1981) study examining how daily hassles link to stress and health, they had to clearly define stress, daily hassles and health.
  • The participants had to rate their hassles, making it clearer.
  • If they were just to list hassles, but with no guidelines or descriptions, the results could have potentially been less valid.
  • Making the variables crystal clear improves the validity and reliability of the test.

Jump to other topics

1Social Influence

2Memory

3Attachment

4Psychopathology

5Approaches in Psychology

6Biopsychology

7Research Methods

8Issues & Debates in Psychology (A2 only)

9Option 1: Relationships (A2 only)

10Option 1: Gender (A2 only)

11Option 1: Cognition & Development (A2 only)

12Option 2: Schizophrenia (A2 only)

13Option 2: Eating Behaviour (A2 only)

14Option 2: Stress (A2 only)

15Option 3: Aggression (A2 only)

16Option 3: Forensic Psychology (A2 only)

17Option 3: Addiction (A2 only)

Go student ad image

Unlock your full potential with GoStudent tutoring

  • Affordable 1:1 tutoring from the comfort of your home

  • Tutors are matched to your specific learning needs

  • 30+ school subjects covered

Book a free trial lesson