Logo image
Inter-rater reliability, intra-rater reliability and internal consistency of the Brisbane Evidence-Based Language Test
Journal article   Open access   Peer reviewed

Inter-rater reliability, intra-rater reliability and internal consistency of the Brisbane Evidence-Based Language Test

Alexia Rohde, Molly McCracken, Linda Worrall, Anna Farrell, Robyn O'Halloran, Erin Godecke, Michael David and Suhail A Doi
Disability and Rehabilitation, Vol.44(4), pp.637-645
22/06/2020
PMID: 32571103
pdf
Rohde and others_2020_Inter rater reliability_Journal article1.24 MBDownloadView
Published (Version of record)CC BY-NC-ND V4.0 Open Access
url
https://doi.org/10.1080/09638288.2020.1776774View
Published (Version of record)

Related links

Metrics

133 File views/ downloads
47 Record Views

UN Sustainable Development Goals (SDGs)

This output has contributed to the advancement of the following goals:

#3 Good Health and Well-Being

Source: InCites

Abstract

Aphasia psychometric properties test outcome measures stroke reliability Other Medical and Health Sciences Public Health and Health Services Allied Health Therapies (excl. Mental Health Services)
<em>Purpose:</em> To examine the inter-rater reliability, intra-rater reliability, internal consistency and practice effects associated with a new test, the Brisbane Evidence-Based Language Test.</p> <em>Methods:</em> Reliability estimates were obtained in a repeated-measures design through analysis of clinician video ratings of stroke participants completing the Brisbane Evidence-Based Language Test. Inter-rater reliability was determined by comparing 15 independent clinicians' scores of 15 randomly selected videos. Intra-rater reliability was determined by comparing two clinicians' scores of 35 videos when re-scored after a two-week interval.</p> <em>Results:</em> Intraclass correlation coefficient (ICC) analysis demonstrated almost perfect inter-rater reliability (0.995; 95% confidence interval: 0.990-0.998), intra-rater reliability (0.994; 95% confidence interval: 0.989-0.997) and internal consistency (Cronbach's α = 0.940 (95% confidence interval: 0.920-1.0)). Almost perfect correlations (0.998; 95% confidence interval: 0.995-0.999) between face-to-face and video ratings were obtained.</p> <em>Conclusion:</em> The Brisbane Evidence-Based Language Test demonstrates almost perfect inter-rater reliability, intra-rater reliability and internal consistency. High correlation coefficients and narrow confidence intervals demonstrated minimal practice effects with scoring or influence of years of clinical experience on test scores. Almost perfect correlations between face-to-face and video scoring methods indicate these reliability estimates have direct application to everyday practice. The test is available from <i>brisbanetest.org</i></p>

Details

Logo image