The Osteopathic Clinical Practice Assessment: a pilot study to develop a new workplace-based assessment tool

Brett Vaughan; Keri Moore

doi:10.1016/j.ijosm.2015.05.002

<p><h4 id="x-x-x-x-absSec_1">Background</h4> <p id="x-x-x-x-abspara0010">It is widely recognised that multiple forms of assessment are required in order to make decisions about learner competency and fitness-to-practice. One assessment tool that is gaining popularity in the Australian allied health professions is the global clinical competency assessment. These tools are designed to assess learner performance across a range of areas required for professional practice, with the assessment typically performed at the end of a ‘block’ clinical placement. There is no literature on their use in osteopathy longitudinal placements. <h4 id="x-x-x-x-absSec_2">Objective</h4> <p id="x-x-x-x-abspara0015">To explore the applicability of an adaptation of the Assessment of Physiotherapy Practice in an osteopathic context. The study presents pilot data and discussion about the adaptation of a workplace-based assessment tool – the Osteopathic Clinical Practice Assessment (OCPA). <h4 id="x-x-x-x-absSec_3">Design</h4> <p id="x-x-x-x-abspara0020">Evaluation of the OCPA using data from multiple administrations. <h4 id="x-x-x-x-absSec_4">Setting</h4> <p id="x-x-x-x-abspara0025">Osteopathic on-campus, student-led teaching clinic at one Australian university. <h4 id="x-x-x-x-absSec_5">Methods</h4> <p id="x-x-x-x-abspara0030">Clinical Educators completed the OCPA for learners during weeks 5 and 12 of a 12 week semester. Descriptive statistics were generated for the data. The Wilcoxon signed rank test was used to investigate differences between the week 5 and 12 ratings. Cronbach's alpha was used to assess the internal consistency and Spearman's coefficient used to assess the relationship between the total OCPA score and global rating. <h4 id="x-x-x-x-absSec_6">Participants</h4> <p id="x-x-x-x-abspara0035">The OCPA was completed by 12 Clinical Educators assessing 31 learners in year 4 of the program. <h4 id="x-x-x-x-absSec_7">Results</h4> <p id="x-x-x-x-abspara0040">Learners were rated, on average, at the ‘expected level’ at each of the two time points. This was consistent for both the OCPA items and the global rating contained on the OCPA. Cronbach's alpha was 0.822 and Spearman's coefficient was 0.59 suggesting a ‘large’ relationship between the total OCPA score and the global rating. <h4 id="x-x-x-x-absSec_8">Conclusions</h4> <p id="x-x-x-x-abspara0045">There is a clear need for the OCPA to be used in conjunction with other assessment tools in order to make learner progress and fitness-to-practice decisions. Data suggest if learners are assessed at two or more different time points (across a longitudinal placement) changes need to be considered in the rating scale used on the OCPA in order to more clearly demonstrate learner progression. The OCPA could be used as a formative assessment tool in osteopathy with an adjustment to the current rating scale. In its current format caution should be applied if it is to be used as a summative tool as we do not have data supporting its use for this purpose. At present we cannot make any further arguments about the ability of the OCPA results to be <em>extrapolated</em> and make reliable and defensible <em>decisions</em> as there are no data correlating it with other performance assessments nor data supporting its reliability. This will be the subject of future research.</p>

The Osteopathic Clinical Practice Assessment: a pilot study to develop a new workplace-based assessment tool

Files and links (1)

Metrics

UN Sustainable Development Goals (SDGs)

Abstract

Details

The Osteopathic Clinical Practice Assessment: a pilot study to develop a new workplace-based assessment tool

Files and links (1)

Metrics

UN Sustainable Development Goals (SDGs)

Abstract

Details

Southern Cross University Social media