Lorenzo, S, Lang, T, Pastor, R, Tampieri, A, Santos-Eggimann, B, Smith, H, Liberat, A and Restuccia, J (1999) Reliability study of the European appropriateness evaluation protocol. International Journal for Quality in Health Care, 11 (5). pp. 419-424. ISSN 1353-4505

PDF - Published Version Restricted to SRO admin only Download (192kB)

Abstract

Objective: To help to co-ordinate and harmonize research on utilization review in Europe, the US Appropriateness Evaluation Protocol (AEP) was adapted for use in the European setting. The aim of this paper is to assess the reliability of the European version of the AEP (EU-AEP).

Design: Nineteen English-language medical records were reviewed by a physician reviewer from each of six participating countries: Austria, France, Italy, Spain, Switzerland and the UK. Each of the six reviewers was asked to assess the appropriateness of the 19 admissions and 31 hospitalization days (19 admission days and 12 randomly selected days of hospital stay, excluding days of discharge) using the revised review instrument. To evaluate inter-rater reliability, the κ statistic was used to measure overall and pair-wise agreement for the assessment of appropriateness of admission and of day of care, respectively.

Results: For admission, the overall κ statistic among the six reviewers was 0.64, with κ values for each pair of reviewers in the range 0.46-0.86. For day of care, the κ was 0.59, with pair-wise κcoefficients in the range 0.25-0.95.

Conclusion: The observed agreement could be considered substantial, especially if the fact that medical records were handwritten in a language native to only one of the reviewers is considered. Besides all the study limitations, this finding provides at least preliminary support for the application of the EU-AEP as a reliable instrument in the European setting, including application in comparative studies involving two or more countries.

Item Type:	Article
Schools and Departments:	Brighton and Sussex Medical School > Primary Care and Public Health
Depositing User:	Jane Harle
Date Deposited:	06 Oct 2008
Last Modified:	30 Apr 2018 12:13
URI:	http://srodev.sussex.ac.uk/id/eprint/1944
Google Scholar:	18 Citations

View download statistics for this item

📧 Request an update