Evaluation as a multi-ontological endeavour: a case from the English National Program for IT in healthcare

Klecun, Ela, Lichtner, Valentina, Cornford, Tony and Petrakaki, Dimitra (2014) Evaluation as a multi-ontological endeavour: a case from the English National Program for IT in healthcare. Journal of the Association for Information Systems, 15 (3). pp. 147-176. ISSN 1536-9323

Full text not available from this repository.


This paper analyzes how researchers’ different ontological and epistemological assumptions shape the process and outcomes of evaluation research. Focusing on the critical realism (CR) and social constructionism (SC) philosophical approaches, it outlines the rationale for multi-ontological evaluation and develops principles for conducting it. The paper draws from experience of evaluating a national implementation program of electronic health records in hospitals, one of the projects of the English National Programme for IT. It argues that an evaluation based on SC and one based on CR are significantly different in how they use knowledge gained in the field, and in the kind of evidence and recommendations that they can offer policy makers. The CR philosophy applied to evaluation research provides foundations from which judgments and abstractions can be presented in the form expected by the policy makers and managers who commission evaluations. In line with its ontological standing, social constructionism cannot simply or directly abstract and generalize across contexts, though it can offer other types of valuable evaluative insight. We show that, despite their differences, these two philosophical positions can, when taken together, produce jointly useful knowledge. This paper argues for the use of multi-ontological evaluation approaches and provides guidelines for undertaking such endeavors by emphasizing the need for mutual respect, dialogue, negotiation, and reflection.

Item Type: Article
Schools and Departments: School of Business, Management and Economics > Economics
Subjects: R Medicine
T Technology > T Technology (General) > T0055.4 Industrial engineering. Management engineering > T0058.6 Management information systems
Related URLs:
Depositing User: Catrina Hey
Date Deposited: 25 Jun 2013 11:14
Last Modified: 30 Apr 2018 14:23
URI: http://srodev.sussex.ac.uk/id/eprint/45538
📧 Request an update