Realist evaluation is a theory-driven approach to evaluating evidence from complex interventions. Realist evaluations attempt to answer questions such as what works, for whom, in which circumstances, and why. Four Volume Set. It describes five key ideas which frame realism and their implications for impact evaluation. It provides an explanatory analysis aimed at discerning what works for whom, in what circumstances, in what respects and how. The realist evaluation approach is a relatively new approach to evaluation, especially in some fields (such as health services research). The Uncritical Realism of Realist Evaluation. One of the tasks of a realist evaluation is therefore to make the theories within a program explicit, by developing clear hypotheses about how, and for whom, Realistic Evaluation shows how program evaluation needs to be, and can be bettered. 4.0 out of 5 stars 4. Paperback. Olsen W (2010) Editor’s Introduction: Realist Methodology – A Review. Nursing scientists should be more critical when using novel methodology and contribute to academic debates about limitations. Realist evaluation broadens the methodologies that have traditionally been used in nursing. It is based on the “Context-Mechanisms … Doing Realist Research Nick Emmel. That is, whenever a program is implemented, it is testing a theory about what ‘might cause change’, even though that theory may not be explicit. What is a complex initiative? It concludes with describing when and when not to use RE. ROMA is an online guide to improving policy engagement with practical tools and advice, based on RAPID’s extensive experience fostering policy change. The realist philosophy positions itself between positivist and constructivist paradigms and seeks to answer the question ‘What works for whom, in what circumstances and why?’ endobj 87, No. Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. (ed. We defined a ‘case’ as a pediatric unit involved in Lean implementation from one acute hospital setting in the Saskatchewan health system. Strategies and methods of realist evaluation 4. Realist evaluation is a form of theory-driven evaluation, but is set apart by its explicit philosophical underpinnings. The authors call this new approach `realistic evaluation'. zA���H�!2. In this chapter I list and describe various innovative methodological contributions made in recent years by realists. 4.8 out of 5 stars 8. Pawson and Tilley (1997) developed the first realist evaluation approach, although other interpretations have been developed since. Realist evaluation broadens the methodologies that have traditionally been used in nursing. The external validity of realist methodologies The currency of realist methodologies are ideas (theories) about 'what works, for whom, in which circumstances, why, and how’. Therefore, this study design may draw criticism for not being as … Critical realists also engage constructively with social theory, but they are more than just theorists. <>>> Using realist theories and methods in programme evaluation and social research also appears to facilitate a more inclusive approach to incorporating the input of those closer to the programme in the study design (consulting practitioners, service-users and other stakeholders) and making sure their views are represented. 4.5 out of 5 stars 2. Realist approaches to evaluation assume that nothing works everywhere or for everyone: context really does make a difference to programme outcomes. These ideas are transferred from investigation to investigation, and setting to setting, where … 3.1 out of 5 stars 5. <> We then present the results and the analysis. Evidence-Based Policy: A Realist Perspective Ray Pawson. Realist approaches to evaluation assume that nothing works everywhere or for everyone: context really does make a difference to programme outcomes. 3 0 obj This makes it particularly suitable for evaluations of certain topics and questions – for example, complex interventions and programmes that involve human decisions and actions. Bringing together leading theorists, researchers and policy makers with expertise in using realist methods, this book is a definitive guide to putting realist methodologies into practice. Realist evaluation is increasingly used in health services and other fields of research and evaluation. The paper suggests that Realistic Evaluation provides a useful means of exploring the health and social sciences through the use of mixed methods and concludes with how a researcher might go about constructing a Realist Evaluation study. Paperback. Realist evaluation is a species of theory-driven evaluation. <> Not just an overview of the field, this book looks to extend current debates and apply realist methods to new and practical challenges in social research. This paper offers a model of research synthesis which is designed to work with complex social interventions or programmes, and which is based on the emerging 'realist' approach to evaluation. <>/ProcSet[/PDF/Text/ImageB/ImageC/ImageI] >>/MediaBox[ 0 0 720 540] /Contents 4 0 R/Group<>/Tabs/S/StructParents 0>> … Realist evaluation is based on a realist philosophy of science, which permeates and informs its underlying epistemological assumptions, methodology and quality considerations. •Samples are purposively selected to test the theory. In the discussion, we frame our findings in the larger picture of the management literature and compare them with the findings of our previous case studies. •Realism is a philosophy with implications for methodology and methods, not a method in itself. In realist evaluation, the retroductive question is about the causal powers of the policy, intervention or programme, ... Encyclopedia of Social Science Research Methods, Thousand Oaks: SAGE. endobj Realism’s place in the policy cycle: formative, summative and synthetic approaches 5. ��?��,)��/މ���h�6��L�_;?�*�� Abstract . Realist Methodology for Complexity Mindful Evaluations in the Food, Energy, Water and Climate Sector - Duration: 58 minutes. 5 0 obj Methods section the realist evaluation methodology and the middle range theory that formed the initial hypoth-esis of this study. I point out ways in which research methods (i.e. •The purpose of realist investigation is explanatory, not (just) descriptive. Realist evaluation is a theory-driven approach, rooted in a realist philosophy of science, which emphasises an understanding of causation and how causal mechanisms are shaped and constrained by context. The term ‘realist evaluation’ is drawn from Pawson and Tilley’s seminal work, Realistic Evaluation (1997). £27.99 . The Science of Evaluation: A Realist Manifesto Ray Pawson. Recorded 13.03.17. CECAN Webinar Series by Dr. Justin Jagosh. A systematic review of the scientific literature was conducted to identify methods used for the evaluation of CI. In: OLSEN, W. Methods and analysis. Realist evaluation broadens the methodologies that have traditionally been used in nursing. Is realist evaluation keeping its promise? The initial step of realist studies aims to identify programme theories underlying the intervention. We followed a realist evaluation methodology framework with an explanatory case study research design . Realist evaluations are based on an assumption that projects and programmes work under certain conditions and are influenced by the way that different stakeholders respond to them. It comprises three linked studies: (1) formulating initial programme theory (IPT) through developing programme logic models to describe regional DHB working; (2) empirically testing IPT through both a qualitative process evaluation of regional DHB working using a case study design; and (3) a … The CMO framework, most closely associated with realist evaluation methodology, of which Pawson (2016) was an early proponent, is not necessarily a critical realist methodology (critical realism is a philosophy or metatheory about ontology); i.e., the CMO framework is a methodology that is not always informed or underpinned by this philosophy. August 2005; Journal ... and evaluation, 8. but is … Realist evaluation. Pawson and Tilley argue persuasively and passionately that scientific evaluation requires a careful blend of theory and method, quality and quantity, ambition and realism. • Realist evaluation = primary research • Realist synthesis = secondary research • Both methods: – have more of an explanatory rather than judgmental focus. Realist methodology is increasingly used in the evaluation of complex health care interventions, to facilitate a deeper understanding of ‘what works, how, for whom, in what circumstances and to what extent’ [1,2,3,4].The initial step of realist studies aims to identify programme theories underlying the intervention . The main body of this book is devoted to the articulation of a new evaluation paradigm, which promises greater validity and utility from the findings of evaluation studies. There are few published examples of realist synthesis. Realist methodology is increasingly used in the evaluation of complex health care interventions, to facilitate a deeper understanding of ‘what works, how, for whom, in what circumstances and to what extent’ [ 1, 2, 3, 4 ]. 1 What is Realist Evaluation? I argue that Pawson misinterprets critical realism’s positions on both natural and social science. The paper will be useful for evaluators and commissioners of evaluations to decide whether a realist approach is appropriate or feasible for evaluating a particular programme or policy; as well as for anyone interested in understanding a realist approach to impact evaluation. x��TMo�@�#��D�f�X��'�Z)RZY�!�bl#ap������78�hzA�3�f�����\]]�O?܂�����)|J*��1*��(�����/gP�������Vn'iq�� �� �����,.�i�)���P��zp�K�a�&x��>���H[�E*6U������c�!�m!&�LR7�yĲ�ܽ��h�-��[-�!��yj"�75�х�T� .�O���B��=�%��oڲ@V�MyS�IW��Y�x���WE���W�� �庈����+J��l��M��������Y ~}�b��:��C,�ߖ�E��g�fyI�%xw����E������zZ�8OEחK�ٗԩ>Ɛ�Z���^ww�ToR���W*��l�t�EP�-kdN):��6�5� Realist synthesis is an increasingly popular approach to the review and synthesis of evidence, which focuses on understanding the mechanisms by which an intervention works (or not). Realist impact evaluation draws on the realism school of philosophy. Excerpt "A realist approach assumes that programs are “theories incarnate”. 1. 1 0 obj Trends indicate that the proliferation in the use of this methodology also applies to research in low- and middle-income countries (LMICs). A Realist Approach for Qualitative Research Joseph A. Maxwell. 391–416) Paper by Trisha Greenhalgh about applying realist evaluation to understand a range of factors supporting change across four large health care organisations and their delivery of three areas of health services. The paper provides an overview of methodology as well as exploring its underpinning philosophy, that of critical realism. The realist evaluation approach is a relatively new approach to evaluation, especially in some fields (such as health services research). There is a consensus among researchers that critical realist is more popular and appropriate than direct realist approach due to its ability to capture the fuller picture when studying a phenomenon. endstream <> Impact evaluations tend to be more expensive than other kinds of evaluation, because they cannot be done quickly or cheaply. 5.1 Rationale for use of evaluation methodology informed by Realistic Evaluation principles 102 5.2 Participants 104 5.3 Intervention design and rationale 107 5.4 Data collection 108 . It is based on qualita-tive research methods for data collection . �YZ�(y���h�/`Q��H�E`���u$���9he����=�a�R2g���=%�Іt���('�=0�,O��rYf�:M�^_3x��%��8��U��+�V���j�QVqtQ��O*��"�w2�>4ĭ�MK��4��.>� Ontology, epistemology, axiology and research methods associated with critical realism research philosophy. 2 0 obj The idea is to explore mechanisms that are activated by the intervention to produce its effects in a given context. However, integration of Q methodology within a realist evaluation is scarce. This research uses a mixed methods realist evaluation design. <> Realist evaluation, a methodology for exploring generative causation within complex health interventions to understand ‘how, why and for whom’ programmes work, is experiencing a surge of interest. Realist evaluation can provide an explanation on how an intervention functions and in what circumstances . Evaluation, 18(2), 192–212. Applying realist evaluation methodology to understand the context of collaboration: the context-mechanism-outcome (CMO) framework. As such, a realist evaluator’s duty is to understand “how, why, for whom, and under which conditions” interventions work (Pawson & Tilley, 1997). Realist impact evaluation draws on the realism school of philosophy. endobj Edited by: Wendy Olsen - University of Manchester, UK ... and realists assert that the real world will tend to constrain science so that wrong claims get challenged. endobj One of the tasks of a realist evaluation is therefore to make the theories within a program explicit, by developing clear hypotheses about how, and for whom, programs might ‘work’. This standard was developed as part of the RAMESES II project. Realist evaluation methods were used to understand ‘what works well, how, for whom and to what extent.’ Mixed methods were employed including qualitative interviews and descriptive analyses of routine data sets. Critical realists offer a set of philosophical underpinnings for social research. The realist perspective has found a welcoming audience among CI evaluators. alternative methods to RCTs. Methodology; Open Access; Published: 19 April 2012; Realist synthesis: illustrating the method for implementation research. A form of theory-driven evaluation, realist evaluations acknowledge that interventions and their outcomes are subject to contextual influence. 6 0 obj Introduction: Realist evaluation is an increasingly popular methodology in health services research. £36.99. Realist review - A new method of systematic review designed for complex policy interventions . Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. Realist evaluation and Q methodology are established approaches in social science. Realist evaluation is a theory-driven approach to evaluating evidence from complex interventions. endobj Some of the differences between it and fellow members of the genus (programme theory evaluation, theories-of-change evaluation) will be noted in the course of the section. No previous standards exist for reporting realist evaluations. endobj This article attempts to illustrate (... Mobilising Q methodology within a realist evaluation: Lessons from an empirical study - Kevin Harris, Steven Henderson, Brian Wink, 2019 How Do You Modernize a Health Service: a Realist Evaluation of Whole-Scale Transformation in London The Milbank Quarterly, Vol. %���� In this workshop, participants will explore the advantage of using realist methodology to go beyond the question of ‘did an intervention work or not?’ to addressing questions about how, for whom, and under what circumstances interventions produce their particular outcomes. <> Mayr E (1982) The Growth of Biological Thought, Cambridge: Harvard University Press. Realist Methodology for Complexity Mindful Evaluations in the Food, Energy, Water and Climate Sectors. It explains when a realist impact evaluation may be most appropriate and outlines how to design and conduct an impact evaluation based on a realist approach. Trends indicate that the proliferation in the use of this methodology also applies to research in low- and middle-income countries (LMICs). Paperback. Our latest guidance and analysis on impact evaluation in complex development settings. Cette publication fait une revue de l’utilisation de l’évaluation réaliste dans le cadre de la recherche sur les systèmes de santé. Conclusion: strengths, limitations and relationships with other approaches Appendix I – ‘Thinking it through’: an exercise in realist hypothesis making. The basic schema of context-mechanism-outcome (CMO) used in realist evaluation methodology (Pawson and Tilley 1997, Westhorp 2014) can be a useful analytical framework to guide research on multifaceted collaborations in SES. The project’s aim is to produce initial reporting standards for realist evaluations. Realist evaluation (RE) is a theory-driven evaluation method that is increasingly used for studying the implementation of complex interventions within health systems, including in low- and middle-income countries [ 23 – 25 ]. Realist Methodology . What are the challenges with evaluating such initiatives? stream Realist evaluation and mixed methods design are relatively new methods in comparison with the randomised controlled trials (RCTs) commonly used in the evaluation of medical interventions. The nature, presentation and use of findings from realist evaluation 6. Conceptual clarity on its principal tenets is still needed, as well as the methods used to assess them. Its overall place in the toolkit … The book offers a complete blueprint for evaluation activities, covering design to data collection and analysis to the accumulation of findings across programs and onto the realization of research into policy.
Subscribe to our mailing list and get interesting stuff and updates to your email inbox.
Thank you for subscribing.