Theory of change explains the process of change by outlining causal linkages in an. Theorybased evaluation and types of complexity ulg. A theorybased evaluation is usually based on an explicit theory of change or logic model that explains. The perception and evaluation of visual art henrik hagtvedt university of georgia, athens reidar hagtvedt georgia institute of technology, atlanta vanessa m. Theorybased evaluation tbe explores the how and why of program success or. Program theory and logic models evaluation resources from wilder research. Theory of change toc is a specific type of methodology for planning, participation, and evaluation that is used in companies, philanthropy, notforprofit and government sectors to promote social change. Types and uses of evaluation in order to plan the evaluation in accord with the most appropriate evaluation method, it is necessary to understand the difference between evaluation types. It is one of the interesting realities of evaluation, that even after over 30 years of discussion and thought about this emerging discipline, most of the people doing evaluation still come from training other than as evaluators. As a motivational the ory, reversal theory apter, 2007 posits human behavior as a ballet among various changing states and goals, so initiated by the circumstances satiation and needs of the individual.
Using theorybased approaches to evaluate causeeffect issues in. One way to do this is for the evaluator and program people to develop a very good description of. Evaluation for education, learning and change theory and. There is a wealth of literature available on theorybased evaluation and impact evaluation tbe, but experts disagree on whether tbe is a common and clearly defined approach. Evaluation theory and practice american university online. There are several different approaches to theorybased evaluation. The dac working party on aid evaluation wpev has developed this glossary of key terms in evaluation and resultsbased management because of the need to clarify concepts and to reduce the terminological confusion frequently encountered in these a reas. Pawson and tilley 1997 developed the first realist evaluation approach, although other interpretations have been developed since. In cflat, we have been using theorybased approaches since 2000. Social ecologic theory and goalsystems theory in mind and evaluated using mediation analysis, and the reaim framework. Theory of change defines longterm goals and then maps backward to identify necessary preconditions. Furthermore, the wellknown writers in the field of evaluation theory did not receive their formal education in a program designed to produce professional. This document is neither an exhaustive training program in theory based evaluation nor a. Specifically, cet is a subtheory of selfdetermination theory that focuses on competence and autonomy while examining how intrinsic motivation is affected by external forces in a process known as motivational crowding out.
Drawing on extant theory that the interplay of affect and cognition evoked by a stimulus drives evaluations. The purpose of theorydriven evaluation is to provide information on not only the performance or. However, there are considerable challenges to program theory and not all evaluators are convinced it is useful 7. If it does, the task of the evaluator is to produce a plausible case, with evidence, that shows what has. For example, the success of an allowancebased incentive program. Cognitive evaluation theory is a theory in psychology that is designed to explain the effects of external consequences on internal motivation. Programs are usually very complex and frequently need effective program theory for evaluation.
Examples of theories of change evaluations are found in carvalho and. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidence based practice. Pdf theorybased evaluations have helped open the black box of. A wealth of approaches and an untapped potential marielle riche european commissioni have w e got closer t o ident if yi ng the ge nerati ve mechani sms that produce an outcom e f or th e lagging regi ons of t he. Contents introduction context and causation in theorybased approaches theories of change and logic models theorybased approaches to evaluation. This booklet presents our understanding and use of theory of change. Cognitive evaluation theory cet is a theory in psychology that is designed to explain the effects of external consequences on internal motivation. We mean rather, one based on a theory about how a program operates. Cognitive evaluation theory theory suggests that there are two motivation systems.
Theorybased stakeholder evaluation article pdf available in american journal of evaluation 3. Thus, by a theorybased evaluation, we do not mean an evaluation based on a theory about evaluation. Managing authorities rarely have the capacities to define the best approach and. Furthermore, 7 argues that sometimes referred to as program logic or theory of change it points to a variety of. Theorybased approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in. The evaluation is designed to test the theory to see if it holds true. An account is offered of the evolution of this persuasion, through the works of chen and rossi, weiss, and pawson and tilley.
Coupling monitoring and evaluation to theory of change can bring a. Program theory and the evaluation of a program s theory have gained interest in the evaluation field. Theorybased approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results. An introduction pdf 475 kb research methods paper 2. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidencebased practice. Realist evaluation is a form of theory driven evaluation, but is set apart by its explicit philosophical underpinnings. Pdf clarifying the theorybased evaluation researchgate. Some think a common conceptual and operational understanding has been elusive, while others point to a completely consistent basic concept regardless of slight. What is evaluation back to determining the evaluation question.
Theorybased programme development and evaluation in. Cognitive evaluation theory of motivation simplified. Christie o ur evaluation theory tree is presented in figure 2. Multiple terms have been integrated into discussions of program theory development and evaluation including. Evaluation theory as a concept components of a meaningful evaluation theory alkins evaluation theory tree sample evaluation theories program theory that brings theory to life in evaluations 10 the concept of evaluation theory and so we begin. Program theory and logic models 1 wilder research, august 2009 wilder research. Theory driven evaluation methods branch of theory tree developed by sociologists huey chen and his advisor, peter rossi chens book published in 1990 normative theory prescriptive, what should be causative theory descriptive, what is research based. This document is neither an exhaustive training program in theorybased evaluation nor a. The accountability root, which is prevalent in government evaluations, stems from the need to account for actions or resources used in programs. Glossary of key terms in evaluation and results based. When pte is implemented at a small project, staff may not have the time or skills to collect and analyze data in ways that either test the program theory or provide useful information to guide decisions and action. Theorybased evaluations have helped open the black box of programmes. Evaluation for education, learning and change theory and practice. Evaluation is based on empirical evidence and typically on social research methods, thus on the process of collecting and synthesizing evidence rossi lipsey and freeman, 2004.
Alkin and christie 2004, through their evaluation theory tree, suggest that the roots of evaluation theory are grounded in accountability and systematic social inquiry. The trunk is built on a dual foundation of accountability and systematic social inquiry. In this article we share our evolving views on the points of connection and digression between the approaches based on our reading of the theorybased evaluation literature and our practice experience. Patrick university of georgia, athens abstract visual art is a complex stimulus.
This description helps to identify how the program should lead to the. Applying program theorydriven approach to design and. The first learning theory to be researched in the 19xxx, based on the work of pavlov and skinner, is known as the behaviourist theory. We explore the theory and practice of evaluation and some of the key issues for informal and community educators, social pedagogues youth workers and others. A theorybased evaluation is usually based on an explicit theory of change or logic modelthat explains the theory of a development intervention. Theorydriven evaluation or program theorydriven evaluation is a contextual or holistic assessment of a program based on the conceptual framework of program theory.
A theory of change can also be developed retrospectively by reading program documents, talking to. A theorybased evaluation is usually based on an explicit theory of change or logic model that explains the theory of a development intervention. In this monograph, evaluation means a study designed and conducted to assist. Theorybased approaches for practical evaluation steve montague, partner steve.
In cflat, we have been using theory based approaches since 2000. Pdf the theorybased evaluation is one of the most used directions in. Evaluation is part and parcel of educating yet it can be experienced as a burden and an unnecessary intrusion. Evaluation also refers to the process of determining the worth or signi. The investigators used a randomized controlled design to evaluate the effectiveness of the program. Evaluation is a relatively new field that has emerged from a diverse array of applied social sciences. Realist evaluation is a form of theorydriven evaluation, but is set apart by its explicit philosophical underpinnings. Interestingly, in none of the studies was the original theory completely right. In behaviourist theory learning is a mechanical process of habit formation, by means of frequent reinforcement of a stimuli.
There are a variety of evaluation designs, and the type of evaluation should match the development level of the program or program activity appropriately. It seeks to find out whether the theories on which the program is based are realized in action for further examples of tbes, see feindler et al. Canadian evaluation society annual learning event february 21, 2012 steve. Theorydriven evaluation methods branch of theory tree developed by sociologists huey chen and his advisor, peter rossi chens book published in 1990 normative theory prescriptive, what should be causative theory descriptive, what is research based. All human service programs are designed to make a difference in the lives of people or to. Program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation were classified on the basis of their level of conformity to a particular definition of evaluation.
1147 1448 995 276 923 1426 876 1007 343 429 1284 1003 1462 751 478 1132 1252 339 22 86 135 1145 814 1189 882 937 1288 226 689 1351 1160 755 1380 835