Since its birth in the late 1980s and early 1990s, the field of comprehensive community initiatives ccis has been struggling to find evaluation strategies and methodologies that. Program theory has several important functions that can improve our ability to generalize from particular evaluations, contribute to social science theory, and achieve consensus in evaluation planning. Some program teams have incorporated evaluation at the start of their planning, while others have. This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. What program evaluation is why evaluation is important the steps in planning and conducting evaluations as outlined in the cdc framework for program evaluation what standards exist for program evaluation how to identify and engage stakeholders step 1 of the framework. What is evaluation use the program theory or logic model to come up with evaluation questions does the program have a positive outcome. Program evaluation hiring and managing an outside evaluator, project managers responsibilities educate the evaluator about the project provide timely feedback update and inform the evaluator of project changes monitor the contract supervisor inhouse evaluation activities provide program expertise. Applying a theory of change approach to the evaluation of comprehensive community initiatives. Christie o ur evaluation theory tree is presented in figure 2. Evaluation theory, models, and applications, 2nd edition wiley. Initially theory of change and program theory, incorporating program theory evaluation pte and the use of program logic models, were applied to evaluating human service programs such as the. Now in its second edition, evaluation theory, models, and applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. Program evaluation theory and practice download ebook. We then focus on several commonly used program evaluation models in the context of those theoretical bases.
A logic model is a visual illustration of a programs 1,2resources, activities and expected outcomes. Rent practical program evaluation theorydriven evaluation and the integrated evaluation perspective 2nd edition 9781412992305 and save up to 80% on textbook rentals and 90% on used textbooks. This resource guide discusses program theory and logic models. Additional resources developing evaluation questions. The evaluation of simple interventions is intended to either develop or test the recipe that others can then follow. It includes a discussion of efforts by the evaluators to involve the stakeholders in an iterative process aimed at producing a stronger evaluation using the program theory approach. A theorybased evaluation is usually based on an explicit theory of change or logic modelthat explains the theory of a development intervention. In this case, the first part of the program theory would be. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidencebased practice. Will shadish 1998 evaluation theory is who we are what we. The golden standard evaluation reference text now in its second edition, evaluation theory, models, and applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. The trunk is built on a dual foundation of accountability and systematic social inquiry.
Part iii concerns the part of evaluation planning that overlaps most with applied. Evaluation theory, models, and applications, 2nd edition. First, there are issues related to the theory and structure of the program, the programs rationale and possible alternatives. The role of theory in program evaluation is an important but neglected area in evaluation practice and theory. Thus, while the primer offers important, even critical, insights into how to undertake utilizationfocused evaluation, it also offers a model for how to engage in serious reflective practice as a community of. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the. Furthermore, the wellknown writers in the field of evaluation theory did not receive their formal education in a program designed to produce. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their programs complexity and their own evaluation needs. It is now commonplace to use research, program theory, and logic models in evaluation practice. It provides a logical and reasonable description of why the things you do your program activities should lead to the intended results or benefits.
Evaluation is a process that critically examines a program. All human service programs are designed to make a difference in the lives of people or to improve our society. A s promised in the preface,this books approach is to give you a barebones, nutsandbolts guide about how to do an evaluation. Program evaluation models and related theories introduction program evaluation is an essential responsibility for anyone overseeing a medical education program. Components of program theory for funnel and rogers p.
Evaluation theory as a concept components of a meaningful evaluation theory alkins evaluation theory tree sample evaluation theories program theory that brings theory to life in evaluations 10 the concept of evaluation theory and so we begin. Program theory and the evaluation of a program s theory have gained interest in the evaluation field. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large and smallscale evaluations. Download program evaluation theory and practice pdf ebook. A program theory explains how and why a program is supposed to work. Initially theory of change and program theory, incorporating program theory evaluation pte and the use of program logic models, were applied to evaluating human service programs such. Using programme theory to evaluate 31 this distinction seemed to provide a particularly useful orienting framework for evaluation patton, 2003 and has obvious implications for programme theory evaluation. Using this metaphor, the authors explain the development of evaluation theory as it appears in western read global north societies. Program evaluations are those set of activities undertaken by private and public agencies to test and analyze the effectiveness and efficiency as well as relevance of policies, projects and programs acf, 2010. Program theory and logic models evaluation resources from wilder research. When pte is implemented at a small project, staff may not have the time or skills to collect and analyze data in ways that either test the program theory or provide useful information to guide decisions and action. Program theory in evaluation is formulated in many different ways and applied for a variety of purposes.
Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate. However, because program evaluation builds on many other disciplines e. A theory based evaluation is usually based on an explicit theory of change or logic modelthat explains the theory of a development intervention. Effective program evaluation is a systematic way to improve and account for actions by involving procedures that are useful, feasible, ethical, and accurate. Evaluation theory, design and methods tei the evaluators. We recognize this as a simple systems model the connection of interdependent parts that together make up the whole\it is a\.
The framework is a practical, nonprescriptive tool, designed to summarize and organize essential elements of program evaluation. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model, and. The book features examples of small and largescale evaluations from a range of fields, many with reflective. Q if participants receive these services, then they experience specific changes in their knowledge, attitudes, or skills. Theory based stakeholder evaluation tse, instead of fusing the theories of different stakeholders into a single unified theory, keeps the program theories of diverse stakeholder groups separate from each other and from the program theory embedded in the institutionalized intervention itself. A programme theory can be a very useful way of bringing together existing evidence about a programme, and clarifying where there is agreement and disagreement about how the programme is.
Program theory and logic models 1 wilder research, august 2009 wilder research. The evaluation is designed to test the theory to see if it holds true. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. A comprehensive guide this engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from. Although policy evaluation and program evaluation have many similarities, there are some important differences as well. If youre looking for a free download links of program evaluation theory and practice pdf, epub, docx and torrent then this site is not for you.
Eric ed530598 program evaluation theory and practice. A program may be as small as an individual class session, a course, or a clerkship rotation in medical school or it may be as large as the whole of an educational program. In both the public and private sectors, stakeholders often want to know whether the programs they are funding, implementing, voting for. F utilization focused evaluation a primer for evaluators. It is crucial to utilize theories well when conducting evaluations. Practical program evaluation theorydriven evaluation and. This approach to evaluation focuses on theoretical rather than methodological issues. The program theory is vital in the theorybased evaluation. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large and smallscale. Dec 09, 2014 in chapter two, he and tina christie talk about an evaluation theory tree and presents this idea graphically all be it in draft form. Develop programme theory theory of change better evaluation.
Lipsey 1993 identified six elements of a program theory consisting of problem definition. This section also presents a lengthy description of the program theory linked to the. Theorybased approaches to evaluation attempt to understand an interventions contribution to observed results through a mechanistic or process interpretation of causation, rather than determining causation through comparison to a counterfactual. Program theory explains why a program is expected to work and a logic model. Theorybased stakeholder evaluation tse, instead of fusing the theories of different stakeholders into a single unified theory, keeps the program theories of diverse stakeholder groups separate from each other and from the program theory embedded in the institutionalized intervention itself. Click download or read online button to get program evaluation theory and practice book now. Reductionism, system theory, and most recently complexity theory have inspired the development of models commonly applied in evaluation studies today. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation. Using programme theory to evaluate complicated and. It includes detailed discussion of the 12 steps for implementing ufe and also provides a number of case studies to guide the user. Program evaluation theory and practice download ebook pdf. The book features examples of small and largescale evaluations from a range of. From program evaluation tip sheets from wilder research, issue 4, october 2005.
Feel free to use this chapter from public policy and program evaluation, but make. Is the program working the way it was intended to work. It is a practical, nonprescriptive tool, designed to. We encourage you to examine your own assumptions about evaluation, and to derive implications for evaluation practice from your own philosophical and theoretical beliefs. They are often used to help design effective programs, and other times as a means to explain how a program is. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models. The framework for evaluation in public health 1 guides public health professionals in their use of program evaluation. Historical and contemporary evaluation paradigms, branches, theories, and approaches. There are two main components of program theory, as shown in the top half of figure 6. In chapter two, he and tina christie talk about an evaluation theory tree and presents this idea graphically all be it in draft form.
All human service programs are designed to make a difference in the lives of people or to. Program theory in evaluation can be developed before a program is implemented or after the. Applying program theorydriven approach to design and. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. The leading text that covers both the theory and practice of evaluation in one engaging volume has now been revised and updated with additional evaluation approaches such as mixed methods and principlesfocused evaluation and new methods such as technologically based strategies. The basic idea is to use the programs rationale or theory as the basis of an evaluation to understand the programs development and impact smith, 1994, p. If it does, the task of the evaluator is to produce a plausible case, with evidence, that shows what has. Evaluation is a relatively new field that has emerged from a diverse array of applied social sciences. The challenges to evaluating plans and planning are discussed, including the reliance on ex ante evaluations, a lack of outcome evaluation methodologies, the attribution gap, and institutional hurdles. It is a tool used to simplify complex relationships between various components and can be used during program planning, implementation and evaluation. Logic models for program design, implementation, and evaluation.
It involves collecting and analyzing information about a programs activities, characteristics, and outcomes. Programme theory can be used to provide a conceptual framework for monitoring, for evaluation, or for an integrated monitoring and evaluation framework. Wilson was program director of the international development program. Consider, for example, an industrial assistance program where the government gives grants on a. Theory of change is a method and an approach that, in recent years, has been increasingly used for designing and monitoring development interventions and also as a framework for use in. In theorybased approaches, the specific steps in a causal chain, the specific causal mechanisms. Request pdf program evaluation theory and practice. Evaluation theory and practice american university online.
Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency. Multiple terms have been integrated into discussions of program theory development and evaluation including. This site is like a library, use search box in the widget to get ebook that you want. Think of your typical tree with three strong branches no leaves and two roots. The basic idea is to use the program s rationale or theory as the basis of an evaluation to understand the program s development and impact smith, 1994, p. Is the evaluation being conducted in a fair and ethical way.
From the point of view of evaluation methods, two groups of evaluation issues can be usefully distinguished. Logic models for program design, implementation, and. Its purpose is to make judgments about a program, to improve its effectiveness, andor to inform programming decisions patton, 1987. Program evaluation theory and practice, first edition. The postpositivist paradigm and the methods branch. Evaluation theory tree evaluation is an everyday activity. Applying a theory of change approach to the evaluation of. From program evaluation tip sheets from wilder research, issue 4. Are approaches at each step accurate, given stakeholder needs and evaluation purpose. To understand program theory, we must first learn about program evaluations.
114 693 336 785 558 1511 779 458 986 1408 815 17 1054 1169 1587 531 397 1050 1566 928 1292 1439 1171 704 491 727 1001 507 1603 362 1589 411 197 473 529 1266 1208 1119 1345 244 831 50 1065 1492 58 182 68