What Do We Know about Evaluator Education? A Review of Peer-Reviewed Publications (1978-2018)
This article reviews peer-reviewed writings on evaluator education from 1978 to 2018. Despite the topic’s presumed importance, scholars to date have not extensively addressed it in peer-reviewed publications. The article first describes the methods used to select articles and the conceptual framework for their analysis. It then presents the content of 64 articles selected for review, divided into two major categories: research studies, and reflective case narratives. We further divide research studies into program directories and empirical studies; the case narratives provide information on programs, curriculum, and inst...
Source: Evaluation and Program Planning - February 2, 2020 Category: International Medicine & Public Health Source Type: research
Mixed-methods library evaluation integrating the patron, library, and external perspectives: The case of Namibia regional libraries
Publication date: Available online 27 January 2020Source: Evaluation and Program PlanningAuthor(s): Moonjung Yim, Michelle Fellows, Chris CowardAbstractThe article presents a mixed-methods evaluation of regional libraries in Namibia, which incorporates three perspectives: the patron perspective (library users), the library perspective (library staff, management, and related officials), and the external perspective (including evaluators and monitoring data). Seven data collection methods were used: patron surveys, patron panel studies, focus group discussions, key informant and staff interviews, secondary data analysis, med...
Source: Evaluation and Program Planning - January 28, 2020 Category: International Medicine & Public Health Source Type: research
Assessing competency-based evaluation course impacts: A mixed methods case study
Publication date: Available online 27 January 2020Source: Evaluation and Program PlanningAuthor(s): Cheryl N. Poth, Michelle Searle, Alexandra M. Aquilina, Jenny Ge, Alexa Elder (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - January 28, 2020 Category: International Medicine & Public Health Source Type: research
The Whole Elephant: Defining Evaluation
Publication date: Available online 27 January 2020Source: Evaluation and Program PlanningAuthor(s): Amy M. Gullickson (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - January 28, 2020 Category: International Medicine & Public Health Source Type: research
Pedagogical Considerations for the Teaching of Evaluation
Publication date: Available online 26 January 2020Source: Evaluation and Program PlanningAuthor(s): John M. LaVelle, Chris Lovato, Clayton StephensonAbstractPedagogy and andragogy refer to the philosophical and empirical assumptions that instructors make about what and how people learn. These assumptions guide much of the subsequent instructional design process, including learning objectives, learning experiences, assessment techniques, and more. Most of the existing literature in evaluator education is descriptive in nature, and there has been limited attention to research on pedagogy specific to evaluation or identificat...
Source: Evaluation and Program Planning - January 27, 2020 Category: International Medicine & Public Health Source Type: research
Practice Makes Better? Testing a Model for Training Program Evaluators in Situation Awareness
This study addressed that gap by examining the potential for one online training program, informed by research on deliberate practice, to accelerate evaluators’ progress towards expertise in situation awareness. Built to align with evidence on developing situation awareness skills, the EvalPractice portal combined (1) an extensive ‘case bank’ of real-world evaluation scenarios, (2) repetitive practice that allowed novice evaluators to practice interpreting these evaluation scenarios, and (3) immediate feedback on the accuracy of these efforts based on events from the real-life version of the scenario. Findings from a...
Source: Evaluation and Program Planning - January 25, 2020 Category: International Medicine & Public Health Source Type: research
Context matters: Using mixed methods timelines to provide an accessible and integrated visual for complex program evaluation data
We present methods and best practices for collecting contextual data and for incorporating a variety of data sources into such a visual. We discuss several strategies to collect and organize context related data including: qualitative interviews, program materials, narrative reports, and member checking with stakeholders and staff. Gathering multiple perspectives is essential to better capture the multi-layered elements of program activities and context. (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - January 24, 2020 Category: International Medicine & Public Health Source Type: research
Development and validation of an instrument to assess institutionalization of health promotion in faith-based organizations
Publication date: Available online 21 January 2020Source: Evaluation and Program PlanningAuthor(s): Randi M. Williams, Jing Zhang, Nathaniel Woodard, Jimmie Slade, Sherie Lou Zara Santos, Cheryl L. KnottAbstractInstitutionalization of health promotion interventions occurs when the organization makes changes to support the program as a component of its routine operations. To date there has not been a way to systematically measure institutionalization of health promotion interventions outside of healthcare settings. The purpose of the present study was to develop and evaluate the initial psychometric properties of an instrum...
Source: Evaluation and Program Planning - January 22, 2020 Category: International Medicine & Public Health Source Type: research
What Can We Learn about Unintended Consequences from a Textual Analysis of Monitoring Reports and Evaluations for U.S. Foreign Assistance Programs?
Publication date: Available online 16 January 2020Source: Evaluation and Program PlanningAuthor(s): Martin de Alteriis (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - January 18, 2020 Category: International Medicine & Public Health Source Type: research
Codifying explicit and tacit practitioner knowledge in community social pediatrics organizations: Evaluation of the first step of a knowledge transfer strategy
Publication date: Available online 3 January 2020Source: Evaluation and Program PlanningAuthor(s): Christian Dagenais, Didier Dupont, Frédéric Nault-Brière, Diego Mena, Gabrielle Yale-Soulière, Esther Mc Sween-Cadieux (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - January 5, 2020 Category: International Medicine & Public Health Source Type: research
Using Video Vignettes in Research and Program Evaluation for People with Intellectual and Developmental Disabilities: A Case Study of the Leadership for Empowerment and Abuse Prevention Project
Publication date: Available online 20 December 2019Source: Evaluation and Program PlanningAuthor(s): Parthenia Dinora, Andrew Schoeneman, Molly Dellinger-Wray, Elizabeth Cramer, Jack Brandt, Allison D’Aguilar (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - December 21, 2019 Category: International Medicine & Public Health Source Type: research
How do public investments in gender equality initiatives and publication patterns interrelate? The case of Germany
This article examines whether two of the major German flagship programmes to increase the participation of female researchers in the German science system, the "Women Professorship Programme" and the "Pact for Research and Innovation", have actually increased the number of women, especially in leadership positions. In a second step, we analyse whether such an assumed increase influences the publication patterns of authors with German affiliation. This article is based on literature and desk research as well as bibliometric analysis using Scopus. The most important result is that the number of women in research has indeed i...
Source: Evaluation and Program Planning - December 21, 2019 Category: International Medicine & Public Health Source Type: research
Evaluation Capacity Building (ECB) Interventions and the Development of Sustainable Evaluation Practice: An Exploratory Study
Publication date: Available online 19 December 2019Source: Evaluation and Program PlanningAuthor(s): Jay Wade, Leanne Kallemeyn (Source: Evaluation and Program Planning)
Source: Evaluation and Program Planning - December 20, 2019 Category: International Medicine & Public Health Source Type: research
Evaluation of Technological Competence and Operations Efficiency in the Defense Industry: The Strategic Planning of South Korea
Publication date: Available online 16 December 2019Source: Evaluation and Program PlanningAuthor(s): Jun Gon Lee, Min Jae ParkAbstractThis research aims to contribute to efficiency improvement by providing the implications for decision-making on continuous defense R&D investment strategies and acquisition methods via analyzing the current position and measuring the efficiency of overall weapon systems on technological competence and operations. This research is distinctive in comparison to previous studies because it is structured in a two-stage DEA analysis for efficiency by distinguishing between the technology and opera...
Source: Evaluation and Program Planning - December 17, 2019 Category: International Medicine & Public Health Source Type: research
Utilizing the RE-AIM framework to determine effectiveness of a preschool intervention program on social-emotional outcomes
Publication date: Available online 16 December 2019Source: Evaluation and Program PlanningAuthor(s): Ruby A. Natale, Ellen Kolomeyer, Ana Robleto, Zafreen Jaffery, Rachel SpectorAbstractSocial-emotional issues in preschoolers continue to be an area of concern across the nation. Models to determine effective implementation practices are needed. The Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework is one model that can be used to evaluate program implementation in preschool settings. The Jump Start program provided short-term intervention to children in low-income preschools from multiethnic bac...
Source: Evaluation and Program Planning - December 17, 2019 Category: International Medicine & Public Health Source Type: research
