As Kathleen Enright rightly stated in the opening article of this issue: “Until all participants in the evaluation chain embrace and support a learning focus, I think our ability to use evaluation results to increase impact will be limited.” As grantmakers, we arguably play the most important role in ensuring that all stakeholders receive the support they need to be full participants, contributors, learners and beneficiaries of an evaluation process. For evaluation to be worth the money and time we spend on it, everyone needs to be a full participant — funders, grantee organizations and even
The Massachusetts Linking Experiences and Pathways Follow-on (M-LEAP2) is a three-year longitudinal empirical research study that is examining prospectively how early formal and informal STEM education experiences are related to gender-based differences in STEM achievement-related choices in middle and high school. M-LEAP2 serves as a complement to - and extension of - a prior NSF-funded study, M-LEAP, which was a largely quantitative research study that followed overlapping cohorts of 3rd - 6th grade female and male students for three years. M-LEAP surveyed over 1,600 students, 627 student-parent pairs, and 134 second parents in 8 diverse public schools across Massachusetts. In contrast, M-LEAP2 is a heavily qualitative three-year study using in-depth interviews with a diverse range of 72 of these students and their families to study how formal and informal science experiences shape the students' science-related beliefs, interests, and aspirations as they progress though middle and high school.
This annotated bibliography provides selected references regarding multiculturalism and cultural competence in evaluation. It contains a section listing more recent publications dating beyond 2007.
CDC provides its funded programs with a wide range of evaluation resources and guides. State health departments, tribal organizations, communities, and partners working in a variety of public health areas may also find these tools helpful. The resources provide guidance on evaluation approaches and methods, relevant examples, and additional resources. The guides are intended to aid in skill building on a wide range of evaluation topics. Practical Strategies for Culturally Competent Evaluation is designed to complement the other evaluation resources offered by the Division for Heart Disease and
DATE:
TEAM MEMBERS:
Centers for Disease Control and Prevention (CDC)Derrick GervinRobin KuwaharaRashon LaneSarah GillRefilwe MoetiMaureen Wilce
This statement of the American Evaluation Association (AEA) affirms the significance of cultural competence in evaluation. It also informs the public of AEA’s expectations concerning cultural competence in the conduct of evaluation.
DATE:
TEAM MEMBERS:
American Evaluation AssociationMelvin HallCindy CrustoKatrina BledsoeJenny JonesKaren KirkhartKatherine TibbettsElizabeth Whitmore
Today, policy makers, funders, and government agencies alike are grappling with the need to use resources efficiently and effectively in order to make a measurable difference in addressing some of today’s pressing significant social, cultural, and educational challenges. When dealing with such complex and “wicked” problems as global warming, hunger, substance abuse, education and skills development (including competencies in STEM disciplines), it’s not enough for an organization to deliver results that contribute only to its bottom line. Increasingly, civic and philanthropic leaders are
The objective of this project is to extend the concept of crowdsourcing in citizen science to the interaction design of the organization as well as to data collection. Distributed technologies offer new opportunities for conducting scientific research on a larger scale than ever before by enabling distributed collaboration. Virtual organizations that use distributed technologies in scientific organizations have primarily focused on how dedicated, professional scientists collaborate and communicate. More recently a rapidly increasing number of citizen science virtual organizations are being formed. Citizen scientists participate in scientific endeavors and typically lack formal credentials, do not hold professional positions in scientific institutions, and bring diversity of knowledge and expertise to projects and challenges. They participate in scientific endeavors related to their personal scientific interests and create new challenges for the design of virtual organizations. In terms of intellectual merit, the project will make three specific contributions: a new interaction design for collecting biodiversity data within a nature park, a model for crowdsourcing the design of an social computing approach to citizen science, and an analysis of the impact of crowdsourcing the design on motivating participation in collecting biodiversity data. Interactive tabletop computers will be placed in two nature parks so that the design of the citizen science environment can be embedded in a park experience and engage the public in understanding more about their parks, in data collection, and develop a personal commitment to environmental sustainability issues. In terms of broader impacts, the project provides three types of impact: research training by including graduate students, broad public dissemination to enhance scientific understanding of biodiversity, and benefits to society through association with the Aspen Center for Environmental Studies (ACES) and Encyclopedia of Life (EOL).
DATE:
-
TEAM MEMBERS:
Mary Lou MaherTom YehJennifer Preece
In this memo, we present a first version of the conceptual framework funded by the John D. and Catherine T. Macarthur Foundation. Our goal is to provide clarity around issues of scale and spread, and to develop a tool that can inform strategic thinking by members of the DML (Digital Media and Learning) community and the broader field. At the heart or the conceptual framework is a typology of conceptions of scale. Our interviews and literature review suggest that there are fundamentally different ways of conceptualizing the goals or outcomes of scale. We identify four: adoption, replication
DATE:
TEAM MEMBERS:
Cynthia CoburnAmy CattersonJenni HiggsKatie MertzRichard Morel
Summative evaluation plays a critical role in documenting the impacts of informal science education (ISE), potentially contributing to the ISE knowledge base and informing ongoing improvements in practice and decision-making. In response to the growing demand for capacity-building in ISE evaluation, this paper presents a framework for summative evaluation based on an extensive review of literature and research-based refinements. The framework synthesizes key elements of high-quality summative evaluation into three dimensions: (a) Intervention Rationale, (b) Methodological Rigor and
This is a handout from the Science Learning Plus (SL+) Forum held on InformalScience.org from July 6-17, 2015. It lists and describes resources about research and practice collaborations.
This paper presents a conceptual framework for analyzing how researchers and district leaders perceive and navigate differences they encounter in the context of research-practice partnerships. Our framework contrasts with images of partnership work as facilitating the translation of research into practice. Instead, we argue that partnership activity is best viewed as a form of joint work requiring mutual engagement across multiple boundaries. Drawing on a cultural-historical account of learning across boundaries (Akkerman & Bakker, 2011) and evidence from a study of two longterm partnerships
Collaboration is a prerequisite for the sustainability of interagency programs, particularly those programs initially created with the support of time-limited grant-funding sources. From the perspective of evaluators, however, assessing collaboration among grant partners is often difficult. It is also challenging to present collaboration data to stakeholders in a way that is meaningful. In this article, the authors introduce the Levels of Collaboration Scale, which was developed from existing models and instruments. The authors extend prior work on measuring collaboration by exploring the
DATE:
TEAM MEMBERS:
Bruce FreyJill LohmeierStephen LeeNona Tollefson