As Kathleen Enright rightly stated in the opening article of this issue: “Until all participants in the evaluation chain embrace and support a learning focus, I think our ability to use evaluation results to increase impact will be limited.” As grantmakers, we arguably play the most important role in ensuring that all stakeholders receive the support they need to be full participants, contributors, learners and beneficiaries of an evaluation process. For evaluation to be worth the money and time we spend on it, everyone needs to be a full participant — funders, grantee organizations and even
The Massachusetts Linking Experiences and Pathways Follow-on (M-LEAP2) is a three-year longitudinal empirical research study that is examining prospectively how early formal and informal STEM education experiences are related to gender-based differences in STEM achievement-related choices in middle and high school. M-LEAP2 serves as a complement to - and extension of - a prior NSF-funded study, M-LEAP, which was a largely quantitative research study that followed overlapping cohorts of 3rd - 6th grade female and male students for three years. M-LEAP surveyed over 1,600 students, 627 student-parent pairs, and 134 second parents in 8 diverse public schools across Massachusetts. In contrast, M-LEAP2 is a heavily qualitative three-year study using in-depth interviews with a diverse range of 72 of these students and their families to study how formal and informal science experiences shape the students' science-related beliefs, interests, and aspirations as they progress though middle and high school.
This annotated bibliography provides selected references regarding multiculturalism and cultural competence in evaluation. It contains a section listing more recent publications dating beyond 2007.
CDC provides its funded programs with a wide range of evaluation resources and guides. State health departments, tribal organizations, communities, and partners working in a variety of public health areas may also find these tools helpful. The resources provide guidance on evaluation approaches and methods, relevant examples, and additional resources. The guides are intended to aid in skill building on a wide range of evaluation topics. Practical Strategies for Culturally Competent Evaluation is designed to complement the other evaluation resources offered by the Division for Heart Disease and
DATE:
TEAM MEMBERS:
Centers for Disease Control and Prevention (CDC)Derrick GervinRobin KuwaharaRashon LaneSarah GillRefilwe MoetiMaureen Wilce
This statement of the American Evaluation Association (AEA) affirms the significance of cultural competence in evaluation. It also informs the public of AEA’s expectations concerning cultural competence in the conduct of evaluation.
DATE:
TEAM MEMBERS:
American Evaluation AssociationMelvin HallCindy CrustoKatrina BledsoeJenny JonesKaren KirkhartKatherine TibbettsElizabeth Whitmore
Many research interventions may show initial positive results, but studies show that these results tend to fade when research structures and supports are removed from the local contexts. In this paper, Gutierrez and Penuel make the case for rethinking what is meant by “rigor” in educational research. To drive truly meaningful and sustainable educational improvement efforts, there is a need for jointly negotiated research that integrates the perspectives, ideas, work, practical considerations, and analysis of educational practitioners. The authors argue that standards for rigorous research
Educators in informal science are exploring data visualization as a way to involve learners in analyzing and interpreting data. However, designing visualizations of data for learners can be challenging, especially when the visualizations show more than one type of data. The Ainsworth three-part DeFT framework can help practitioners design multiple external representations to support learning.
The overall objective of this planning project was to examine the potential effectiveness of the Signing Science Pictionary (SSP) in increasing the ability of parents and their deaf and hard of hearing children to engage in informal science learning. To achieve this objective, research and development included four goals. 1) Design several SSP-based activities to help family members engage in informal science learning. 2) Examine the potential effectiveness of the SSP in increasing family member’s signed science vocabulary. 3) Find out about the potential effectiveness of the SSP in
The resources on this handout were shared by participants of the “Bridging the practice-research gap” forum, which took place on InformalScience.org from July 6-17, 2015.
DATE:
TEAM MEMBERS:
Association of Science-Technology CentersGrace Troxel
The role of informal science institutions in supporting science learning and engagement is becoming increasingly recognised. However, research in this area is published in a variety of journals and can be challenging for practitioners to access and apply. Indeed, it appears that the informal science sector lacks a process by which research can be usefully integrated into practice, and by which practice can inform research. In this paper, we argue that there is a need for research and practice to work together to produce practically relevant and academically credible research. We outline the
This Resource Guide, developed by the California Endowment, was designed to assist foundation staff with evaluations of initiatives and programs working with diverse communities. It has been developed as a “how-to” manual for incorporating a greater multicultural focus when commissioning an evaluation, and also as a resource of ideas for those interested in learning more about the topic.
DATE:
TEAM MEMBERS:
Traci Endo InouyeHanh Cao YuJo-Ann AdefuinChristina JohThe California Endowment
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6. During this first regional workshop in Baltimore, the NFB operated three different programs simultaneously: one program for youth, a second program for their parents/caregivers, and a third program for a group of teachers who work with visually impaired students. A fourth program, for Port Discovery museum staff, was conducted earlier to prepare the museum staff to assist with the youth program