As Kathleen Enright rightly stated in the opening article of this issue: “Until all participants in the evaluation chain embrace and support a learning focus, I think our ability to use evaluation results to increase impact will be limited.” As grantmakers, we arguably play the most important role in ensuring that all stakeholders receive the support they need to be full participants, contributors, learners and beneficiaries of an evaluation process. For evaluation to be worth the money and time we spend on it, everyone needs to be a full participant — funders, grantee organizations and even
The Massachusetts Linking Experiences and Pathways Follow-on (M-LEAP2) is a three-year longitudinal empirical research study that is examining prospectively how early formal and informal STEM education experiences are related to gender-based differences in STEM achievement-related choices in middle and high school. M-LEAP2 serves as a complement to - and extension of - a prior NSF-funded study, M-LEAP, which was a largely quantitative research study that followed overlapping cohorts of 3rd - 6th grade female and male students for three years. M-LEAP surveyed over 1,600 students, 627 student-parent pairs, and 134 second parents in 8 diverse public schools across Massachusetts. In contrast, M-LEAP2 is a heavily qualitative three-year study using in-depth interviews with a diverse range of 72 of these students and their families to study how formal and informal science experiences shape the students' science-related beliefs, interests, and aspirations as they progress though middle and high school.
Many research interventions may show initial positive results, but studies show that these results tend to fade when research structures and supports are removed from the local contexts. In this paper, Gutierrez and Penuel make the case for rethinking what is meant by “rigor” in educational research. To drive truly meaningful and sustainable educational improvement efforts, there is a need for jointly negotiated research that integrates the perspectives, ideas, work, practical considerations, and analysis of educational practitioners. The authors argue that standards for rigorous research
The resources on this handout were shared by participants of the “Bridging the practice-research gap” forum, which took place on InformalScience.org from July 6-17, 2015.
DATE:
TEAM MEMBERS:
Association of Science-Technology CentersGrace Troxel
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6. During this first regional workshop in Baltimore, the NFB operated three different programs simultaneously: one program for youth, a second program for their parents/caregivers, and a third program for a group of teachers who work with visually impaired students. A fourth program, for Port Discovery museum staff, was conducted earlier to prepare the museum staff to assist with the youth program
Today, policy makers, funders, and government agencies alike are grappling with the need to use resources efficiently and effectively in order to make a measurable difference in addressing some of today’s pressing significant social, cultural, and educational challenges. When dealing with such complex and “wicked” problems as global warming, hunger, substance abuse, education and skills development (including competencies in STEM disciplines), it’s not enough for an organization to deliver results that contribute only to its bottom line. Increasingly, civic and philanthropic leaders are
The United Nations Strategic Plan for Biodiversity 2011-2020 is a key initiative within global efforts to halt and eventually reverse the loss of biodiversity. The very first target of this plan states that "by 2020, at the latest, people are aware of the values of biodiversity and the steps they can take to conserve and use it sustainably." Zoos and aquariums worldwide, attracting more than 700 million visits every year, could potentially make a positive contribution to this target. However, a global evaluation of the educational impacts of visits to zoos and aquariums is entirely lacking in
With this 3-year project, TERC and the Museum of Science (MoS) Boston are studying how family and school visitors integrate iPod Touch versions of the Signing Science Pictionary (SSP), Signing Science Dictionary (SSD), and Signing Math Dictionary (SMD) into their museum experience and the impact of dictionary use. This report focuses on family visitors. Each dictionary includes more than 700 standards-based science or mathematics terms. The SSP (funded in part by grants from the Shapiro Family Foundation and the U. S. Department of Education, Grant #H327A080040) is intended for children ages 5
With this project, TERC and the Museum of Science (MoS) Boston are studying how family and school visitors integrate iPod Touch versions of the Signing Science Pictionary (SSP), Signing Science Dictionary (SSD), and Signing Math Dictionary (SMD) into their museum experience and the impact of dictionary use. This report focuses on a sub-study involving family visitors to the Harvard Museum of Natural History (HMNH). Prior to this sub-study, TERC and the MoS conducted a primary study that examined use of the dictionaries at the MoS. Findings from this study showed the following: (1) Visitors
This report details the summative evaluation of the Flight of the Butterflies IMAX film. Four focus with a total of 39 participants took part. They watched the film in either 2D or 3D. The St. Louis Science Center, where the film was presented in large 2D format, hosted two focus groups with adults (n=19). The Maryland Science Center (MSC) in Baltimore, which showed the film in 3D format, hosted one focus group with adults (n=8) and another with middle school age students (n=12). All participants were recruited through the science center membership lists. The focus group began with initial
The report is of the treatment of the Flight of the Butterflies IMAX film. 42 individuals participated in four focus groups in two cities and were asked to read the film treatment in advance and were shown a two and a half minute video clip. Participants then completed a four-page questionnaire with open and closed-ended questions, and engaged in an hour-long discussion of the treatment. Survey and focus group questions were designed to elicit audience perspectives on the appeal and scientific content of the script, including discussion of the film concept, use of the large format medium
Over 200 zoos and aquariums in North America are accredited members of the Association of Zoos & Aquariums (AZA), with a shared vision of the future: a world where all people respect, value and conserve wildlife and wild places. Through programs & experiences that reach millions of people each year, we hope to encourage caring and empathy towards all living things, but we lack the tools that are needed to assess whether – and how – we’re reaching this goal. The overall goal of this 2 year collaborative project is to create tools that zoos and aquariums can use to assess whether they’re meeting their goal of encouraging caring and empathy towards wildlife. Project partners (Woodland Park Zoo, Point Defiance Zoo & Aquarium, & Seattle Aquarium) aim to develop, test and share tools that can be used by accredited zoos & aquariums to assess whether their educational programs are having the desired impact of encouraging children’s empathy towards animals. To better inform our understanding of the empathic experience and the role it plays in human relationships with animals, an advisory team comprised of conservation psychologists and evaluation practitioners in the zoo and aquarium field, has been formed to aid in this two year project.