This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2016. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from evaluations of the new GROW exhibition and First Friday program.
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
The Lemelson Center for the Study of Invention and Innovation (Lemelson) at the National Museum of American History (NMAH) contracted RK&A to conduct a front-end evaluation of Game Changers, a new exhibition that will highlight stories of invention and innovation related to sports. The goals of the study were to identify visitors’ associations with sports and invention and explore their reactions to preliminary exhibition concepts and titles.
How did we approach this study?
RK&A conducted 40 in-depth interviews with walk-in visitors to NMAH. As much as possible, RK&A recruited
Although cooperative, interorganizational networks have become a common mechanism for delivery of public services, evaluating their effectiveness is extremely complex and has generally been neglected. To help resolve this problem, we discuss the evaluation of networks of community-based, mostly publicly funded health, human service, and public welfare organizations. Consistent with pressures to perform effectively from a broad range of key stakeholders, we argue that networks must be evaluated at three levels of analysis: community, network, and organization/participant levels. While the three
Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
In April 2018, FHI 360, under the leadership of Maryann Stimmer and Merle Froschl, convened a meeting of thought leaders in Washington, D.C. to capture a “snapshot” of STEM education. They subsequently conducted additional interviews with more than 50 local and national policy leaders; public and private funders; researchers; PreK-12 and post-secondary educators; parents, and leaders of afterschool programs, science centers and youth-serving organizations. The purpose of this summary report is to identify current trends and gaps to inform research, policy, and practice in order to reinforce
Curiosity is a grant-funding programme from the Wellcome Trust with BBC Children in Need., and it provides funding to help youth organisations develop and deliver inspiring science activities for disadvantaged children and young people. This report looks at the key findings from the 32 projects funded during the first round.
The Round 1 projects were delivered by voluntary and community sector organisations, some of which were in partnership with ISL providers, and offered a variety of science opportunities from surveying local weather to building a green-powered race car. Many projects
As part of the public impacts evaluation work conducted for the Explore Science: Earth & Space activity toolkits developed and created through the NASA-funded Space and Earth Informal STEM education (SEISE) project, this summative evaluation study of the toolkits was designed to address and answer questions regarding the number and range of audiences reached by the project, visitor engagement, relevance, science identity, and their understanding around NASA’s Science Mission Directorate (SMD) content areas (astrophysics, planetary science, heliophysics, Earth science). The results are based on
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families
The Math, Engineering, Science Achievement (MESA) outreach programs are partnerships between K-12 schools and higher education in eight states that for over forty years introduce science, mathematics and engineering to K-12 students traditionally underrepresented in the discipline. This exploratory study examines the influences that those MESA activities have on students' perception of engineering and their self-efficacy and interest in engineering and their subsequent decisions to pursue careers in engineering. The MESA activities to be studied include field trips, guest lecturers, design competitions, hands-on activities and student career and academic advisement.
About 1200 students selected from 40 MESA sites in California, Maryland and Utah are surveyed with instruments that build on those used in prior studies. Focus groups with a randomly selected subset of the students provide follow-up and probe the influence of the most promising activities. In the first year of the project the instruments, based on existing instruments, are developed and piloted. Data are taken in the second year and analyzed in the third year. A separate evaluation determines that the protocols are reasonable and are being followed.
The results are applicable to a number of organizations with similar aims and provide information for increasing the number of engineers from underrepresented populations. The project also investigates the correlation between student engagement in MESA and academic performance. This project provides insights on activities used in informal settings that can be employed in the classroom practice and instructional materials to further engage students, especially student from underrepresented groups, in the study of STEM.
DATE:
-
TEAM MEMBERS:
Christine HaileyCameron DensonChandra Austin
In this paper, we use the concept of consequential learning to frame our exploration of what makes learning and doing science matter for youth from nondominant communities, as well as the barriers these youth must confront in working toward consequential ends. Data are derived from multimodal cases authored by four females from nondominant communities that present an account of 'science that matters' from their work during their middle school years. We argue that consequential learning in science for these girls involves engaging science with a commitment to their community. This form of
DATE:
TEAM MEMBERS:
Daniel BirminghamAngela Calabrese BartonAutumn McDanielJalah JonesCamryn TurnerAngel Roberts
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and