Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Children Investigating Science with Parents and Afterschool (CHISPA) was a collaboration between the Phillip and Patricia Frost Museum of Science, UnidosUS (formerly National Council of La Raza), and the ASPIRA Association that took place from 2014-18. CHISPA sought to address the disparity in science achievement among Latino and non-Latino children through local-level partnerships between science museums in metropolitan areas with growing Latino populations and UnidosUS and ASPIRA affiliate organizations serving the same communities through afterschool programs.
Partners included the
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
The University of California, Davis Tahoe Environmental Research Center (TERC), UC Davis W.M. Keck Center for Active Visualization in the Earth Sciences (KeckCAVES), ECHO Lake Aquarium and Science Center (ECHO), UC Berkeley Lawrence Hall of Science (LHS), and the Institute for Learning Innovation (ILI) will study how 3-D visualizations can most effectively be used to improve general public understanding of freshwater lake ecosystems and Earth science processes through the use of immersive three-dimensional (3-D) visualizations of lake and watershed processes, supplemented by tabletop science activity stations. Two iconic lakes will be the focus of this study: Lake Tahoe in California and Nevada, and Lake Champlain in Vermont and New York, with products readily transferable to other freshwater systems and education venues. The PI will aggregate and share knowledge about how to effectively utilize 3-D technologies and scientific data to support learning from immersive 3-D visualizations, and how other hands-on materials can be combined to most effectively support visitor learning about physical, biological and geochemical processes and systems. The project will be structured to iteratively test, design, and implement 3-D visualizations in both concurrent and staggered development. The public will be engaged in the science behind water quality and ecosystem health; lake formation; lake foodwebs; weather and climate; and the role and impact of people on the ecosystem. A suite of publicly available learning resources will be designed and developed on freshwater ecosystems, including immersive 3-D visualizations; portable science stations with multimedia; a facilitator's guide for docent training; and a Developer's Manual to allow future informal science education venues. Project partners are organized into five teams: 1) Content Preparation and Review: prepare and author content including writing of storyboards, narratives, and activities; 2) 3-D Scientific Visualizations: create visualization products using spatial data; 3) Science Station: plan, design, and produce hands-on materials; 4) Website and Multimedia: produce a dissemination strategy for professional and public audiences; 4) Evaluation: conduct front-end, formative, and summative evaluation of both the 3-D visualizations and science activity stations. The summative evaluation will utilize a mixed methods approach, using both qualitative and quantitative methods, and will include focus groups, semi-structured interviews, web surveys, and in-depth interviews. Leveraging 3-D tools, high-quality visual displays, hands-on activities, and multimedia resources, university-based scientists will work collaboratively with informal science education professionals to extend the project's reach and impact to an audience of 400,000 visitors, including families, youth, school field trip groups, and tourists. The project will implement, evaluate, and disseminate knowledge of how 3-D visualizations and technologies can be designed and configured to effectively support visitor engagement and learning about physical, biological and geochemical processes and systems, and will evaluate how these technologies can be transferred more broadly to other informal science venues and schools for future career and workforce development in these critical STEM areas.
COSI offers special event programming on a monthly basis designed to enhance the guest experience: primarily Science Day and Fun Day special events. Science Days are events that highlight science topics, especially those dealing with our specific areas of focus, and celebrations surrounding events with a science theme, such as Space and Stars Day. On the other hand, Fun Days are events that are appealing to guests and are simple to implement, such as appearances by local sports teams, celebrities, performance groups, etc. COSI would like to better understand the impact special events have in
COSI, in partnership with WOSU @ COSI, will be going forward with a project in which enhancements and other changes may be made to the WOSU exhibition space, entrance area, and adjacent hallway. This project may include, but is not limited to, introducing more elements of the PBS Kids brand, such as Sesame Street and Sid the Science Kid, into the exhibition space, introducing interactive elements regarding TV Production to the site, and adding loose parts to the Chroma Key exhibit. To inform decisions about the type and nature of enhancements most needed in the exhibit area, COSI desires to
Magnolia Consulting, LLC conducted a formative and summative evaluation to examine public perceptions of the utility and quality of two labs/exhibits within the North Carolina Museum of Natural Sciences Natural World Investigate Lab, Biofuels and Science of Scent. Appendix includes survey.
DATE:
TEAM MEMBERS:
North Carolina State Museum of Natural ScienceMary Styers
This report contains findings from a summative evaluation study of a set of four featured elements that comprise the new Nature Research Center of the North Carolina Museum of Natural Sciences. The elements were: 1) an exhibit, Ancient Fossils, New Discoveries; 2) Investigate Labs; 3) Daily Planet Scientist Talks; 4) Science Cafes. Evaluation was conducted as four distinct, multi-method studies to provide targeted understanding of visitor outcomes and experiences at each element. Findings across the four elements indicate that the features of the NRC are enjoyed by visitors and each supports
This is an evaluation study of a new installation of interpretive signage and eight interactives in the Jungle Trails exhibition area of the Cincinnati Zoo and Botanical Garden. The summative evaluation is framed by the overall evaluation question: Does the Jungle Trails area facilitate learning through family interactions? To address this question, four broad sub-questions were determined as indicators of success of the project: 1. Do families engage with the interactives? 2. Do families perceive a difference in the way they interact in Jungle Trails? 3. Does the ‘family approach’ to signage
This is an evaluation study of a new installation of seven interactives in the Jungle Trails exhibition area of the Cincinnati Zoo & Botanical Garden. The formative evaluation is framed by the overall evaluation question: Does the Jungle Trails area facilitate learning through family interactions? To address this question, three broad sub-questions will guide the study: (1) With what interactives did family groups choose to engage and why did they choose to engage? (2) In what ways do participants engage with the interactives and why? (3) What might enhance the interpretations in ways that
The data collection for this project involves three audiences: (1) a post-event survey completed by participants at the 'Eight-Legged Encounters' event, (2) a club experience survey completed by middle school students in an after school club, and (3) focus groups, observations, and end-of-course evaluations conducted with students in the BIOS 497/897 'Communicating Science through Outreach' seminar class at the University of Nebraska-Lincoln. Data was collected from February to April, 2013 and the evaluation was conducted by the Bureau of Sociological Research (BOSR). Appendix contains surveys
DATE:
TEAM MEMBERS:
University of Nebraska-LincolnEileen Hebets