This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The intent of this five-year project is to design, deliver, and study professional development for Informal Science Learning (ISL) educators in the arena of equity-focused STEAM (Science, Technology, Engineering, Art, and Mathematics) teaching and learning. While the strategy of integrating art and science to promote interest, identity, and other STEM-related learning has grown in recent years, this domain is still nascent with respect to a guiding set of best practices. Through prior work, the team has developed and implemented a set of design principles that incorporate effective practices for broadening participation of girls in science via science-art integration on the topic of the biology, chemistry and optics of "Colors in Nature." The continued initiative would impact the ISL field by providing a mechanism for ISL educators in museums, libraries and after-school programs to adopt and implement these STEAM design principles into their work. The team will lead long-term (12-18 months) professional development activities for ISL educators, including: 1) in-person workshops that leverage their four previously developed kits; 2) online, asynchronous learning activities featuring interactive instructional videos around their STEAM design principles; 3) synchronous sessions to debrief content and foster communities of practice; and 4) guided design work around the development or redesign of STEAM activities. In the first four years of the project, the team will work with four core institutional partners (Sitka Sound Science Center, Sno-Isle Libraries, the Fairbanks North Star Borough School District after-school program, and the Pima County Public Library system) across three states (Alaska, Washington, and Arizona). In the project's later stages, they will disseminate their learning tools to a broad, national audience. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project has three main goals: (1) To support ISL educators in offering meaningful STEAM activities, (2) To create institutional change among the partner organizations, and (3) To advance the ISL field with respect to professional development and designing for STEAM Programming. The research questions associated with the professional development activities address the ways in which change occurs and focus on all three levels: individual, institutional, and the ISL field. The methods are qualitative and quantitative, including videotaped observations, pre and post interviews, surveys and analysis of online and offline artifacts. In addition, the project evaluation will assess the implementation of the project's professional development model for effectiveness. Methods will include observations, interviews, surveys and Website analytics and program data.
This poster was presented at the Annual Meeting of the Association for Science Teacher Education in Charleston, SC from January 9-12, 2013. The study seeks to answer the question "What is the role of conversation in influencing science learner identity development during an informal science education camp?"
DATE:
TEAM MEMBERS:
University of North Carolina, WilmingtonKelly Riedinger
Project LIFTOFF works with local, regional, and national partners to engineer statewide systems for Informal Science Education that inspire: YOUTH to pursue STEM education and careers through increased opportunities for quality, hands-on STEM learning. AFTERSCHOOL STAFF to facilitate STEM learning experiences that contribute to the overall STEM education and aspirations of youth in their programs. PROGRAM ADMINISTRATORS to encourage and support staff in the integration of STEM enrichment into the daily programming. STATE LEADERS to sustain and expand afterschool learning opportunities so that all students have access to engaging STEM experiences outside of the regular school day. Project LIFTOFF is dedicated to the development of the following essential elements of statewide systems for informal science education:
Access to appropriate STEM Curriculum for youth of all ages, abilities, and socio-cultural backgrounds that meets the needs and interests of individual community programs
Systematic STEM Professional Development that matches individual skills in positive youth development with abilities to facilitate discovery and science learning
A diverse Cadres of Trainers who will deliver the professional development, technical assistance and curriculum dissemination in their local communities
Authentic Evaluation of informal science efforts that determine the impacts on youth aspirations and the capacity of youth programs to provide quality STEM experiences
Local STEM education leadership to identify the ways in which collaborative education efforts can advance the development of 21st Century Skills and the preparedness for STEM workforce and higher education
Partnerships in support of youth development and informal science education that convene local, regional, and statewide organizations and stakeholders
To advance national initiatives and states' sySTEM engineering efforts, LIFTOFF coordinates an annual convening, the Midwest Afterschool Science Academy, that brings together national informal science experts, system leaders and youth development professionals to elevate the levels of science after school. The 5th MASA will be in the spring of 2014 in Kansas City, MO
DATE:
TEAM MEMBERS:
Missouri AfterSchool NetworkJeff Buehler
Suitcase Science is a community-inspired theatre program and exhibit that highlights many scientific disciplines, including anthropology, biology, chemistry, geology, sociology and material culture. Its development was funded through a Legacy grant from the state of Minnesota. To help generate topics and ideas to include in the Suitcase Science show and exhibit, SMM held several workshops in communities around the state. SMM staff invited local community members to bring two objects of value, meaning, or significance to the workshop and to share their story about them. These stories and
Fort Worth Museum of Science and History (FWMSH) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate CSI: The Experience National Science Foundation- and Science Museum Exhibit Collaborative-funded project focused on forensic science. The project included a museum exhibition and an online gaming experience (Web Adventure) targeting children ages 9 to 17 and adults. A summative evaluation explored visitors' overall experiences, understanding of forensic sciences, and the research question: Does the Web Adventure extend exhibition visitors' learning of forensic science? A process
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Fort Worth Museum of Science and History
Marvelous Molecules: The Secret of Life is a 3,500-square-foot exhibition installed on the lower exhibit floor of the New York Hall of Science (NYHoS) between Hidden Kingdoms and Realm of the Atom. The 27 exhibit elements are grouped in sections that feature molecules for sensing, moving, reproduction, defending, and other biological functions. The big idea of the exhibition is: Inside what appear to be very different living things, molecules interact in similar ways to make things happen. In Spring 2001, a summative evaluation of Marvelous Molecules was conducted by Serrell & Associates
The University of California, Berkeley is developing "Windows on Research," a two-year experimental exhibit project at the Lawrence Hall of Science focused on engaging and informing the public about current scientific research. The project will develop and evaluate different media to translate the leading edge of nanotechnology research for the science center audience by featuring live demonstrations and presentations, physical- and technology-based exhibits, and Internet-based exhibits. Formative evaluation of all products, including ongoing public focus groups and surveys, will be used to establish which of the several media, alone or combined, work best to communicate research content. The project team also is developing new assessment tools to test usability and effectiveness of the artificial intelligence and technology-based components in conveying content. The results of this prototype effort to present ongoing research in a museum setting will be disseminated to the informal science education field. The PI, Marco Molinaro, and the team from the Lawrence Hall of Science will work closely with scientists representing research in a number of nanotechnology fields. These scientists bring expertise in the areas of materials science, chemistry, education, bioengineering, mechanical engineering, molecular and cell biology, geochronology and isotope geochemistry, and psychology.
DATE:
-
TEAM MEMBERS:
Marco MolinaroUniversity of California-BerkeleyDarrell Porcello
This formative evaluation was conducted to see how the addition of an interactive media piece enhanced visitors' understanding of Nasturtium, a life sciences exhibit that demonstrates the water repelling properties of nasturtium leaves. The media piece allows the visitor to view leaf structures at progressively higher magnifications to better illustrate their scale and function. The interview questions used in this study are included in the appendix of this report.
This report documents two formative evaluations on an interactive media piece that allows its users to zoom in from a human hand to an atom. This zoom uses a spiral to connote zooming and is a departure from a more conventional zoom in which each successive image is a magnification of a portion of the preceding image. Interview protocols are included in the appendix of this report.
The Science Museum of Minnesota surveyed 30 museum visitors after they used the Changing Colors exhibit. This formative testing of the exhibit assessed its ability to teach about nanoscale structures and the uses of nanophenomena to create new products.