This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Northwest Passage Project explored the changing Arctic through an innovative expedition aboard the Swedish Icebreaker Oden to conduct groundbreaking ocean science research, while it actively engaged 22 undergraduate and graduate students from the project’s five Minority Serving Institution (MSI) partners and 2 early career Inuit researchers in the research at sea. Over 35 hours of training in Arctic research techniques, polar science, and science communication was provided to these participants, who were engaged in the Northwest Passage expedition and worked with the onboard science team
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. The project will develop and research an integrated package of high-quality, widely accessible media and other outreach materials designed to engage middle school youth, educators, and libraries in learning about viruses in relation to COVID-19. There is an immediate need to provide youth with accurate, engaging, and accessible materials to help them understand the basic biology underlying the COVID-19 pandemic, including the routes of COVID-19 transmission and mechanisms to prevent its spread. This is particularly important for those without science backgrounds or interests so that the rumors, hearsay, and gossip circulating among youth can be replaced with research-based information. Since 2007, the project team and partners have focused on developing and studying new ways of educating youth and the public about biology, virology, and infectious disease. The project will develop a web-accessible package of customizable graphics, illustrated stories, and essays--all of which can be easily incorporated into free-choice and directed on-line learning as well standards-based lesson plans for Grades 6-8. These resources will be disseminated broadly and at no cost to youth and educators of all kinds, including schools, libraries, museums, and other established networks for formal and informal science education. The project web package will be linked to multiple websites that serve as important educational resources on science and virology for youth, the general public, and educators. A prominent university press will publish and promote the illustrated stories and support distribution of 7,000 free copies.
The project will conduct research examining how richly-illustrated science narratives impact youth understanding of and curiosity about science. The research will help develop the foundation for better understanding how to educate youth about COVID-19 (and future pandemics) while generating new knowledge about effective methods for public science outreach during a major unanticipated natural event. For formative evaluation, the project will use an innovative rapid response feedback method. Youth will be invited to provide timely, specific comments on the serialized stories through a curated portal. As new excerpts are related online, different questions will be posed to youth who are selected because of specific characteristics (e.g., low or high initial science interest). These data will guide story development in real time and provide a mechanism to gauge the story appeal, comprehensibility, and initial impacts. The project will address two research questions: (1) How effective are illustrated stories in having positive impacts among participants on COVID-19 knowledge, science identity, attitudes, and interest in science careers?; and (2) How do story lines and characters have differential impacts on virus knowledge, epidemiology, and youth attitudes towards science and science careers? To conduct this research, the project will conduct online surveys using adapted items from prior research conducted by the project team. Additional items will assess COVID-19 knowledge, attitudes, personal experiences with the virus, well-being, and exposure to public health messaging about the virus. Research findings will be shared widely to inform the field about new ways delivering science education content during the advent of rapidly evolving global and educational challenges.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Judy DiamondJulia McQuillanPatricia Wonch HillElizabeth VanWormer
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
This CAISE report is designed to track and characterize sector growth, change and impact, important publications, hot topics/trends, new players, funding, and other related areas in Informal STEM Education (ISE) in 2017. The goal is to provide information and links for use by ISE professionals, science communicators, and interested stakeholders who want to discover new strategies and potential collaborators for project and proposal development. Designed as a slide presentation and divided into sectors, it can be used modularly or as a complete report. Each sector reports on research, events
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
The University of California, Berkeley's Lawrence Hall of Science (LHS), in partnership with the Bishop Museum in Honolulu, HI, propose to develop and evaluate curriculum-based content modules for spherical display systems. These modules will combine successful research-driven curriculum materials with the compelling nature of a spherical display to engage and inform museum visitors in the process of observing and interpreting patterns of global climate data.
The Environmental Scientist-in-Residence Program will leverage NOAA s scientific assets and personnel by combining them with the creativity and educational knowledge of the pioneer hands-on science center. To do this, the program will embed NOAA scientists in a public education laboratory at the Exploratorium. Working closely with youth Explainers, exhibit developers, and Web and interactive media producers at the Exploratorium, NOAA scientists will share instruments, data, and their professional expertise with a variety of public audiences inside the museum and on the Web. At the same time the scientists will gain valuable skills in informal science communication and education. Through cutting-edge iPad displays, screen-based visualizations, data-enriched maps and sensor displays, and innovative interactions with visitors on the museum floor, this learning laboratory will enable NOAA scientists and Exploratorium staff to investigate new hands-on techniques for engaging the public in NOAA s environmental research and monitoring efforts.
The Museum of Science and Industry, Chicago (MSI) will develop museum-based education resources to engage high school age youth in the exploration of climate literacy and Earth systems science through its Teen ACES (Teen Advocates for Community and Environmental Sustainability) project. As the future leaders who will make decisions about the issues they face in their communities, youth participants will be positioned to act as advocates for establishing resilient communities in the Midwest. The project will utilize a variety of resources, including NOAA Science On a Sphere® (SOS) technology and datasets, Great Lakes and local climate assets from the Midwest Regional Climate Center and Illinois-Indiana Sea Grant, and existing local planning guides to develop museum-based youth programming. Teens will explore environmental hazards including severe weather events and temperature extremes, and consider the impact of the Great Lakes on regional climate. The Chicago Metropolitan Agency for Planning, Resilient Chicago, the Institute of Environmental Sustainability at Loyola University Chicago, and the South Metropolitan Higher Education Consortium will advise on the project to support the integration of municipal resiliency plans and their related adaptation and mitigation measures into the program. Teen participants will share their learning with the Chicago community through interactions with public visitors in the Museum, programs at Chicago Public Library branches, and MSI’s teen science program broadcast on Chicago’s public access TV station. Teen facilitated experiences will be tailored for SOS® experiences at MSI. The project will revise content for use in 100 after-school science clubs for students from diverse communities across the Chicago area. Further dissemination to three regional science center partners equipped with SOS® technology (Boonshoft Museum of Discovery in Dayton, Ohio; Science Central in Fort Wayne, Indiana; and Hawthorn Hollow in Kenosha, Wisconsin) will build a foundation of knowledge and resources to adapt materials to meet the needs of their communities and consider how their vulnerabilities and resiliency plans may differ from Chicago.
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.