The Implementation Manual is a practical guide for organizations planning to implement Portal to the Public. It represents the experiences of Portal to the Public sites and is supported by research and evaluation results. The seven chapters in the manual are designed around the main components of the Portal to the Public guiding framework. The chapters guide you through the process of developing successful conversation-based public programs featuring scientists.
Chapter 1: The Guiding Framework
Chapter 2: Conceptual Planning
Chapter 3: Partnership and Relationship Building
Chapter
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Many of the nation's poorest-performing schools are in rural areas. Anecdotal information suggests participation in and access to informal STEM learning opportunities in Mississippi - a state with among the lowest STEM-career readiness in the nation - is unequally distributed among geographic regions and sociocultural environments. Informal learning programs in science, technology, engineering, and math (STEM) have the potential to reach into rural communities and provide a bridge to greater STEM access, literacy, and career readiness. Building Bridges: Broadening the STEM Conversation in Rural Mississippi will initiate a dialog among key practitioners, experts, and stakeholders in informal STEM learning focused on identifying the causes of and solutions to STEM inclusion barriers among rural youth. The goal of this Advancing Informal STEM Learning (AISL) Conference Project aligns with NSF's mission to promote the progress of science for all segments of society, including rural K-12 students. Solutions to STEM disconnections identified in Mississippi through this project will have relevance and transferability to rural communities across the southeastern US, given regional commonalities in socioeconomic, educational, and cultural factors.
This project aims to conduct an interactive and participant-based summit that brings together key leaders and experts from informal science learning institutions and organizations, STEM-related agencies and industries, and rural community groups to improve methods for linking informal STEM learning opportunities with rural, K-12 students. The goal of the project is to identify the common barriers and explore potential solutions to informal STEM participation by rural K-12 students in Mississippi. With the guidance of a steering committee, a Mississippi STEM Consortium will be formed and convened at a 2019 Mississippi Informal STEM Consortium Summit with the following goals: (1) Identify broad barriers to informal STEM learning in diverse and rural K-12 populations. (2) Define crucial and transformative elements in informal STEM programs deemed successful in rural student recruitment and engagement. (3) Improve collaborative networking to enhance the role of informal education in building statewide STEM capacity. These objectives will be met by developing, implementing, and evaluating statewide needs-assessment surveys and a two-day summit of Consortium members. The project evaluator will ensure process and outcome evaluations are properly conducted throughout the entire course of the project to inform planning, promote iterative improvement, monitor progress, and ensure achievement of desire objectives. With regards to broader impacts, it is anticipated that outcomes from this project will have impact within and beyond Mississippi's borders. Expected project outcomes include scientific manuscripts on needs-assessment surveys, modified approaches to existing informal STEM activities, future research on identified informal STEM participation barriers and mitigation measures, new collaborations that broaden participation and expand future research, and a draft Informal STEM Strategic Plan for Mississippi. Varied dissemination methods will be used to communicate the findings broadly.
This conference project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Leslie BurgerSarah LeeKatherine EcholsVemitra White
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The team of Associated Universities Inc. (AUI), Michigan State University (MSU), California Academy of Science (the Academy), Astronomical Society of the Pacific (ASP), and Association of Universities for Research in Astronomy (AURA), will bring together experts in astronomy, STEM education, and planetarium show production. This work will tell the story of the people and places that make "big astronomy" possible, particularly the search for exoplanets and understanding of how planets form. The show and related materials will be presented in dozens of venues around the USA and internationally. Through a planetarium show and learning experiences that extend beyond the theater, the team will take visitors to extreme sites of the NSF ground-based observatories on the mountains of Chile and meet the diverse people who enable amazing discoveries in astronomy. In addition, the project develops the Dome+ model, which ensures engagement does not end with the planetarium. Dome+ will include additional content, weekly virtual sessions with STEM professionals, and a suite of closely linked outreach activities. Dome+ will serve as a model to extend engagement and increase the impact of future planetarium shows. Project goals include 1) increasing awareness of the research in astronomy being made at the NSF-funded observatories in Chile, 2) increasing awareness and interest in diverse STEM career opportunities at large observatories and related institutions in the USA, 3) increasing knowledge of science enabled by big observatories, 4) increasing Latinx perceptions as someone who can have a career at a major observatory, and 5) developing the Dome+ model and identify best practices for implementation. Iterative and summative evaluation of the project by collaborators at MSU will address four main questions: How does the Dome+ model affect visitors' perceptions of diversity of careers in STEM? How does the Dome+ model affect visitors' interest and understanding of Chile as an ideal observing location for astronomy? How does the Dome+ model support visitors' interest and understanding of the science of exoplanets? How do planetariums implement Dome+, and how does implementation affect the outcomes for visitors? The impact assessment component of this project takes places in four phases. The goals of the first phase are to leverage the expertise of the research team to inform the creation of the planetarium show and to set up a robust research agenda to be achieved in Years 2-4 of the project. The goals of the second phase are to collect preliminary data from visitors on their responses to planetarium show content and to use this information to advise on edits to the show and to develop the content and format of the web-portal and educational materials. The goal of the third phase is to then collect data on how effectively the technology-rich environments of the three components of the Dome+ model (planetarium show, web-portal, educational materials) work in concert to reach the intended goals of changing visitors' perceptions of diversity in STEM, engaging visitors with astronomy content on exoplanets, and exposing visitors to the wonders of astronomy research in Chile. The goal of the fourth phase is to perform data analysis, synthesize findings and make recommendations for future implementations of the Dome+ model for practitioners. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Antarctic Dinosaurs project aims to leverage the popularity and charisma of dinosaurs to inspire a new generation of polar scientists and a more STEM (Science, Technology, Engineering, Mathematics)-literate citizenry. The project, centered on a giant screen film that will reach millions of theatrical viewers across the U.S., will convey polar science knowledge through appealing, entertaining media experiences and informal learning programs. Taking advantage of the scope of research currently taking place in Antarctica, this project will incorporate new perspectives into a story featuring dinosaurs and journey beyond the bones to reveal a more nuanced, multi-disciplinary interpretation of paleontology and the profound changes the Antarctic continent has endured. The goals of the project are to encourage young people to learn about Antarctica and its connection to the rest of the globe; to challenge stereotypes of what it means to participate in science; to build interest in STEM pursuits; and to enhance STEM identity.
This initiative, aimed particularly at middle school age youth (ages 11-14), will develop a giant screen film in 2D and 3D formats; a 3-episode television series; an "educational toolkit" of flexible, multi-media resources and experiences for informal use; a "Field Camp" Antarctic science intervention for middle school students (including girls and minorities); fictional content and presentations by author G. Neri dealing with Antarctic science produced for young people of color (including non-readers and at-risk youth who typically lack access to science and nature); and presentations by scientists featured in the film. The film will be produced as a companion experience for the synonymous Antarctic Dinosaurs museum exhibition (developed by the Field Museum, Chicago, in partnership with the Natural History Museum of Los Angeles County, Discovery Place, Charlotte, NC, and the Natural History Museum of Utah). Project partner The Franklin Institute will undertake a knowledge-building study to examine the learning outcomes resulting from exposure to the film with and without additional experiences provided by the Antarctic Dinosaurs exhibition and film-related educational outreach. The study will assess the strategies employed by practitioners to make connections between film and other exhibits, programs, and resources to improve understanding of the ways film content may complement and inspire learning within the framework of the science center ecosystem. The project's summative evaluation will address the process of collaboration and the learning impacts of the film and outreach, and provide best practices and new models for content producers and STEM educators. Project partners include film producers Giant Screen Films and Dave Clark Inc.; television producer Natural History New Zealand (NHNZ); Discovery Place (Charlotte, NC); The Franklin Institute; The Field Museum; The Natural History Museum of Utah (The University of Utah); author G. Neri; and a team of scientists and diversity advisers. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project has co-funding support from the Antarctic section of the Office of Polar Programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants. This pilot study, Akeakamai (Hawaiian, literally lover of wisdom, scientist, scholar), will explore the convergence of contemporary Western science topics with indigenous Hawaiian culture-based science experiences as a mechanism to strengthen STEM perceptions, cross-cultural science collaboration, and multi-generational community engagement with STEM. The work is grounded in the notion that STEM learning within the context of local informal indigenous community settings should be culturally responsive and culturally sustaining, and should privilege indigenous epistemologies. If successful, the results of this pilot could provide valuable insights on effective approaches to developing and implementing culturally consistent and sustainable multigenerational STEM engagement among Native Hawaiians and Pacific Islanders, and across the Pacific region.
Over a two-year duration, the study will address three research questions. (1) To what extent does inclusion of culture into curriculum designed for informal Culture-Science Explorations mitigate perceived barriers to participation in science? (2) What barriers do community members perceive to limit their participation in science? (3) What are the areas of consonance between Native Hawaiian and Western scientific approaches to knowledge and learning? Approximately 200 predominantly Native Hawaiian and Pacific Islanders, ranging in age from 8 - 85 years old, will participate in the pilot. The research team will collect participant data during all phases of the social intervention, a suite of culture-science exploration experiences held at the Halau Inana, a Native Hawaiian community collaboration space. The intervention will employ pedagogical methods that are responsive to Hawaiian cultural norms to deliver content that integrates across the interfaces of Western science and technology and indigenous knowledge, and incorporates Hawaiian language. A rigorous external evaluation will also be conducted. The results of the research and evaluation will be broadly disseminated. Ultimately, the project aims to develop a conceptual and practical cross-cultural, multi-generational framework for community-based science learning in Hawai'i that can serve as a model for future research and programs that extend into and beyond indigenous communities of the Pacific region.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Helen TurnerJonathan BakerChrystie Naeole
resourceprojectProfessional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is a two-day conference, along with pre- and post-conference activities, with the goal of furthering the informal science learning field's review of the research and development that has been conducted on data visualizations that have been used to help the public better understand and become more engaged in science. The project will address an urgent need in informal science education, providing a critical first step towards a synthesis of research and technology development in visualization and, thus, to inform and accelerate work in the field in this significant and rapidly changing domain.
The project will start with a Delphi study by the project evaluator prior to the conference to provide an Emerging Field Assessment on data visualization work to date. Then, a two-day conference at the Exploratorium in San Francisco and related activities will bring together AISL-funded PIs, computer scientists, cognitive scientists, designers, and technology developers to (a) synthesize work to date, (b) bring in relevant research from fields outside of informal learning, and (c) identify remaining knowledge gaps for further research and development. The project team will also develop a website with videos of all presentations, conference documentation, resources, and links to social media communities; and a post-conference publication mapping the state of the field, key findings, and promising technologies.
The initiative also has a goal to broaden participation, as the attendees will include a diverse cadre of professionals in the field who contribute to data visualization work.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Public engagement with science (PES) is about dialogue between scientific and technological experts and public audiences about societal questions that science can inform but not answer. In making decisions about these kinds of societal questions, social values and personal experience play roles equal to or greater than the one played by science. Rather than focusing exclusively on science itself, PES focuses on discussing problems that communities view as worth solving; the information society needs and wants from scientists; the potential risks, benefits, and consequences of new technologies
Scientists (and engineers) wishing to conduct public engagement do so in the context of established disciplinary norms and complex institutional systems that may support or limit their success. This report seeks to convey the known complexity, unique challenges, and opportunities for universities to better support for scientists in their public engagement work. The report is intended to drive discussion towards deeper exploration and development of actionable next steps.
This is the executive summary of report from Workshop III: Academic Institutions, part of the Support Systems for
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This RAPID project was submitted in response to the NSF Dear Colleague letter (NSF 17-128) related to Hurricane Harvey along the Gulf Coast. The PBS NewsHour team will produce 9 stories for national distribution using multiple broadcast and online channels that will engage the public and increase their understanding of the science and engineering research being conducted to better predict and mitigate the impact of future storms. Hurricane Harvey was the first of several storms in 2017 that hit first Texas then Florida and the Caribbean creating unprecedented devastation. This project aims to help the public better understand the science behind storms, and how scientists and engineers are actively collecting data, developing new models, using new technologies, and studying the environmental recovery. The PBS NewsHour team has in place experienced science journalists, production facilities, and a distribution network that can quickly develop media stories based on the work of scientists and engineers in the field, many of whom are funded by NSF. The NewsHour has a strong track record of telling stories that are scientifically accurate yet highly engaging and understandable to a diverse audience. Researchers from several universities including Texas A&M, Rice University, and Norfolk State University are advising the NewsHour team and may also be featured in some of the media. The team will also use their existing collaboration with education researchers at New Knowledge, Inc. to seek audience feedback on proposed/produced media.
The potential audience reach of these stories is extensive. Stories that are broadcast on the nightly PBS NewsHour reach 1.6 million people. The NewsHour's website currently reaches 6 million while their YouTube channel has 40 million views. They have a growing audience of younger viewers who mainly get their news on social media channels such as ScienceScope and Apple News. EXTRA is another service offered just for teachers.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will research and produce science media based on the role that interest, motivations, identify, and values play in engaging diverse, millennial audiences in a dynamic media environment. Using a design-based research approach the project team will develop Millennial Science Media Engagement Profiles (a set of categories describing different audience types who engage with science media in different ways). It will design and test science media content (text, audio, graphics, video), placement and platform use for millennials; and make conclusions around science media storytelling and outreach tactics that spark interest and engagement, the precursors to learning. Broader impacts include contributing significant new knowledge about millennials interest and engagement in science while they are at a stage in life making critical career decisions. It will also provide a model for other science media producers providing new protocols for creating targeted digital media for this specific audience. And further impacts include reaching a large national audience through social media. The project is a collaboration between KQED and researchers at Texas Tech.
The research will focus on the distinctive experience and interest of "millennial" science consumers. It builds on a previously funded national survey and series of focus groups with millennials looking at their science media preferences versus other generations. With these survey results this project will build profiles of millennial audiences based on two factors: level of science curiosity and level of science media engagement. The researchers will use a previously validated Science Curiosity Scale. The Millennial Profiles will be validated in two ways: through performance-based survey questions and through internet audience behavior analysis using existing digital analysis tools. KQED will produce different science media content and send it to certain groups conducting A/B testing to validate profiles online. The profile assumptions will continue to be tested until the team can effectively predict the kinds of science content that different profile groups prefer. The research will use a study protocol used in other domains to bridge the gap between lab and real-world settings. The protocol involves four steps: initial hypothesis development; ante experimental simulation; real-world communication; and ex post experimental simulations. Following the profile validation, the protocol will be used to test the efficacy of new KQED Science content, testing the variables that contribute to millennial engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
We propose a thoughtful process for scientists to develop their “impact identity”, a concept that integrates scholarship in a scientific discipline with societal needs, personal preferences, capacities and skills, and one’s institutional context. Approaching broader impacts from a place of integrated identity can support cascading impacts that develop over the course of a career. We argue identity is a productive driver that can improve outcomes for scientists and for society. Widespread adoption of the concept of impact identity may also have implications for the recruitment and retention of