As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Many of the nation's poorest-performing schools are in rural areas. Anecdotal information suggests participation in and access to informal STEM learning opportunities in Mississippi - a state with among the lowest STEM-career readiness in the nation - is unequally distributed among geographic regions and sociocultural environments. Informal learning programs in science, technology, engineering, and math (STEM) have the potential to reach into rural communities and provide a bridge to greater STEM access, literacy, and career readiness. Building Bridges: Broadening the STEM Conversation in Rural Mississippi will initiate a dialog among key practitioners, experts, and stakeholders in informal STEM learning focused on identifying the causes of and solutions to STEM inclusion barriers among rural youth. The goal of this Advancing Informal STEM Learning (AISL) Conference Project aligns with NSF's mission to promote the progress of science for all segments of society, including rural K-12 students. Solutions to STEM disconnections identified in Mississippi through this project will have relevance and transferability to rural communities across the southeastern US, given regional commonalities in socioeconomic, educational, and cultural factors.
This project aims to conduct an interactive and participant-based summit that brings together key leaders and experts from informal science learning institutions and organizations, STEM-related agencies and industries, and rural community groups to improve methods for linking informal STEM learning opportunities with rural, K-12 students. The goal of the project is to identify the common barriers and explore potential solutions to informal STEM participation by rural K-12 students in Mississippi. With the guidance of a steering committee, a Mississippi STEM Consortium will be formed and convened at a 2019 Mississippi Informal STEM Consortium Summit with the following goals: (1) Identify broad barriers to informal STEM learning in diverse and rural K-12 populations. (2) Define crucial and transformative elements in informal STEM programs deemed successful in rural student recruitment and engagement. (3) Improve collaborative networking to enhance the role of informal education in building statewide STEM capacity. These objectives will be met by developing, implementing, and evaluating statewide needs-assessment surveys and a two-day summit of Consortium members. The project evaluator will ensure process and outcome evaluations are properly conducted throughout the entire course of the project to inform planning, promote iterative improvement, monitor progress, and ensure achievement of desire objectives. With regards to broader impacts, it is anticipated that outcomes from this project will have impact within and beyond Mississippi's borders. Expected project outcomes include scientific manuscripts on needs-assessment surveys, modified approaches to existing informal STEM activities, future research on identified informal STEM participation barriers and mitigation measures, new collaborations that broaden participation and expand future research, and a draft Informal STEM Strategic Plan for Mississippi. Varied dissemination methods will be used to communicate the findings broadly.
This conference project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Leslie BurgerSarah LeeKatherine EcholsVemitra White
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This exploratory Pilot study project brings together a diverse set of partners that include the Watertown Children's Theatre (WCT) which is west of Boston, and, from Boston College a team of science educators, learning science researchers, and positive youth development experts. The goal is to design and develop a project for middle school-aged youth. The pilot project, which integrates hands-on science learning experiences, experiments, and field trips with the student-led production of short plays, will engage youth in expressing their beliefs, passions, and their own identities about STEM by examining how the intersection of skills and practices used in both domains (science and theatre) can enable them to learn about science concepts, principles and methods as well as to develop science-focused identities. Middle-school youth will be engaged in a three-week summer program where they will be led by science teachers, playwrights, and high school students to conduct hands-on investigations in science in conjunction with developing original, ten-minute plays around a specific scientific theme relevant to their life experience, for example, the potential impact on their lives of heavy metals in water and poor air quality. After a science theme is chosen, the principal investigators will identify the big ideas that are important for youth to understand and be able to explain. Upon identification of the key science ideas, youth will then engage in pertinent science activities, visits to local sites, reading current news articles and then in identifying the local impacts and how the underlying science relates to those local impacts. The youth will perform their ten-minute plays at the end of the summer program. Following this showcase event, they will engage in additional science learning experiences and also revise their productions throughout the academic year in preparation for a youth science festival, where their creations will be performed by professional adult actors as a part of the Cambridge Science Festival taking place in the spring. The broader impact of the work focuses on broadening participation in STEM, specifically, the engagement of youth from under-represented populations in the sciences, such as African-Americans, Latinxs, and women with partner Boston Public Schools. The Pilot study will investigate the student learning and organizational dimensions of the model being developed.
The Boston College researchers will study youth's sense of purpose and identity toward science, particularly how youth's identity discrepancy changes through participation in the project. The work places youth voice at the center of the creation of STEM-based theatre plays. The theoretical foundation of the work is grounded in part in the concept of "path to purpose." The major research questions are: How do youth perceptions (interest, science anxiety, identity) toward science shift as they participate in the project? What is the residual impact on parents (family members) and youth on their discussions about science, and how does participation in the project impact those discussions? Research methods include surveys, interviews and observations. The external evaluation study will focus on understanding project implementation and progress toward meeting the project goals, in particular, how well the initiative works to establish a model for the informal STEM learning field that the team and others can apply beyond the Pilot study.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project explores augmented reality (AR) technology as a way to make STEM content accessible to Deaf and Hard-of-Hearing (DHH) learners in "live" presentation settings found within science centers and museums. The current ways of providing communication and information access to DHH museum visitors require DHH learners to split their attention between the visual focus of the experience and the interpreter or captioning display. As a result, DHH learners are forced to decide which information to miss during live presentations, thus presentations may not be fully comprehended by the DHH learner. Furthermore, this issue perpetuates a lack of inclusivity and accessibility in informal STEM learning environments. The work focuses on investigating approaches to develop an AR platform with a near-eye display that will allow DHH visitors to receive signed or captioned instruction while still looking at and interacting with the intended exhibits. The new platform will allow for transmission of live and spontaneous instruction. Researchers will evaluate and recommend efficient ways to make information at science centers and museums accessible to the DHH population based on data collected from DHH learners. This project is funded by the Advancing Informal STEM Learning program's Pilot and Feasibility Studies which seek new approaches to design and development of STEM learning to be accessible to all learners including underrepresented groups in informal environments.
The researchers will investigate the following research question: how can the use of Augmented Reality (AR) as a method of support service delivery improve the engagement of Deaf and Hard-of-Hearing (DHH) adolescent learners in semi-structured learning environments? Both formative and summative evaluations will be conducted from two different angles: (1) an engineering-centric evaluation focused on technical development and (2) an educational-research centric evaluation focused on pilot studies on user experiences, attitudes, and learning outcomes. Both qualitative and quantitative data on the use of this technology will be collected. The evaluation methods include attitudinal surveys (pre/post), ethnographic observations, pre/post tests of content knowledge, and semi-structured group and individual interviews. This project will be conducted by researchers in the Center on Access Technology at National Technical Institute for the Deaf, one of the colleges of Rochester Institute of Technology, in partnership with the Rochester Museum & Science Center, which includes the Rochester Challenger Learning Center. This project represents a first step in setting future directions for research & development and to make educational materials more accessible to the DHH community.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Wendy DannelsSara SchleyBrian TragerMel Chua
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants. This pilot study, Akeakamai (Hawaiian, literally lover of wisdom, scientist, scholar), will explore the convergence of contemporary Western science topics with indigenous Hawaiian culture-based science experiences as a mechanism to strengthen STEM perceptions, cross-cultural science collaboration, and multi-generational community engagement with STEM. The work is grounded in the notion that STEM learning within the context of local informal indigenous community settings should be culturally responsive and culturally sustaining, and should privilege indigenous epistemologies. If successful, the results of this pilot could provide valuable insights on effective approaches to developing and implementing culturally consistent and sustainable multigenerational STEM engagement among Native Hawaiians and Pacific Islanders, and across the Pacific region.
Over a two-year duration, the study will address three research questions. (1) To what extent does inclusion of culture into curriculum designed for informal Culture-Science Explorations mitigate perceived barriers to participation in science? (2) What barriers do community members perceive to limit their participation in science? (3) What are the areas of consonance between Native Hawaiian and Western scientific approaches to knowledge and learning? Approximately 200 predominantly Native Hawaiian and Pacific Islanders, ranging in age from 8 - 85 years old, will participate in the pilot. The research team will collect participant data during all phases of the social intervention, a suite of culture-science exploration experiences held at the Halau Inana, a Native Hawaiian community collaboration space. The intervention will employ pedagogical methods that are responsive to Hawaiian cultural norms to deliver content that integrates across the interfaces of Western science and technology and indigenous knowledge, and incorporates Hawaiian language. A rigorous external evaluation will also be conducted. The results of the research and evaluation will be broadly disseminated. Ultimately, the project aims to develop a conceptual and practical cross-cultural, multi-generational framework for community-based science learning in Hawai'i that can serve as a model for future research and programs that extend into and beyond indigenous communities of the Pacific region.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Helen TurnerJonathan BakerChrystie Naeole
resourceprojectProfessional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is a two-day conference, along with pre- and post-conference activities, with the goal of furthering the informal science learning field's review of the research and development that has been conducted on data visualizations that have been used to help the public better understand and become more engaged in science. The project will address an urgent need in informal science education, providing a critical first step towards a synthesis of research and technology development in visualization and, thus, to inform and accelerate work in the field in this significant and rapidly changing domain.
The project will start with a Delphi study by the project evaluator prior to the conference to provide an Emerging Field Assessment on data visualization work to date. Then, a two-day conference at the Exploratorium in San Francisco and related activities will bring together AISL-funded PIs, computer scientists, cognitive scientists, designers, and technology developers to (a) synthesize work to date, (b) bring in relevant research from fields outside of informal learning, and (c) identify remaining knowledge gaps for further research and development. The project team will also develop a website with videos of all presentations, conference documentation, resources, and links to social media communities; and a post-conference publication mapping the state of the field, key findings, and promising technologies.
The initiative also has a goal to broaden participation, as the attendees will include a diverse cadre of professionals in the field who contribute to data visualization work.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. A frequently overlooked but significantly under-represented STEM audience is people who live in rural settings. The proposed conference is the first of its kind to bring together key innovators and experts in rural Informal STEM education, to address this question: How can we build on recent innovations to create more effective and scalable pathways for informal STEM learning in rural communities?
The conference will focus primarily on advancing informal STEM education for rural youth, but will also include some participants who cross boundaries, to situate the work in an ecosystem perspective: informal-formal education, childhood-adult education, rural ecosystems and economic drivers for STEM related jobs. The provisional list of topics will be refined through a pre-conference survey of participants, and will be followed with a report that includes survey responses, conference discussion, and final recommendations by participants. The conference will be held in Washington D.C. to enable policymakers to attend.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Public engagement with science (PES) is about dialogue between scientific and technological experts and public audiences about societal questions that science can inform but not answer. In making decisions about these kinds of societal questions, social values and personal experience play roles equal to or greater than the one played by science. Rather than focusing exclusively on science itself, PES focuses on discussing problems that communities view as worth solving; the information society needs and wants from scientists; the potential risks, benefits, and consequences of new technologies
Scientists (and engineers) wishing to conduct public engagement do so in the context of established disciplinary norms and complex institutional systems that may support or limit their success. This report seeks to convey the known complexity, unique challenges, and opportunities for universities to better support for scientists in their public engagement work. The report is intended to drive discussion towards deeper exploration and development of actionable next steps.
This is the executive summary of report from Workshop III: Academic Institutions, part of the Support Systems for
Due to the dynamic nature of many fields of science, most adults will acquire the majority of their science information after they leave formal schooling. Future public-policy decisions will require adults to have an understanding of the practice and nature of modern science and technology. A major source for continued learning is science media and journalism, which has the capacity to provoke and increase science curiosity and the value of science.
In partnership with Jacobs Media Strategies, the Cultural Cognition Project at Yale Law School and Texas Tech University, KQED, the NPR and PBS
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will research and produce science media based on the role that interest, motivations, identify, and values play in engaging diverse, millennial audiences in a dynamic media environment. Using a design-based research approach the project team will develop Millennial Science Media Engagement Profiles (a set of categories describing different audience types who engage with science media in different ways). It will design and test science media content (text, audio, graphics, video), placement and platform use for millennials; and make conclusions around science media storytelling and outreach tactics that spark interest and engagement, the precursors to learning. Broader impacts include contributing significant new knowledge about millennials interest and engagement in science while they are at a stage in life making critical career decisions. It will also provide a model for other science media producers providing new protocols for creating targeted digital media for this specific audience. And further impacts include reaching a large national audience through social media. The project is a collaboration between KQED and researchers at Texas Tech.
The research will focus on the distinctive experience and interest of "millennial" science consumers. It builds on a previously funded national survey and series of focus groups with millennials looking at their science media preferences versus other generations. With these survey results this project will build profiles of millennial audiences based on two factors: level of science curiosity and level of science media engagement. The researchers will use a previously validated Science Curiosity Scale. The Millennial Profiles will be validated in two ways: through performance-based survey questions and through internet audience behavior analysis using existing digital analysis tools. KQED will produce different science media content and send it to certain groups conducting A/B testing to validate profiles online. The profile assumptions will continue to be tested until the team can effectively predict the kinds of science content that different profile groups prefer. The research will use a study protocol used in other domains to bridge the gap between lab and real-world settings. The protocol involves four steps: initial hypothesis development; ante experimental simulation; real-world communication; and ex post experimental simulations. Following the profile validation, the protocol will be used to test the efficacy of new KQED Science content, testing the variables that contribute to millennial engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
We propose a thoughtful process for scientists to develop their “impact identity”, a concept that integrates scholarship in a scientific discipline with societal needs, personal preferences, capacities and skills, and one’s institutional context. Approaching broader impacts from a place of integrated identity can support cascading impacts that develop over the course of a career. We argue identity is a productive driver that can improve outcomes for scientists and for society. Widespread adoption of the concept of impact identity may also have implications for the recruitment and retention of