As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop and test a model for audience assessment that STEM professionals can use during their public engagement efforts. These on-the-spot assessments will allow scientists to monitor audience understanding and use this to make immediate improvements to their activity. This project fills a critical gap in the field of public science communication as expressed by outreach scientists and by the professional and academic organizations that train them. Project partners include The Astronomical Society of the Pacific, Oregon State University, Pacific Science Center, and the National Radio Astronomy Observatory. Research questions include: (1) How and under what conditions can scientists, regardless of discipline, learn to build assessment into outreach activities? (2) To what degree are scientists willing and able to change their outreach activities to include assessment to ascertain audience attentiveness or understanding? (3) To what degree will scientists be able to adjust their outreach and engagement efforts based on audience feedback, and what support do they need to do so? (4) With constraints on their time and resources, how can the model help scientists conduct audience assessment on their own? (5) Are audience members finding events more enjoyable and fruitful that use assessment techniques? Several iterative rounds of R&D will be used in the spiral design-based approach. A group of Design Testers will start each of the iterative cycles for the initial development and testing techniques, associated training, and support. Later phases will use Field Testers using a rubric for usability, validity, and reliability of various strategies. The summative evaluation of the project will begin early and add data over the life of the project. A mixed methods approach will be used including surveys of scientists once each year after they have participated in the Prototype training. Descriptive and inferential statistics will be used to document the extent to which the project has achieved its intended outcomes. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This project examines the conditions in which families and young learners most benefit from "doing science and math" together among a population that is typically underserved with respect to STEM experiences--families experiencing poverty. This project builds on an existing program called Teaching Together that uses interactive parent-child workshops led by a museum educator and focused on supporting STEM learning at home. The goal of these workshops is to increase parents'/caregivers' self-perception and ability to serve as their child's first teacher by supporting learning and inquiry conversations during daily routines and informal STEM activities. Families attend a series of afternoon and evening workshops at their child's preschool center and at a local children's museum. Parents/Caregivers may participate in online home learning activities and museum experiences. The project uses an experimental design to test the added value of providing incremental supports for informal STEM learning. The study uses an experimental design to address potential barriers parents/caregivers may perceive to doing informal STEM activities with their child. The project also explores how the quantity and quality parent-child informal learning interactions may relate to changes in children's science and mathematics knowledge during the pre-kindergarten year. The project partners include the Children's Learning Institute at the University of Texas Health Science Center at Houston and the Children's Museum of Houston.
The project is designed to increase understanding of how parents/caregivers can be encouraged to support informal STEM learning by experimentally manipulating key aspects of the broader expectancy-value-cost motivation theory, which is well established in psychology and education literatures but has not been applied to preschool parent-child informal STEM learning. More specifically, the intervention conditions are designed to identify how specific parent supports can mitigate potential barriers that families experiencing poverty face. These intervention conditions include: modeling of informal STEM learning during workshops to address skills and knowledge barriers; materials to address difficulties accessing science and math resources; and incentives as a way to address parental time pressures and/or costs and thereby improve involvement in informal learning activities. Intervention effects will be calculated in terms of effect sizes and potential mediators of change will be explored with structural equation modeling. The first phase of the project uses an iterative process to refine the curriculum and expand the collection of resources designed for families of 3- to 5-year-olds. The second phase uses an experimental study of the STEM program to examine conditions that maximize participation and effectiveness of family learning programs. In all, 360 families will be randomly assigned to four conditions: 1) business-as-usual control; 2) the Teaching Together core workshop-based program; 3) Teaching Together workshops + provision of inquiry-based STEM activity kits for the home; and 4) Teaching Together workshop + activity kits + provision of monetary incentives for parents/caregivers when they document informal STEM learning experiences with their child. The interventions will occur in English and Spanish. A cost analysis across the interventions will also be conducted. This study uses quantitative and qualitative approaches. Data sources include parent surveys and interviews, conversation analysis of home learning activities, parent photo documentation of informal learning activities, and standardized assessments of children's growth in mathematics, science, and vocabulary knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Museum of Science will launch the "Collaboration for Ongoing Visitor Experience Studies" (COVES) project to construct an infrastructure for collaboration, which will unite science centers across the country in the systematic collection, analysis, and reporting of visitor experience data. The COVES program will develop common instruments for studying visitors in science museums and provide staff training on how to use these instruments and how to make sense of findings. The collaborative effort will enable participating science centers to become data-driven organizations focused on their audiences and will allow museums to learn from one another.
The Collaboration for Ongoing Visitor Experience Studies (COVES) is designed to unite science centers across the country to systematically collect, analyze, and report on visitor experience data. We envision a collaborative museum community seeking to better understand and improve the visitor experience. We believe that studying the visitor experience in science centers—who visits a particular museum, why they visit, what they experience during their visit, and how they react to different aspects of their experience—can help organizations learn about their visitors, make evidence-based
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop a collaborative program to connect and prepare researchers from divergent disciplines to communicate science to publics of all ages in three distinct informal environments: pop-ups at community events, experiential learning with problem solving events for youth, and presentations at a science museum. It will study the effects of this program on the identity and motivations of STEM researchers and evaluate the short and medium-term outcomes for public audiences. Project partners include, The STEAM Factory, OHI/O Informal Learning in Tech Program, and the Center of Science and Industry (COSI) all located in Columbus, Ohio.
The primary goals of this project are as follows. 1) Develop a collaborative program that connects and prepares researchers from divergent disciplines to creatively and effectively communicate science to people of all ages. 2) Evaluate the short and medium-term learning outcomes across different informal learning settings. 3) Study the effect of this collaborative program on the motivations and identify of the researchers. The specific research question is: In what ways do researchers motivations and identities further develop because of these collaborative experiences with divergent perspectives? A mixed method approach will be used. Data will be collected and analyzed from 3 cohorts of researchers who implement programs in different informal learning settings. A series of pre- and post interviews with scientists will be designed to answer the research question above. Interviews will be grounded in self-determination theory. Later reflective surveys will serve as triangulation for the data.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sathya GopalakrishnanJustin MeyerRachel KajfezArnab Nandi
In June of 2017, the Exploratorium hosted the GENIAL Summit which brought together approximately 91 practitioners, community leaders, diversity-focused organization staff, researchers, and media/marketing specialists from across the country and Puerto Rico for a one and a half day gathering. The National Science Foundation (NSF) funded Summit focused on increasing Latino participation in Informal STEM Learning (ISL) environments by examining these five content strands identified by the GENIAL team:
1. Latino Audiences
2. Marketing, Communicating, and Media
3. Community Collaboration and
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project explores augmented reality (AR) technology as a way to make STEM content accessible to Deaf and Hard-of-Hearing (DHH) learners in "live" presentation settings found within science centers and museums. The current ways of providing communication and information access to DHH museum visitors require DHH learners to split their attention between the visual focus of the experience and the interpreter or captioning display. As a result, DHH learners are forced to decide which information to miss during live presentations, thus presentations may not be fully comprehended by the DHH learner. Furthermore, this issue perpetuates a lack of inclusivity and accessibility in informal STEM learning environments. The work focuses on investigating approaches to develop an AR platform with a near-eye display that will allow DHH visitors to receive signed or captioned instruction while still looking at and interacting with the intended exhibits. The new platform will allow for transmission of live and spontaneous instruction. Researchers will evaluate and recommend efficient ways to make information at science centers and museums accessible to the DHH population based on data collected from DHH learners. This project is funded by the Advancing Informal STEM Learning program's Pilot and Feasibility Studies which seek new approaches to design and development of STEM learning to be accessible to all learners including underrepresented groups in informal environments.
The researchers will investigate the following research question: how can the use of Augmented Reality (AR) as a method of support service delivery improve the engagement of Deaf and Hard-of-Hearing (DHH) adolescent learners in semi-structured learning environments? Both formative and summative evaluations will be conducted from two different angles: (1) an engineering-centric evaluation focused on technical development and (2) an educational-research centric evaluation focused on pilot studies on user experiences, attitudes, and learning outcomes. Both qualitative and quantitative data on the use of this technology will be collected. The evaluation methods include attitudinal surveys (pre/post), ethnographic observations, pre/post tests of content knowledge, and semi-structured group and individual interviews. This project will be conducted by researchers in the Center on Access Technology at National Technical Institute for the Deaf, one of the colleges of Rochester Institute of Technology, in partnership with the Rochester Museum & Science Center, which includes the Rochester Challenger Learning Center. This project represents a first step in setting future directions for research & development and to make educational materials more accessible to the DHH community.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Wendy DannelsSara SchleyBrian TragerMel Chua
Public engagement with science (PES) is about dialogue between scientific and technological experts and public audiences about societal questions that science can inform but not answer. In making decisions about these kinds of societal questions, social values and personal experience play roles equal to or greater than the one played by science. Rather than focusing exclusively on science itself, PES focuses on discussing problems that communities view as worth solving; the information society needs and wants from scientists; the potential risks, benefits, and consequences of new technologies
Scientists are increasingly being called upon to play a more prominent role in the interface of science and society by contributing to science literacy in ways that support two-way exchanges with the public. However, many remain reluctant to participate in public engagement activities in part because they feel they lack relevant skills and experience. We surveyed scientists trained on engagement through a nationwide program called Portal to the Public and examined how participation in the program may have influenced their self-efficacy, commitment and attitudes about outreach, and perceived
This report, from the "Tinkering EU: Building Science Capital for All" project, provides a theoretical rationale for understanding the relationship between Tinkering as a pedagogical approach, students’ individual science capital, and inclusive STEM teaching approaches. By exploring the relationship between these three areas, it invites professionals to reflect on the ways in which Tinkering can be used a teaching tool for building science capital.
“Tinkering EU: Building Science Capital for All” aims to develop activities and resources that support a learner-centred culture, improve science education and develop 21st century skills - all of which are fundamental for active citizenship, employability, and social inclusion. To do this, it adopts ‘Tinkering’, an innovative pedagogy developed in the USA, which is used by museums, and has proven able to create a lifelong engagement with science for everyone. Tinkering works particularly well for people who argue that “they are not good at science” or are disaffected from any formal teaching and learning process. It can be a powerful tool to tackle disadvantage. The project integrates Tinkering into the school curriculum to develop the science capital of disadvantaged youth through the use of museums. It addresses students from 8 to 14 years old (primary and junior high schools).
Coordinator: National Museum of Science and Technology Leonardo da Vinci
Partners:
University of Cambridge – UK
NEMO Science Museum – The Netherlands
Science Gallery Dublin – Ireland
CosmoCaixa – Spain
Science Center Network – Austria
NOESIS – Greece