As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will explore how understanding visitors' experiences with science museum exhibits may contribute to increasing engagement among diverse audiences. Museums have made great strides in understanding how exhibit design can support underrepresented audiences, but often tend to focus on individual demographic groups such as females, certain racial and ethnic minorities, and people with disabilities. This project will explore relationships between visitors' demographic and science identities to assess the affordances of using science identity as an intersectional proxy that could help the field move beyond its reliance on demographics. Building on prior National Science-funded work about museum engagement, the project applies appraisal theory--a psychological model about how people make conscious and subconscious assessments of situations that manifest in emotions--to the informal learning context. To date, museums have tended to focus on cognitive and behavioral aspects of engagement. Appraisal theory can add emotional processes to the conceptual understanding of engagement, and can be applied to help exhibit professionals develop a design framework that upholds complex identities. Such a framework could have implications for inclusive design of learning experiences in museums, schools, and other educational contexts.
This Pilot and Feasibility Study will address methodological and theoretical questions about the feasibility of a research approach that considers the relationships among: 1) exhibit design features; 2) multiple identity factors including science identity, demographics, and self-defined personal identity; 3) visitor appraisals; and 4) engagement with exhibits. Led by researchers at the Museum of Science, Boston and EdTogether, a non-profit research and development organization for inclusive design, the project will begin with a pre-piloting phase during which researchers will work with youth and professional advisors from local community organizations to test a suite of data collection approaches including self-report in the form of questionnaires and interviews; observations of visitor engagement; and biometric data collection including galvanic skin response and eye tracking. Building from this pre-piloting phase, the team will conduct four mini-studies that will iteratively refine measures towards enhanced validity and parsimony while gathering data to test the investigators' hypothesized model of design, identity, appraisal, and engagement. The evidence from testing this model through the four mini-studies will lay the foundation for larger-scale research that intends to explore causal relationships among intersectional identities, science identities, appraisal, and visitor engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins
Robots and robotics excite and challenge youths and adults. Unfortunately, the cost of purchasing robots or building useful robots is prohibitive for many low resource individuals and groups. This project will relieve this expense and provide an opportunity for resource limited individuals to experience the thrilling aspects of robotics by building a computer game that simulates robotic action. This project uses co-robotics wherein the participating player programs an avatar to assist in a symbiotic manner to achieve the goals of the game and participant. The game will provide access to the ideas and concepts such as programing, computational thinking and role assumption. The overarching goals are (1) to engage low-resource learners in STEM education through robotics in out-of-school spaces, and (2) to update the field of robotics-base STEM education to integrate the co-robotics paradigm.
This project is designed to gain knowledge on how co-robotics can be used in the informal education sector to facilitate the integration of computational science with STEM topics and to expand the educational use of co-robotics. Because the concept of co-robotics is new, a designed-based research approach will be used to build theoretical knowledge and knowledge of effective interventions for helping participants learn programing and computational thinking. Data will be collected from several sources including surveys, self-reports, in game surveys, pre and post-tests. These data collection efforts will address the following areas: Technology reliability, Resolution of cognitive tension around co-play, Accelerate discovery and initial engagement, Foster role-taking and interdependence with co-robots, Investigate social learning, and Validate measures using item response theory analysis. The DBR study questions are:
1.What design principles support the development of P3Gs that can effectively attract initial engagement in a free-choice OST space that offers large numbers of competing options? 2.What design principles support a P3G gameplay loop that enables learning of complex skills, computational thinking and co-robotics norms, and building of individual and career interest over the course of repeated engagement?
3.What design principles support P3Gs in attaining a high rate of re-engagement within low-resource OST settings? 4.What kinds of positive impact can P3Gs have on their proximal and distal environment? In addition, the project will research these questions about design: 1.What technical and game design features are needed to accommodate technological interruption? 2.What design elements or principles mitigate competition for cognitive resources between real-time play and understanding the co-robotic's behavior in relation to the code the player wrote for it? 3.What design elements are effective at getting learners in OST settings to notice and start playing the game? 4.What designs are effective at encouraging learners to engage with challenging content, particularly the transition from manual play to co-play? 5.What design elements help players develop a stake in the role the game offers? 6.What social behaviors emerge organically around a P3G prototype that is not designed to evoke specific social interactions?
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
It is estimated that there could be 40 billion earth-sized planets orbiting in the habitable zones of stars in the Milky Way. Major advances in long range telescopes have allowed astronomers to identify thousands of exoplanets in recent decades, and the discovery of new exoplanets is a now a common occurrence. Public excitement for the discoveries grown alongside these discoveries, thus opening new possibilities for inspiring a new generation of scientists and engineers that may dream of one day visiting these planets. This project investigates the use of interactive, intelligent educational technologies to generate interest in STEM by allowing learners to explore and even create their own exoplanets. Research will occur across several informal learning contexts, including summer camps, after school programs, planetarium shows, and at home. The approach is based on the idea of "What if?"questions about Earth (e.g., "What if the Moon did not exist?"), designed to trigger interest in STEM and frame exploratory and elaborative discussions around hypothetical science questions that are subsequently linked to the search for habitable exoplanets. Learners are able to interact with and explore scientifically accurate simulations of alternative versions of Earth, while making observations and posing explanations for what they see. Technology-based informal learning experiences designed to act as triggers for and sustainment of interest in STEM have the potential to plug the leaky STEM pipeline, and thus have profound implications for the future of science and technology in the United States.
The project seeks to advance the science of designing technologies for promoting interest in STEM and informal astronomy education in several ways. First, the project will develop simulations for exploratory learning about astronomy and planetary science. These simulations will present hypothetical worlds based on what-if questions and feasible models of known exoplanets, thus giving learners a chance to better understand the challenges of finding a habitable world and learning about what is needed to survive there. Second, a new PBS NOVA Lab will be developed that will focus on Exoplanet education. This web-based activity has the potential to reach millions of learners and will help them understand how planets are formed and the requirements for supporting life. Learners who use the lab will have an opportunity to invent their own exoplanets and export them for first-person exploration. Third, researchers on the project will design and implement Artificial Intelligence-based pedagogical agents to support learning and promote interest. These agents will inhabit the simulations with the learner, acting as a coach and guide, and be designed to be culturally responsive and personalized based on learner preferences. Fourth, interactive exoplanet-focused planetarium shows, that will involve live interaction with simulations, will take place at the Fiske Planetarium (Boulder, CO). Finally, the project will develop a server-based infrastructure for tracking and supporting long term development of interest in STEM. This back-end will track fine-grained behaviors, including movement, actions, and communications in the simulations. Such data will reveal patterns about how interest develops, how learners engage in free-choice learning activities, and how they interact with agents and peers in computer simulations. A design-based research methodology will be employed to assess the power of these different experiences to trigger interest and promote learning of astronomy. A range of different pathways for interest in STEM will therefore be considered and assessed. Research will measure the power of these experiences to trigger interest in STEM and promote re-engagement over time. Innovation lies in the use of engaging and intelligent technologies with thought-provoking pedagogy as a method for extended engagement of diverse young learners in STEM. Project research and educational resources will be widely disseminated to researchers, designers developers and the general public via peer-reviewed research journals, conference presentations, informal STEM education networks of science museums, children's museums, Fab Labs, and planetariums, and public media such as public television's NOVA science program website.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
H Chad LaneNeil CominsJorge Perez-GallegoDavid Condon
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.
The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.
Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project responds to calls to increase children's exposure and engagement in STEM at an early age. With the rise of the maker-movement, the informal and formal education sectors have witnessed a dramatic expansion of maker and tinkering spaces, programs, and curricula. This has happened in part because of the potential benefits of tinkering experiences to promote access and equity in engineering education. To realize these benefits, it is necessary to continue to make and iterate design and facilitation approaches that can deepen early engagement in disciplinary practices of engineering and other STEM-relevant skills. This project will investigate how stories can be integrated into informal STEM learning experiences for young children and their families. Stories can be especially effective because they bridge the knowledge and experiences young children and their caregivers bring to tinkering as well as the conversations and hands-on activities that can extend that knowledge. In addition, a unique contribution of the project is to test the hypothesis that stories can also facilitate spatial reasoning, by encouraging children to think about the spatial properties of their emerging structures.
This project uses design-based research methods to advance knowledge and the evidence base for practices that engender story-based tinkering. Using conjecture mapping, the team will specify their initial ideas and how it will be evident that design/practices impact caregivers-child behaviors and learning outcomes. The team will consider the demographic characteristics, linguistic practices, and funds of knowledge of the participants to understand the design practices (resources, activities) being implemented and how they potentially facilitate learning. The outcome of each study/DBR cycle serves as inputs for questions and hypotheses in the next. A culturally diverse group of 300+ children ages 5 to 8 years old and their parents at Chicago Children's Museum's Tinkering Lab will participate in the study to examine the following key questions: (1) What design and facilitation approaches engage young children and their caregivers in creating their own engineering-rich tinkering stories? (2) How can museum exhibit design (e.g., models, interactive displays) and tinkering stories together engender spatial thinking, to further enrich early STEM learning opportunities? and (3) Do the tinkering stories children and their families tell support lasting STEM learning? As part of the overall iterative, design-based approach, the team will also field test the story-based tinkering approaches identified in the first cycles of DBR to be most promising.
This project will result in activities, exhibit components, and training resources that invite visitors' stories into open-ended problem-solving activities. It will advance understanding of mechanisms for encouraging engineering learning and spatial thinking through direct experience interacting with objects, and playful, scaffolded (guided) problem-solving activities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This report details the results of a five-year longitudinal study on the Explainer program at the Exploratorium. Explainers from the summer 1999, fall 1999 and spring 2000 cohorts were interviewed before and after their first semester of work as an Explainer, then followed up with additional interviews three more times at intervals of from one to three years. Additional supplemental data were gathered from a larger set of Explainers via surveys that were administered to these same cohorts before and after their first semester of work, and to a set of Explainer alumni who had been out of the
Research shows that science centers and museums play an important role in giving youth STEM learning opportunities (Hamilton, Nussbaum, Kupermintz, Kerkhoven, & Snow, 1995; Salmi, 2001, 2002). These informal learning spaces use interactive exhibits and programming to spur excitement, generate interest in the sciences, shape STEM identities, and support science skills (National Research Council, 2009). A previous Knowledge Base article on engaging diverse youth further details the potential of informal learning to activate STEM interest.
However, despite these encouraging findings, informal
This study investigated the effect of different scientific inquiry activities on visitors’ understanding of the science underlying an interactive exhibit. The exhibit, “colored shadows,” creates a pattern of colored shadows on a white wall, due to a person’s body blocking the light from colored lamps. The subjects were 392 museum visitors, aged 7 to adult. They were individually guided through a structured interview, during which they did one of seven inquiry activities, randomly assigned. The activities were: generate an explanation; interpret an explanation; troubleshoot an explanation
This report summarizes the ideas and conversations of the CAISE Broadening Participation Task Force, which was led by the authors, along with James Bell, Principal Investigator and project director of CAISE (see informalscience.org/bp-task-force). The task force was instrumental in identifying key ideas and challenges to the field, providing edits and input into the report, developing and drafting the associated practice briefs, and piloting the materials.
Across the nation, many are undertaking efforts to significantly transform who participates in science, technology, engineering, and
The Year in ISE is a slidedoc designed to track and characterize field growth, change and impact, important publications, and current topics in ISE in 2018. Use it to inform new strategies, find potential collaborators for your projects, and support proposal development. Scope This slidedoc highlights a selection of developments and resources in 2018 that were notable and potentially useful for the informal STEM education field. It is not intended to be comprehensive or exhaustive, nor to provide endorsement. To manage the scope and length, we have focused on meta analyses, consensus reports
Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about