As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) developed, implemented, and evaluated the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through this grant, the NCBYS extended opportunities for informal science learning for the direct benefit of blind students by conducting six NFB STEM2U regional programs included programs for blind youth, their parents/caregivers, blind teen mentors (apprentices), and museum educators.
Staff facilitators in museums and science centers are a critical but often overlooked component of the visitor experience. Despite assertions about the important role they play in visitor learning, there continues to be almost no research to understand staff facilitation in these settings or identify effective practices. To address these gaps, we conducted a design-based research study to describe the work of experienced museum educators and iteratively refine a model of staff facilitation to support family learning at interactive math exhibits developed through a prior project. The resulting
One way to encourage youth to pursue training in the STEM fields and enter the STEM workforce is to foster interest and engagement in STEM during adolescence. Informal STEM Learning Sites (ISLS) provide opportunities for building interest and engagement in the STEM fields through a multitude of avenues, including the programming that they provide for youth, particularly teens. Frequently, ISLS provide opportunities to participate in volunteer programs, internships or work, which allow teens both to learn relevant STEM knowledge as well as to share that knowledge with others through opportunities to serve as youth educators. While youth educator programs provide rich contexts for teens to engage as both learners and teachers in these informal STEM environments, research to date has not yet identified the relationship between serving as youth educators and STEM engagement. Thus, the goal of this project is to document the impact of youth educators on visitor learning in ISLS and to identify best practices for implementing youth educator programs. The project studies STEM interests and engagement in the youth participants and the visitors that they interact with at six different ISLS in the US and UK. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This project examines youth educator experiences related to STEM identity, educational aspirations, and motivation. The project also identifies outcomes that the youth educators have on visitors to ISLS in terms of knowledge, interest, and engagement in STEM. The specific aims are: 1) Outcomes for Teens - To measure the longitudinal impact of participation in an extended youth educator experience in an ISLS; 2) Outcomes for Visitors - To compare visitor engagement with and learning from exhibits in ISLS when they interact with a youth educator, relative to outcomes of interacting with an adult educator or no educator; and 3) Outcomes Across Demographics and STEM Sites - To examine differences in visitor engagement based on participant characteristics such as socio-economic status (SES), age, gender, and ethnicity and to compare outcomes of youth educator experiences across different types of ISLS. This research, which draws on expectancy value theory and social cognitive theory, will follow youth participants longitudinally over the course of 5 years and use latent variable analyses to understand the impact on the youth educators as well as the visitors with whom they interact. Importantly, the results of this research will be used to develop best practices for implementing youth educator programs in ISLS and the results will be disseminated to both academic and practice-based communities.
This project has clear and measurable broader impacts in a variety of ways. First, the project provides guidance to improve programming for youth in ISLS, including both the sites involved directly in the research and to the larger community of ISLS through evaluation, development, and dissemination of best practices. Additionally, this project provides rigorous, research-based evidence to identify and describe the outcomes of youth educator programs. This study directly benefits the participants of the research, both the visiting public and the youth educators, through opportunities to engage with science. The findings speak to issues of access and inclusivity in ISLS, providing insight into how to design environments that are welcoming and accessible for diverse groups of learners. Finally, this project provides evidence for best practices for ISLS in developing programs for youth that will lead to interest in and pursuit of STEM careers by members of underrepresented groups.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The proposed project broadens the utility of Public Participation in Scientific Research (PPSR) approaches, which include citizen science, to support new angles in informal learning. It also extends previous work on interactive data visualizations in museums to encompass an element of active contribution to scientific data. To achieve these goals, this project will develop and research U!Scientist (pronounced `You, Scientist!')--a novel approach to using citizen science and learning research-based technology to engage museum visitors in learning about the process of science, shaping attitudes towards science, and science identity development. Through the U!Scientist multi-touch tabletop exhibit, visitors will: (1) interact with scientific data, (2) provide interpretations of data for direct use by scientists, (3) make statements based on evidence, and (4) visualize how their data classifications contribute to globe-spanning research projects. Visitors will also get to experience the process of science, gaining efficacy and confidence through these carefully designed interactions. This project brings together Zooniverse, experts in interactive design and learning based on large data visualizations in museums, and leaders in visitor experience and learning in science museums. Over fifty thousand museum visitors are expected to interact annually with U!Scientist through this effort. This impact will be multiplied by packaging the open-source platform so that others can easily instantiate U!Scientist at their institution.
The U!Scientist exhibit development process will follow rapid iterations of design, implementation, and revision driven by evaluation of experiences with museum visitors. It will involve close collaboration between specialists in computer science, human-computer interaction and educational design, informal science learning experts, and museum practitioners. The summative evaluation will be based on shadowing observations, U!Scientist and Zooniverse.org logfiles (i.e., automated collection of user behavior metrics), and surveys. Three key questions will be addressed through this effort: Q1) Will visitors participate in PPSR activities (via the U!Scientist touch table exhibit) on the museum floor, despite all the distractions and other learning opportunities competing for their attention? If so, who engages, for how long, and in what group configurations? Q2) If visitors do participate, will they re-engage with the content after the museum visit (i.e., continue on to Zooniverse.org)? Q3) Does engaging in PPSR via the touch table exhibit--with or without continued engagement in Zooniverse.org after the museum visit--lead to learning gains, improved understanding of the nature of science, improved attitudes towards science, and/or science identity development?
As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The project will bring together science museum visitor experience developers, visitor studies staff, indoor location technology developers, cyber-learning researchers, and STEM informal learning specialists for a two day conference, COMPASS (Conference on Mobile Position Awareness Systems and Solutions), to address the achievements and potential of indoor location aware mobile (ILAM) technology in science museums. The pre-conference work, the conference itself, and a subsequent e-publication will provide multiple, informed perspectives and knowledge around ILAM for science museums to develop apps for visitors' own smartphones to enhance and personalize the visitor experience and to experiment with new kinds of inquiry-based learning. The goals of the conference are to form an integrated vision by consolidating expertise from disparate disciplines connected to ILAM tech development, to transform visitor mobile tools to provide more innovative forms of interaction and personalization, and to open new avenues for visitor research with automated data collection and analysis.
The COMPASS conference will bring together 80 participants for two days in September 2018 at the Exploratorium in San Francisco, CA. The first dissemination will take place in a presentation at the ASTC conference the following month in October 2018. A webinar sharing insights from COMPASS and inviting others to engage will be held in March 2019 hosted by ASTC and accessible by ASTC members and non-members alike. A companion COMPASS e-publication will be released for free download, also in March 2019, with summaries of conference proceedings, key issues identified, case histories of ILAM in museums, white papers and other resources. Conference outcomes include establishing a community of practice or special interest group and establishing common goals for future collaborative work. By gathering a diverse range of perspectives and expertise to share research and evidence based findings, COMPASS include collective problem solving and an informed cross disciplinary approach to planning and implementing ILAM technology in the museum environment. The conference will explicitly address the benefits and quality of open source code and protocols and how techniques could be shared among institutions. As professional experience with deploying ILAM apps grows, this tool could be used to increase accessibility for diverse visitor populations, put in use at smaller and medium sized science centers, and applied to a variety of research studies, increasing the impact for funders and benefiting the science center community at large.
Becoming computationally literate is increasingly crucial to everyday life and to expanding workforce capacity. Research suggests that computational literacy--knowing what, when, how, and why to use the ideas of computer science, in combination with the capacity to view problems and potential solutions through the lens of computational structures and procedures--can be supported through digital game play. This project aims to develop a social and creative exhibit game that foregrounds aspects of computer science, specifically artificial intelligence (AI) and computer programming, in ways that enable youth to explore, construct, and share computational complex systems content with one another and other museum visitors. To play the game, pairs of youth visitors will use code cards to program the behavior of AI animals in a virtual forest. As they do so, youth will engage with computational literacy practices, such as basic computer programming, describing their computational ideas, and doing computational problem solving with their friends. Their activity will be projected on a large screen as a strategy for enabling youth to test, rehearse, and communicate their computational ideas and to also interest other visitors into computational problem solving.
Using multi-perspective and iterative design-based research, university learning scientists, museum practitioners, and game developers will pursue research questions around how science museums can better engage youth who are traditionally underrepresented in computer science in complex computational practices. Data sources will include interactive-log data, observations of visitor interactions with the game, visitor interviews, and visitor surveys. A multimodal and mixed methods approach that searches for convergences between qualitative analysis, quantitative analysis, and learning analytics will be used to generate research findings. Changes in computational literacy will be assessed by evaluating what problems visitors choose to solve with programming, how they frame those problems, and their selections from among possible solutions, what they program, how they program, and how they describe programming ideas. The results of this project will include: 1) a social, interactive gameplay experience that supports the development of computational literacy; 2) design principles for game-based exhibits that facilitate development of computational literacy; and 3) new knowledge of variations in design and gameplay across diverse gameplay users, including those from underrepresented groups in computer science. It is anticipated that 1,000 museum youth visitors will directly participate in the study.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Matthew BerlandLeilah LyonsMatthew Cannady
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will advance knowledge in the design of interest triggers for science in immersive digital simulation learning games. When learners are interested in a topic, it can have a profound impact on the quality of their learning. Although much is known about how informal learning experiences can promote interest in STEM, much less research has addressed links between technology use and interest development. This Exploratory Pathways project will investigate (1) the impact of entertainment technology use by middle school learners on STEM interest development, (2) the design of interactive educational technologies created specifically to trigger interest in astronomy, and (3) informal learning resources for sustained interaction with STEM content over time. In particular, learners will have the opportunity to interactively explore the scientific consequences of considering alternative versions of Earth via "What if?" questions, such as "What if the earth had no moon?" or "What if the earth were twice its current size?". While using the simulations, learners will be invited to make observations and propose scientific explanations for what they see as different. Given recent discoveries of potentially habitable worlds throughout the Galaxy, such questions have high relevance to public discourse around space exploration, conditions necessary for life, and the long-term future of the human race. Studies will occur across three informal learning settings: museum exhibits, afterschool programs, and summer camps, and are driven by the following research questions: What technology-based triggers of interest have the strongest influence on interest? Which contextual factors are most important for supporting long-term interest development? And, what kinds of technology-based triggers are most effective for learners from audiences who are underrepresented in STEM? This research will result in an empirically tested approach for cultivating interest that will allow educators to leverage the "What if?" pedagogy in their own work, as well as downloadable materials suitable for use in both informal and formal learning settings.
Planned studies will identify features that are effective in triggering interest, with an emphasis on groups underrepresented in STEM, and elaborate on the importance of engaging learners in explanatory dialogues and in service of interest development. It is hypothesized that interacting in such novel ways can act as a trigger for interest in astronomy, physics, and potentially other areas of STEM. Design iterations will also investigate different forms of learning supports, such as guidance from facilitators, collaboration, and automated guidance available within the simulations, and identify how features vary with respect to learning contexts. Data collected will include interview and survey data to track interest development, measures of knowledge in astronomy and physics, and log files of simulation use to better understand how behaviors in the simulations align with stated interests. Results of the studies will advance the theoretical understanding of interest development and its relationship to interactive experiences, and will also have practical implications for the deployment of technology in informal settings by identifying features critical for triggering the interest of middle school learners. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
H Chad LaneJorge Perez-GallegoNeil Comins
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
Makerspaces and engineering design spaces have proliferated in science museums, schools, libraries, and community settings at a rapid pace. However, there is a risk that some of the same inequities that exist in the engineering field are being replicated in these settings. Research has provided evidence of persistent gaps between boys' and girls' levels of interest in engineering as it has been traditionally represented in informal learning environments, particularly in Making and engineering spaces. This Research-In-Service to Practice project intends to address this gap by employing a design-based research approach to examine if and to what extent narrative elements can interest and engage middle school girls in science, technology, engineering, and mathematics (STEM), and promote equitable, effective engineering design experiences and practices. This work is significant, as it will build upon current research and conceptual understanding of how to design narrative-rich engineering design activities for informal learning spaces, especially for girls, and within museum drop-in experiential learning contexts. It will also contribute to the evidence base regarding how girls approach and choose to persist in solving engineering design problems. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The New York Hall of Science (NYSCI) in collaboration with the Amazeum in Bentonville, Arkansas, the Tech Museum of Innovation in San Jose, California, the Creativity Labs at Indiana University and a team of advisors will conduct the 30-month, design-based research project in two phases. In the first phase, NYSCI will garner ongoing input from its partners to develop parallel versions of six pairs of engineering design activities, one with narrative elements and one without. These activities will be iteratively tested in NYSCI's Design Lab, a 10,000 square foot exhibition devoted to hands-on exploration of engineering design. Several research questions will be explored, focused primarily on building evidence-based design knowledge, establishing appeal and comprehensibility, and understanding facilitation. Observational and interview data will be garnered from 30 girls aged 7-14 and their family groups for each of the twelve activities developed, totaling 360 girls in the study sample. The results of the research on the paired activities will be iterative and provide insight on how narrative elements can most effectively invite girls into sustained engagement with the core engineering concepts and practices highlighted in each activity. In the second phase, formative and summative evaluation will be conducted to study the impact of the narrative and non-narrative versions of the engineering design activities on participating girls' engagement and persistence, by contrasting the quality of girls' engagement across the two types of activities while they are implemented across three museum sites. Project deliverables include journal articles reporting on project findings; documentation of activities that meet project goals; design guidelines for exhibit and curriculum developers who are interested in using narrative effectively to frame engineering design activities; and practical guidance for facilitators seeking to ensure that they are supporting girls effectively as they explore those activities.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
Merging art and science, "Self Reflected" aims to communicate the incredible complexity of the neural signaling in our brains that makes us who we are. The artists, Dr. Greg Dunn and Dr. Brian Edwards, invented a novel technique called reflective microetching to simulate the microscopic behavior of neurons in the viewer’s brain as they observe this work of art. "Self Reflected" is currently on display in the Your Brain exhibit at The Franklin Institute in Philadelphia. This summative evaluation study explores museum visitors’ behavior, reactions, and learning outcomes as they interact with