Makerspaces and engineering design spaces have proliferated in science museums, schools, libraries, and community settings at a rapid pace. However, there is a risk that some of the same inequities that exist in the engineering field are being replicated in these settings. Research has provided evidence of persistent gaps between boys' and girls' levels of interest in engineering as it has been traditionally represented in informal learning environments, particularly in Making and engineering spaces. This Research-In-Service to Practice project intends to address this gap by employing a design-based research approach to examine if and to what extent narrative elements can interest and engage middle school girls in science, technology, engineering, and mathematics (STEM), and promote equitable, effective engineering design experiences and practices. This work is significant, as it will build upon current research and conceptual understanding of how to design narrative-rich engineering design activities for informal learning spaces, especially for girls, and within museum drop-in experiential learning contexts. It will also contribute to the evidence base regarding how girls approach and choose to persist in solving engineering design problems. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The New York Hall of Science (NYSCI) in collaboration with the Amazeum in Bentonville, Arkansas, the Tech Museum of Innovation in San Jose, California, the Creativity Labs at Indiana University and a team of advisors will conduct the 30-month, design-based research project in two phases. In the first phase, NYSCI will garner ongoing input from its partners to develop parallel versions of six pairs of engineering design activities, one with narrative elements and one without. These activities will be iteratively tested in NYSCI's Design Lab, a 10,000 square foot exhibition devoted to hands-on exploration of engineering design. Several research questions will be explored, focused primarily on building evidence-based design knowledge, establishing appeal and comprehensibility, and understanding facilitation. Observational and interview data will be garnered from 30 girls aged 7-14 and their family groups for each of the twelve activities developed, totaling 360 girls in the study sample. The results of the research on the paired activities will be iterative and provide insight on how narrative elements can most effectively invite girls into sustained engagement with the core engineering concepts and practices highlighted in each activity. In the second phase, formative and summative evaluation will be conducted to study the impact of the narrative and non-narrative versions of the engineering design activities on participating girls' engagement and persistence, by contrasting the quality of girls' engagement across the two types of activities while they are implemented across three museum sites. Project deliverables include journal articles reporting on project findings; documentation of activities that meet project goals; design guidelines for exhibit and curriculum developers who are interested in using narrative effectively to frame engineering design activities; and practical guidance for facilitators seeking to ensure that they are supporting girls effectively as they explore those activities.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project plans to deliver and improve a constructivist professional development (PD) program called Remake Making for library staff that work with youth in maker spaces. The proposed project will be led by a team at the University of Pittsburgh and builds on a pilot facilitation framework developed in an earlier project by this team. The PD program responds to the rapid growth of makerspaces with a constructivist PD program focused on facilitation. Maker spaces are a new service model in many public libraries, part of a broader shift in general library services. Effective facilitation for learning, like that required in makerspaces, is a relatively new facet of librarianship that is not a consistent part of librarian education or PD. The project will work with two local library systems with libraries that have makerspaces but little to no PD opportunities around facilitation. The project plans to iteratively design and investigate the Remake Making program, its impact on library maker facilitators and their interactions with child and youth learners. This will provide a setting for preliminary research about constructivist PD and the experiences and struggles of staff who facilitate making in libraries within the context of shifting library norms. This project will produce an efficient, maker-friendly PD system for facilitation in makerspaces, applicable to a broad range of informal and formal educators who wish to incorporate facilitated making.
The project plans to conduct an iterative development process involving several cohorts of participants and using multiple data sources which include embedded PD workshop data, participant pre-post surveys, observation of library makerspaces, and interviews/focus groups. A participatory approach will be employed by involving participants in creating and refining research questions within the scope of the project. This approach is designed around inquiry-based improvement, which is experienced by participants as reflective practice or continuous improvement. The proposed project aims to advance knowledge and PD strategies for facilitation in library makerspaces. The research will build knowledge about the efficacy of an innovative constructivist PD program with adaptation as a key feature. The data collected in the context of the development of this innovation will provide opportunities for applied research about informal STEM learning in the context of library maker spaces, and the role that library staff play in facilitating this type of learning.
As part of its overall effort to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program, seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. In alignment with these aims, the University of Washington will design and pilot an innovative leadership development program, NextGen Broadening Participation in ISE Professional Learning Program, to develop the leadership capacity of mid-career professionals, primarily from underrepresented groups in STEM, whose work focuses on broadening participation in informal STEM education (ISE). Unlike most existing ISE leadership models, this pathways project will employ a bottom-up, iterative design approach to engage program participants and garner new insights. Formative data and analysis will be used to better understand the broadening participation context, inform the model, and develop strategies and resources necessary to best support a more diversified next generation of ISE leaders. This pilot study is timely and significant. There is currently a substantial dearth of literature on the intersection between broadening participation and mid-level professional leadership development. Likewise, there are few comparable models in the current AISL portfolio. As such, the findings from this pilot will address critical gaps in the AISL portfolio and in the field, at large. It has the potential to markedly transform the capacity and impact of next generation ISE leaders. Over an eighteen-month period, this feasibility study will design, implement and test key aspects of the model to determine its potential for short and long term success. Using a competitive application process, twenty ISE mid-career professionals, who work primarily within broadening participation in STEM contexts, will be recruited to participate in the NextGen Broadening Participation in ISE Professional Learning Program. The year-long program includes four core components: (a) 4-day workshop, (b) four online webinars, (c) pilot projects carried out in participants' home institutions, and (d) poster presentations of projects at a national conference. A small cohort of faculty-mentors -- leaders from both research and practice in ISE broadening participation efforts -- will serve as participant mentors and play an integral role in the design and implementation of the program. Evaluative efforts will focus on documenting the efficacy of the design strategies (ex., recruitment, mentorship, social networking), the interests, needs, and professional growth of participants and the implications for broadening participation in STEM. The evaluation will be informed by data collected via interviews, surveys, focus groups, observations, content analyses of discourse, and participant deliverables. Formative and summative external evaluations will be conducted by the Garibay Group.
The Exploratorium, in collaboration with the city of San Francisco, the Tenderloin and Civic Center communities, and national museum-community partners, are excited to announce Middle Ground: Experiments in Urban Social Science (fka Street Smarts), a project to bring research on social psychology to public urban environments. Middle Ground combines recent work by the Exploratorium in social science exhibitry and urban learning spaces to develop a novel contribution to science learning in public spaces. The project will produce an outdoor learning installation in front of San Francisco City Hall that will serve the exceptionally diverse audiences that frequent the area. The installation will be populated with exhibits that engage this public in social observation and participatory experiences, promoting learning about the science of social polarization, social dilemmas, and social norms. The project will also produce an online "Guide to People Watching" for the general public, with additional materials to support professionals in the creation of social science learning experiences. The project will be supported by a community of practice of professionals engaged in educational place-making. Finally, Middle Ground will produce new research on how to design experiences that prompt structured, quasi-scientific social observation skills and foster empathy for the social experience of others.
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
This longitudinal research study will contribute to a broader understanding of the pathways of STEM-interested high school students from underrepresented groups who plan to pursue or complete science studies in their post-high school endeavors. The project will investigate the ways that formative authentic science experiences may support youth's persistence in STEM. The study focuses on approximately 900 urban youth who are high interest, high potential STEM students who participate in, or are alumni of, the Science Research Mentoring Program. This program provides intensive mentoring for high school youth from groups underrepresented in STEM careers. It takes place at 17 sites around New York City, including American Museum of Natural History, which is the original program site. Identifying key supports and obstacles in the pathways of high-interest, under-represented youth towards STEM careers can help practitioners design more inclusive and equitable STEM learning experiences and supports. In this way, the project will capitalize on student interest so that students with potential continue to persist.
In order to understand better the factors that influence these students, this research combines longitudinal social network and survey data with interviews and case studies, as well as an analysis of matched student data from New York City Public Schools' records. The research questions in the study are a) how do youths' social networks develop through their participation in scientists' communities of practice? b) what is the relationship between features of the communities of practice and youths' social networks, measures of academic achievement, and youths' pursuit of a STEM major? and c) what are the variations in youth pathways in relationship to learner characteristics, composition of social networks, and features of the community of practice? The research design allows for a rich, layered perspective of student pathways. In particular, by employing social network analysis, this study will reveal relational features of persistence that may be particularly critical for underrepresented youth, for whom STEM role models and cultural brokers provide an otherwise unavailable sense of belonging and identity in STEM. The study will also access a New York City Public Schools data set comprised of student-level records containing biographical and demographic variables, secondary and postsecondary course enrollment and grades, exam scores, persistence/graduation indicators, linked responses to post-secondary surveys, and post-education employment records and wages. These data enable examination of inter-relationships between in-school achievement and out-of-school STEM experiences through comparison of program participants to similar non-participant peers. This project is supported by NSF's EHR Core Research (ECR) program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field.
In order to improve science, technology, mathematics, and engineering (STEM) learning, it is crucial to better understand the informal experiences that young children have that prepare them for formal science education. Young children are naturally curious about the world around them, and research in developmental psychology shows that families often support children in exploring and seeking explanations for scientific phenomena. It is less clear how to link children's natural curiosity and everyday parent-child interaction with more formal STEM learning. This collaborative project will team researchers from the University of California, Santa Cruz, the University of Texas, and Brown University with informal learning practitioners at the Children's Discovery Museum, The Thinkery, and the Providence Children's Museum in order to investigate how family interaction relates to children's causal learning, as well as how modifications to museum exhibit design and facilitation by museum staff influence families' styles of interaction and increase children's causal learning. This project is funded by the Research on Education and Learning (REAL) program which supports fundamental research by investigators from a range of disciplines in order to deepen what is known about STEM learning.
The project team will examine how ethnically and linguistically diverse samples of parents and children engage in collaborative scientific learning in three children's museums across the U.S. The research will combine observational studies of parent-child interaction in a real-world setting with experimental measures of children's causal learning. The investigators will examine how children explore and derive explanations for museum exhibits about mechanical gear function and fluid dynamics. In this way, the researchers will investigate the relation between styles of parent-child interaction and children's causal learning. The team will also investigate novel ways of presenting material within the exhibits to facilitate exploration and explanation. They will explore how signage, conversations with museum staff, parents' attitudes towards learning in museum settings, and parents' own prior knowledge about the exhibits can influence the parent-child interaction and subsequent causal learning. The project will advance the basic research goal of advancing what is known about what affects children's science content learning. It will also advance the practice-oriented goal of developing new strategies for the design of science museum exhibits and make recommendations for how parents can better talk to their children about scientific phenomena.
The Growing Beyond Earth Project (GBE) is a STEM education program designed to have middle and high school students conduct botany experiments, designed in partnership with NASA researchers at Kennedy Space Center, that support NASA research on growing plants in space. GBE was initiated by Fairchild Tropical Botanic Garden in collaboration with NASA's Exploration Research and Technology Programs and Miami-Dade County Public School District. Project goals are to: (1) improve STEM instruction in schools by providing authentic research experiments that have real world implications through curricular activities that meet STEM education needs, comprehensive teacher training, summer-long internships and the development of replicable training modules; (2) increase and sustain youth and public engagement in STEM related fields; (3) better serve groups historically underrepresented in STEM fields; and (4) support current and future NASA research by identifying and testing new plant varieties for future growth in space. During the 2016-17 academic year, 131 school classrooms participated in the program. To date, students have tested 91 varieties of edible plants and produced more than 100,000 data points that have been shared with the researchers at KSC.
This proposal was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.
The study will investigate the processes that connect gestures and mathematics learning. Gestures are an important yet under-investigated aspect of mathematics teaching. They can influence students' memory and understanding of mathematical representations. The series of studies will examine students' learning of the concept of mathematical equivalence by testing instruction that incorporates commonly used verbal explanations and gestures. Mathematical equivalence includes understanding the meaning of the equal sign and determining if two expressions are equal. Second and third grade children will be participants. Of particular interest in the studies is the influence of gestures on preexisting knowledge of procedures, how gestures support learning beyond emphasizing information and direct learners' attention, and the creation of procedural knowledge.
The series of experimental studies will examine the mechanisms that connect gestures and procedural understanding of mathematical equivalence. The studies begin in the first phase with examining how gesture is connected to procedural knowledge of mathematical equivalence. Subsequent studies investigate how gesture functions as a mechanism for learning beyond emphasizing or directing attention to relevant information. Data collected will students' responses to equivalence problems and eye tracking data to follow whether students are looking from one side of the equal sign to the other. In the second phase of the work, the studies will examine how gesture has beneficial effects on learning more generally in mathematics. Working memory will be assessed in order to examine the role of gesture across different individuals. Fraction tasks will be used to examine the generalization of the previous results regarding gestures to other mathematics concepts.