Makerspaces and engineering design spaces have proliferated in science museums, schools, libraries, and community settings at a rapid pace. However, there is a risk that some of the same inequities that exist in the engineering field are being replicated in these settings. Research has provided evidence of persistent gaps between boys' and girls' levels of interest in engineering as it has been traditionally represented in informal learning environments, particularly in Making and engineering spaces. This Research-In-Service to Practice project intends to address this gap by employing a design-based research approach to examine if and to what extent narrative elements can interest and engage middle school girls in science, technology, engineering, and mathematics (STEM), and promote equitable, effective engineering design experiences and practices. This work is significant, as it will build upon current research and conceptual understanding of how to design narrative-rich engineering design activities for informal learning spaces, especially for girls, and within museum drop-in experiential learning contexts. It will also contribute to the evidence base regarding how girls approach and choose to persist in solving engineering design problems. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The New York Hall of Science (NYSCI) in collaboration with the Amazeum in Bentonville, Arkansas, the Tech Museum of Innovation in San Jose, California, the Creativity Labs at Indiana University and a team of advisors will conduct the 30-month, design-based research project in two phases. In the first phase, NYSCI will garner ongoing input from its partners to develop parallel versions of six pairs of engineering design activities, one with narrative elements and one without. These activities will be iteratively tested in NYSCI's Design Lab, a 10,000 square foot exhibition devoted to hands-on exploration of engineering design. Several research questions will be explored, focused primarily on building evidence-based design knowledge, establishing appeal and comprehensibility, and understanding facilitation. Observational and interview data will be garnered from 30 girls aged 7-14 and their family groups for each of the twelve activities developed, totaling 360 girls in the study sample. The results of the research on the paired activities will be iterative and provide insight on how narrative elements can most effectively invite girls into sustained engagement with the core engineering concepts and practices highlighted in each activity. In the second phase, formative and summative evaluation will be conducted to study the impact of the narrative and non-narrative versions of the engineering design activities on participating girls' engagement and persistence, by contrasting the quality of girls' engagement across the two types of activities while they are implemented across three museum sites. Project deliverables include journal articles reporting on project findings; documentation of activities that meet project goals; design guidelines for exhibit and curriculum developers who are interested in using narrative effectively to frame engineering design activities; and practical guidance for facilitators seeking to ensure that they are supporting girls effectively as they explore those activities.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project plans to deliver and improve a constructivist professional development (PD) program called Remake Making for library staff that work with youth in maker spaces. The proposed project will be led by a team at the University of Pittsburgh and builds on a pilot facilitation framework developed in an earlier project by this team. The PD program responds to the rapid growth of makerspaces with a constructivist PD program focused on facilitation. Maker spaces are a new service model in many public libraries, part of a broader shift in general library services. Effective facilitation for learning, like that required in makerspaces, is a relatively new facet of librarianship that is not a consistent part of librarian education or PD. The project will work with two local library systems with libraries that have makerspaces but little to no PD opportunities around facilitation. The project plans to iteratively design and investigate the Remake Making program, its impact on library maker facilitators and their interactions with child and youth learners. This will provide a setting for preliminary research about constructivist PD and the experiences and struggles of staff who facilitate making in libraries within the context of shifting library norms. This project will produce an efficient, maker-friendly PD system for facilitation in makerspaces, applicable to a broad range of informal and formal educators who wish to incorporate facilitated making.
The project plans to conduct an iterative development process involving several cohorts of participants and using multiple data sources which include embedded PD workshop data, participant pre-post surveys, observation of library makerspaces, and interviews/focus groups. A participatory approach will be employed by involving participants in creating and refining research questions within the scope of the project. This approach is designed around inquiry-based improvement, which is experienced by participants as reflective practice or continuous improvement. The proposed project aims to advance knowledge and PD strategies for facilitation in library makerspaces. The research will build knowledge about the efficacy of an innovative constructivist PD program with adaptation as a key feature. The data collected in the context of the development of this innovation will provide opportunities for applied research about informal STEM learning in the context of library maker spaces, and the role that library staff play in facilitating this type of learning.
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.
Increasingly, the prosperity, innovation and security of individuals and communities depend on a big data literate society. Yet conspicuously absent from the big data revolution is the field of teaching and learning. The revolution in big data must match a complementary revolution in a new kind of literacy, through a significant infusion of STEM education with the kinds of skills that the revolution in 21st century data-driven science demands. This project represents a concerted effort to determine what it means to be a big data literate citizen, information worker, researcher, or policymaker; to identify the quality of learning resources and programs to improve big data literacy; and to chart a path forward that will bridge big data practice with big data learning, education and career readiness.
Through a process of inquiry research and capacity-building, New York Hall of Science will bring together experts from member institutions of the Northeast Big Data Innovation Hub to galvanize big data communities of practice around education, identify and articulate the nature and quality of extant big data education resources and draft a set of big data literacy principles. The results of this planning process will be a planning document for a Big Data Literacy Spoke that will form an initiative to develop frameworks, strategies and scope and sequence to advance lifelong big data literacy for grades P-20 and across learning settings; and devise, implement, and evaluate programs, curricula and interventions to improve big data literacy for all. The planning document will articulate the findings of the inquiry research and evaluation to provide a practical tool to inform and cultivate other initiatives in data literacy both within the Northeast Big Data Innovation Hub and beyond.
This project, conducted by the University of Pittsburgh and the University of California, Berkeley, seeks to discover what makes middle school students engaged in science, technology, engineering, and mathematics (STEM). The researchers have developed a concept known as science learning activation, including dispositions, practices, and knowledge leading to successful STEM learning and engagement. The project is intended to develop and validate a method of measuring science learning activation.
The first stage of the project involves developing the questions to measure science activation, with up to 300 8th graders participating. The second stage is a 16-month longitudinal study of approximately 500 6th and 8th graders, examining how science learning activation changes over time. The key question is what are the influencers on science activation, e.g., student background, classroom activities, and outside activities.
This project addresses important past research showing that middle school interest in STEM is predictive of actually completing a STEM degree, suggesting that experiences in middle school and even earlier may be crucial to developing interest in STEM. This research goes beyond past work to find out what are the factors leading to STEM interest in middle school.
This work helps the Education and Human Resources directorate, and the Division of Research on Learning, pursue the mission of supporting STEM education research. In particular, this project focuses on improving STEM learning, as well as broadening participation in STEM education and ultimately the STEM workforce.
A quasi-experimental separate-sample pretest/posttest study was implemented in Boston with adult viewers of the IMAX film "Dolphins." A majority of adults rated the film as 'very interesting,' reporting that they liked the film's cinematography, educational value and experiential quality. Viewing the film significantly increased adult viewers' knowledge about topics associated with dolphins. A second study focused on seventh grade students who viewed only the film or viewed the film and subsequently completed film-related activities in their school classroom setting. A quasi-experimental
A summative evaluation in Jersey City, New Jersey at the Liberty Science Center’s IMAX® Dome Theater was carried out with adult (18+ years) viewers. A quasi-experimental separate-sample pretest/posttest design was used. "Island of the Sharks" made a positive impact on sample adult audience member’s knowledge of topics presented in the film and was reportedly moderately or very interesting to 81% of the adult sample. A second summative evaluation involving three classes from each of two middle schools was carried out with seventh grade students. A quasi-experimental pretest/posttest
This study addressed the questions of whether or not the IMAX/OMNIMAX film "Tropical Rainforest" contributes to a positive attitude towards, and and increase in knowledge about, the tropical rain forests of the world. Results indicate that there are statistically significant increases in knowledge gained as well as an increase in positive attitudes towards the tropical rain forests. All three specific audiences (grades 1-6; grades 7-12; adult general) tended to increase overall.
A quasi-experimental separate-sample pretest/posttest design was used to assess the impact of the giant screen film "The Greatest Places" on adult viewers. A second evaluation was implemented with eighth grade students who either viewed the film after two related reading activities or viewed the film without associated activity.