Informal STEM learning experiences (ISLEs), such as participating in science, computing, and engineering clubs and camps, have been associated with the development of youth’s science, technology, engineering, and mathematics interests and career aspirations. However, research on ISLEs predominantly focuses on institutional settings such as museums and science centers, which are often discursively inaccessible to youth who identify with minoritized demographic groups. Using latent class analysis, we identify five general profiles (i.e., classes) of childhood participation in ISLEs from data
DATE:
TEAM MEMBERS:
Remy DouHeidi CianZahra HazariPhilip SadlerGerhard Sonnert
Maker Education scholarship is accumulating increasingly complex understandings of the kinds of learning associated with maker practices along with principles and pedagogies that support such learning. However, even as large investments are being made to spread maker education, there is little understanding of how organizations that are intended targets of such investments learn to develop new maker related educational programs. Using the framework of Expansive Learning, focusing on organizational learning processes resulting in new and unfolding forms of activity, this paper begins to fill
Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
This exploratory learning research and design project will study how to use emerging technologies to help document practices in maker-based learning experiences. Despite its established potential for consolidating learning and sense-making, project documentation is often overlooked, not prioritized or seen as burdensome and therefore not integrated into the learning experiences. The project team seeks to understand and address with practice partners the barriers to documentation by systematically exploring how to physically embed and incorporate smart tools and documentation practices into learning environments, specifically creative hands-on learning spaces, like makerspaces. The goal is to understand how to scaffold learners to become more aware, reflective and attentive to their progress towards learning outcomes by embedding supportive tools physically in space as the actions unfold. Making and maker-based learning experiences offer tremendous opportunities to more fully engage diverse learners in STEM education and build a workforce prepared for innovation. Documentation of these learning experiences, both as an authentic practice that professionals engage in as well as an assessment practice for instruction, is often not supported. The project will create open source documentation for solutions and develop supporting case studies, web resources and guides to facilitate easy uptake and adoption of promising approaches.
This proposal will make significant research contributions in three ways: (1) develop and iteratively test a suite of embedded "smart" tools designed to scaffold, manage and trace process documentation practices; (2) study the integration of these tools in formal and informal activities and programs settings and characterize their influence on instruction and the assessment of learning outcomes; (3) establish a set of rubrics based on learner data streams to aid instruction and mark learner progress. Improving documentation practices and the assessment of learning outcomes will advance making as a core STEM educational activity. Through a better understanding of why and how to place networked documentation tools sensitive to space, time and context cues, the threshold for enactment and scaffolded usage can be lowered in a broader range of settings. Ultimately, this exploratory project will not only develop an integrated set of situated documentation tools, but also help us develop hypotheses for how documentation as a mediating process productively supports learning.
The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The Multimedia Immersion (MI) project is will develop, pilot, and evaluate a nine-week STEM-rich multimedia production course for high school students. MI will make important contributions to the field through its efforts to design and evaluate the promises and challenges of a nine-week multimedia curriculum in multiple urban high schools. The MI course will engage teams of students to develop a personally and socially relevant storyline that guides their use of accessible audio and video technologies to create a five-minute animated video. To develop student STEM experience and provide technical support, the project will provide guidance and learning experiences in engineering (e.g., criteria, constraints, optimization, tradeoffs), science (e.g. sound, light, energy, mechanics) and multimedia technologies (e.g., computer based audio production, video editing and visualizations through animatics (i.e., shooting a succession of storyboards with a soundtrack). animatics).
Because the curriculum situates engineering and science learning in the context of multimedia production, there are natural synergies with several existing high school courses including engineering design, audio/video media production, and multimedia technology. Although these courses are typically electives in high school, developing a 5-minute animated short on a topic of interest may encourage girls and students from underrepresented groups to select this course over other electives. MI will impact 10 teachers and approximately 250 high school students per year. The project will result in the following resources: nine-week curricular unit (multimedia, science, engineering); assessments to monitor student learning of science, engineering and technology (design logs); and research on changes in student knowledge, interest, and a nine-week curricular unit (multimedia, science, engineering). Project resources will be disseminated to teachers, researchers, and curriculum and professional development providers via conference presentations, publications, and online webinars.
The MI project builds on student familiarity and interest in music, video and technology to promote an: (1) understanding of engineering design and physics and an (2) an appreciation of the fundamental role of STEM in popular culture. Project evaluation will be conducted using student surveys and an examination of work products in conjunction with implementation challenges and successes to generate evidence for the feasibility and utility of a high school multimedia course that explicitly addresses science and engineering learning. Project evaluation will use student design logs as a window into student design processes and conceptual understanding. Student design logs are an essential feature of MI curriculum design. With an appropriate structure, these design logs can inform teaching, afford an opportunity for students to reflect on their own work, and provide evidence of student thinking and learning for assessment purposes. Using student design logs as a window into students? design process and conceptual understanding is an important contribution to the engineering education community which has few options for measuring student knowledge in ways that are consistent with the hands-on, iterative nature of the design process.
As the maker movement is increasingly adopted into K-12 schools, students are developing new competences in exploration and fabrication technologies. This study assesses learning with these technologies in K-12 makerspaces and FabLabs.
Our study describes the iterative process of developing an assessment instrument for this new technological literacy, the Exploration and Fabrication Technologies Instrument, and presents findings from implementations at five schools in three countries. Our index is generalizable and psychometrically sound, and permits comparison between student confidence
DATE:
TEAM MEMBERS:
Paulo BliksteinZaza KabayadondoAndrew P. MartinDeborah A. Fields
The Sustainability Teams Empower and Amplify Membership in STEM (S-TEAMS), an NSF INCLUDES Design and Development Launch Pilot project, will tackle the problem of persistent underrepresentation by low-income, minority, and women students in STEM disciplines and careers through transdisciplinary teamwork. As science is increasingly done in teams, collaborations bring diversity to research. Diverse interactions can support critical thinking, problem-solving, and is a priority among STEM disciplines. By exploring a set of individual contributors that can be effect change through collective impact, this project will explore alternative approaches to broadly enhance diversity in STEM, such as sense of community and perceived program benefit. The S-TEAMS project relies on the use of sustainability as the organizing frame for the deployment of learning communities (teams) that engage deeply with active learning. Studies on the issue of underrepresentation often cite a feeling of isolation and lack of academically supportive networks with other students like themselves as major reasons for a disinclination to pursue education and careers in STEM, even as the numbers of underrepresented groups are increasing in colleges and universities across the country. The growth of sustainability science provides an excellent opportunity to include students from underrepresented groups in supportive teams working together on problems that require expertise in multiple disciplines. Participating students will develop professional skills and strengthen STEM- and sustainability-specific skills through real-world experience in problem solving and team science. Ultimately this project is expected to help increase the number of qualified professionals in the field of sustainability and the number of minorities in the STEM professions.
While there is certainly a clear need to improve engagement and retention of underrepresented groups across the entire spectrum of STEM education - from K-12 through graduate education, and on through career choices - the explicit focus here is on the undergraduate piece of this critical issue. This approach to teamwork makes STEM socialization integral to the active learning process. Five-member transdisciplinary teams, from disciplines such as biology, chemistry, computer and information sciences, geography, geology, mathematics, physics, and sustainability science, will work together for ten weeks in summer 2018 on real-world projects with corporations, government organizations, and nongovernment organizations. Sustainability teams with low participation by underrepresented groups will be compared to those with high representation to gather insights regarding individual and collective engagement, productivity, and ongoing interest in STEM. Such insights will be used to scale up the effort through partnership with New Jersey Higher Education Partnership for Sustainability (NJHEPS).
DATE:
-
TEAM MEMBERS:
Amy TuiningaAshwani VasishthPankaj Lai
To reach its full potential in science, technology, engineering, and mathematics (STEM), the United States must continue to recruit, prepare and maintain a diverse STEM workforce. Much work has been done in this regard. Yet, underrepresentation in STEM fields persists and is especially pronounced for Hispanic STEM professionals. The Hispanic community is the youngest and fastest growing racial/ethnic group in the United States but comprises only seven percent of the STEM workforce. More evidence-based solutions and innovative approaches are required. This project endeavors to address the challenges of underrepresentation in STEM, especially among individuals of Hispanic descent, through an innovative approach. The University of San Diego will design, develop, implement, and test a multilayered STEM learning approach specific to STEM learning and workforce development in STEM fields targeting Hispanic youth. The STEM World of Work project will explore youth STEM identity through three mechanisms: (1) an assessment of their individual interests, strengths, and values, (2) exposure to an array of viable STEM careers, and (3) engagement in rigorous hands-on STEM activities. The project centers on a youth summer STEM enrichment program and a series of follow-up booster sessions delivered during the academic year in informal contexts to promote family engagement. Paramount to this work is the core focus on San Diego's Five Priority Workforce Sectors: Advanced Manufacturing, Information and Communications Technology, Clean Energy, Healthcare, and Biotech. Few, if any, existing projects in the Advancing Informal STEM learning portfolio have explored the potential connections between these five priority workforce sectors, informal STEM learning, and identity among predominately Hispanic youth and families engaged in a year-long, culturally responsive STEM learning and workforce focused program. If successful, the model could provide a template for the facilitation of similar efforts in the future.
The STEM World of Work project will use a mixed-methods, exploratory research design to better understand the variables influencing STEM learning and academic and career choices within the proposed context. The research questions will explore: (1) the impacts of the project on students' engagement, STEM identity, STEM motivation, and academic outcomes, (2) factors that moderate these outcomes, and (3) the impact the model has on influencing youths' personal goals and career choices. Data will be garnered through cross-sectional and longitudinal surveys and reflective focus groups with the students and their parents/guardians. Multivariate analysis of variance, longitudinal modeling, and qualitative analysis will be conducted to analyze and report the data. The findings will be disseminated using a variety of methods and platforms. The broader impacts of the findings and work are expected to extend well beyond the project team, graduate student mentors, project partners, and the estimated 120 middle school students and their families from the predominately Hispanic Chula Vista Community of San Diego who will be directly impacted by the project.
This exploratory pathways project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Perla MyersVitaliy PopovOdesma DalrympleYaoran LiJoi Spencer
The FIRST Longitudinal Study is a multi-year longitudinal study assessing the impacts of FIRST’s afterschool robotics programs on the STEM related interests and educational and career trajectories of program participants. FIRST is one of the nation’s largest after-school robotics programs, serving more than 460,000 youth aged 6-18 annually through the FIRST LEGO League (Ages 7-14), the FIRST Tech Challenge (grades 7-12) and the FIRST Robotics Competition (grades 9-12). The study is tracking over 1200 program participants and comparison students, using a quasi-experimental design, over a
DATE:
TEAM MEMBERS:
Alan MelchiorCathy BurackMatthew HooverJill Marcus
While the term 'failure' brings to mind negative associations, there is a current focus on failure as a driver of innovation and development in many professional fields. It is also emerging from prior research that for STEM professionals and educators, failure plays an important role in designing and making to increase learning, persistence and other noncognitive skills such as self-efficacy and independence. By investigating how youth and educators attend to moments of failure, how they interpret what this means, and how they respond, we will be better able to understand the dynamics of each part of the experience. The research team will be working with youth from urban, suburban and rural settings, students from Title I schools or who qualify for free/reduced-price lunches, those from racial and ethnic minority groups, as well as students who are learning English as a second language. These youth are from groups traditionally underrepresented in STEM and in making, and research indicates they are more likely to experience negative outcomes when they experience failure.
The intellectual merit of this project centers on establishing a baseline understanding of how failure in making is triggered and experienced by youth, what role educators play in the process, and what can be done to increase persistence and learning, rather than failure being an end-state. The research team will investigate these issues through the use of qualitative and quantitative research methods. In particular, the team will design and evaluate the effectiveness of interventions on increasing the abilities of youth and educators in noticing and responding to failures and increasing positive (e.g., resilience) outcomes. Research sites are selected because they will allow collection of data on youth from a wide range of backgrounds. The research team will also work to test and revise their hypothesized model of the influence of factors on persistence through failures in making. This project is a part of NSF's Maker Dear Colleague Letter (DCL) portfolio (NSF 15-086), a collaborative investment of Directorates for Computer & Information Science & Engineering (CISE), Education and Human Resources (EHR) and Engineering (ENG).
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.