Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
K-12 informal engineering education can support student confidence, interest, and awareness of the field of engineering. Studies have suggested that K-12 informal learning can influence students’ awareness of the fields of engineering as potential career opportunities. Researchers have also found that engineering activities outside of school can engage youth in disciplines of which they are unfamiliar because of a lack of engineering opportunity in K12 formal education. In this paper, we provide a rich case study of one lesson’s implementation in a 5th-6th grade girls afterschool program. Our
As part of ongoing efforts to support a diverse and robust engineering workforce and ensure that children and adults from all communities have the engineering and design thinking skills to succeed in a science, technology, engineering, and mathematics (STEM)-rich world, identity has become a growing focus of research and education efforts. In order to advance our understanding of engineering-related identity negotiation within informal STEM education contexts, we conducted an in-depth, qualitative investigation of six adolescent girls participating in an afterschool engineering education
“Tinkering EU: Building Science Capital for All” aims to develop activities and resources that support a learner-centred culture, improve science education and develop 21st century skills - all of which are fundamental for active citizenship, employability, and social inclusion. To do this, it adopts ‘Tinkering’, an innovative pedagogy developed in the USA, which is used by museums, and has proven able to create a lifelong engagement with science for everyone. Tinkering works particularly well for people who argue that “they are not good at science” or are disaffected from any formal teaching and learning process. It can be a powerful tool to tackle disadvantage. The project integrates Tinkering into the school curriculum to develop the science capital of disadvantaged youth through the use of museums. It addresses students from 8 to 14 years old (primary and junior high schools).
Coordinator: National Museum of Science and Technology Leonardo da Vinci
Partners:
University of Cambridge – UK
NEMO Science Museum – The Netherlands
Science Gallery Dublin – Ireland
CosmoCaixa – Spain
Science Center Network – Austria
NOESIS – Greece
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The Montana Girls STEM Collaborative brings together organizations and individuals throughout Montana who are committed to informing and motivating girls to pursue careers in STEM – Science, Technology, Engineering and Mathematics. The Collaborative offers professional development, networking and collaboration opportunities to adults who offer and/or support STEM programs for girls and other youth typically under-represented in STEM. The vision of Montana Girls STEM is that every young person in Montana has the opportunity to learn about STEM careers and feels welcome pursuing any dream they
DATE:
TEAM MEMBERS:
Suzi TaylorRay CallawayCathy Witlock
This one-year Collaborative Planning project seeks to bring together an interdisciplinary planning team of informal and formal STEM educators, researchers, scientists, community, and policy experts to identify the elements, activities, and community relationships necessary to cultivate and sustain a thriving regional early childhood (ages 3-6) STEM ecosystem. Based in Southeast San Diego, planning and research will focus on understanding the needs and interests of young Latino dual language learners from low income homes, as well as identify regional assets (e.g., museums, afterschool programs, universities, schools) that could coalesce efforts to systematically increase access to developmentally appropriate informal STEM activities and resources, particularly those focused on engineering and computational thinking. This project has the potential to enhance the infrastructure of early STEM education by providing a model for the planning and development of early childhood focused coalitions around the topic of STEM learning and engagement. In addition, identifying how to bridge STEM learning experiences between home, pre-k learning environments, and formal school addresses a longstanding challenge of sustaining STEM skills as young children transition between environments. The planning process will use an iterative mixed-methods approach to develop both qualitative and quantitative and data. Specific planning strategies include the use of group facilitation techniques such as World Café, graphic recording, and live polling. Planning outcomes include: 1) a literature review on STEM ecosystems; 2) an Early Childhood STEM Community Asset Map of southeast San Diego; 3) a set of proposed design principles for identifying and creating early childhood STEM ecosystems in low income communities; and 4) a theory of action that could guide future design and research. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project will coordinate and focus existing educational elements with the common goal of increasing the participation of underrepresented minorities in STEM degree programs and the STEM workforce. This goal will help the US maintain its leadership in science and engineering innovation while supporting the expansion of the talent pool needed to fuel economic growth in technical areas. The program will feature an assessment system that addresses both social influence factors and the transfer of STEM skills with the aim of identifying the reasons that underrepresented minorities leave the STEM pipeline. By including both curricular and extracurricular elements of the STEM pipeline, ranging from middle school through college, the program will be able to respond quickly to findings from the assessment component and take proactive steps to retain STEM students and maintain their self perception as future scientists or engineers.
The program proposes to assess, unite and coordinate elements in the New Mexico STEM pipeline with the ultimate goal of increasing the participation of underrepresented groups in the STEM workforce. The need to grow a diverse science, technology, engineering and mathematics (STEM) workforce is recognized throughout the State of New Mexico, and beyond, by both the public and private sectors. The project develops a crosscutting assessment system that addresses both social influence factors and the skills component of STEM education. The project develops a collective impact framework aimed at increasing the participation of underrepresented minorities in the STEM workforce and implements a common assessment system for students in the 6-20+ STEM pipeline. This assessment system will address both social influence factors and the transfer of STEM related skills with the aim of building a research base to investigate why students from underrepresented minorities leave the STEM pipeline. The output from this research will drive the development of a set of best practices for increasing retention and a scheme for improving the integration of minority students into the STEM community. The retention model developed as part of the program will be shared with the STEM partners through a series of workshops with the goal of developing a more coordinated approach to the retention of underrepresented minorities. The program focuses on a small set of STEM programs with existing connections to the College of Engineering.
DATE:
-
TEAM MEMBERS:
Steven StochajPatricia SullivanLuis Vazquez
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
This project by California State University San Marcos and their collaborators will expand and continue to innovate on a pilot Mobile Making program with the goal of developing a sustainable, regional model for serving underserved, middle-school aged youth in twelve after-school programs in the San Diego region. Evaluation of the current Mobile Making program has documented positive impacts on participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life, and led to a model for engaging underserved youth in Making. The work will focus on implementing the program model sustainably at greater capacity by increasing the number of undergraduate activity leaders, after-school sites, and level of community engagement. The expanded Mobile Making program is expected to engage ~1800 middle school youth at 12 local school sites, with activities facilitated by ~1020 undergraduate CSU-SM STEM majors. The sites are in ethnically diverse and economically disadvantaged neighborhoods, with as many as 90% of students at some sites qualifying for free or reduced price lunch. The undergraduate facilitators are drawn from CSU-SM's diverse student body, which includes 44% underrepresented minorities. Outcomes are expected to include increases in the youth participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life. Positive impacts on the undergraduate facilitators will include broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. The program is designed to achieve sustainability through innovative means such as involving undergraduate facilitators via Community Service Learning (rather than paid positions), and increased community engagement via development and support of a community of practice including local after-school providers, teachers, Makers, and University members. Evaluation of the program outcomes and lessons learned are expected to result in a comprehensive model for a sustainable, university-based after-school Making program with regional impact in underserved communities. Dissemination to other regions will be leveraged via CSU-SM's membership in the California State University (CSU) system, yielding a potential statewide impact. The support of the CSU Chancellor's Office and input from a CSU implementation group will ensure the applicability of the model to other regional university settings, identify common structural barriers and solutions, and increase the probability of secondary implementations. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The project will further develop, roll out, and conduct research on a set of materials that will introduce middle school age youth to innovative and engaging engineering challenges in the Boys and Girls Club (B&GCs) context. Building on substantial prior work and evaluation-based learning, WISE Guys and Gals - Boys & Girls as WISEngineering STEM Learners (WGG) will: (1) combine engineering design activities with the (open source, online) WISEngineering infrastructure; (2) scale-up the infrastructure; (3) engage youth in informal afterschool experiences; and (4) collect a wealth of rich data to further our understanding of how youth learn through these experiences. This work will be conducted by Hofstra University's Center for STEM Research in conjunction with Brookhaven National Laboratory (BNL), The CUNY Graduate Center's Center for Advanced Study in Education (CASE), the Boys & Girls Club of America, and 25 B&GCs in New York and New Jersey. The underlying theoretical framework builds on proof-of-concept work supported by NSF and the Bill and Melinda Gates Foundation. An open source, on-line interface (WISEngineering) provides numerous virtual tools (e.g., social networking, Design Journal, embedded assessments) that promote learning and collaboration through challenging, thoughtful, and creative work. WGG will explore how to incorporate creativity, social networking, connections to real-world STEM needs/careers, and teamwork into challenges that can be completed in a one-hour period, an activity time constraint in many B&GC settings. Staff from the clubs will participate in face-to-face and virtual professional development in an effort to build their capacity as facilitators of STEM learning. Research will focus on: (1) how activities developed for 60-minute implementation and guided by informed engineering design and interconnected learning frameworks support youth learning and engagement; and (2) characteristics of the professional development approach that support B&GC facilitators' capacity development. By the end of the project, over 6,000 middle school aged youth, the majority from groups underrepresented in STEM areas, will gain experience with engineering design as they develop engineering thinking, new STEM competencies, STEM career awareness, and an appreciation for the civic value of STEM knowledge.
DATE:
-
TEAM MEMBERS:
David BurghardtXiang FuKenneth WhiteMelissa Rhodes