Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
In April 2018, FHI 360, under the leadership of Maryann Stimmer and Merle Froschl, convened a meeting of thought leaders in Washington, D.C. to capture a “snapshot” of STEM education. They subsequently conducted additional interviews with more than 50 local and national policy leaders; public and private funders; researchers; PreK-12 and post-secondary educators; parents, and leaders of afterschool programs, science centers and youth-serving organizations. The purpose of this summary report is to identify current trends and gaps to inform research, policy, and practice in order to reinforce
Informal science learning (ISL) organizations that are successful at providing meaningful science, technology, engineering, arts, and mathematics (STEAM) experiences for Latino children, youth, and their families share some common traits. They have leaders and staff who believe in the importance of developing culturally relevant models and frameworks that meet the needs and acknowledge the legacy of STEAM in Latino communities. Such organizations are willing to take risks to create experiences that are culturally meaningful, garner funding and implement programs by working closely with their
DATE:
TEAM MEMBERS:
Cheryl JuarezVerónika NúñezExploratorium
This study explored the effect of depth of learning (as measured in hours) on creativity, curiosity, persistence and self-efficacy. We engaged ~900 parents and 900 students across 21 sites in Washington, Chicago, Los Angeles, New York, Alabama, Virginia and the United Arab Emirates, in 5-week (10-hr) Curiosity Machine programs. Iridescent trained partners to implement the programs. Thus, this analysis was also trying to establish a baseline to measure any loss in impact from scaling our programs and moving to a “train-the-trainer” model. We analyzed 769 surveys out of which 126 were paired. On
DATE:
TEAM MEMBERS:
Iridescent
resourceprojectProfessional Development, Conferences, and Networks
Project SYSTEMIC (A Systems Thinking Approach to STEM Ecosystem Development in Chicago) will apply systems thinking to a community-level STEM ecosystem development effort in one of Chicago's largest and most distressed neighborhoods. The project aims to broaden participation of African American and low-income Chicago Public School students (preK-12) in STEM learning opportunities. The proposed model of collaborative change for this project builds on the work of two coordinated collective impact initiatives--the Chicago STEM Pathways Cooperative and Austin Coming Together, a network of local organizations committed to improving educational and economic outcomes for the community. A key feature of this project is that it adds innovative, interactive, visual problem structuring and solving strategies to highlight and uncover the systemic interdependencies that contribute to the BP challenge for African American youth. The project will convene a series of workshops to engage community stakeholders in the mapping of the STEM ecosystem. A broad and representative cross-section of community stakeholders will design and develop evidence-based STEM ecosystem organizing and implementation strategies. Key outcomes anticipated from this project are the development of a shared understanding, agenda, activities, and commitment to collectively address the underlying challenges of STEM access and participation for African American youth. The goal of this community-driven project is to develop a viable system model that elevates neighborhood voices, historically excluded from the problem-solving table and decision-making processes, to leverage existing assets, build local capacity, increase messaging and awareness of the value of STEM, identify needed new programs, and develop coordination/resource sharing mechanisms across partners to support implementation. The evaluation of this project will be grounded in systems thinking and culturally-responsive approaches that seek to understand the diverse perspectives of stakeholders while measuring progress toward project goals. Evaluation data will be used to assess the problem structuring process, to evaluate the organizational strategy designed to address the structured problem, and to support adaptive learning among stakeholders.
Increasingly, the prosperity, innovation and security of individuals and communities depend on a big data literate society. Yet conspicuously absent from the big data revolution is the field of teaching and learning. The revolution in big data must match a complementary revolution in a new kind of literacy, through a significant infusion of STEM education with the kinds of skills that the revolution in 21st century data-driven science demands. This project represents a concerted effort to determine what it means to be a big data literate citizen, information worker, researcher, or policymaker; to identify the quality of learning resources and programs to improve big data literacy; and to chart a path forward that will bridge big data practice with big data learning, education and career readiness.
Through a process of inquiry research and capacity-building, New York Hall of Science will bring together experts from member institutions of the Northeast Big Data Innovation Hub to galvanize big data communities of practice around education, identify and articulate the nature and quality of extant big data education resources and draft a set of big data literacy principles. The results of this planning process will be a planning document for a Big Data Literacy Spoke that will form an initiative to develop frameworks, strategies and scope and sequence to advance lifelong big data literacy for grades P-20 and across learning settings; and devise, implement, and evaluate programs, curricula and interventions to improve big data literacy for all. The planning document will articulate the findings of the inquiry research and evaluation to provide a practical tool to inform and cultivate other initiatives in data literacy both within the Northeast Big Data Innovation Hub and beyond.
Maker Corps is a program delivered by the Maker Education Initiative (Maker Ed) to increase organizational capacity to develop and deliver maker programing. Since its inception in 2013, the program has grown to support over 100 organizations by providing professional development, connections to a community of other maker educators and individualized support. Over time the program elements have changed in response to feedback from participants, collaboration with evaluators and shifts in focus for Maker Ed’s goals. In the spirit of maker education – tinkering, observing, responding, iterating –
The data collection for this project involved three audiences: (1) a post-event survey completed by participants at the 'Eight-Legged Encounters' event, (2) a club experience survey completed by middle school students in an after-school club, and (3) focus groups, observations, and end-of-course evaluations conducted with students in the BIOS 497/897 'Communicating Science through Outreach' seminar class at the University of Lincoln, Nebraska. Year two data collection was completed from September 2013 - March 2014. Appendix includes survey.
DATE:
TEAM MEMBERS:
University of Nebraska-LincolnEileen Hebets
The data collection for this project involves three audiences: (1) a post-event survey completed by participants at the 'Eight-Legged Encounters' event, (2) a club experience survey completed by middle school students in an after school club, and (3) focus groups, observations, and end-of-course evaluations conducted with students in the BIOS 497/897 'Communicating Science through Outreach' seminar class at the University of Nebraska-Lincoln. Data was collected from February to April, 2013 and the evaluation was conducted by the Bureau of Sociological Research (BOSR). Appendix contains surveys
DATE:
TEAM MEMBERS:
University of Nebraska-LincolnEileen Hebets
This report is the result of a project to investigate through a sociocultural lens whether girls-only, informal STEM experiences have potential long-term influences on young women's lives, both in terms of STEM but also more generally. The authors documented young women's perceptions of their program experiences and the ways in which they influenced their future choices in education, careers, leisure pursuits, and ways of thinking about what science is and who does it. This report includes the questionnaire used in the study.
This article analyzes findings from the PISEC Family Learning Project in Philadelphia to better understand gender-based visitor behavior in science museums. It includes a brief review of the PISEC project, a discussion of gender differences among PISEC families, and a comparison of PISEC data to findings from from another study conducted by Kevin Crowley of the Learning Research Collaborative at the University of Pittsburgh's Learning and Research Development Center.