This project, conducted by the University of Pittsburgh and the University of California, Berkeley, seeks to discover what makes middle school students engaged in science, technology, engineering, and mathematics (STEM). The researchers have developed a concept known as science learning activation, including dispositions, practices, and knowledge leading to successful STEM learning and engagement. The project is intended to develop and validate a method of measuring science learning activation.
The first stage of the project involves developing the questions to measure science activation, with up to 300 8th graders participating. The second stage is a 16-month longitudinal study of approximately 500 6th and 8th graders, examining how science learning activation changes over time. The key question is what are the influencers on science activation, e.g., student background, classroom activities, and outside activities.
This project addresses important past research showing that middle school interest in STEM is predictive of actually completing a STEM degree, suggesting that experiences in middle school and even earlier may be crucial to developing interest in STEM. This research goes beyond past work to find out what are the factors leading to STEM interest in middle school.
This work helps the Education and Human Resources directorate, and the Division of Research on Learning, pursue the mission of supporting STEM education research. In particular, this project focuses on improving STEM learning, as well as broadening participation in STEM education and ultimately the STEM workforce.
The summative evaluation with middle school students focused on three major outcomes: (1) To what extent did the film appeal to middle school viewers? (2) To what extent did the film achieve its intended viewing goals? (3) Did the implementation of school-based activities prior to viewing affect outcomes? A quasi-experimental pretest/posttest nonequivalent comparison group design was used with middle school students to evaluate the film and ancillary schoolroom activities. Intact school classes were assigned to one of two treatments: Viewing the film only (FILM, N = 225)) and viewing the film
The summative evaluation focused on four major outcomes: (1) to what extent did the film appeal to adult viewers? (2) to what extent did the film achieve its intended viewing goals? (3) what did viewers perceive that they learned from the film, if anything? (4) did viewing the film influence the audience beyond the museum visit? A quasi-experimental separate-sample pretest-posttest design was used to evaluate the film in its natural theater setting: 204 adults responded to the presurvey and 199 to the post survey. Thirty adult audience members were also interviewed by phone one week later
The aim of the study was to analyse learning using Augmented Reality (AR) technology and the motivational and cognitive aspects related to it in an informal learning context. The 146 participants were 11- to 13-year-old Finnish pupils visiting a science centre exhibition. The data, which consisted of both cognitive tasks and self-report questionnaires, were collected using a pre- post-test design and were analysed by SEM path-analysis. The results showed that AR-technology experience was beneficial for all, but especially for the lowest-achieving group and for the girls. In general, pre
DATE:
TEAM MEMBERS:
Hannu SalmiHelena ThunebergMari-Pauliina Vainikainen
This final evaluation report shares findings from the summative evaluation study of the Connected Science Learning: Linking In-School and Out-of-School STEM Learning (CSL) journal as well as themes that emerged across the broader three-year evaluation study. The ongoing study was conducted by researchers at the Center for Research on Lifelong STEM Learning at Oregon State University in collaboration with the National Science Teachers Association (NSTA) and the Association of Science-Technology Centers (ASTC).
The CSL journal was the result of an Early-concept Grant for Exploratory Research
The National Science Teachers Association (NSTA) and the Association for Science-Technology Centers (ASTC), with support from the National Science Foundation (NSF), has launched an initiative to develop and distribute two pilot issues of a new resource for STEM education practitioners in both formal and informal (out-of-school) settings. An aim of the new resource is to better connect practitioners across education settings and the research and knowledge base about STEM learning. David Heil & Associates, Inc. (DHA) is serving in a co-PI role on the grant to provide NSTA and ASTC with
This report details the formative evaluation study conducted through collaboration with the National Science Teachers Association (NSTA) and the Association of Science-Technology Centers (ASTC) to inform the iterative development and piloting of the Connected Science Learning: Connecting In-School and Out-of-School STEM Learning journal. The journal was the result of an Early Concept Grant for Exploratory Research (EAGER) project funded by the National Science Foundation (NSF) to develop, disseminate and evaluate a new resource for connecting STEM education practitioners across settings and to
Over three years beginning in January 2016, the Science Museum of Virginia will launch a new suite of public programming entitled “Learn, Prepare, Act – Resilient Citizens Make Resilient Communities.” This project will leverage federally funded investments at the Museum, including a NOAA-funded Science On a Sphere® platform, National Fish and Wildlife-funded Rainkeepers exhibition, and the Department of Energy-funded EcoLab, to develop public programming and digital media messaging to help the general public understand climate change and its impacts on Virginia’s communities and give them tools to become resilient to its effects. Home to both the delicate Chesapeake Bay ecosystem and a highly vulnerable national shoreline, Virginia is extremely susceptible to the effects of climate change and extreme weather events. It is vital that citizens across the Commonwealth understand and recognize the current and future impacts that climate variability will have on Virginia’s economy, natural environment, and human health so that they will be better prepared to respond. In collaboration with NOAA Chesapeake Bay Office, George Mason University’s Center for Climate Change Communication, Virginia Institute for Marine Science, Public Broadcasting Service/National Public Radio affiliates, and Resilient Virginia, the Museum will use data from the National Climatic Data Center and Virginia Coastal Geospatial and Educational Mapping System to develop and deliver new resiliency-themed programming. This will include presentations for Science On a Sphere® and large format digital Dome theaters, 36 audio and video digital media broadcast pieces, two lecture series, community preparedness events, and a Resiliency Checklist and Certification program. This project supports NOAA’s mission goals to advance environmental literacy and share its vast knowledge and data with others.
The Institute for Learning Innovation (ILI) will undertake a rigorous study of the public learning impact of the Science on a Sphere (SOS) museum education program that was began by NOAA in 2005. As proposed, this study will identify and evaluate the range and depth of SOS audience impacts and outcomes to provide the essential baseline understanding for its ongoing and future uses. The study will further explore the role and impact of data visualization in contemporary society as an effective means of deepening public understanding of such complex issues as Earth natural systems.
Purpose: The United States (U.S.) has traditionally produced the world’s top research scientists and engineers, leading to breakthrough advances in science and technology. Despite the importance of STEM careers, many U.S. students are not graduating with strong STEM knowledge, skills or interests, and the percentage of students prepared for or pursuing STEM degrees or careers is declining. Research shows that the decreased interest in STEM typically begins in the middle school years, pose significant academic and social challenges for students. This project will develop a web-based game teach 6th to 8th students key scientific inquiry skills, along with the academic mindsets and learning strategies to facilitate engagement and effective science learning.
Project Activities: The researchers will create a prototype by mapping key Next Generation Science Standards and learning goals with concepts and content, and producing a game design document. Following completion of the prototype, the researchers will finalize the server architecture, create the core code systems, concept art, and develop a prototype in order to simulate the final user experience. Iterative refinements will be conducted as needed at major production milestones until the game is fully functional. Once development is complete, the research team will assess the usability and feasibility, fidelity of implementation, and the promise of the game to improve outcomes in a pilot study. In this study, 200 students in 10 classes will participate, with 5 of the classrooms randomly assigned to use the game and 5 who will proceed as normal. All students will complete pre- and post- program surveys assessing their academic mindsets, learning strategies, and science skills.
Product: This project will develop SciSkillQuest, a web-based multiplayer game intended to teach middle school students scientific inquiry skills and to foster academic growth mindsets in science. Students will pursue quests, employing inquiry skills to navigate and succeed in the game, including Questioning, Modeling, Investigating, Analyzing, Computing, Explaining, Arguing, and Informing. The game will include different paths to a solution, role playing elements, immersive narratives, challenge-based progressions, and peer collaboration to engage players. The growth mindset message — that ability and skill are developed through effort and learning — will be introduced and reinforced through feedback by embedded in-game characters. The games will be supplemental to the curriculum but will also be designed to be integrated within instructional practice. The game will be available for mobile devices as well as web browsers.
The project team is developing a prototype of Thinking Time, a tablet-based app and game for early learners (ages 3- to 6-years-old) that provides cognitive training games based on neuropsychological research. Game play will be self-guided and adaptive, and will support the development of working memory, attention and impulse control, and flexibility. The goal is to promote academic readiness by scaffolding cognitive skills during the early years of heightened brain plasticity. In the Phase I pilot research, the project team will examine whether the software prototype functions as planned, if teachers are able to integrate it within the classroom environment, and whether children are engaged with the prototype.
The project team is developing a prototype of a mobile platform, Zaption, to support teachers in using video clips to enrich learning. The product’s user-interface will allow teachers to easily add annotations to videos, make short video clips that align to topics, and enhance videos with time-linked elements and assessments that appear at the top of each video. In Phase I pilot research, the team will examine whether the prototype functions as planned, if teachers are able to use the prototype for different purposes, and whether students are engaged by the prototype.