In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Science Hunters is an outreach project which employs the computer game Minecraft to engage children with scientific learning and research through school visits, events, and extracurricular clubs. We principally target children who may experience barriers to accessing Higher Education, including low socioeconomic status, being the first in their family to attend university, and disability (including Special Educational Needs). The Minecraft platform encourages teamwork and makes science learning accessible and entertaining for children, irrespective of background. We employ a flexible approach
DATE:
TEAM MEMBERS:
Laura HobbsCarly StevensJackie HartleyCalum Hartley
In this literature review, we seek to understand in what ways aspects of computer science education and making and makerspaces may support the ambitious vision for science education put forth in A Framework for K-12 Science as carried forward in the Next Generation Science Standards. Specifically, we examine how computer science and making and makerspace approaches may inform a project-based learning approach for supporting three-dimensional science learning at the elementary level. We reviewed the methods and findings of both recently published articles by influential scholars in computer
DATE:
TEAM MEMBERS:
Samuel SeveranceSusan CodereEmily MillerDeborah Peek-BrownJoseph Krajcik
resourceprojectGames, Simulations, and Interactives
EMERGE in STEM (Education for Minorities to Effectively Raise Graduation and Employment in STEM) is a NSF INCLUDES Design and Development Launch Pilot. This project addresses the broadening participation challenge of increasing participation of women, the at-risk minority population, and the deaf in the STEM workforce. The project incorporates in and out-of-school career awareness activities for grades 4-12 in a high poverty community in Guilford County, North Carolina. EMERGE in STEM brings together a constellation of existing community partners from all three sectors (public, private, government) to leverage and expand mutually reinforcing STEM career awareness and workforce development activities in new ways by using a collective impact approach.
This project builds on a local network to infuse career exposure elements into the existing mutually reinforcing STEM activities and interventions in the community. A STEM education and career exposure software, Learning Blade, will be used to reach approximately 15,000 students. A shared measurement system and assessment process will contribute to the evaluation of the effectiveness of the collective impact strategies, the implementation of mutually reinforcing activities across the partnership and the extent to which project efforts attract students to consider STEM careers.
DATE:
-
TEAM MEMBERS:
Gregory MontyMargaret KanipesMalcolm SchugSteven Jiang
resourceresearchGames, Simulations, and Interactives
We describe a game and teachers’ experiences using it in their middle and high school science courses. The game, which is called “Luck of the Draw,” was designed to engage middle, high school, and college students in genetics and encourage critical thinking about issues, such as genetic engineering. We introduced the game to high school science teachers attending a summer workshop and asked them to describe their initial impressions of the game and how they might use it in their classes; later, during the academic year, we asked them whether they used the game in their classrooms and, if so
DATE:
TEAM MEMBERS:
Alicia BowerKami L. TsaiCarey S. RyanRebecca AndersonAndrew JametonMaurice Godfrey
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.
Purpose: The United States (U.S.) has traditionally produced the world’s top research scientists and engineers, leading to breakthrough advances in science and technology. Despite the importance of STEM careers, many U.S. students are not graduating with strong STEM knowledge, skills or interests, and the percentage of students prepared for or pursuing STEM degrees or careers is declining. Research shows that the decreased interest in STEM typically begins in the middle school years, pose significant academic and social challenges for students. This project will develop a web-based game teach 6th to 8th students key scientific inquiry skills, along with the academic mindsets and learning strategies to facilitate engagement and effective science learning.
Project Activities: The researchers will create a prototype by mapping key Next Generation Science Standards and learning goals with concepts and content, and producing a game design document. Following completion of the prototype, the researchers will finalize the server architecture, create the core code systems, concept art, and develop a prototype in order to simulate the final user experience. Iterative refinements will be conducted as needed at major production milestones until the game is fully functional. Once development is complete, the research team will assess the usability and feasibility, fidelity of implementation, and the promise of the game to improve outcomes in a pilot study. In this study, 200 students in 10 classes will participate, with 5 of the classrooms randomly assigned to use the game and 5 who will proceed as normal. All students will complete pre- and post- program surveys assessing their academic mindsets, learning strategies, and science skills.
Product: This project will develop SciSkillQuest, a web-based multiplayer game intended to teach middle school students scientific inquiry skills and to foster academic growth mindsets in science. Students will pursue quests, employing inquiry skills to navigate and succeed in the game, including Questioning, Modeling, Investigating, Analyzing, Computing, Explaining, Arguing, and Informing. The game will include different paths to a solution, role playing elements, immersive narratives, challenge-based progressions, and peer collaboration to engage players. The growth mindset message — that ability and skill are developed through effort and learning — will be introduced and reinforced through feedback by embedded in-game characters. The games will be supplemental to the curriculum but will also be designed to be integrated within instructional practice. The game will be available for mobile devices as well as web browsers.
Purpose: In the most recent National Assessment of Educational Progress only 17% of 8th grade students performed at or above the proficient level in U.S. history. One way to engage students in learning history is to create history learning resources that are designed to be relevant and appealing to young people's interests and regular activities. Surveys find that almost all teenage boys and girls play digital games, and the majority of teens play daily. This project will leverage the potential of games and technology to engage students and increase history skills and content knowledge.
Project Activities: The team, consisting of graphic artists, content specialists, computer scientists, and programmers, will initially create wireframes and a functional game prototype. Following feedback from a group of students and teachers on the user-interface, the team will produce an online tablet app. Iterative refinements will be conducted at major production milestones until the intervention is fully functional. Once development is complete, the researchers will assess the usability and feasibility, fidelity of implementation, and the promise of the product to improve outcomes in a pilot study. The study will include 200 8th grade students in eight classrooms. Four classrooms will be assigned to play to game as part of the curriculum over three to five class periods, and four classrooms will be taught the same historical content using the business as usual curriculum without the game. Each group will complete pre- and post- assessments to assess differences in history knowledge and skills.
Product: This project team will develop a tablet-based interactive role-playing game that immerses 5th through 9th grade students in the history of the Great Depression. The game will provide players an experiential understanding of the hardships that beset Americans in the 1930s and their strategies for survival, as individuals and as a nation. Features of the game will include story-based immersive narrative missions where student's decisions continually drive the action, tips and hints for students who are struggling in the game, writing tools, and interactive maps. The game will can be integrated within a course or used as a supplement. A teacher dashboard will be developed to facilitate the use of the game within classroom settings. Finally, the final product will include upgrades to existing games, including City of Immigrants and the The Hardest Times. The upgrades will publish these games to tablets and will include deeper in-game assessment opportunities.
Purpose: There is concern about a decline in mathematics achievement scores among U.S. students during the middle school years. For example, while 4th grade U.S. students rank 8th overall on an international mathematics comparison, by 10th grade U.S. student's drop significantly to 25th in the same comparison. Some researchers posit that much of this decline relates to how math is taught in the U.S. and with how students become less engaged as learners in middle school. The purpose of this project is to develop a web-based game to engage 7h grade students in a narrative-based story which will apply learning of content and skills aligned to the Common Core State Standards (CCSS) in mathematics.
Project Activities: During Phase I in 2012, the team developed a functioning prototype and conducted usability and feasibility research with fourteen 7th grade students. Researchers found that the prototype functioned as intended and that students were highly engaged while playing the game. In Phase II, the team will develop a fully-functional user interface with animated characters, interactivity across student users, narrative scripts and accompanying art assets, 36 problem sets, and student and teacher dashboards and databases. After development is complete, a pilot study will examine the usability and feasibility, fidelity of implementation, and the promise of the game to improve math learning. The study will include 120 students in 6 classrooms in three schools, with one classroom per school randomly assigned to use the game and the other half assigned to a business-as-usual control. Analyses will compare student scores on pre and post mathematics measures.
Product: Empires is a web-based game that addresses 36 pre-algebra Common Core State Standards in mathematics for 7th and 8th grades. The game follows a storyline in a recreation of an ancient empire which is at the brink of agricultural revolution and of becoming a trade economy. As students play the game, they engage in math-focused activities to drive the action, such as taxing citizens to learn ratios and proportions, allocating resources to learn percentages, and measuring the distance and time between a neighboring empire by applying the principles of the Pythagorean Theorem. As a socially networked game, students will interact with other students in the class to complete trades that lead to encounters with different math problems. The game will include two helpful, funny, advisors who will scaffold learning through mathematical discourse, arguing over the next most important thing to do. The game design architecture will work on a wide range of computers, including desktops and iPads. A teacher's guide and companion website will provide guidance to classroom activities that complement the game.
The project team is developing a prototype of Happy Atoms, a game to support middle school students in learning about the composition of molecules. Happy Atoms will include physical manipulative balls with embedded magnets wirelessly connected to a tablet application (app) to recognize whether or not the created molecule exists and explain why or why not. The app will also include teacher resources including instructional videos and curriculum suggestions in order to better integrate the use of the product into classrooms. In the Phase I pilot research, the project team will examine whether the hardware and software prototypes function as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: This project will develop and test Eco, an online multiplayer virtual environment and game designed to enhance middle school students' knowledge of ecology and environmental literacy. This is important because according to the 2011 National Assessment of Educational Progress, students in the United States ranked 17th in science among the world's most developed countries, and over a third of eighth-graders scored below basic level, the lowest performance level. The Framework for 21st Century Skills presents the need for education materials that engage students and use technology effectively, meet rigorous content and skill standards, foster interdisciplinary work, and promote collaborative problem solving.
Project Activities: During Phase I (completed in 2014), the team developed a prototype of Eco consisting of a system architecture that enabled user-controlled avatars to complete basic tasks. At the end of Phase I, a pilot study with 60 students from five classrooms demonstrated that the prototype functioned as intended, that students found the game to be engaging, and that students were able to collaborate with classmates during gameplay. In Phase II the developers will strengthen functionality, add content, and build a teacher dashboard to track student data and house implementation resources. After development is complete, the team will conduct a pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the game for promoting students' ecosystem learning and environmental literacy. The researchers will collect data from 150 students in 10 classrooms. Half of the classrooms will be randomly assigned to use Eco to supplement standard classroom instruction while the other half will continue with normal practice. Analyses will compare pre-and-post scores of student's ecology knowledge and environmental literacy.
Product: Eco will be a multi-player game to teach standards in ecology and prepare middle schools students to be environmentally literate citizens. To play the game, students will enter a shared online world featuring a simulated ecosystem of plants and animals. Students will co-create a civilization by measuring, modeling, and analyzing the underlying ecosystem. Students will advocate for proposed plans to classmates and make decisions as a group. Cooperation and science-based decision making activities will occur, in order to prevent the destruction of the environment. The game will include teacher resources to support the alignment of game play to learning goals, and implementation.