This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
This chapter discusses the selection and potential use of electronic games and simulations in distance learning supported by an operational model called AIDLET. After analyzing the different approaches to the use of games and simulations in education, and discussing their benefits and shortcomings, a framework was developed to facilitate the selection, repurposing, design and implementation of games and simulations, with focus on the practical aspects of the processes used in Open and Distance Learning (ODL). Whereas traditional learning is based on knowledge memorization and the completion of
DATE:
TEAM MEMBERS:
Jose BidarraMeagan RothschildKurt Squire
Smartphones and other mobile devices like the iPhone, Android, Kindle Fire, and iPad have boosted educators' interest in using mobile media for education. Applications from games to augmented reality are thriving in research settings, and in some cases schools and universities, but relatively little is known about how such devices may be used for effective learning. This article discusses the selection and potential use of electronic games, simulations and augmented reality in mobile learning supported by an operational model called AIDLET. After analyzing the different approaches to the use
DATE:
TEAM MEMBERS:
Jose BidarraMegan RothschildKurt SquireMauro Figueiredo
The Year in ISE is a slidedoc designed to track and characterize field growth, change and impact, important publications, and current topics in ISE in 2018. Use it to inform new strategies, find potential collaborators for your projects, and support proposal development. Scope This slidedoc highlights a selection of developments and resources in 2018 that were notable and potentially useful for the informal STEM education field. It is not intended to be comprehensive or exhaustive, nor to provide endorsement. To manage the scope and length, we have focused on meta analyses, consensus reports
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
The project team is developing a prototype of a web-based game utilizing the illustrations of chemical elements and science terms created by Simon Basher in his three books, The Periodic Table: Elements with Style!, Chemistry: Getting a Big Reaction!, and Physics: Why Matter Matters! The game will incorporate augmented reality (person-to-person gameplay with the support of the software) to teach grade 4 to 6 students science concepts, including an introduction to chemistry. The game will include curriculum support materials. Pilot research in Phase I will seek to demonstrate that the software prototype functions as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
Purpose: There is concern about a decline in mathematics achievement scores among U.S. students during the middle school years. For example, while 4th grade U.S. students rank 8th overall on an international mathematics comparison, by 10th grade U.S. student's drop significantly to 25th in the same comparison. Some researchers posit that much of this decline relates to how math is taught in the U.S. and with how students become less engaged as learners in middle school. The purpose of this project is to develop a web-based game to engage 7h grade students in a narrative-based story which will apply learning of content and skills aligned to the Common Core State Standards (CCSS) in mathematics.
Project Activities: During Phase I in 2012, the team developed a functioning prototype and conducted usability and feasibility research with fourteen 7th grade students. Researchers found that the prototype functioned as intended and that students were highly engaged while playing the game. In Phase II, the team will develop a fully-functional user interface with animated characters, interactivity across student users, narrative scripts and accompanying art assets, 36 problem sets, and student and teacher dashboards and databases. After development is complete, a pilot study will examine the usability and feasibility, fidelity of implementation, and the promise of the game to improve math learning. The study will include 120 students in 6 classrooms in three schools, with one classroom per school randomly assigned to use the game and the other half assigned to a business-as-usual control. Analyses will compare student scores on pre and post mathematics measures.
Product: Empires is a web-based game that addresses 36 pre-algebra Common Core State Standards in mathematics for 7th and 8th grades. The game follows a storyline in a recreation of an ancient empire which is at the brink of agricultural revolution and of becoming a trade economy. As students play the game, they engage in math-focused activities to drive the action, such as taxing citizens to learn ratios and proportions, allocating resources to learn percentages, and measuring the distance and time between a neighboring empire by applying the principles of the Pythagorean Theorem. As a socially networked game, students will interact with other students in the class to complete trades that lead to encounters with different math problems. The game will include two helpful, funny, advisors who will scaffold learning through mathematical discourse, arguing over the next most important thing to do. The game design architecture will work on a wide range of computers, including desktops and iPads. A teacher's guide and companion website will provide guidance to classroom activities that complement the game.
The project team is developing a prototype of Eco, a multi-player game to prepare high school students to be environmentally literate citizens with 21st century skills. To play the game, students will enter a shared online world featuring a simulated ecosystem of plants and animals. Students will co-create the civilization by measuring, modeling, and analyzing the underlying ecosystem. Students advocate proposed plans to classmates and make decisions as a group. Cooperation and science-based decision making activities are necessary for success in preventing the destruction of their environment. The prototype will include teacher resources to support the alignment of game play to learning goals, and implementation. In the Phase I pilot research, the project team will examine whether the game prototypes function as planned, if teachers are able to integrate it within the classroom environment, and whether students are engaged with the prototype.
The project team is developing a prototype of Happy Atoms, a game to support middle school students in learning about the composition of molecules. Happy Atoms will include physical manipulative balls with embedded magnets wirelessly connected to a tablet application (app) to recognize whether or not the created molecule exists and explain why or why not. The app will also include teacher resources including instructional videos and curriculum suggestions in order to better integrate the use of the product into classrooms. In the Phase I pilot research, the project team will examine whether the hardware and software prototypes function as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: This project will develop and test Kiko's Thinking Time, a series of game apps designed to strengthen children's cognitive skills related to executive functioning and reasoning. A principle objective of preschool is to prepare children for later success in school. Most programs focus on activities to support children's social and emotional development, and to strengthen pre-reading and mathematics competencies. Fewer programs explicitly focus on fostering children's executive function and reasoning skills—even though research in the cognitive sciences demonstrates these skills also provide a foundation for school-readiness.
Project Activities: During Phase I (completed in 2014), the team developed six prototype games and a teacher portal to track student progress. At the end of Phase I, results from a pilot study with 55 kindergarten students and 5 teachers demonstrated that the games operated as intended. Results indicated that students were engaged based on duration of game play, and that teachers were able to review game data for each child. In Phase II, the team will develop 15 more games and will further refine and enhance the functionality of the teacher portal. After development is complete, a pilot study will assess the feasibility and usability, fidelity of implementation, and the promise of the games for promoting students' executive functioning and reasoning. The researchers will collect data from 200 students in 10 preschool classrooms over 2 months. Half of the students in each class will be randomly assigned to use Kiko's Thinking Time while the other half will play an art-focused gaming app. Analyses will compare pre-and-post scores on measures of student's executive functioning and reasoning.
Product: Kiko's Thinking Time will be an app with 25 games, each based on tasks shown to have cognitive benefits in lab research. Each game will be designed to isolate and train skills related to executive functioning, such as: working memory, reasoning, inhibition, selective attention, cognitive flexibility, and spatial skills. Game play will be self-guided and adaptive, as the software will adjust in difficulty based on student responses. The app will work on tablets, smartphones, as well desktops. In addition, a companion website will allow teachers to track student performance and to obtain educational material around executive function and cognitive development.
Purpose: This project will develop and test Happy Atoms, a physical modeling set and an interactive iPad app for use in high school chemistry classrooms. Happy Atoms is designed to facilitate student learning of atomic modeling, a difficult topic for chemistry high school students to master. Standard instructional practice in this area typically includes teachers using slides, static ball and stick models, or computer-simulation software to present diagrams on a whiteboard. However, these methods do not adequately depict atomic interactions effectively, thus obscuring complex knowledge and understanding of their formulas and characteristics.
Project Activities: During Phase I (completed in 2014), the team developed a prototype of a physical modeling set including a computerized ball and stick molecular models representing the first 17 elements on the periodic table and an iPad app that identifies and generates information about atoms. A pilot study at the end of Phase I tested the prototype with 187 high school students in 12 chemistry classes. Researchers found that the prototype functioned as intended. Results showed that 88% of students enjoyed using the prototype, and that 79% indicated that it helped learning. In Phase II, the team will develop additional models and will strengthen functionality for effective integration into instructional practice. After development is complete, a larger pilot study will assess the usability and feasibility, fidelity of implementation, and promise of Happy Atoms to improve learning. The study will include 30 grade 11 chemistry classrooms, with half randomly assigned to use Happy Atoms and half who will continue with business as usual procedures. Analyses will compare pre-and-post scores of student's chemistry learning, including atomic modeling.
Product: Happy Atoms will include a set of physical models paired with an iPad app to cover high school chemistry topics in atomic modeling. The modeling set will include individual plastic balls representing the elements of the periodic table. Students will use an iPad app to take a picture of models they create. Using computer-generated algorithms, the app will then identify the model and generate information about its physical and chemical properties and uses. The app will also inform students if a model that is created does not exist. Happy Atoms will replace or supplement lesson plans to enhance chemistry teaching. The app will include teacher resources suggesting how to incorporate games and activities to reinforce lesson plans and learning.