The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
The project team is developing a prototype of a web-based game utilizing the illustrations of chemical elements and science terms created by Simon Basher in his three books, The Periodic Table: Elements with Style!, Chemistry: Getting a Big Reaction!, and Physics: Why Matter Matters! The game will incorporate augmented reality (person-to-person gameplay with the support of the software) to teach grade 4 to 6 students science concepts, including an introduction to chemistry. The game will include curriculum support materials. Pilot research in Phase I will seek to demonstrate that the software prototype functions as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
Purpose: This project will develop and test Kiko's Thinking Time, a series of game apps designed to strengthen children's cognitive skills related to executive functioning and reasoning. A principle objective of preschool is to prepare children for later success in school. Most programs focus on activities to support children's social and emotional development, and to strengthen pre-reading and mathematics competencies. Fewer programs explicitly focus on fostering children's executive function and reasoning skills—even though research in the cognitive sciences demonstrates these skills also provide a foundation for school-readiness.
Project Activities: During Phase I (completed in 2014), the team developed six prototype games and a teacher portal to track student progress. At the end of Phase I, results from a pilot study with 55 kindergarten students and 5 teachers demonstrated that the games operated as intended. Results indicated that students were engaged based on duration of game play, and that teachers were able to review game data for each child. In Phase II, the team will develop 15 more games and will further refine and enhance the functionality of the teacher portal. After development is complete, a pilot study will assess the feasibility and usability, fidelity of implementation, and the promise of the games for promoting students' executive functioning and reasoning. The researchers will collect data from 200 students in 10 preschool classrooms over 2 months. Half of the students in each class will be randomly assigned to use Kiko's Thinking Time while the other half will play an art-focused gaming app. Analyses will compare pre-and-post scores on measures of student's executive functioning and reasoning.
Product: Kiko's Thinking Time will be an app with 25 games, each based on tasks shown to have cognitive benefits in lab research. Each game will be designed to isolate and train skills related to executive functioning, such as: working memory, reasoning, inhibition, selective attention, cognitive flexibility, and spatial skills. Game play will be self-guided and adaptive, as the software will adjust in difficulty based on student responses. The app will work on tablets, smartphones, as well desktops. In addition, a companion website will allow teachers to track student performance and to obtain educational material around executive function and cognitive development.
The project team is developing and testing a prototype of Thinkzone, a blended learning portal intended for Kindergarten through Grade 8 teachers to host existing education learning games across core subject areas. The prototype will host games, and include a learning system to train educators to integrate games to replace or supplement instructional practice. In the Phase I pilot study will include 10 teachers and 200 students. The researchers will examine if the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether students are engaged across the various games.
This project team is developing and testing a prototype of the Teachley Analytics Library, a platform intended to host third party-developed mathematics game apps for students in kindergarten through Grade 8. The prototype will include a dashboard to host games and generate formative assessment data to inform teacher instruction. In the Phase I pilot study, the team will examine whether the prototype functions as planned with 40 Grade 1 and 2 math teachers. The study will test if teachers are able to implement games within the classroom and utilize data to inform practice, and whether students are engaged by gameplay.
The project team is developing and testing a prototype of a computer science game-based intervention intended for Grade 1 students. The prototype will include physical robots that will be designed and controlled on a game board by students through a blue-tooth enabled smartphone app. The product will include teacher resources and suggestions to facilitate classroom integration. In the Phase I pilot research with 5 classrooms and 150 students, the researchers will examine whether the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
In prior research and development, the project team and partners developed Cyberchase, a multimedia story-based series for students to practice and learn math. Researchers will develop and test a prototype of a mobile app-based fractions game to be integrated within the multimedia series. The prototype will adjust to students of different skill levels, and will present fractions in different representations (pictures, numbers, and words) to support different modes of learning. In the Phase I pilot, researchers will work with two grade 3 classrooms, and will examine whether the prototype functions as planned, if teachers are able to integrate the game into classroom practice, and whether the prototype shows promise for improving student learning of fractions.
Purpose: This project team will fully develop and test Cyberchase Fractions Quest, a web-based mathematics game for students in grade 3 and 4. Research shows that inadequate understanding of fractions can persist from early grades through higher education, and that success in fractions predicts future success in mathematics and other STEM subjects.
Project Activities: During Phase I (completed in 2016), the team developed a prototype of Cyberchase Fractions Quest, including an interactive number line game with four levels of challenges, and a tool to scaffold learning through hints and provide encouragement as students progress. At the end of Phase I, the research team conducted a pilot study over one week with 60 grade 4 students, half of whom were randomly assigned to use the prototype and half assigned to paper-based fractions activities. Results revealed that the prototype functioned as intended, that students were engaged during gameplay, and that from pre- to post-test, students using the prototype increased significantly in their knowledge of number line problems compared to the control group. In Phase II, the team will finalize the design, artwork, and animation, the formative and summative assessment component, and learning management system. After development is complete, the researchers will carry out a pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the game to improve student learning of fractions over a 5-week period. The study will include four classrooms of grade 3 students, two of which will be randomly assigned, to use the games to supplement in-class lessons while the others will use paper-based activities. The researchers will compare pre-and-post scores for student learning of fractions. The study will also track teacher implementation.
Product: The final product is Cyberchase Fractions Quest—a math game based on the storyline of PBS children's television series, Cyberchase. In the game, students in grades 3 and 4 will apply learning fractions within three contexts: areas and regions (such as shapes), sets (groups of objects), and on a number line. The game will identify specific areas where students struggle and will introduce challenges to support individualized learning. Similar to other popular game apps, student will receive immediate feedback from one to three stars based on how well they perform on each challenge as well as in-game rewards as they progress toward mastery. The game will include teacher resources for classroom implementation, and an educator dashboard presenting results.
The mixed methods randomized experimental study assessed a model of engagement and education that examined the contribution of SciGirls multimedia to fifth grade girls’ experience of citizen science. The treatment group (n = 49) experienced 2 hours of SciGirls videos and games at home followed by a 2.5 hour FrogWatch USA citizen science session. The control group (n = 49) experienced the citizen science session without prior exposure to SciGirls. Data from post surveys and interviews revealed that treatment girls, compared to control girls, demonstrated significantly greater interest in their
Well-designed educational games represent a promising technology for increasing students interest in and learning of STEM topics such as physics. This project will research how to optimally combine and embed dynamic assessment and adaptive learning supports within an engaging game design to build effective educational games. The project will add enhancements to a physics game called Physics Playground. The general goal of this research is to test a valid methodology that can be used in the design of next-generation learning games. The enhancement of Physics Playground will leverage the popularity of video games to capture and sustain student attention and teach physics to a much broader audience than is currently the case in traditional physics classrooms. To be most effective, this new genre of learning games needs to not only be highly engaging as a game but also to provide real-time assessment and feedback to students; support understanding of science content (i.e.,Newtonian physics); be accessible to beginners; accommodate a range of proficiencies and interests; and support equity. The research will have particular relevance to designers developing other science games and simulation by providing information about the kinds of learning supports and feedback to students are most effective in promoting engagement and learning. The project is supported by the Cyberlearning and Future Learning Technologies Program, which funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively.
The project will systematically develop, test, and evaluate ways to integrate engaging, dynamic learning supports in Physics Playground to teach formal conceptual physics competencies. More generally, the project aims to advance the learning sciences, particularly in the fields of adaptivity and assessment in educational technology. Using a design-based research approach spanning three years, the research team will: (1) develop and test the effectiveness of various learning support features included in the game in Year 1; (2) develop and test an adaptive algorithm to manage the progression of difficulty in game levels in Year 2; and (3) test learning supports and adaptive sequencing in a controlled evaluation study. This research will provide evidence of the instructional effectiveness of an educational game designed using principles of instructional, game, and assessment design. It will advance understanding of the contributions of different kinds of learning supports (e.g., visualizations and explanations) and adaptivity to game-based learning and contribute to the design of next-generation learning games that successfully blur the distinction between assessment and learning. The project will generate research findings that can be incorporated into other types of STEM learning games.
DATE:
-
TEAM MEMBERS:
Valerie ShuteRussell AlmondFengfeng Ke