Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
Purpose: The team will fully develop and test three puzzle-based math games that adaptively assess and support student learning in middle school classrooms. A principle objective of middle school math is to prepare students for more complicated and advanced STEM topics, providing the foundation for a wide variety of college majors and careers. Students who struggle in math in grade 5 and 6 are more likely to show deficits as coursework turns to topics in algebra. However, in many classrooms, commonly used progress monitoring instruments often do not adjust in ease or difficulty based on student performance, and do not provide data teachers can use to tailor instruction to meet the needs of students.
Project Activities: During Phase I (completed in 2015), the team developed a prototype of an adaptive engine for Wuzzit Trouble, a previously developed app where players rotate a virtual wheel to solve puzzles by applying number sense mathematical strategies. The engine tailors gameplay to the skill level of individual students in real time, providing tips and support to students having difficultly or by making challenges more difficult for those who master puzzles. The research team conducted a pilot study at the end of Phase I in order to test the prototype. A little more than 200 grade 5 and 6 students and six teachers participated over two weeks. Researchers found that the prototype functioned as intended and that teachers successfully used the game before, during, and after class as a supplement to instruction. They learned that 65% of students enjoyed using the prototype and 46% indicated that the game adjusted to the right level of difficulty during gameplay. In Phase II, the team will develop two new games on topics including algebraic thinking and problem solving, will strengthen and validate the adaptive engine, and will build out the dashboard to report formative and summative assessment results. After development is complete, the researchers will carry out a larger pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the three games to improve student learning over a 9-week period. Thirty-two grade 5 and 6 math classrooms from 16 schools will participate. One classroom from each school will be randomly assigned to use the games and half will continue with business-as-usual procedures. The researchers will compare pre-and-post scores for student learning on standardized measures of pre-algebra topics. They will also track teacher implementation.
Product: The final product will include a suite of three app-based puzzle games aligned to national math standards for number sense, algebraic thinking, and problem solving. The games will be designed for use in grade 5 and 6 classrooms where students develop and apply content expertise to solving challenges. The games will include an adaptive engine that assesses and adjusts content based on student level of performance, a back-end system to organize data, and a reporting dashboard to present measures of student performance, persistence, and creativity. The project team will also develop teacher resources for suggesting how to incorporate games and activities into classroom instructional practice to reinforce lesson plans and learning.
Purpose: This project team will fully develop and test Cyberchase Fractions Quest, a web-based mathematics game for students in grade 3 and 4. Research shows that inadequate understanding of fractions can persist from early grades through higher education, and that success in fractions predicts future success in mathematics and other STEM subjects.
Project Activities: During Phase I (completed in 2016), the team developed a prototype of Cyberchase Fractions Quest, including an interactive number line game with four levels of challenges, and a tool to scaffold learning through hints and provide encouragement as students progress. At the end of Phase I, the research team conducted a pilot study over one week with 60 grade 4 students, half of whom were randomly assigned to use the prototype and half assigned to paper-based fractions activities. Results revealed that the prototype functioned as intended, that students were engaged during gameplay, and that from pre- to post-test, students using the prototype increased significantly in their knowledge of number line problems compared to the control group. In Phase II, the team will finalize the design, artwork, and animation, the formative and summative assessment component, and learning management system. After development is complete, the researchers will carry out a pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the game to improve student learning of fractions over a 5-week period. The study will include four classrooms of grade 3 students, two of which will be randomly assigned, to use the games to supplement in-class lessons while the others will use paper-based activities. The researchers will compare pre-and-post scores for student learning of fractions. The study will also track teacher implementation.
Product: The final product is Cyberchase Fractions Quest—a math game based on the storyline of PBS children's television series, Cyberchase. In the game, students in grades 3 and 4 will apply learning fractions within three contexts: areas and regions (such as shapes), sets (groups of objects), and on a number line. The game will identify specific areas where students struggle and will introduce challenges to support individualized learning. Similar to other popular game apps, student will receive immediate feedback from one to three stars based on how well they perform on each challenge as well as in-game rewards as they progress toward mastery. The game will include teacher resources for classroom implementation, and an educator dashboard presenting results.