This report details the formative evaluation study conducted through collaboration with the National Science Teachers Association (NSTA) and the Association of Science-Technology Centers (ASTC) to inform the iterative development and piloting of the Connected Science Learning: Connecting In-School and Out-of-School STEM Learning journal. The journal was the result of an Early Concept Grant for Exploratory Research (EAGER) project funded by the National Science Foundation (NSF) to develop, disseminate and evaluate a new resource for connecting STEM education practitioners across settings and to
The CADRE Early Career Guide offers advice from experienced DR K-12 awardees on becoming a successful researcher in the field of STEM education. The guide also profiles a support program, the CADRE Fellows, for doctoral students in STEM education research.
DATE:
TEAM MEMBERS:
Jennifer StilesCatherine McCullochCommunity for Advancing Discovery Research in Education (CADRE)
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
The project team is developing a prototype of a mobile platform, Zaption, to support teachers in using video clips to enrich learning. The product’s user-interface will allow teachers to easily add annotations to videos, make short video clips that align to topics, and enhance videos with time-linked elements and assessments that appear at the top of each video. In Phase I pilot research, the team will examine whether the prototype functions as planned, if teachers are able to use the prototype for different purposes, and whether students are engaged by the prototype.
The project team is developing a prototype of Eco, a multi-player game to prepare high school students to be environmentally literate citizens with 21st century skills. To play the game, students will enter a shared online world featuring a simulated ecosystem of plants and animals. Students will co-create the civilization by measuring, modeling, and analyzing the underlying ecosystem. Students advocate proposed plans to classmates and make decisions as a group. Cooperation and science-based decision making activities are necessary for success in preventing the destruction of their environment. The prototype will include teacher resources to support the alignment of game play to learning goals, and implementation. In the Phase I pilot research, the project team will examine whether the game prototypes function as planned, if teachers are able to integrate it within the classroom environment, and whether students are engaged with the prototype.
Purpose: This project team will develop and test Zaption, a mobile and desktop platform designed to support educators in effectively and efficiently utilizing video (e.g., from YouTube, Vimeo, or their own desktop) as an interactive teaching and learning object. Personalized learning devices (e.g., smartphones, tablets) populated with video content provide opportunities for students to access educationally-meaningful content anywhere and anytime. Yet, video has yet to realize its potential as a learning tool in or out of the classroom. One reason for this is that watching video can be a passive experience for students, whereas learning requires active engagement. A second reason is that even if students are actively engaged while watching a video, there is no easy way to elicit student responses to a video. And finally, there is no easy way to feed student responses to teachers as formative assessment data to guide subsequent instruction.
Project Activities: During Phase I, (completed in 2014), the team expanded a pre-existing prototype by building a mobile app to enable anytime use and increase its functionality for teachers. At the end of Phase I, pilot research with 150 students in 7 classrooms demonstrated that the prototype operated as intended, teachers were able to integrate the videos within instructional practice, and students found the mobile app helpful and engaging. In Phase II, the team will add additional components to the prototype and will develop content-specific modules for use in high school physics classes. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Zaption for supporting student's physics learning. The study will include 32 Grade 10 physics classrooms, half of whom will be randomly assigned to use Zaption and half of whom will follow business as usual procedures. Analyses will compare pre-and-post scores of student's physics learning.
Product: Zaption will be a mobile and web-based platform to support the use of any video (e.g., from YouTube, Vimeo, or their own desktop) as a teaching and learning tool. Zaption will include an authoring engine where users can find and select video clips and easily insert interactive elements such as questions, discussions, and annotations into the videos. Users will then publish videos directly on Zaption's website, or on any learning management system or classroom website. Students will be able to view videos as homework or in class, respond individually to the questions and prompts, and get feedback on their responses. Teachers will use Zaption Analytics to receive immediate and actionable data showing whether students actually watched and engaged with a video, and how students responded to the questions and prompts.
Purpose: This project will develop and test Happy Atoms, a physical modeling set and an interactive iPad app for use in high school chemistry classrooms. Happy Atoms is designed to facilitate student learning of atomic modeling, a difficult topic for chemistry high school students to master. Standard instructional practice in this area typically includes teachers using slides, static ball and stick models, or computer-simulation software to present diagrams on a whiteboard. However, these methods do not adequately depict atomic interactions effectively, thus obscuring complex knowledge and understanding of their formulas and characteristics.
Project Activities: During Phase I (completed in 2014), the team developed a prototype of a physical modeling set including a computerized ball and stick molecular models representing the first 17 elements on the periodic table and an iPad app that identifies and generates information about atoms. A pilot study at the end of Phase I tested the prototype with 187 high school students in 12 chemistry classes. Researchers found that the prototype functioned as intended. Results showed that 88% of students enjoyed using the prototype, and that 79% indicated that it helped learning. In Phase II, the team will develop additional models and will strengthen functionality for effective integration into instructional practice. After development is complete, a larger pilot study will assess the usability and feasibility, fidelity of implementation, and promise of Happy Atoms to improve learning. The study will include 30 grade 11 chemistry classrooms, with half randomly assigned to use Happy Atoms and half who will continue with business as usual procedures. Analyses will compare pre-and-post scores of student's chemistry learning, including atomic modeling.
Product: Happy Atoms will include a set of physical models paired with an iPad app to cover high school chemistry topics in atomic modeling. The modeling set will include individual plastic balls representing the elements of the periodic table. Students will use an iPad app to take a picture of models they create. Using computer-generated algorithms, the app will then identify the model and generate information about its physical and chemical properties and uses. The app will also inform students if a model that is created does not exist. Happy Atoms will replace or supplement lesson plans to enhance chemistry teaching. The app will include teacher resources suggesting how to incorporate games and activities to reinforce lesson plans and learning.
The project team is developing and testing a prototype of Thinkzone, a blended learning portal intended for Kindergarten through Grade 8 teachers to host existing education learning games across core subject areas. The prototype will host games, and include a learning system to train educators to integrate games to replace or supplement instructional practice. In the Phase I pilot study will include 10 teachers and 200 students. The researchers will examine if the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether students are engaged across the various games.
This project team is developing and testing a prototype of the Teachley Analytics Library, a platform intended to host third party-developed mathematics game apps for students in kindergarten through Grade 8. The prototype will include a dashboard to host games and generate formative assessment data to inform teacher instruction. In the Phase I pilot study, the team will examine whether the prototype functions as planned with 40 Grade 1 and 2 math teachers. The study will test if teachers are able to implement games within the classroom and utilize data to inform practice, and whether students are engaged by gameplay.
The project team is developing and testing a prototype of a computer science game-based intervention intended for Grade 1 students. The prototype will include physical robots that will be designed and controlled on a game board by students through a blue-tooth enabled smartphone app. The product will include teacher resources and suggestions to facilitate classroom integration. In the Phase I pilot research with 5 classrooms and 150 students, the researchers will examine whether the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
This report introduces a framework to support learning in library and museum makerspaces. The framework demonstrates how we can create the conditions for ambitious learning experiences to unfold within the making experience.
DATE:
TEAM MEMBERS:
Children's Museum of PittsburghInstitute of Museum and Library ServicesPeter Wardrip