Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
In prior research and development, the project team and partners developed Cyberchase, a multimedia story-based series for students to practice and learn math. Researchers will develop and test a prototype of a mobile app-based fractions game to be integrated within the multimedia series. The prototype will adjust to students of different skill levels, and will present fractions in different representations (pictures, numbers, and words) to support different modes of learning. In the Phase I pilot, researchers will work with two grade 3 classrooms, and will examine whether the prototype functions as planned, if teachers are able to integrate the game into classroom practice, and whether the prototype shows promise for improving student learning of fractions.
DATE:
-
TEAM MEMBERS:
Gary Goldberger
resourceevaluationProfessional Development, Conferences, and Networks
Researching the Value of Educator Actions for Learning (REVEAL) is an NSF-funded research project, led by the Oregon Museum of Science and Industry (OMSI) in collaboration with TERC and Oregon State University (OSU), which studied the impact of science center staff facilitation strategies at math exhibits. Building on and using exhibits from Design Zone—an interactive math exhibition which engaged visitors in exploring algebraic relationships and functions—the study was designed to add to the scant existing literature about the impact of staff facilitation on visitors. The study also aimed to
Front-line staff are an integral part of the visitor experience at museums and science centers across the country, facilitating activities and programs, leading classes, and more. But do these staff make a difference for visitor learning? And what are the most effective facilitation strategies and approaches? In 2013, the Oregon Museum of Science and Industry (OMSI) received funding from the National Science Foundation for a three-year study, Researching the Value of Educator Actions for Learning (REVEAL), to begin to address these questions. Building on the Design Zone exhibition, REVEAL
The Oregon Museum of Science and Industry (OMSI), located in Portland, is a hands-on science museum. In 2013, OMSI received funding from the National Science Foundation for the project Researching the Value of Educator Actions for Learning (REVEAL) to study how museum educators can better help families learn math while interacting with museum exhibits. Through REVEAL, OMSI was able to partner with Adelante Mujeres, a non-profit community organization located in Forest Grove that educates and empowers Latina women and their families. Here we share some of the lessons learned from the
This project was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.
In 2015, average mathematics scores on the National Assessment of Educational Progress (NAEP) declined in fourth and eighth grades, the first declines in mathematics at these grade levels since 1990. Declines in U.S. mathematics performance has important implications for overall STEM education as well as STEM workforce and international competitiveness. Researchers at Rutgers University will conduct an analysis to isolate the cause of the mathematics decline by investigating the dimensionality of the NAEP assessment, state-level outcomes, and demographic trends.
The team will use multilevel item response theory modeling techniques to investigate the declines by examining the factor structures to determine dimensionality across years. Researchers will examine subscores corresponding to each dimension of the factor structure at the state and national levels. In addition, subscores will be examined for trends in individual states and jurisdictions. Potentially, the analyses will allow for examination of factors related to state standards adoptions, demographic shifts, and participation rates.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
resourceprojectProfessional Development, Conferences, and Networks
The purpose of this proposal is to convene scholars at a two-day conference to closely examine validity-related measurement issues, create a guidelines for the field of mathematics education research that addresses key ideas (e.g., validity, validity arguments, evidence for validity and measurement at-scale), and set a clear pathway for scholars to discuss quantitative measurement within mathematics education. Invitees will include a mix of young, older and diverse scholars in mathematics education research. Products include refereed journal articles along with a website.
The workshop will engage the Mathematics Education, Policy, Statistical, Psychometrics and other education research communities in examining and critiquing measurement validity evidence of mathematics education research with the long-term goal of increasing the quality of quantitative inference in mathematics education research (to include improvements in the training of doctoral students).
Teaching mathematics in informal settings is a relatively new phenomenon, but it has gained more attention due to the recent changes in the society. The aim of the present quantitative study was to compare the learning outcomes of Latvian and Swedish 12-year-olds when they visited a science centre mathematics-art exhibition originally designed in Estonia. The results showed that in general, prior knowledge of the exhibition contents was the strongest predictor of post-test results in both countries but that mathematical thinking skills and self-concept had a small added value in explaining the
DATE:
TEAM MEMBERS:
Hannu SalmiMari-Pauliina VainikainenHelena Thuneberg
The REVEAL project is an NSF funded project to learn about how facilitation impacts family’s experiences of math exhibits. The goal of the project was to iteratively develop and refine a theoretical model of how staff facilitation deepens and extends family mathematical discourse at interactive exhibits. This model underwent rigorous testing and ultimately provided the evidence and research-based tools to support PD efforts for informal STEM educators. As part of this testing the learnings from developing at OMSI (Oregon Museum of Science and Industry, in Portland, Oregon) were applied in an
This chapter reviews four projects that reflect the principles of design-based implementation research (DBIR) in an effort to highlight a range of relevant theoretical and methodological perspectives and tools that can inform future work associated with DBIR.The goal of this chapter is to highlight a range of relevant theoretical and methodological perspectives and tools that can inform future work associated with design-based implementation research (DBIR). As Penuel, Fishman, Cheng, and Sabelli (2011) described, DBIR entails engaging “learning scientists, policy researchers, and
DATE:
TEAM MEMBERS:
Jennifer RussellKara JacksonAndrew KrummKenneth Frank
Research on mathematical reasoning and learning has long been a central part of the classroom and formal education literature (e.g., National Research Council, 2001, 2005). However, much less attention has been paid to how children and adults engage with and learn about math outside of school, including everyday settings and designed informal learning environments, such as interactive math exhibits in science centers. With the growing recognition of the importance of informal STEM education (National Research Council, 2009, 2015), researchers, educators, and policymakers are paying more