The goal of the project is to advance understanding of basic questions about learning and teaching through the development of a theory of embodied mathematical cognition that can apply to a broad range of people, settings and activities. The investigative team brings together expertise from a range of quantitative and qualitative research methodologies. A theory of embodied mathematical cognition empirically rooted in classroom learning and workplace practices will broaden the range of activities and emerging technologies that count as mathematical, and help educators to envision alternative forms of bodily engagement with mathematical problems.
DATE:
-
TEAM MEMBERS:
Ricardo NemirovskyRogers HallMartha AlibaliMitchell NathanKevin Leander
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The Math, Engineering, Science Achievement (MESA) outreach programs are partnerships between K-12 schools and higher education in eight states that for over forty years introduce science, mathematics and engineering to K-12 students traditionally underrepresented in the discipline. This exploratory study examines the influences that those MESA activities have on students' perception of engineering and their self-efficacy and interest in engineering and their subsequent decisions to pursue careers in engineering. The MESA activities to be studied include field trips, guest lecturers, design competitions, hands-on activities and student career and academic advisement.
About 1200 students selected from 40 MESA sites in California, Maryland and Utah are surveyed with instruments that build on those used in prior studies. Focus groups with a randomly selected subset of the students provide follow-up and probe the influence of the most promising activities. In the first year of the project the instruments, based on existing instruments, are developed and piloted. Data are taken in the second year and analyzed in the third year. A separate evaluation determines that the protocols are reasonable and are being followed.
The results are applicable to a number of organizations with similar aims and provide information for increasing the number of engineers from underrepresented populations. The project also investigates the correlation between student engagement in MESA and academic performance. This project provides insights on activities used in informal settings that can be employed in the classroom practice and instructional materials to further engage students, especially student from underrepresented groups, in the study of STEM.
DATE:
-
TEAM MEMBERS:
Christine HaileyCameron DensonChandra Austin
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
This Integrative Graduate Education and Research Training (IGERT) award supports the establishment of an interdisciplinary graduate training program in Cognitive, Computational, and Systems Neuroscience at Washington University in Saint Louis. Understanding how the brain works under normal circumstances and how it fails are among the most important problems in science. The purpose of this program is to train a new generation of systems-level neuroscientists who will combine experimental and computational approaches from the fields of psychology, neurobiology, and engineering to study brain function in unique ways. Students will participate in a five-course core curriculum that provides a broad base of knowledge in each of the core disciplines, and culminates in a pair of highly integrative and interactive courses that emphasize critical thinking and analysis skills, as well as practical skills for developing interdisciplinary research projects. This program also includes workshops aimed at developing the personal and professional skills that students need to become successful independent investigators and educators, as well as outreach programs aimed at communicating the goals and promise of integrative neuroscience to the general public. This training program will be tightly coupled to a new research focus involving neuro-imaging in nonhuman primates. By building upon existing strengths at Washington University, this research and training initiative will provide critical new insights into how the non-invasive measurements of brain function that are available in humans (e.g. from functional MRI) are related to the underlying activity patterns in neuronal circuits of the brain. IGERT is an NSF-wide program intended to meet the challenges of educating U.S. Ph.D. scientists and engineers with the interdisciplinary background, deep knowledge in a chosen discipline, and the technical, professional, and personal skills needed for the career demands of the future. The program is intended to catalyze a cultural change in graduate education by establishing innovative new models for graduate education and training in a fertile environment for collaborative research that transcends traditional disciplinary boundaries.
DATE:
-
TEAM MEMBERS:
Kurt ThoroughmanGregory DeAngelisRandy BucknerSteven PetersenDora Angelaki
The project team is developing a prototype of a web-based game utilizing the illustrations of chemical elements and science terms created by Simon Basher in his three books, The Periodic Table: Elements with Style!, Chemistry: Getting a Big Reaction!, and Physics: Why Matter Matters! The game will incorporate augmented reality (person-to-person gameplay with the support of the software) to teach grade 4 to 6 students science concepts, including an introduction to chemistry. The game will include curriculum support materials. Pilot research in Phase I will seek to demonstrate that the software prototype functions as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: The United States (U.S.) has traditionally produced the world’s top research scientists and engineers, leading to breakthrough advances in science and technology. Despite the importance of STEM careers, many U.S. students are not graduating with strong STEM knowledge, skills or interests, and the percentage of students prepared for or pursuing STEM degrees or careers is declining. Research shows that the decreased interest in STEM typically begins in the middle school years, pose significant academic and social challenges for students. This project will develop a web-based game teach 6th to 8th students key scientific inquiry skills, along with the academic mindsets and learning strategies to facilitate engagement and effective science learning.
Project Activities: The researchers will create a prototype by mapping key Next Generation Science Standards and learning goals with concepts and content, and producing a game design document. Following completion of the prototype, the researchers will finalize the server architecture, create the core code systems, concept art, and develop a prototype in order to simulate the final user experience. Iterative refinements will be conducted as needed at major production milestones until the game is fully functional. Once development is complete, the research team will assess the usability and feasibility, fidelity of implementation, and the promise of the game to improve outcomes in a pilot study. In this study, 200 students in 10 classes will participate, with 5 of the classrooms randomly assigned to use the game and 5 who will proceed as normal. All students will complete pre- and post- program surveys assessing their academic mindsets, learning strategies, and science skills.
Product: This project will develop SciSkillQuest, a web-based multiplayer game intended to teach middle school students scientific inquiry skills and to foster academic growth mindsets in science. Students will pursue quests, employing inquiry skills to navigate and succeed in the game, including Questioning, Modeling, Investigating, Analyzing, Computing, Explaining, Arguing, and Informing. The game will include different paths to a solution, role playing elements, immersive narratives, challenge-based progressions, and peer collaboration to engage players. The growth mindset message — that ability and skill are developed through effort and learning — will be introduced and reinforced through feedback by embedded in-game characters. The games will be supplemental to the curriculum but will also be designed to be integrated within instructional practice. The game will be available for mobile devices as well as web browsers.
Purpose: In the most recent National Assessment of Educational Progress only 17% of 8th grade students performed at or above the proficient level in U.S. history. One way to engage students in learning history is to create history learning resources that are designed to be relevant and appealing to young people's interests and regular activities. Surveys find that almost all teenage boys and girls play digital games, and the majority of teens play daily. This project will leverage the potential of games and technology to engage students and increase history skills and content knowledge.
Project Activities: The team, consisting of graphic artists, content specialists, computer scientists, and programmers, will initially create wireframes and a functional game prototype. Following feedback from a group of students and teachers on the user-interface, the team will produce an online tablet app. Iterative refinements will be conducted at major production milestones until the intervention is fully functional. Once development is complete, the researchers will assess the usability and feasibility, fidelity of implementation, and the promise of the product to improve outcomes in a pilot study. The study will include 200 8th grade students in eight classrooms. Four classrooms will be assigned to play to game as part of the curriculum over three to five class periods, and four classrooms will be taught the same historical content using the business as usual curriculum without the game. Each group will complete pre- and post- assessments to assess differences in history knowledge and skills.
Product: This project team will develop a tablet-based interactive role-playing game that immerses 5th through 9th grade students in the history of the Great Depression. The game will provide players an experiential understanding of the hardships that beset Americans in the 1930s and their strategies for survival, as individuals and as a nation. Features of the game will include story-based immersive narrative missions where student's decisions continually drive the action, tips and hints for students who are struggling in the game, writing tools, and interactive maps. The game will can be integrated within a course or used as a supplement. A teacher dashboard will be developed to facilitate the use of the game within classroom settings. Finally, the final product will include upgrades to existing games, including City of Immigrants and the The Hardest Times. The upgrades will publish these games to tablets and will include deeper in-game assessment opportunities.
Purpose: There is concern about a decline in mathematics achievement scores among U.S. students during the middle school years. For example, while 4th grade U.S. students rank 8th overall on an international mathematics comparison, by 10th grade U.S. student's drop significantly to 25th in the same comparison. Some researchers posit that much of this decline relates to how math is taught in the U.S. and with how students become less engaged as learners in middle school. The purpose of this project is to develop a web-based game to engage 7h grade students in a narrative-based story which will apply learning of content and skills aligned to the Common Core State Standards (CCSS) in mathematics.
Project Activities: During Phase I in 2012, the team developed a functioning prototype and conducted usability and feasibility research with fourteen 7th grade students. Researchers found that the prototype functioned as intended and that students were highly engaged while playing the game. In Phase II, the team will develop a fully-functional user interface with animated characters, interactivity across student users, narrative scripts and accompanying art assets, 36 problem sets, and student and teacher dashboards and databases. After development is complete, a pilot study will examine the usability and feasibility, fidelity of implementation, and the promise of the game to improve math learning. The study will include 120 students in 6 classrooms in three schools, with one classroom per school randomly assigned to use the game and the other half assigned to a business-as-usual control. Analyses will compare student scores on pre and post mathematics measures.
Product: Empires is a web-based game that addresses 36 pre-algebra Common Core State Standards in mathematics for 7th and 8th grades. The game follows a storyline in a recreation of an ancient empire which is at the brink of agricultural revolution and of becoming a trade economy. As students play the game, they engage in math-focused activities to drive the action, such as taxing citizens to learn ratios and proportions, allocating resources to learn percentages, and measuring the distance and time between a neighboring empire by applying the principles of the Pythagorean Theorem. As a socially networked game, students will interact with other students in the class to complete trades that lead to encounters with different math problems. The game will include two helpful, funny, advisors who will scaffold learning through mathematical discourse, arguing over the next most important thing to do. The game design architecture will work on a wide range of computers, including desktops and iPads. A teacher's guide and companion website will provide guidance to classroom activities that complement the game.
This evaluator reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It reflects on the nature of learning and challenges assumptions of outcomes from engaging in informal learning experiences.
This funder reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It describes the importance of evaluation to funders, and provides some prompts and questions for thinking about evaluation with relation to funding.
This leadership reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It provides an organizational leadership perspective on evaluation.