The Council for Opportunity in Education, in collaboration with TERC, seeks to advance the understanding of social and cultural factors that increase retention of women of color in computing; and implement and evaluate a mentoring and networking intervention for undergraduate women of color based on the project's research findings. Computing is unique because it ranks as one of the STEM fields that are least populated by women of color, and because while representation of women of color is increasing in nearly every other STEM field, it is currently decreasing in computing - even as national job prospects in technology fields increase. The project staff will conduct an extensive study of programs that have successfully served women of color in the computing fields and will conduct formal interviews with 15 professional women of color who have thrived in computing to learn about their educational strategies. Based on those findings, the project staff will develop and assess a small-scale intervention that will be modeled on the practices of mentoring and networking which have been established as effective among women of color who are students of STEM disciplines. By partnering with Broadening Participation in Computing Alliances and local and national organizations dedicated to diversifying computing, project staff will identify both women of color undergraduates to participate in the intervention and professionals who can serve as mentors to the undergraduates in the intervention phase of the project. Assisting the researchers will be a distinguished Advisory Board that provides expertise in broadening the representation of women of color in STEM education. The external evaluator will provide formative and summative assessments of the project's case study data and narratives data using methods of study analysis and narrative inquiry and will lead the formative and summative evaluation of the intervention using a mixed methods approach. The intervention evaluation will focus on three variables: 1) students' attitudes toward computer science, 2) their persistence in computer science and 3) their participant attitudes toward, and experiences in, the intervention.
This project extends the PIs' previous NSF-funded work on factors that impact the success of women of color in STEM. The project will contribute an improved understanding of the complex challenges that women of color encounter in computing. It will also illuminate individual and programmatic strategies that enable them to participate more fully and in greater numbers. The ultimate broader impact of the project should be a proven, scalable model for reversing the downward trend in the rates at which women of color earn bachelor's degrees in computer science.
This research extends the investigator's prior NSF supported work to develop theoretical and empirical understanding of the double bind faced by women of color in STEM fields. That is, their race and gender present dual dilemmas as they move through STEM educational and career paths. The proposed study will identify gaps in our understanding, and identify some of the methodological problems associated with answering outstanding questions about the double bind. The major research question is: What strategies work to enable women of color to achieve higher levels of advancement in STEM academia and professions? The goal is to bring a clearer understanding of the issues which confront women of color as they pursue study of science and engineering, and what factors influence whether they leave or remain in STEM.
The work will employ a highly structured narrative analysis process to identify and quantify factors that have been successful in broadening the participation of minority women in STEM. The research design involves two separate tracks of work: 1) to conduct narrative analysis of primary documents associated with women of color in science; and 2) to conduct site visits and interviews to understand features of programs associated with successful support of women of color in undergraduate and graduate education. The first part is designed to inform the second, with the narrative analysis helping to identify features to look for in site visits and to use in development of interview protocols.
This research will focus on individual and programmatic factors that sustain women of color as they confront barriers to their career goals. It examines institutional strategies and support structures that help women of color ultimately to succeed, and social and pedagogic elements that influence their educational experiences. Although women of color have made some progress over the last three decades towards more equitable participation in STEM fields, the major efforts made to address this issue have not produced the desired outcomes; minority women continue to be underrepresented relative to white women and non-minority men. The factors that account for continued lower participation rates are not yet fully understood.
Beyond the Double Bind is designed to transform the intellectual basis for building future programs that will better enable women of color to be successful in STEM. While focused on women of color, the results will ultimately inform strategies and programs to expand the presence of all women and minorities in STEM.
The goal of the project is to advance understanding of basic questions about learning and teaching through the development of a theory of embodied mathematical cognition that can apply to a broad range of people, settings and activities. The investigative team brings together expertise from a range of quantitative and qualitative research methodologies. A theory of embodied mathematical cognition empirically rooted in classroom learning and workplace practices will broaden the range of activities and emerging technologies that count as mathematical, and help educators to envision alternative forms of bodily engagement with mathematical problems.
DATE:
-
TEAM MEMBERS:
Ricardo NemirovskyRogers HallMartha AlibaliMitchell NathanKevin Leander
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
The project team is developing a prototype of a web-based game utilizing the illustrations of chemical elements and science terms created by Simon Basher in his three books, The Periodic Table: Elements with Style!, Chemistry: Getting a Big Reaction!, and Physics: Why Matter Matters! The game will incorporate augmented reality (person-to-person gameplay with the support of the software) to teach grade 4 to 6 students science concepts, including an introduction to chemistry. The game will include curriculum support materials. Pilot research in Phase I will seek to demonstrate that the software prototype functions as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
Purpose: There is concern about a decline in mathematics achievement scores among U.S. students during the middle school years. For example, while 4th grade U.S. students rank 8th overall on an international mathematics comparison, by 10th grade U.S. student's drop significantly to 25th in the same comparison. Some researchers posit that much of this decline relates to how math is taught in the U.S. and with how students become less engaged as learners in middle school. The purpose of this project is to develop a web-based game to engage 7h grade students in a narrative-based story which will apply learning of content and skills aligned to the Common Core State Standards (CCSS) in mathematics.
Project Activities: During Phase I in 2012, the team developed a functioning prototype and conducted usability and feasibility research with fourteen 7th grade students. Researchers found that the prototype functioned as intended and that students were highly engaged while playing the game. In Phase II, the team will develop a fully-functional user interface with animated characters, interactivity across student users, narrative scripts and accompanying art assets, 36 problem sets, and student and teacher dashboards and databases. After development is complete, a pilot study will examine the usability and feasibility, fidelity of implementation, and the promise of the game to improve math learning. The study will include 120 students in 6 classrooms in three schools, with one classroom per school randomly assigned to use the game and the other half assigned to a business-as-usual control. Analyses will compare student scores on pre and post mathematics measures.
Product: Empires is a web-based game that addresses 36 pre-algebra Common Core State Standards in mathematics for 7th and 8th grades. The game follows a storyline in a recreation of an ancient empire which is at the brink of agricultural revolution and of becoming a trade economy. As students play the game, they engage in math-focused activities to drive the action, such as taxing citizens to learn ratios and proportions, allocating resources to learn percentages, and measuring the distance and time between a neighboring empire by applying the principles of the Pythagorean Theorem. As a socially networked game, students will interact with other students in the class to complete trades that lead to encounters with different math problems. The game will include two helpful, funny, advisors who will scaffold learning through mathematical discourse, arguing over the next most important thing to do. The game design architecture will work on a wide range of computers, including desktops and iPads. A teacher's guide and companion website will provide guidance to classroom activities that complement the game.
This chapter reviews four projects that reflect the principles of design-based implementation research (DBIR) in an effort to highlight a range of relevant theoretical and methodological perspectives and tools that can inform future work associated with DBIR.The goal of this chapter is to highlight a range of relevant theoretical and methodological perspectives and tools that can inform future work associated with design-based implementation research (DBIR). As Penuel, Fishman, Cheng, and Sabelli (2011) described, DBIR entails engaging “learning scientists, policy researchers, and
DATE:
TEAM MEMBERS:
Jennifer RussellKara JacksonAndrew KrummKenneth Frank
The purpose of this study was to investigate the ways in which environmental education (EE) programs are contributing to environmental quality (EQ) improvement. The research applied the Pressure-State-Response (PSR) environmental indicator framework to the reported outcomes of 103 EE programs in order to 1) determine the extent to which existing EE programs are reporting EQ improvement outcomes; and 2) examine the extent to which these programs are impacting indicators in the three areas of the PSR framework. The study consisted of three research phases: evaluation synthesis, semi-structured
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.