The article describes the purpose of the evaluation for Statistics for Action (SfA): to learn to what extent SfA's set of materials and resources and training developed by math educators with input from environmental organizers, could increase numeracy among environmental organizers and the community members they serve. For this generally unpopular content (math) in an unusual context (environmental campaigns), the author describes project and evaluation design choices that worked, and those that didn’t.
This MSP-Start Partnership, led by Widener University, in partnership with Bryn Mawr College, Delaware County Community College, Philadelphia University, Lincoln University, and Haverford Township School District, is developing the Greater Philadelphia Environment, Energy, and Sustainability Science (ES)2 Teacher Leader Institute. Additional partners include the Center for Social and Economic Research at West Chester University, Delaware Valley Industrial Resource Center, Energy Coordinating Agency, US EPA Region 3 Office of Innovation, National Center for Science and Civic Engagement and its SENCER program, Pennsylvania Campus Compact, Philadelphia Higher Education Network for Neighborhood Development, Project Kaleidoscope, Sustainable Business Network of Greater Philadelphia, and the 21st Century Partnership for STEM Education. Building on a base of relationships developed over the past five years by many partners in the Math Science Partnership of Greater Philadelphia, the project brings together faculty and resources from multiple institutions (a "Mega-University" model) to develop a coherent, innovative, and content-rich, multi-year curriculum in environment, energy, and sustainability science for an Institute that leads to a newly developed Master's degree. Teachers participating in the Institute (A) improve their STEM content knowledge in areas critical to human environmental sustainability, (B) improve their use of project based/service learning and scientific teaching pedagogies in their teaching, (C) engage in real-world sustainability problem solving in an externship with a local business, non-profit or government organization that is active in the newly emerging green economy, and (D) develop important leadership skills as change agents in their schools to improve student interest, learning, and engagement in STEM education. The Institute aims to serve as a regional hub, connecting educational, business, non-profit and government organizations to strengthen the STEM education and workforce development pipelines in the region and simultaneously support positive social change toward environmental sustainability and citizenship. The project's "Mega-University" and "Institute as a regional connector-hub" approaches are powerful models of collaboration that could have widespread and significant national applicability as organizations and systems adjust to the new challenges of our global economy and to the needed transition to sustainability.
DATE:
-
TEAM MEMBERS:
Stephen MadigoskyWilliam KeilbaughVictor DonnayBruce GrantThomas Schrand
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.
Evaluators sought to determine impact on math attitude and content knowledge of students (3rd - 6th grade), and math literacy workers (high school and college students), based on pre-post testing and observation of YPP after school programs, in which college and high school students teach math games to elementary and middle school students in marginalized and vulnerable communities. The study focused on the Chicago YPP site, 1 of 7 in the YPP national network. Increases in math attitude scores were not statistically significant, however in some instances evaluators found significant increases
DATE:
TEAM MEMBERS:
Norman LedermanYoung People's Project, Inc.
resourceprojectProfessional Development, Conferences, and Networks
This model science teacher retention and mentoring project will involve more than 300 elementary teachers in "Lesson Study" of inquiry science around school gardens. Drawing on the rich resources of the University of California Botanical Garden and the science educators at the Lawrence Hall of Science this project will develop Teacher Leaders and provide science content professional development to colleagues in four urban school districts. Using the rich and authentic contexts of gardens to engage students and teachers in scientific inquiry opens the opportunity to invite parents to become actively involved with their children in the learning process. As teachers improve their classroom practices of teaching science through inquiry with the help of school-based mentoring they are able to connect the teaching of science to mathematics and literacy and will be able to apply the lesson study approach in their teaching of other innovative projects. Teacher leaders and mentors will have on-going learning opportunities as well as engage participating teachers in lesson study and reflection aimed toward improving science content understanding and the quality of science learning in summer garden learning experiences and having context rich science inquiry experiences throughout the school year.
This collaborative project aims to establish a national computational resource to move the research community much closer to the realization of the goal of the Tree of Life initiative, namely, to reconstruct the evolutionary history of all organisms. This goal is the computational Grand Challenge of evolutionary biology. Current methods are limited to problems several orders of magnitude smaller, and they fail to provide sufficient accuracy at the high end of their range. The planned resource will be designed as an incubator to promote the development of new ideas for this enormously challenging computational task; it will create a forum for experimentalists, computational biologists, and computer scientists to share data, compare methods, and analyze results, thereby speeding up tool development while also sustaining current biological research projects. The resource will be composed of a large computational platform, a collection of interoperable high-performance software for phylogenetic analysis, and a large database of datasets, both real and simulated, and their analyses; it will be accessible through any Web browser by developers, researchers, and educators. The software, freely available in source form, will be usable on scales varying from laptops to high-performance, Grid-enabled, compute engines such as this project's platform, and will be packaged to be compatible with current popular tools. In order to build this resource, this collaborative project will support research programs in phyloinformatics (databases to store multilevel data with detailed annotations and to support complex, tree-oriented queries), in optimization algorithms, Bayesian inference, and symbolic manipulation for phylogeny reconstruction, and in simulation of branching evolution at the genomic level, all within the context of a virtual collaborative center. Biology, and phylogeny in particular, have been almost completely redefined by modern information technology, both in terms of data acquisition and in terms of analysis. Phylogeneticists have formulated specific models and questions that can now be addressed using recent advances in database technology and optimization algorithms. The time is thus exactly right for a close collaboration of biologists and computer scientists to address the IT issues in phylogenetics, many of which call for novel approaches, due to a combination of combinatorial difficulty and overall scale. The project research team includes computer scientists working in databases, algorithm design, algorithm engineering, and high-performance computing, evolutionary biologists and systematists, bioinformaticians, and biostatisticians, with a history of successful collaboration and a record of fundamental contributions, to provide the required breadth and depth. This project will bring together researchers from many areas and foster new types of collaborations and new styles of research in computational biology; moreover, the interaction of algorithms, databases, modeling, and biology will give new impetus and new directions in each area. It will help create the computational infrastructure that the research community will use over the next decades, as more whole genomes are sequenced and enough data are collected to attempt the inference of the Tree of Life. The project will help evolutionary biologists understand the mechanisms of evolution, the relationships among evolution, structure, and function of biomolecules, and a host of other research problems in biology, eventually leading to major progress in ecology, pharmaceutics, forensics, and security. The project will publicize evolution, genomics, and bioinformatics through informal education programs at museum partners of the collaborating institutions. It also will motivate high-school students and college undergraduates to pursue careers in bioinformatics. The project provides an extraordinary opportunity to train students, both undergraduate and graduate, as well as postdoctoral researchers, in one of the most exciting interdisciplinary areas in science. The collaborating institutions serve a large number of underrepresented groups and are committed to increasing their participation in research.
DATE:
-
TEAM MEMBERS:
Tandy WarnowDavid HillisLauren MeyersDaniel MirankerWarren Hunt, Jr.
The institution is The Ohio State University at Lima, the university partners are the University of North Carolina at Greensboro and Fayetteville State University. It's About Discovery is a unique partnership to engage students and teachers in critical thinking skills in STEM content areas. The Ford Partnership for Advanced Studies (PAS) new science curriculum is the foundation for the project which will include over 700 students and 20-25 teachers. While the primary focus is on students, throughout the life of the project all teachers will participate in professional development focusing on the PAS units to ensure the quality teaching and understanding of the content. Technology will be integrated throughout the program to enable students to create inquiry based projects across state lines and for teachers to continue their professional development opportunities. Community partners will serve as mentors, host field trips, and engage in on-line conversations with students. An interactive website will be created for both teachers and students. The focus is on 8th grade science as it relates to STEM careers, 9th grade physical science and 10th science and mathematics. We are implementing a new Ford PAS curriculum module, Working Towards Sustainability, which comprises of four modules: We All Run on Energy, Energy from the Sun, Is Hydrogen a Solution? and The Nuclear Revolution. Teachers across states will engage in a new professional development model. Students will create projects through on-line conversations. A website will be created for project participants and the ITEST community. These hands-on, inquiry-based learning experiences engage students and prepare and encourage them to pursue science, engineering, and technology in high school and beyond. All PAS curricula use real world experiences, open-ended problems and result in real world applications. Assessments are on-going and inquiry driven. Teamwork and on-line resources and research are built into the curriculum design. The evaluation consists of a multi-method pre-post design. Teachers complete a Pre Survey at the beginning of the program and then again at the end of the school year. Students complete a Pre Survey at the beginning of the school year and a post survey at the end of the school year. In addition, teachers share students' scores on curriculum assessments completed throughout the year, including student scores on the Comprehensive Adult Student Assessment System's (CASAS) Assessment of Critical Thinking in Science writing tasks.
This pilot project establishes and implements a professional development model with teachers of Native American students by creating a culturally relevant science, technology, engineering and mathematics (STEM) teacher in-service model for 30 grade 4-6 teachers from schools from two nations in Utah. The in-service program relies on community advisory panels, current standards and best practices in science, mathematics and technology education, by implementing engineering and technology education activities as a means of teaching science and mathematics. The goal is to improve teacher preparation in science and mathematics for Native Americans by creating culturally relevant curriculum materials with the help of community advisory panels and providing each teacher participant with at least 100 hours of structured professional development. The long-range goal is to develop an in-service model that can be transported to other Native American nations and schools. STEM and education faculty, community teachers, parents and leaders, as well as, tribal elders are to work together to assure the professional development model and materials are developed in a culturally inclusive manner. The evidence-based outcome of this project is that Native American students effectively learn mathematics and science with the longer-term influence being improvement in student achievement.
DATE:
-
TEAM MEMBERS:
Kurt BeckerJames BartaRebecca Monhardt
The intent of this project is to use social network methods to study networks of afterschool and informal science stakeholders. It would attempt to create knowledge that improves afterschool programs access to informal science learning materials. This is an applied research study that applies research methods to improving access to and enactment of informal science education programs across a range of settings. The investigators plan to collect data from 600 community- and afterschool programs in California, conduct case studies of 10 of these programs, and conduct surveys of supporting intermediary organizations. The analysis of the data will provide descriptions of the duration, intensity, and nature of the networks among afterschool programs and intermediary agencies, and the diffusion patterns of science learning materials in afterschool programs. The project will yield actionable knowledge that will be disseminated among afterschool programs, intermediary organizations, funding agencies, and policymakers to improve the dissemination and support of afterschool science learning opportunities. The project is focused on free-choice settings where every day the largest numbers of children attend afterschool programs at schools and in other community settings. It seeks information about what conditions are necessary for informal science programs to significantly impact the largest possible number of children in these settings.
DATE:
-
TEAM MEMBERS:
Barbara MeansAnn HouseCarlin LlorenteRaymond McGhee
Concord Evaluation Group (CEG) performed an evaluation study in the fall of 2010 on behalf of WGBH to evaluate the effectiveness of an online, interactive webisode developed as an educational component of the FETCH! with Ruff Ruffman series (http://pbskids.org/fetch/). The webisode was not connected to the FETCH! website at the time of the evaluation study, but will be after the study is complete. With an emphasis on building math skills, the interactive webisode was designed to teach and engage elementary-aged kids (ages 6 – 10) to identify and create combinations. In addition to identifying
Produced by Thirteen/WNET New York and Nelvana International, the Award-winning series CYBERCHASE is the only mathematics series for children on American television. Designed for kids ages 8 to 12 and packed with mystery, humor, and action, each episode delivers positive messages about math by teaching concepts in a fun way that kids can understand. The goal of this formative evaluation for Season 3 evaluation was two-fold: 1) to observe and assess the performance of third-graders on tasks related to two math topics in development for Season 3 (Angle & Distance and Logic & Reasoning) and 2) to
This formative evaluation gathered feedback from parents and their fourth grade children in response to two activities included in the Cyberchase at Home outreach materials. The user-based feedback assisted with the design of new outreach materials. The general goals for the research were to explore reactions to the activity card format; assess appeal and difficulties in implementation of two activities; estimate comprehension of activity content; and evaluate parental interest in further activities and workshops. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS