This Handbook was developed to provide project directors and principal investigators working with the National Science Foundation (NSF) with a basic guide for evaluating NSF’s educational projects. It is aimed at people who need to learn more about both the value of evaluation and how to design and carry out an evaluation, rather than those who already have a solid base of experience in the field. It builds on firmly established principles, blending technical knowledge and common sense to meet the special needs of NSF and its stakeholders. The Handbook discusses quantitative and qualitative
DATE:
TEAM MEMBERS:
Joy Frechtling WestatNational Science Foundation
This report is the result of a two-year study that sought to provide a sustained, coherent, and proactive effort to identify and develop the future science, technology, engineering, and math (STEM) innovators in the United States. The report puts forth several policy recommendations, including: increasing K-12 access to accelerated coursework and enrichment programs; offering more “above-level tests,” especially in economically disadvantaged urban and rural areas; holding schools, and perhaps districts and states, accountable for the performance of the top students at each grade level; and
DATE:
TEAM MEMBERS:
National Science BoardNational Science Board
Backyard Mystery is an NSF-funded curriculum, focused on diseases, pathogens and careers, using interactive paper and physical activities. Content is for middle school participants in afterschool settings, like 4-H and other similar venues. The curriculum engages student interest in genetics and genomics and in the bioSTEM workforce. The curriculum storyline is placed in a familiar setting to students--the backyard--and explores fungi, bacteria, viruses and parasites in a way that is engaging fun and informative. It can be tailored to specific audiences, e.g. participants interested in animal science will gain from focusing on the parasite panel. The curriculum is available in two forms: a combined lesson that brings all of the elements together in one session and another in which the content is broken out into three separate lessons. We would like to share this curriculum with facilitators and educators for both out-of-school time and classroom settings. It is available electronically and free to use. We only ask for users to complete a brief survey to give us feedback, which is helpful for NSF.
The overarching purpose of the Climate Literacy Zoo Education Network is to develop and evaluate a new approach to climate change education that connects zoo visitors to polar animals currently endangered by climate change, leveraging the associative and affective pathways known to dominate decision-making. Utilizing a polar theme, the partnership brings together a strong multidisciplinary team that includes the Chicago Zoological Society of Brookfield, IL, leading a geographically distributed consortium of nine partners: Columbus Zoo & Aquarium, OH; Como Zoo & Conservatory, St. Paul, MN; Indianapolis Zoo, IN; Louisville Zoological Garden, KY; Oregon Zoo, Portland, OR; Pittsburgh Zoo & PPG Aquarium, PA; Roger Williams Park Zoo, Providence, RI; Toledo Zoological Gardens, OH, and the organization Polar Bears International. The partnership leadership includes the Learning Sciences Research Institute at the University of Illinois at Chicago, and the Earth System Science Center at Pennsylvania State University. The partnership is joined by experts in conservation psychology and an external advisory board. The primary stakeholders are the diverse 13 million annual visitors to the nine partner zoos. Additional stakeholders include zoo docents, interpreters and educators, as well as the partnership technical team in the fields of learning innovations, technological tools, research review and education practice. The core goals of the planning phase are to a) develop and extend the strong multidisciplinary partnership, b) conduct research needed to understand the preconceptions, attitudes, beliefs, and learning modes of zoo visitors regarding climate change; and c) identify and prototype innovative learning environments and tools. Internal and external evaluations will be conducted by Facet Innovations of Seattle, WA. Activities to achieve these goals include assessments and stakeholder workshops to inventory potential resources at zoos; surveys of zoo visitors to examine demographic, socioeconomic, and technology access parameters of zoo visitors and their existing opinions; and initial development and testing of participatory, experiential activities and technological tools to facilitate learning about the complex system principles underlying the climate system. The long-term vision centers on the development of a network of U.S. zoos, in partnership with climate change domain scientists, learning scientists, conservation psychologists, and other stakeholders, serving as a sustainable infrastructure to investigate strategies designed to foster changes in public attitudes, understandings, and behavior surrounding climate change.
Arizona State University (ASU) in collaboration with Arizona Science Center, Boeing, Intel, Microchip, Motorola, Salt River Project, AZ Foundation for Resource Education, AZ Game & Fish Department, US Partnership for the Decade of Education for Sustainable Development, Mesa Public Schools, and Boys & Girls Clubs of the East Valley, offer a three-year extracurricular project resulting in IT/STEM-related learning outcomes for 96 participants in grades 7, 8, and 9. The project targets and engages female and minority youth traditionally under-represented in IT/STEM fields in multi-year out-of-school technological design and problem solving experiences. These include summer internships/externships and university research in the science center and industrial settings where participants develop socially responsible solutions for challenging real world problems. The program includes cognitive apprenticeships with diverse mentors, opportunities to practice workplace skills such as leadership, teamwork, time management, creativity and reporting, and use of technological tools to gather and analyze complex data sets. Participants simulate desert tortoise behaviors, research and develop designs to mitigate the urban heat island, build small-scale renewable energy resources, design autonomous rovers capable of navigating Mars-like terrain, and develop a model habitat for humans to live on Mars. Together with their families participants gain first-hand knowledge of IT/STEM career and educational pathways. In addition to youth outcomes, the adults associated with this project are better prepared to positively influence IT/STEM learning experiences for under-represented youth. The evaluation measures participant content knowledge, attitudes and interest in IT/STEM subjects, workplace skills and intentions to pursue IT/STEM educational and career pathways to understand participant reactions, learning, transfer and results. Informal curricula developed through this project, field-tested with youth at Boys & Girls Clubs and youth at Arizona Science Center will be available on the project website.
DATE:
-
TEAM MEMBERS:
Tirupalavanam GaneshMonica ElserStephen KrauseDale BakerSharon Robinson-Kurplus
Stroud Water Research Center (SWRC) will partner with Longwood Gardens (LG) to develop educational materials that help visitors understand the links between the hydrologic and carbon cycles. The goal is to demonstrate how landscape aesthetics can influence land-use decisions, and to offer carbon-neutral methods the public and others can employ to reduce the impact of storm runoff. The intended audience is primarily adults among the 800,000 annual visitors to the Gardens who are landowners as well as professionals such as engineers, regional planners, landscape architects, developers and municipal officials. This project will also communicate research to public audiences through SWRC and LG websites.
DATE:
-
TEAM MEMBERS:
Louis KaplanJ. Denis NewboldSusan GillAnthony Aufdenkampe
resourceprojectProfessional Development, Conferences, and Networks
This MSP-Start Partnership, led by Widener University, in partnership with Bryn Mawr College, Delaware County Community College, Philadelphia University, Lincoln University, and Haverford Township School District, is developing the Greater Philadelphia Environment, Energy, and Sustainability Science (ES)2 Teacher Leader Institute. Additional partners include the Center for Social and Economic Research at West Chester University, Delaware Valley Industrial Resource Center, Energy Coordinating Agency, US EPA Region 3 Office of Innovation, National Center for Science and Civic Engagement and its SENCER program, Pennsylvania Campus Compact, Philadelphia Higher Education Network for Neighborhood Development, Project Kaleidoscope, Sustainable Business Network of Greater Philadelphia, and the 21st Century Partnership for STEM Education. Building on a base of relationships developed over the past five years by many partners in the Math Science Partnership of Greater Philadelphia, the project brings together faculty and resources from multiple institutions (a "Mega-University" model) to develop a coherent, innovative, and content-rich, multi-year curriculum in environment, energy, and sustainability science for an Institute that leads to a newly developed Master's degree. Teachers participating in the Institute (A) improve their STEM content knowledge in areas critical to human environmental sustainability, (B) improve their use of project based/service learning and scientific teaching pedagogies in their teaching, (C) engage in real-world sustainability problem solving in an externship with a local business, non-profit or government organization that is active in the newly emerging green economy, and (D) develop important leadership skills as change agents in their schools to improve student interest, learning, and engagement in STEM education. The Institute aims to serve as a regional hub, connecting educational, business, non-profit and government organizations to strengthen the STEM education and workforce development pipelines in the region and simultaneously support positive social change toward environmental sustainability and citizenship. The project's "Mega-University" and "Institute as a regional connector-hub" approaches are powerful models of collaboration that could have widespread and significant national applicability as organizations and systems adjust to the new challenges of our global economy and to the needed transition to sustainability.
DATE:
-
TEAM MEMBERS:
Stephen MadigoskyWilliam KeilbaughVictor DonnayBruce GrantThomas Schrand
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley
resourceprojectProfessional Development, Conferences, and Networks
This four year project led by The American Association for the Advancement of Sciences (AAAS) will continue fostering interactions among projects funded by the Graduate STEM Fellows in K-12 Education (GK-12)through a series of meetings that include one annual meeting and two special focus meetings every year. The annual meeting will be broad and will target all different GK-12 participants (PIs, Fellows, Teachers, Project Coordinators, Evaluators and Faculty Members). The special focus meetings will target a specific GK-12 group or will explore a theme or issue of special interest to the GK-12 program or GK-12 projects. AAAS also will update the current website and revise and expand its content to provide a resource to the GK-12 community. Some of the additions to the website will be: an e-newsletter, alumni directory, evaluation instruments, ready access to STEM activities and statistical data on projects.
MarshAccess is an informal science education program based at the Meadowlands Environment Center (MEC) in Lyndhurst, NJ, and funded by the National Science Foundation. MarshAccess seeks to engage largely underserved populations of young and older adults with disabilities, as well as older adults with age-related limitations, in outdoor experiential STEM activities centered on the New Jersey Meadowlands marsh ecosystem. Program modules are designed to increase interest in science, increase scientific literacy, develop a sustained relationship between the MEC and the target audience and audience
DATE:
TEAM MEMBERS:
Hilarie B. DavisBradford T. DaveyRamapo College of New Jersey
Evaluators sought to determine impact on math attitude and content knowledge of students (3rd - 6th grade), and math literacy workers (high school and college students), based on pre-post testing and observation of YPP after school programs, in which college and high school students teach math games to elementary and middle school students in marginalized and vulnerable communities. The study focused on the Chicago YPP site, 1 of 7 in the YPP national network. Increases in math attitude scores were not statistically significant, however in some instances evaluators found significant increases
DATE:
TEAM MEMBERS:
Norman LedermanYoung People's Project, Inc.