This report grew out of a workshop and follow-up session sponsored by the National Science Foundation (NSF), Directorate for Education and Human Resources (EHR). The two-day workshop and subsequent meeting sought to develop and validate evaluation practices to assess the value of NSF's investment in broadening participation across all directorates and programs. Invited participants included NSF grantees, professional evaluators, and the policy community (which included representatives from Congress, the Office of Management and Budget (OMB), NSF staff, and staff from other federal agencies).
DATE:
TEAM MEMBERS:
Fitzgerald BramwellPatricia CampbellBeatriz Chu ClewellDarnella DavisNorman FortenberryAntonio GarciaDonna NelsonAdam StollVeronica Thomas
Produced by Twin Cities Public Television, St. Paul, MN, DragonflyTV (DFTV) is a weekly television series of half-hour live action shows for 8-12 year olds, distributed by PBS Plus. DFTV features real children engaged in real inquiry-based investigations in and around science centers across America. Six 2009 episodes of DFTV focus on the world of nanoscale science and technology. DFTV Nano highlights science centers and university research labs while applying the DFTV “Real Kids … Real Science” model to communicate basic concepts and the scientific process in nanoscience. The themes of the
The purpose of the summative evaluation is to two-fold: 1) provide documentation to NSF about the extent to which the project met its goals and objectives, and 2) give the Lab of Ornithology information about how well the Web application and the ecosystem within which it resides is engaging the intended audiences. The main evaluation questions the study needed to answer related to who is participating in YardMap, how much participation affects participants’ knowledge, attitudes and behaviors around birding, gardening, and citizen science.
A true experimental design was used, where
In Spring 2006, the Missouri Botanical Garden received a National Science Foundation grant to fund the LIONS program. LIONS trained educators from the St. Louis region, through professional development about place-based education, to deliver after school and summer programming to students grades 5 through 8. Since its inception, the LIONS program has included evaluation of program implementation and outcomes. There were dramatic changes in the scope of the program, which expanded beyond the originally targeted University City school district by adding additional schools recruited by LIONS
Hidden Universe is a multi-faceted project built around production of a 2D/3D giant screen film. The goal is to inspire, engage, and excite viewers about the mysterious worlds hidden around us and the science and technology that reveal them. The film will illuminate natural wonders that are invisible to the naked eye, such as objects and processes that are too slow, too fast, and too small to be seen without advanced technologies. It will include nanoscience and microbiology research and developing wavelength technologies such as ultrafast lasers. The project will employ cutting-edge
The Adler Planetarium, Johns Hopkins University, and Southern Illinois University-Edwardsville are investigating the potential of online citizen science projects to broaden the pool of volunteers who participate in analysis and investigation of digital data and to deepen volunteers' engagement in scientific inquiry. The Investigating Audience Engagement with Citizen Science project is administering surveys and conducting case studies to identify factors that lead volunteers to engage in the astronomy-focused Galaxy Zoo project and its Zooniverse extensions. The project is (1) identifying volunteers' motivations for joining and staying involved, (2) determining factors that influence volunteers' movement from lower to higher levels of involvement, and (3) designing features that influence volunteer involvement. The project's research findings will help informal science educators and scientists refine existing citizen science programs and develop new ones that maximize volunteer engagement, improve the user experience, and build a more scientifically literate public.
DATE:
-
TEAM MEMBERS:
Karen CarneyMichael RaddickPamela Gay
The ScienceMakers: African Americans and Scientific Innovation is a three-year project designed to increase awareness of the contributions of African American scientists, raise awareness of STEM careers, and increase understanding of STEM concepts through the creation of education, media, and career resources. The project team is supplemented with an extensive advisory board of STEM education, museum, and community professionals, as well as representatives from partnering science centers. Project partners include the St. Louis Science Center, Liberty Science Center, New York Hall of Science, Pacific Science Center, Franklin Institute, COSI Columbus, Lawrence Hall of Science, SciWorks, Detroit Science Center, and MOSI Chicago. Additional collaborators include middle and high schools with high minority populations. Project deliverables include a fully accessible multi-media archive of video oral histories of 180 African American scientists and web resources and contests utilizing Web 2.0 and 3.0 applications such as social networking tools that foster engagement and build community around the ScienceMakers. Public programs for youth and adults at science museums, after-school programs, and community organizations highlight African American contributors, and encourage interest in science and science careers and the ScienceMakers DVD Toolkit expand the reach of this innovative project. Intended impacts for youth and adults consist of increased awareness of STEM concepts and career options, exposure to African American scientists, awareness of the contributions of minority scientists, and 21st century skills. Intended impacts on professional audiences include increased awareness and understanding of STEM careers and workforce diversity, 21st century skills, and STEM career options. The project evaluation, conducted by Knight-Williams Research Communications, utilizes a mixed-methods approach. The evaluation assesses the impact of the oral history archive, public programs, and other deliverables on public and professional audiences' knowledge, interest, and awareness of the contributions of African American scientists, STEM concepts, and STEM careers. The evaluation also includes an ethnography which examines factors that contribute to success in STEM careers by African-American scientists. The ScienceMakers significantly expands the world\'s largest searchable oral history archive and may have an enduring impact on research and practice in the field of informal science education. The project has the potential to enrich programs and exhibits, while raising awareness of the contributions of African-American scientists among informal science education professionals and the general public.
The Space Science Institute, in collaboration with the Catawba Science Center (North Carolina), the New Mexico Museum of Natural History and Science, the American Library Association, and the Astronomical Society of the Pacific propose to develop a multi-pronged project on the topic of asteroids. Content areas will include: Asteroids ? Up-close and Personal; Deep Impact; and Planetary Protection. Deliverables will include a 2,500 square-foot traveling exhibit for small to mid-sized museums; four, 300 square-foot "small exhibit components" (SECs) for libraries, community centers, etc.; Web 2.0 sites for the project developers and for the public; public education programs; professional development programs for informal STEM professionals; and a study of how Web 2.0 can be used to improve the evaluation of Web sites. The project team will be experimenting with virtual prototyping of exhibit modules as a way to improve exhibit development, especially with team members who are around the country. Teens from around the country will be enlisted to help inform the project on its deliverables. The Association of Science-Technology Centers will manage the exhibit tour. The Institute for Learning Innovation will conduct the evaluation activities, including the study of Web 2.0 and virtual prototyping tasks.
Funded by the National Science Foundation (NSF), the Center for High-rate Nanomanufacturing (CHN) brings together three universities with unique strengths in nanoscience and nanomanufacturing: the University of Massachusetts, Lowell (UML); Northeastern University, Boston (NEU); and the University of New Hampshire, Durham (UNH). The University of Massachusetts Donahue Institute (UMDI) is conducting the five-year evaluation of CHN's education and outreach activities. The evaluation uses multiple sources of evidence to analyze project processes and outcomes. Using quantitative and qualitative
DATE:
TEAM MEMBERS:
Center for High-rate NanomanufacturingCarol Lynn AlpertCarol BarryUMass Donahue Institute Research and Evaluation Group
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley
Youth Radio, an after-school media production program, consists of a main campus in Oakland, CA, and regional bureaus in Atlanta, GA, Washington, D.C., and Los Angeles, CA. Youth Radio’s model is to engage underserved young people in broadcast journalism, radio and web production, engineering, and media literacy through media projects that are relevant to the students’ lives and communities. In doing so, Youth Radio prepares young people for college programs and careers in media. The organization also supports young people in their transition from school to career through an externship program