Goodman Research Group, Inc. conducted a comprehensive multi-method external evaluation of the first season of the Design Squad TV series and outreach initiative. The broad evaluation goals were to: assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, document the implementation of community events resulting form the November 2006 Engineering Summit, and assess the effectiveness of the Afterschool Educators Guide with leaders and students.
DATE:
TEAM MEMBERS:
Peggy VaughanEmilee PressmanIrene GoodmanWGBH
Design Squad, produced by WGBH-Boston (http://www.wgbh.org), premiered on the Public Broadcasting Service in October 2009. Design Squad is a reality television series that encourages kids ages 9-12 years to “show off their smarts as they design and build working solutions for real-world clients—people who are hungry for clever ideas from a new generation of innovators.” Each season, the series culminates in a final episode when the top two scorers compete for a $10,000 college scholarship from the Intel Foundation. The underlying educational goals of Design Squad are to: (1) Increase students'
Cracking the Maya Code is a one-hour PBS/NOVA adaptation of the two-hour feature documentary Breaking the Maya Code, based on the book of the same title by Michael D. Coe. Major funding for the project - which included website, eduational and outreach components - was provided by the National Science Foundation and the National Endowment for the Humanities. Knight Williams Research conducted a summative evaluation of Cracking the Maya Code. The evaluation examined the appeal, clarity, and educational impact of the program, focusing on educating Viewers about: The basic principles that underlie
SciGirls is a new weekly public television series produced by Twin Cities Public Television and supported by the National Science Foundation. Twelve half-hour animated and live action shows are accompanied by web and outreach activities in the fields of science, technology and engineering (STEM). Multimedia Research, an independent evaluation group, implemented a summative evaluation of SciGirls television programming with a rigorous randomized controlled trial design comparing treatment and control groups. Girls entering fifth grade were assigned randomly either to a treatment group (n = 42)
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
KQED's QUEST is a multi-year, multiple-media project seeking to influence the Bay Area's discussions about and activities related to science, the environment, and nature, with a particularly local focus. Rockman et al (REA), a San Francisco-based research and evaluation organization, conducted an evaluation of QUEST programming and activities over the course of several years. The evaluation examined general QUEST audiences, formal and informal educators' use of QUEST, and KQED's development and maintenance of a partnership among a number of Bay Area science and environmental organizations. The
DATE:
TEAM MEMBERS:
Elizabeth BandyMonnette FungKQED Northern California Public Media
The Museum of Science (MoS) in Boston is contributing to early endeavors of informal science educators to engage and inform the public about the emerging field of nanotechnology by producing 3-5 minute segments that appear on a regional cable news station, New England Cable News (NECN). Multimedia Research implemented a naturalistic post-only experiment with three general goals: (1) to assess the effectiveness of four Sci-Tech Today segments in engaging, educating and motivating the public to learn more about nanotechnology; (2) to appraise local news viewers' support for science and
Sea Studios has undertaken the daunting task of motivating the American public to engage in solving some of the Earth's most challenging problems. Initially, Sea Studios' efforts focused on bringing significant environmental challenges to light. More recently, the organization's work has explored ways of communicating challenges facing natural systems with consequences in seemingly "unrelated" issue areas like poverty, globalization, and health. This task is formidable for a number of reasons. First, many of the problems Sea Studios is addressing are global in nature. As a result they seem
DATE:
TEAM MEMBERS:
Topos Research Partnership, LLCSea Studios Foundation
Listening to the River (LTTR) is a watershed science education project funded by the National Science Foundation. Its aims are to deliver education experiences in the local area, Traverse City, Michigan, and also to develop a model that could be replicated in other locations. Inverness Research was contracted by the Listening to the River project to conduct both formative and summative evaluations. Our work began in 2005 when the project received a planning grant, and continued through the life of the project. Primarily through interviews and product reviews, along with some direct program
DATE:
TEAM MEMBERS:
Mark St. JohnHeather MitchellDawn RoblesElizabeth HorschLaura StokesLand Information Access Assocation
Radiolab is a public radio series of hour-long interdisciplinary shows, co-hosted by Robert Krulwich and Jad Abumrad, and produced by WNYC. To help guide the future development of shows, this evaluation, sponsored by the National Science Foundation, gathered feedback from listeners via online and mailed questionnaires in response to a season 4 show entitled Choice. The general goals for the evaluation process are: (1) To explore what attributes of the format engage and interest listeners; (2) To examine influences on awareness and comprehension of content; and (3) To assess impact on post
WGBH has produced NOVA scienceNOW since 2005, with major funding from the National Science Foundation, the Howard Hughes Medical Institute, and the Alfred. P. Sloan Foundation. NOVA scienceNOW (NsN) is comprised of a science news and magazine television series, a companion website, and a science cafe outreach initiative. All NsN offerings share common goals: (a) increase public awareness and understanding of cutting edge science content, and (b) increase public engagement in science-related activities. Beginning in Season 4 of NOVA scienceNOW (NsN), WGBH increased its efforts to promote the
"Evolution in Action: Isolation and Speciation in the Lower Congo" is a 9-minute documentary about a team of researchers working to understand what is driving the rapid evolution and speciation of fishes in the Lower Congo River. The evaluation was designed to probe the following: 1) Connection and Interest in the science content 2) Connections between the scientific story and other topics of personal interest 3) Implications of the multilingual versions for disseminating science to the public and to science educators The participants included international education students who work in
DATE:
TEAM MEMBERS:
Maritza MacdonaldAmerican Museum Natural History
The evaluation research summarized here focuses on science reports developed by MacNeil/Lehrer Productions. The reports appear on The NewsHour television broadcasts and are archived as streaming video available on the program's Web site (www.pbs.org/newshour/science), which includes enhanced media resources such as audio Podcasts, RSS feeds, transcripts, teacher lesson plans, background reports, slideshows, and interactives. The project's general intention is to produce positive learning outcomes and attitudes towards STEM topics (Science, Technology, Engineering and Mathematics) and to foster