In 2008, Goodman Research Group, Inc. (GRG) conducted summative evaluation of Absolute Zero, a collaborative effort of the University of Oregon's Cryogenic Helium Turbulence Laboratory and Twin Cities Public Television. The films were produced by Meridian/Windfall Productions, Washington DC, and/Windfall Films in London, UK. Outreach was spearheaded by Devillier Communications, Inc. The Absolute Zero project was centered on a two-part documentary about low-temperature physics, which aired on PBS/NOVA in early January 2008, as well as an outreach campaign, which included approximately 20
DATE:
TEAM MEMBERS:
Irene GoodmanUniversity of OregonLaura HousemanMarianne McPherson
In 2005, Independent Broadcasting Associates (IBA) received funding from the National Science Foundation (NSF) to create a series of radio programs for National Public Radio that features the Ganges river basin in South Asia. The radio programs, which are in the process of being produced, will describe the 650 million people who are supported by the river, as well as its cultural and religious significance. The programs will also describe the political and/or economic environment of the river and its surrounding areas. Each of these topics will encourage listeners to divorce themselves from U
GRG conducted summative evaluation of Ganga, a NSF-funded six-segment series of NPR radio programs about the culture and ecology of the river Ganga in India and Bangladesh and its companion Website. Through a web-based survey, GRG assessed the study participants' knowledge gain from and the satisfaction with the series and the Website. The appendix of this report includes the online survey used in the study.
DATE:
TEAM MEMBERS:
Irene GoodmanIndependent Broadcasting Associates, Inc.
The goal of this project is to extend the impact of the nationally broadcast weekly radio program, Science Friday to a new, young audience through the various new cyber-space platforms and interactive tools such as Facebook, Twitter, and Second Life as well as new emerging social networking tools. The STEM content over the course of the two year project will include a wide variety of topics in all disciplines. The relationship between art and science will also be a focus. The NPR radio broadcasts currently reach 1.3 million listeners every week, and that audience is expected to increase. In addition to that audience, this project will target a new audience of adults under the age of 35 using various cyber platforms and new social networking tools such as Second Life, Facebook, YouTube and Twitter. Audiences will also be reached through remote broadcasts from science centers and art centers around the country. Over 30 science centers will use this project's web content on their own web sites, reaching their audiences as well. The web content will be translated into Spanish and widely disseminated to Hispanic audiences. Each Friday afternoon, Ira Flatow, the PI will produce and host the nationally broadcast Science Friday radio program interviewing scientists and engineers in a lively engaging format. In addition, the Science Friday digital media team will be producing and inviting others to create and post digital content and commentary on the Science Friday web site for further dissemination through Second Life, Facebook, as well as other emerging networking platforms. The evaluation will use a quasi-experimental design to study the appeal of both the radio broadcasts and the cyber-platforms with both older and younger audiences. Proposed audience impacts include increased STEM knowledge, interest, and behaviors. Partner organizations include the Self Reliance Foundation, the New York Hall of Science, LA Theatreworks, and Tribeca Film Festival.
The Coalition for Watershed Education, consisting of the Land Access Information Association, Great Lakes Children's Museum, Interlochen Public Radio and Northwestern Michigan College Great Lakes Studies Institute will implement a comprehensive science education project for youth and adults. The major components include: Watershed Discovery field experiences, Soundscapes radio broadcasts, Waterscapes exhibits, a project website, and the expanded Great Lakes Coalition for Watershed Education. Watershed Discovery is a field-based experience for youth ages 11-17. Teams of 6-10 youth will work with mentors who specialize in GPS, GIS, geology and geography to research and collect data on the Great Lakes watershed. These students will also use their new knowledge to produce radio segments as part of the Soundscapes component. Youth teams will be trained to interview sources, gather information and write scripts for use on the local National Public Radio affiliate. The Great Lakes Children's Museum will design a permanent, interactive watershed of 1,500 square feet, as well as a traveling exhibit of 500 square feet for visitors ages 7-12. Other deliverables include "A Community Guide to Watershed-based Science Education" (available in print and CD-ROM), a one-day regional dissemination conference, and an interactive website. Strategic impact will be realized through the development of a novel model for watershed education, its subsequent replication and summative evaluation outcomes. It is estimated that over 40,000 children will be reached by this community-wide initiative.
The PBS NewsHour STEM Learning project is a broadcast and online science journalism and informal science education initiative to report breaking science news and cutting-edge STEM (Science, Technology, Engineering and Mathematics) research and researchers to a national audience. The multi-platform project goals are to: (1) increase and improve the knowledge of the audience with respect to science and technology; (2) stimulate the active engagement of the audience with science and technology through interactive tools; and (3)position the PBS NewsHour as a regular destination for in-depth and innovative science reporting; (4) deploy new and creative digital tools to extend the impact of NewsHour science reporting, especially for youth. The PBS NewsHour is produced by MacNeil/Lehrer Productions and distributed by PBS to PBS television and radio stations across the country, five nights per week. This project is informed by an expert advisory board and other consultants. Project evaluation will be conducted by City Square Associates. The formative evaluation in year one will employ focus groups of adults from the general audience and teens as well as a quantitative survey online to determine a benchmark of current science knowledge, attitudes and behaviors. The evaluation in year two will test digital components of the project in a usability lab setting to gather information to help improve the quality and effectiveness of these deliverables. The summative evaluation will administer a tracking study with the same population surveyed in the first year. Deliverables include: a minimum of 26 science documentary reports broadcast per year plus additional in-studio interviews and coverage of breaking science news; a revamped website, notably "Science and Tech To Go"; a weekly STEM interview or report online featuring Hari Sreenivasan or other reporters; additional weekly digital STEM reporting; and an expanded and redesigned outreach program for teens and educators including an innovative, cloud-based student editing and content-sharing initiative in collaboration with several science centers. Six new PBS NewsHour Student Reporting Labs, established in high-need urban schools, will shoot, edit, and post their videos on the web. The PBS NewsHour science reports will be broadcast and featured on the NewsHour iPhone app, as well as disseminated on the NewsHour's YouTube Channel, Disqus and UStream, Hulu.com, with new science material updated daily on the web. The NewsHour is seen by more than 7 million viewers each week, with additional audiences being reached by radio, the Online NewsHour website, podcasts, and other social media. New community-based programs expand the audience farther. The final summative report will outline the impact of the project and identify the strategies and tactic found to be most effective in making use of digital media to support project goals.
This project will engage underserved Native and non-native youth and adults in environmental science content and awareness through innovative exhibitions and hands-on activities. Traditional ecological knowledge (TEK) and western science will be communicated and promoted within culturally relevant contexts as valuable, complementary ways of knowing, understanding, and caring for the world. The Oregon Museum of Science and Industry (OMSI), the lead institution, and its partner organizations, The Indigenous Education Institute (IEI), The National Museum of the American Indian (NMAI), the Tramastklikt Cultural Institute, the Confederated Tribes of the Umatilla Indian Reservation, the Hibub Cultural Center and Natural History Preserve (Tulalip Tribes) will work collaboratively to develop and deliver all aspects of the project. An estimated 1.5 million Native American and non-Native American youth and adults are expected to be engaged in the project\'s exhibits, website, and activity kits over the five year duration of the project. Native American and non-Native American youth (ages 11-14) and their families from the Portland area and visitors to national science centers, tribal museums, and members of Native American organizations and service providers will be targeted for participation in Generations of Knowledge activities. In addition, the Professional Collaborative component will bring professionals from the partnering organizations to share resources, professional opportunities, and document their collaborative process. OMSI, project partners, Native scientists, tribal museum partner, exhibit developers, advisors, and members of various Native American communities will work collaboratively to develop four integrated deliverables. Each deliverable will be interconnected and designed to accommodate a variety of venues and audiences. Project deliverables include: (a) a 2,000 sq ft traveling exhibition, (b) a small traveling graphic panel exhibition, (c) an online virtual exhibition, (d) an activity kit for Native youth in informal and formal settings, and (e) opportunities and resources for reciprocal collaboration between ISE and Native American partners through a professional collaborative initiative. IEI and advisors from RMC Research and Native Pathways will conduct the external evaluation using a mixed method, community-based participatory research (CBPR) approach. Formative and summative evaluative data will be used to monitor, assess, and inform the project and the extent to which project goals have been met and the intended impacts achieved. The anticipated project outcomes include (but not limited to): (a) an awareness and understanding of the interconnectedness of TEK and western science, (b) a recognition of the relevancy and value of TEK and western science for understanding and caring for the natural world, (c) intergenerational learning and discussions about related TEK and western science issues, and (d) an increased capacity, supported by evidence, among the project team and partners to facilitate reciprocal collaborative efforts. This project builds on a long history of successful NSF/DRL supported work led by OMSI and IEI. It also extends existing traditional ecological knowledge focused work through a culturally contextualized hands-on traveling and virtual exhibitions, a rigorous professional development component, highly visible national partners (e.g., NMAI), and a national reach to over one million Native American and non-Native American youth and adults over a five year period. The project\'s research and evaluation findings will add to the knowledge base on strategies that can be employed to communicate and promote TEK and western science as complementary, valuable was of understanding and caring for the natural world.
The objective of this youth media project is to provide 14-24 year olds with training and hands-on experience in engineering, and the physical and biological sciences. The project is designed around core practices that engage youth in original research and inquiry through experimentation, development, and creative use of new technologies and tools to communicate STEM to the public. Youth Radio project participants in Oakland, CA, Atlanta, GA and Washington, DC include 540 youth, 80% of whom are low-income and/or youth of color, plus another 400 youth via off-site outreach in schools and community centers. Core deliverables include: (1) "Brains and Beakers," eight live events per year where a visiting STEM researcher brings his/her work out of the lab and onto the stage at Youth Radio facilities, demonstrating key principles and discoveries and interacting with youth participants; (2) "Youth Radio Investigates," an annual 6-part multimedia series, where youth partner with university and industry-based researchers to explore the veracity of scientific claims applied to products and services and they use every day; (3) The "Application Development Lab," where youth develop, create and disseminate online embeddable and downloadable applications (12 annually) that serve real needs in youth communities. The digital media produced by the youth will be broadcast by National Public Radio and distributed online through various sites including iTunes and BoingBoing.net, one of the most frequently visited technology-focused sites on the web. Project advisors include STEM researchers in universities as well as highly experienced and successful new media technology developers. Project partners include National Public Radio, KQED, the California Academy of Sciences, and the Oakland Unified School District. This project builds on the successful prior work (NSF #0610272) that initiated a Science and Technology program within the Youth Radio organization. The summative evaluation by Rockman et al will measure how the program affects students' science and technology knowledge, skills, and attitudes. It will build on the evaluation from the prior NSF funded project (#0610272) that highlighted the organizational and staff growth processes as Youth Radio discovered how to design and implement successful, sustainable STEM programs. Rockman will evaluate the new programs (Youth Investigates, Brains and Beakers, and the Application Lab), measuring the following STEM-related student outcomes/impacts: perceptions of selves as producers/creators of science or technology; attitudes toward science and perceptions of scientists; understanding the process of scientific inquiry and research and/or technology skills development; and understanding or interest in careers in science or technology (based on National Research Council report, 2009). Data will be collected from the youth at the Oakland site and from the other Youth Radio bureaus to determine which aspects of the program transfer to multiple sites and which ones are unique to a specific location or set of circumstances. Methods include surveys of student attitudes, participant focus groups, interim assessments, objective skills assessments, and interviews. This project provides an innovative new model for collaborations between STEM researchers and under-represented youth resulting in digital media that impacts the youth as well as the public's understanding and engagement in science.
This project is designed to bridge the "public understanding of science" radio model with a "public engagement with science" approach using a new public media tool - the "Public Insight Network". Radiolab, an innovative hour-long radio program has developed a highly innovative and successful format over the past 5 years that fosters interest and understanding in STEM based on audiences' natural curiosity. It has exposed non-science attentive listeners to transformative STEM concepts such as Stochasticity (physics, statistics, neuroscience), Musical Language (behavioral science, neurology, acoustics) and Space (mathematics, astronomy, technology, engineering). This project will expand the model using innovative online strategies that will connect listeners with working scientists, with each other and with the Radiolab hosts. This new model is grounded in the direct interaction of audiences and scientists which positions listeners as active creators and curators of content rather than passive recipients. The target audience is young adults 18 years old and above. Key organizational partners are The Public Insight Network (and their affiliation with the National Academies of Science), American Public Media, the Borough of Manhattan Community College and Brooklyn College. Project deliverables include 30 hour-long Radiolab programs for broadcast on public radio stations; interactive, user generated articles for the web site; live online chats, engagement "apps" for mobile smart phones; and live events at college campuses and science centers. In addition, the project will implement a mentorship program to train college-aged underrepresented students that have demonstrated an interest in science and/or science journalism. Formative evaluation will gather actionable information from audiences and scientists than can inform the design of the deliverables.The summative evaluation will assess the success of the strategy for engaging audiences in ongoing science learning. Audiences are projected to increase from the current base of 1 million radio listeners per season and 2 million podcast downloads per month. The intended learning outcomes for the audience include their gaining greater knowledge and exposure to current scientific research, and increased engagement by becoming participatory learners through online interactions with science professionals and other listeners.
DATE:
-
TEAM MEMBERS:
Ellen HorneJad AbumradRobert KrulwichSoren Wheeler
TERC is partnering with the Toxics Action Center to enhance the capacity of environmental organizations to teach mathematical literacy skills to low-income citizens, mostly women of color. Secondary collaborators include four environmental organizations around the country. The project is (1) developing math- and statistics-rich educational materials that help non-scientists interpret environmental test results, (2) developing training materials that help environmental organization personnel provide quantitative literacy training to citizens, (3) helping environmental organizations institutionalize project resources, and (4) evaluating the impact of project activities on environmental organizers, community members, and the general public. Project deliverables include bilingual, print- and web-based instructional materials (including videos) for environmental organizations to use with staff and community members; training sessions to create a cadre of environmental organization leaders who can conduct environment-focused, math training workshops; a communications toolkit for dissemination to journalists who cover environmental issues; and a resource-rich project web site.
This multimedia project tells the human story of the long, continuing quest to identify, understand, and organize the basic building blocks of matter leading to the Periodic Table of Elements. Project deliverables include a two hour PBS documentary; a website on the Periodic Table and discovery of the elements; a Teacher\'s Guide; and an Outreach Plan led by the St. Louis Science Center and nine other science centers. The target audiences are adults with an interest in science, inner-city youth, and high school chemistry teachers and their students. Partners include Moreno/Lyons Productions, the American Chemical Society (ACS), the Chemical Heritage Foundation; the St. Louis Science Center; and Oregon Public Broadcasting. The national broadcast and outreach activities are intended to complement the International Year of Chemistry (IYC) 2011, furthering the opportunity to enhance the public understanding of chemistry. The goal of the project is to reveal science as an intensely human process of discovery through stories of some of the greatest scientists. The two-hour PBS special will tell a "detective story" of chemistry, stretching from the ancient alchemists to today's efforts to find stable new forms of matter. Among key characters will be Joseph Priestley, Antoine Lavoisier, Humphry Davy, Dmitrii Mendeleev, Marie Curie, Harry Moseley, and Glenn Seaborg. The program will show both their discoveries and the creative process, using reenactments shot with working replicas of their original lab equipment. Interwoven with history will be segments on modern chemical research and the real-world consequences of the discoveries. A two-part Outreach Plan is aimed at engaging inner-city youths through a network of ten science centers led by the St. Louis Science Center and at reaching a broader audience through events, activities, and publications offered by ACS during National Chemistry Week and IYC 2011. The television program is projected to reach three million viewers during its multiple broadcasts over premiere week, increasing to five million or more with subsequent repeat broadcasts and DVD distribution. It is estimated that 6,500 underrepresented urban teens will participate in the hands-on activities in the ten science centers during IYC 2011. The website is intended to become a resource extending the reach and impact of the project for a decade or more. The summative evaluation will assess the extent to which the project accomplishes the goals of enhancing public understanding of chemistry, affecting public attitudes toward chemistry and chemists, and improving the understanding of the nature of science. Three studies will be conducted. The first will be an in-depth evaluation of the program and Web site with a sample of 150 adult PBS viewers using a two-group post-test randomized study design. The second study will evaluate the outreach effort with diverse audiences at the local level prior to and during National Chemistry Week using on site observations, surveys, and interviews to capture participant feedback at local events. The third study will evaluate high school educators' use of the Teacher's Edition & Guide.
'TV411 What's Cooking?' provides adults with low levels of literacy and numeracy with access to a free multi-media resource which delivers mathematics and science content in the form of an online cooking show. This series builds on a prior NSF planning grant (DRL 07-75623) and the research-based design of the TV411 educational materials while addressing biochemical, physical, and mathematical processes that occur in cooking and daily life. The project will be managed by the Education Development Center's Adult Literacy Media Alliance (ALMA) project, in partnership with the Public Internet Channel, a New York-based Head Start Program, and formal education partners. The project's goals are to raise awareness of math and science content in daily life, overcome negative attitudes and behaviors related to science learning, and increase knowledge, vocabulary, and skills related to science and math while building capacity to use informal science education resources. Additional goals are to increase the capacity level of adult educators and informal workshop facilitators to teach basic math and science concepts. Finally, the project is designed to research strategies in which low-literacy adult learners utilize informal math and science resources in a Web 2.0 environment. Deliverables include six video segments that embed basic literacy and numeracy concepts in a cooking show format, 12 interactive web activities including games and simulations, and a reconstructed TV411 Online website with Web 2.0 features. In year 2, Spanish language videos and web lessons, customized toolkits for The Public Internet Channel, workshop materials for parents, and articles and reports for dissemination to education and informal learning networks nationwide are produced. The videos will be distributed on TV411 Online and the Public Internet Channel (pic.tv). The mixed-methods evaluation addresses four impact categories (awareness, engagement, attitudes, and behavior). An embedded evaluation approach will be used to determine knowledge gains, while behavioral and attitudinal questions will be asked separately in two web surveys given to random sample of 500 website visitors. Interviews are used to determine teacher perceptions of usability and effectiveness of materials. 'TV411 What's Cooking?' is projected to attract 1.5 million website visitors in the first year and an additional 500,000 each subsequent year. This well-researched project advances adult literacy and numeracy, while providing students participating in GED, adult basic education, and informal community-based programs with engaging STEM content.