Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the
Summary of Findings Summative Evaluation Cielo y Tierra Noticias del Mundo Robert L. Russell, Ph.D. Learning Experience Design October 2011 Learning Experience Design conducted summative evaluation of the project entitled: Cielo y Tierra Noticias del Mundo (Sky & Earth News of the World). A series of three evaluation sessions were conducted with radio listeners to look at the impacts of the programs on their interest in the topics presented, their understanding of the content presented, and their motivation to take further action. The first two studies used focus group sessions. The third and
DATE:
TEAM MEMBERS:
Robert RussellEarthSky Communications, Inc.Malu Jimenez
Research Questions: (1) To what extent do children's and parent's interest in math and science increase as a result of exposure to one or more of the project's components? (2) To what extent do children and parents want to engage further with Mateo y Cientina after initial exposure to the cartoon through one or more of the project's components? (3) To what extent do parents and children think they've learned new concepts about math and science as a result of completing a Mateo y Cientina activity? (4) To what extent do parents and children gain confidence in their understanding of math and
DATE:
TEAM MEMBERS:
Sarah MushlinUniversity of CaliforniaColleen Kuusinen
"Evolution in Action: Isolation and Speciation in the Lower Congo" is a 9-minute documentary about a team of researchers working to understand what is driving the rapid evolution and speciation of fishes in the Lower Congo River. The evaluation was designed to probe the following: 1) Connection and Interest in the science content 2) Connections between the scientific story and other topics of personal interest 3) Implications of the multilingual versions for disseminating science to the public and to science educators The participants included international education students who work in
DATE:
TEAM MEMBERS:
Maritza MacdonaldAmerican Museum Natural History
ConCiencia News was the first Spanish-language news service in the United States focused exclusively on health, science and environmental news, providing free of cost news stories to a diverse array of Hispanic media including 100+ newspapers and magazines, top Hispanic web portals, and almost 150 Spanish-language radio stations. Each news story features original content developed by SRF journalists, and Hispanic researchers are often features to serve as role models for the public. The summative evaluation focused on two primary audiences for the Spanish-language stories: 1) the professional
The Understanding Race website is informative, varied, accessible, and appealing. It speaks to people with a wide range of ages and backgrounds. It is a clear, understandable treatment of a difficult topic. The site is a rich resource for teachers who can use the content with their classes at varying levels. There is also information for scholars who wish to delve more deeply. No educational resource can please everyone, but this one comes close.
DATE:
TEAM MEMBERS:
Minda BorunS2N MediaAmerican Anthropological Association
WNET is producing "The Human Spark," a multimedia project that includes a four-part television series (4 x 60 min) for national primetime broadcast on PBS, innovative outreach partnerships with museums, an extensive Web site and outreach activities, including a Spanish-language version and companion book. Hosted by Alan Alda, "The Human Spark" will explore the intriguing questions: What makes us human? Can the human spark be found in the differences between us and our closest genetic relative -- the great apes? Is there some place or process unique to the human brain where the human spark resides? And if we can identify it, could we transfer it to machines? The programs will explore these questions through presenting cutting-edge research in a number of scientific disciplines including evolution, genetics, cognitive neuroscience, behavioral science, anthropology, linguistics, AI, robotics and computing. The series will highlight opposing views within each field, and the interdisciplinary nature of science, including its intersection with the humanities. The series will develop a new innovative format, the "muse concept", which involves pairing the host with a different scientific expert throughout each program. The outreach plan is being developed with a consortium of four leading science museums, American Museum of Natural History in New York, Museum of Science in Boston, The Exploratorium in San Francisco, and the Fort Worth Museum of Science and History, paired with their respective local public television stations. An additional six museums and local broadcasters will be chosen through an RFP process to develop local initiatives around the series. Multimedia Research and Leflein Associates will conduct formative as well as summative evaluations of the series and web.
DATE:
-
TEAM MEMBERS:
William GrantJared LipworthGraham CheddBarbara Flagg
The goal of this project is to extend the impact of the nationally broadcast weekly radio program, Science Friday to a new, young audience through the various new cyber-space platforms and interactive tools such as Facebook, Twitter, and Second Life as well as new emerging social networking tools. The STEM content over the course of the two year project will include a wide variety of topics in all disciplines. The relationship between art and science will also be a focus. The NPR radio broadcasts currently reach 1.3 million listeners every week, and that audience is expected to increase. In addition to that audience, this project will target a new audience of adults under the age of 35 using various cyber platforms and new social networking tools such as Second Life, Facebook, YouTube and Twitter. Audiences will also be reached through remote broadcasts from science centers and art centers around the country. Over 30 science centers will use this project's web content on their own web sites, reaching their audiences as well. The web content will be translated into Spanish and widely disseminated to Hispanic audiences. Each Friday afternoon, Ira Flatow, the PI will produce and host the nationally broadcast Science Friday radio program interviewing scientists and engineers in a lively engaging format. In addition, the Science Friday digital media team will be producing and inviting others to create and post digital content and commentary on the Science Friday web site for further dissemination through Second Life, Facebook, as well as other emerging networking platforms. The evaluation will use a quasi-experimental design to study the appeal of both the radio broadcasts and the cyber-platforms with both older and younger audiences. Proposed audience impacts include increased STEM knowledge, interest, and behaviors. Partner organizations include the Self Reliance Foundation, the New York Hall of Science, LA Theatreworks, and Tribeca Film Festival.
Pulse of the Planet children's science challenge includes 150 radio programs which focus on the interaction between a select group of scientists and youths 8-11, who have been chosen from a nationwide Science Challenge which encourages children to submit questions and potential experiments to scientists. Project partners include a variety of businesses (e.g., sports manufacturers such as K2), media (e.g., internet social networks such as imbee.com, TIME for Kids, Dragonfly TV, and Hispanic Communications Network) and educational partnerships (e.g. Community Science Workshops and the National Science Teacher's Association.) Underserved participants will be reached through Celebra la Ciencia science outreach programs.
The Oregon Museum of Science and Industry (OMSI) will partner with the City of Portland's Office of Sustainable Development, Metro Regional Government, Portland Community College, Verde, and the Coalition for a Livable Future, to create a series of informal science education experiences on the theme of Sustainability. For this project, sustainability is defined in terms of a triple bottom line of economic, social, and environmental needs. The project responds to calls for broad environmental education of the public in response to environmental crises (such as climate change), and specific research suggesting that even museums that do provide information about such issues rarely help their visitors learn to make the comparisons necessary to make more sustainable choices. For the public audience, the project team will create a 1,500 sq. ft. bilingual (Spanish/English) exhibition to encourage the public to develop skills in making personal choices that affect the sustainability of their community. They will also create 25-40 bilingual cell phone tags that will provide listeners who dial the phone numbers with information, personal perspectives, current STEM research, invitations to contribute ideas or vote on issues, interactive phone-based activities, and links to websites, all in service of helping them make intentional and informed personal decisions on sustainability. The cell phone tags will be located at approximately 100 locations in the Portland area, including predominantly Hispanic neighborhoods, public transit locations, public works, and community projects. The team will also create a bilingual website and will offer quarterly bilingual events at the museum on the topic of sustainable living. For the professional audience, the team will create a set of tools and indicators for assessing the sustainability of exhibit-development processes, using the triple bottom line of financial, environmental, and social impacts. For example, a Green Exhibit Guide will provide resources and a checklist for exhibit development projects, and will propose field-wide standards analogous to the LEED (Leadership in Energy and Environmental Design) rating system for green buildings. Regional workshops will engage exhibit developers, designers, fabricators, and administrators in using the tools in their own institutions. The project will create a coordinated set of resources to inform the public about the science of sustainability and to engage them in making informed choices in their daily lives, both in the museum and beyond. The topic of sustainability is timely and important, and the use of cell phones as a mobile technology linked to web resources and an exhibition constitute an innovative synergy of media to create impacts on a city-wide scale. The project serves underrepresented Hispanic audiences through its creation of bilingual materials, placement of cell phone tags, and community involvement in the development process. Finally, the project advances the ISE field in proposing and broadly disseminating a set of standards for green exhibit design, along with developing resources and tools for assessing sustainability. Created in collaboration with other organizations, this work has the potential to reduce the environmental impact of museums while providing highly visible examples of sustainable practices for visitors.
This full-scale development project would use a multi-platform approach (TV, Field School, and Web site) to engage public audiences and underserved youth in archaeology research and discovery. The project will advance knowledge and practice in the field of ISE by establishing the utility of archaeology as an entry point to multiple STEM fields showing how it answers important questions about human origins-culture, history, and the natural environment. The target audience includes a broad demographic of viewers who will watch the PBS broadcasts. The other key audience is underserved youth who will participate in the archeology digs and be featured in the national broadcast. They will engage other underserved youth who will have the opportunity to participate in the interactive online virtual field school. Primary organizational partners include the Crow Canyon Archaeology Center in Colorado and other archeology organizations at the 4 field sites. Deliverables include four hours of PBS programming filmed at four archaeological sites telling the stories of diverse cultures (Native American, African American, Hispanic); field schools designed for underrepresented youth both onsite and online; blogs, online discussions, and user-generated videos. The evaluation will determine the impact of the television series, online content, and the on-site Field School on audiences' understanding of, interest in, and interactions around STEM topics within the context of archaeology. Formative evaluation will provide input and help refine the television programs, web site, and field school. The summative evaluation will use a variety of methods and artifacts to determine the degree to which the process of the TV series, web site, and Field School was successful. The television programs are expected to reach 13 million viewers via broadcast, 300,000 via streaming video and 50,000 unique web site visitors. The lessons learned from this project will be disseminated to other media and ISE organizations.
The Herpetology Education in Rural Places & Spaces (HERPS) project is a four-year full-scale development project designed to engage diverse North Carolina residents from the Central Piedmont, Eastern Piedmont, and Inner Coastal Plain regions of the state in conservation and field experiences focused on herpetology, the study of reptiles and amphibians. The project targets rural underrepresented groups in STEM; predominately African-Americans, Hispanics, and Lumbee Native Americans. The University of North Carolina-Greensboro and its partner organizations, Elon University and University of North Carolina-Pembroke, will partner to develop and implement all phases of the project. Ultimately, the project aims to increase knowledge of and interest in herpetology and related conservation issues, provide authentic research experiences, and better understand identity-related motivations and affordances of the casual, regular, and enthusiastic participant across project strands. HERPS builds on four pilot studies and will engage people of all ages in a broad range of herpetological activities including: (a) an annual herpetology-focused community event (HERPS Celebrations), (b) technology resources such as a project website and customized mobile applications (HERPS Cyberhub), (c) summer and year-long herpetological research experiences (HREs) for high school students and teachers, and (d) in-depth longitudinal herpetological study opportunities (e.g., box turtle study). In addition, there is separate but integrated research stand that will focus on identity and HERPS experiences, as settings for informal science learning. The identity research will study: (a) identity-related motivations and (b) identity-related affordances of casual, regular and enthusiastic participants across threads. In addition, an extensive formative and summative evaluation will be conducted using a mixed methods approach by an external evaluator. Using a multiple-entry-points approach for learning and engagement, this project could serve as a replicable model for similar efforts in other settings. In addition, the results of the identity reseach strand could fill a critical gap in the identity and informal science education research bases. With an average estimated reach of nearly 15,000 people of all ages and diverse backgrounds, the potential broader impacts of this project could be extensive.
DATE:
-
TEAM MEMBERS:
Catherine MatthewsAndy AshTerry TomasekAnn SomersHeidi Carlone