August, 2009 Communities of Effective Practice, 2008-2009 Evaluation Abstract: The Communities of Effective Practice (CEP) project is a National Science Foundation (NSF)-funded project to develop a professional development model for supporting math and science instructional practices that are culturally responsive within American Indian communities. This report summarizes findings from the Year 3 evaluation (conducted during the 2008-2009 academic year) and discusses these findings within the context of the Years 1 and 2 evaluations. It presents key considerations for developing a Community
DATE:
TEAM MEMBERS:
Gina MaghariousKasey McCrackenUtah State University
Grossology Live! was a creative and innovative program that involved unique format, content, and collaboration. The program used live video-conferencing techniques to create two-way interaction between onscreen actors in a colorful Grossology set in the studio in Noblesville, Indiana; uniquely imaginative comedic and musical presentations on the human body; and a live presenter, stage set, and audience at 5 small science or health centers primarily in the mid-west and southeast. The receiving sites were members of the National Association of Health Education Centers (NAHEC), which played a
In 2008, Goodman Research Group, Inc. (GRG) conducted summative evaluation of Absolute Zero, a collaborative effort of the University of Oregon's Cryogenic Helium Turbulence Laboratory and Twin Cities Public Television. The films were produced by Meridian/Windfall Productions, Washington DC, and/Windfall Films in London, UK. Outreach was spearheaded by Devillier Communications, Inc. The Absolute Zero project was centered on a two-part documentary about low-temperature physics, which aired on PBS/NOVA in early January 2008, as well as an outreach campaign, which included approximately 20
DATE:
TEAM MEMBERS:
Irene GoodmanUniversity of OregonLaura HousemanMarianne McPherson
This Pathways Project connects rural, underserved youth and families in Eastern Washington and Northern Idaho to STEM concepts important in sustainable building design. The project is a collaboration of the Palouse Discovery Science Center (Pullman, WA), Washington State University and University of Idaho, working in partnership with rural community organizations and businesses. The deliverables include: 1) interactive exhibit prototype activities, 2) a team cooperative learning problem-solving challenge, and (3) take-home materials to encourage participants to use what they have learned to investigate ways to make their homes more energy-efficient and sustainable. The project introduces youth and families to the traditionally difficult physics concept of thermal energy, particularly as it relates to sustainable building design. Participants explore how building materials and their properties can be used to control all three types of heat transfer: conduction, convection, and radiation. The interactive exhibit prototypes are coupled with an Energy Efficient Engineering Challenge in which participants, working in cooperative learning teams, use information learned from the exhibit prototype activities to retrofit a model house, improving its energy efficiency. The project components are piloted at the Palouse Discovery Science Center, and then travel to three underserved rural/tribal communities in Northern Idaho and Eastern Washington. Front-end and formative evaluation studies will demonstrate whether this model advances participant understanding of and interest in STEM topics and careers. The project will yield information about ways that other ISE practitioners can effectively incorporate cooperative learning strategies in informal settings to improve the transferability of knowledge gained from exhibits to real-world problem-solving challenges, especially for rural and underserved audiences. This project will also provide the ISE field with: 1) a model for increasing the capacity of small, rural science centers to form collaborative regional networks that draw on previously unused resources in their communities and provide more effective outreach to the underrepresented populations they serve, and 2) a model for coupling cooperative learning with outreach exhibits, providing richer experiences of active engagement.
Vital Signs a community-based education program that links middle school students, citizen scientists, and scientists in the collection and analysis of environmental data related to invasive species. Vital Signs leverages technology to enable students to practice scientific inquiry, collect rigorous and consistent data, share the data and knowledge they have collected, and to serve as a distributed data collection network for the scientific community.
The Virginia Master Naturalist program is a corps of well-trained volunteers conducting natural resource education, citizen science, and stewardship projects in their communities for the Commonwealth of Virginia.
DATE:
TEAM MEMBERS:
Michelle PrysbyVirginia Department of Conservation and RecreationVirginia Department of Game and Inland FisheriesVirginia Department of ForestryVirginia Museum of Natural History
In the Spring of 2003, Rockman et al conducted an evaluation that was designed to explore children's viewing behavior, outcomes of viewing, the impact of the program's structural features, viewers' content preferences, and factors that motivate greater participation by viewers. Nearly six hundred children and twenty-five adults in three major U.S. cities participated in this study. Evaluation activities included: Five sets of student surveys: one administered prior to viewing episodes of DragonflyTV, one following each of the three programs viewed as part of the evaluation, and one
DATE:
TEAM MEMBERS:
Rockman, et. al.Twin Cities Public TelevisionJennifer Borland
Green City Data is an after-school community service project. Teams of secondary students are trained to inventory urban natural areas selected by regional resource planning agencies to supplement their own data collection efforts. Representatives from seven agencies and educational institutions initiated this project to support development of a system of greenspaces within the Portland, Oregon/Vancouver, Washington metropolitan area. This consortium includes expertise in resource management, geography, biology, computer telecommunications, science education and community coordination. These and other community professionals tech students and volunteer team leaders (teachers or other adults) the basics of habitat identification and mapping in the context of regional planning. ***
DATE:
-
TEAM MEMBERS:
Gail WhitneyMichael HouckJames GillenJoseph PoracskyEllen Lanier-Phelps
Glaciers: A Chronology of Climate Change is a CRPA project that seeks to explain the historical cycling of glaciers in the context of climate change. By using chemical isotopes (Beryllium 10), the age of rocks that have been covered with glacier ice and exposed to sunlight later can be determined fairly accurately. Through this method, the glaciation cycles have been determined for the last 70,000 years. In collaboration between the Lamont-Doherty Earth Observatory at Columbia University and the American Museum of Natural History (AMNH), this project is designed to impact adult audiences, youth in grades 6th-12th, and teachers writ large. The research results shall be expressed via an eight-minute high definition film for large screen viewing in the \"Science Bulletins\" section of the AMNH and the affiliated museums. A rigorous front-end evaluation will be used to inform the presentation and assess audience impact. Subsequent formative evaluations are designed to measure the learning impact of the film and the retention of longer term concepts. It is anticipated that more than 700,000 individuals will have access to current, scientifically accurate data and related information on glaciation cycles and climate change through the educational film and website. Materials will be easily accessible to teachers and the film will be closed captioned in both English and Spanish.
DATE:
-
TEAM MEMBERS:
Joerg SchaeferGeorge DentonMichael Kaplan
The PBS NewsHour STEM Learning project is a broadcast and online science journalism and informal science education initiative to report breaking science news and cutting-edge STEM (Science, Technology, Engineering and Mathematics) research and researchers to a national audience. The multi-platform project goals are to: (1) increase and improve the knowledge of the audience with respect to science and technology; (2) stimulate the active engagement of the audience with science and technology through interactive tools; and (3)position the PBS NewsHour as a regular destination for in-depth and innovative science reporting; (4) deploy new and creative digital tools to extend the impact of NewsHour science reporting, especially for youth. The PBS NewsHour is produced by MacNeil/Lehrer Productions and distributed by PBS to PBS television and radio stations across the country, five nights per week. This project is informed by an expert advisory board and other consultants. Project evaluation will be conducted by City Square Associates. The formative evaluation in year one will employ focus groups of adults from the general audience and teens as well as a quantitative survey online to determine a benchmark of current science knowledge, attitudes and behaviors. The evaluation in year two will test digital components of the project in a usability lab setting to gather information to help improve the quality and effectiveness of these deliverables. The summative evaluation will administer a tracking study with the same population surveyed in the first year. Deliverables include: a minimum of 26 science documentary reports broadcast per year plus additional in-studio interviews and coverage of breaking science news; a revamped website, notably "Science and Tech To Go"; a weekly STEM interview or report online featuring Hari Sreenivasan or other reporters; additional weekly digital STEM reporting; and an expanded and redesigned outreach program for teens and educators including an innovative, cloud-based student editing and content-sharing initiative in collaboration with several science centers. Six new PBS NewsHour Student Reporting Labs, established in high-need urban schools, will shoot, edit, and post their videos on the web. The PBS NewsHour science reports will be broadcast and featured on the NewsHour iPhone app, as well as disseminated on the NewsHour's YouTube Channel, Disqus and UStream, Hulu.com, with new science material updated daily on the web. The NewsHour is seen by more than 7 million viewers each week, with additional audiences being reached by radio, the Online NewsHour website, podcasts, and other social media. New community-based programs expand the audience farther. The final summative report will outline the impact of the project and identify the strategies and tactic found to be most effective in making use of digital media to support project goals.
The University of Minnesota is partnering with several nature centers in the Midwest to transform citizen "technicians" into citizen "scientists." The Driven to Discover project will use existing citizen science programs with strong educational components to engage 12-14 year old youth and their adult mentors in authentic research. The goal of the project is to develop a training model for adults who work with youth in a variety of informal education settings to involve them in authentic scientific inquiry via citizen science rather than just data collection activities. In the proof-of-concept phase, teams consisting of 4-H youth, adult leaders, and several scientists are conducting participatory action research to understand what factors lead youth to full engagement in ecological research. In phase two, project personnel are training 4-H educators, naturalists, and teachers how to engage youth and their adult leaders in other 4-H programs and other informal education programs to conduct ecological research with scientists in advisory roles. Phase one involves approximately 10 adults and 70 youth, whereas phase two involves approximately 40 adults and 300 youth. A front-end study defined the project's target audiences and partners. Formative evaluation study will monitor interactions among members of the research teams and summative evaluation will measure impacts on participants' knowledge, skills development, attitudes, and behavior. Project deliverables include youth-generated ecological research findings, web-based program implementation materials, an annual conference, and a model for engaging youth groups in informal settings in authentic scientific inquiry. The model is expected to impact more than six million youth nationwide.
DATE:
-
TEAM MEMBERS:
Karen OberhauserNathan MeyerAndrea Lorek StraussPamela NippoltKatie ClarkRobert Blair
resourceprojectProfessional Development, Conferences, and Networks
The University of Minnesota and the University of Florida are collaborating on the creation of a Master Naturalist Program for adults that will serve as a model for nationnwide dissemination. This program, which builds on the existing Florida Master Naturalist Program, will provide intensive 40-hour training sessions in ecology, natural/cultural history and the environment for volunteers in Minnesota. Participants will then complete 40 hours of supervised volunteer service at local natural history centers while volunteers in both Florida and Minnesota will have the option of participating in advanced training workshops. Staff members at informal science education institutions and natural history centers take part in train-the-trainer workshops to assist with dissemination. Deliverables include three training modules (Big Woods, Big Rivers; Prairies and Potholes; North Woods, Great Lakes), advanced training workshops, local Master Naturalist Chapters, annual conferences, training materials and workshops for Master Naturalist Instructors, and a project website. It is anticipated that this project will result in the implementation of 64 Master Naturalist workshops, directly reaching 1,280 volunteers, while 750 participants are anticipated for advanced training workshops. It is estimated that 130 staff will participate as Master Naturalist Instructors. Indirect impacts will be realized as volunteers contribute more than 51,000 hours in service to nature centers and informal science institutions interacting with public audiences while conducting natural history activities. Strategic impact will be realized in the outcomes of the comprehensive evaluation plan that will assess immediate and longitudinal impacts on public and professional audiences.
DATE:
-
TEAM MEMBERS:
Robert BlairMartin MainAmy RagerKaren Oberhauser