The summative evaluation focuses on two project components: (1) an IMAX® Dome film, titled Coral Reef Adventure, and (2) an associated interactive exhibit, titled Weird, Wild and Underwater, intended to be displayed in museum and science center lobbies. The general goals for the summative evaluation study were to assess the appeal of "Coral Reef Adventure" film and the lobby exhibit; acquisition of scientific knowledge and understanding as related to the project’s learning goals and understanding of film topics; and the impact that the exhibit has on viewers of the film. A separate-sample
This project will develop standardized, exportable and comparable assessment instruments and models for Women In Engineering (WIE) programs nationwide, thus allowing them to assess their program's activities and ultimately provide data for making well-informed evaluations.
To accomplish this goal, the principal investigators at the University of Missouri and Penn State University will work over a three-year period with their institutions' WIE programs and three cooperating programs at Rensselaer Polytechnic Institute, Georgia Tech, and University of Texas at Austin. With these five programs that collectively represent a variety of private and public, years of experience for WIE directors and student body characteristics, the investigators will pilot, revise, implement, conduct preliminary data analysis and disseminate easy-to-access, reliable and valid assessment instruments. The principles of formative evaluation will be applied to all instruments and products. All institutions will use the same set of instruments, thus allowing them to have access to powerful benchmarking data in addition to the data from each of their respective institutions.
A prior project, the Women's Experience in College Engineering Project (WECE) sought to characterize the factors that influence women students' experiences and decisions by studying college environments, events and support programs that affect women's satisfaction with their engineering major, and their decisions to persist or leave these majors. In contrast to WECE's macro-level and student focus, this proposal's target audience is WIE directors, with a focus on WIE programs, not students.
Women in Engineering programs around the United States are a crucial part of our country's response to the need for more women in engineering professions. There are about 50 WIE programs nationwide. Half have expressed interest in this effort. WIE directors will benefit by having ready-made assessment tools that will allow them to collect data on programs, evaluate these programs, and make decisions on how to revise programs and / or redistribute limited resources to maximize overall program effectiveness. Data from these instruments will also provide substantiated evidence for administrators, advisory boards and potential funding agencies. Finally, because these instruments will be available nationwide, programs will have the opportunity to take advantage of powerful benchmarking data for their decision-making processes.
This project provides the next logical step in the national movement to recruit and retain women in engineering.
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk radio show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the first study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ future increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not
One method for studying visitors in museums is to audiotape their conversations while videotaping their behavior. Many researchers inform visitors of such recordings by posting signs in the areas under scrutiny. An earlier study tested the assumption that visitors notice, read and understand posted signs (Gutwill, 2003). Interviews revealed that 75 percent of visitors leaving a recording area had read and understood the signs. This article describes our attempt at increasing this percentage by placing additional signs on the exhibit elements being used, as well as on the camera itself
This article describes an exhibit evaluation project at the San Diego Natural History Museum, funded by NSF in 2001, which took a participatory approach to better understand their audience. The authors, two participants in this project, discuss their motivations and goals, useful models and lessons learned from a special needs focus group.
Produced by Thirteen/WNET New York and Nelvana International, the Award-winning series CYBERCHASE is the only mathematics series for children on American television. Designed for kids ages 8 to 12 and packed with mystery, humor, and action, each episode delivers positive messages about math by teaching concepts in a fun way that kids can understand. The goal of this formative evaluation for Season 3 evaluation was two-fold: 1) to observe and assess the performance of third-graders on tasks related to two math topics in development for Season 3 (Angle & Distance and Logic & Reasoning) and 2) to
This formative evaluation gathered feedback from parents and their fourth grade children in response to two activities included in the Cyberchase at Home outreach materials. The user-based feedback assisted with the design of new outreach materials. The general goals for the research were to explore reactions to the activity card format; assess appeal and difficulties in implementation of two activities; estimate comprehension of activity content; and evaluate parental interest in further activities and workshops. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS
The goal of this evaluation was to assess issues of user friendliness, appeal and comprehension related to the Cyberchase website’s homepage, web adventures, weekly polls and games. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS GO! using broadcast, web, new media and educational outreach to impact millions nationwide. Designed for children ages 8 to 11 and packed with mystery, humor, and action, Cyberchase’s mission is to improve kids' problem-solving and math skills, and inspire them with confidence and enthusiasm toward math. The TV series airs daily on PBS
DATE:
TEAM MEMBERS:
Barbara FlaggSandra SheppardCarey BolsterMichael TempletonThirteen/WNET
Produced by Thirteen/WNET New York and Nelvana International, the Award-winning series CYBERCHASE is the only mathematics series for children on American television. Designed for kids ages 8 to 12 and packed with mystery, humor, and action, each episode delivers positive messages about math by teaching concepts in a fun way that kids can understand. To assess the impact of Cyberchase on children's mathematical problem solving, MediaKidz Research & Consulting conducted summative research using an experimental/control, pretest/posttest design. Participants were 108 third- and fourth-grade
The first phase of the evaluation, a front-end visitor study, assessing visitors' knowledge of and interest in space science and the cosmos, was conducted in May and June of 2000 at Boston's Museum of Science (MOS). The evaluation's second phase, a formative evaluation of the exhibition prototype, was completed in February of 2001 at the MOS. This summative report represents the third round of the evaluation process conducted by PERG, and is an evaluation of the current Cosmic Questions exhibition and related activities, based on data obtained by evaluators at two sites Boston's Museum of
DATE:
TEAM MEMBERS:
Joan KarpJudah LeblangSusan Baker CohenHarvard-Smithsonian Center for Astrophysics
This formative evaluation gathered feedback from after-school group leaders and their 3rd-5th grade youth in response to two activities included in the Cyberchase Workshops-In-A-Box. The user-based feedback will assist with the design of new after-school materials. The general goals for the research were:To explore reactions to the workshop guide generally To assess appeal of the two activities To pinpoint difficulties in the implementation of the two activities To estimate comprehension of the activity content.To evaluate leader interest in further activities.Cyberchase is the Emmy Award
This formative evaluation gathered feedback from teachers and their fourth grade children in response to two activities included in the Cyberchase Teachers' Guide. The user-based feedback will assist with the design of new school-based materials. The general goals for the research were to explore reactions to the guide; assess appeal and difficulties in implementation of two activities; estimate comprehension of activity content; and evaluate teacher interest in further activities. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS GO! using broadcast, web, new