This project will develop standardized, exportable and comparable assessment instruments and models for Women In Engineering (WIE) programs nationwide, thus allowing them to assess their program's activities and ultimately provide data for making well-informed evaluations.
To accomplish this goal, the principal investigators at the University of Missouri and Penn State University will work over a three-year period with their institutions' WIE programs and three cooperating programs at Rensselaer Polytechnic Institute, Georgia Tech, and University of Texas at Austin. With these five programs that collectively represent a variety of private and public, years of experience for WIE directors and student body characteristics, the investigators will pilot, revise, implement, conduct preliminary data analysis and disseminate easy-to-access, reliable and valid assessment instruments. The principles of formative evaluation will be applied to all instruments and products. All institutions will use the same set of instruments, thus allowing them to have access to powerful benchmarking data in addition to the data from each of their respective institutions.
A prior project, the Women's Experience in College Engineering Project (WECE) sought to characterize the factors that influence women students' experiences and decisions by studying college environments, events and support programs that affect women's satisfaction with their engineering major, and their decisions to persist or leave these majors. In contrast to WECE's macro-level and student focus, this proposal's target audience is WIE directors, with a focus on WIE programs, not students.
Women in Engineering programs around the United States are a crucial part of our country's response to the need for more women in engineering professions. There are about 50 WIE programs nationwide. Half have expressed interest in this effort. WIE directors will benefit by having ready-made assessment tools that will allow them to collect data on programs, evaluate these programs, and make decisions on how to revise programs and / or redistribute limited resources to maximize overall program effectiveness. Data from these instruments will also provide substantiated evidence for administrators, advisory boards and potential funding agencies. Finally, because these instruments will be available nationwide, programs will have the opportunity to take advantage of powerful benchmarking data for their decision-making processes.
This project provides the next logical step in the national movement to recruit and retain women in engineering.
With support from the National Science Foundation, Denver Museum of Nature and Science and Thomas Lucas Productions have produced a planetarium show entitled, Black Holes: The Other Side of Infinity. The 20-minute full-motion program uses scientific simulations and data-based animations to illustrate the death of stars and the birth and characteristics of black holes.
Multimedia Research implemented a one-group pretest-posttest summative evaluation focused on appeal to and impact on upper elementary school students. Participating fourth graders (n = 104) and fifth graders (n = 64) were
With support from the National Science Foundation, Denver Museum of Nature and Science and Thomas Lucas Productions have produced a planetarium show entitled, Black Holes: The Other Side of Infinity. The 20-minute full-motion program uses scientific simulations and data-based animations to illustrate the death of stars and the birth and characteristics of black holes.
Multimedia Research implemented a quasi-experimental separate-sample pretest/posttest summative evaluation to evaluate the show in its natural theater setting. A random sample of 126 adults and teens completed questionnaires
Talk of the Nation: Science Friday is a weekly two-hour listener call-in talk show devoted to the understanding of complex scientific topics and methods. The series is hosted by science correspondent Ira Flatow. With support from the National Science Foundation, Multimedia Research presents the second study of a two-part summative evaluation on the impact of Science Friday on public radio listeners, focusing on the series’ increased emphasis on public understanding of basic research. The evaluation assessed what demographic or background characteristics relate to whether or not one listens to
This paper reports findings from a study at the Exploratorium of a single physics exhibit that compared three labels and assessed visitors' attitudes and behavior. Based on interviews with 60 visitors, evaluators found a preference for labels containing both questions and suggestions, but that this type of phrasing may not always affect visitor behavior.
The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley
Goodman Research Group, Inc. (GRG) conducted front-end evaluation of New Earth Explorers, a four-part science documentary series developed by Earth Images Foundation. The project's goal was to create a series that would target prime time PBS viewers with an aim to present information about earth science and relevant current research in a way that is engaging for viewers. In addition to the series, the project intended to develop related outreach with the intent of increasing STEM learning and promoting an understanding and appreciation of the earth sciences as an interesting field and
This report presents the findings of a summative evaluation of the Conservatory for Botanical Science, conducted by Randi Korn & Associates, Inc. (RK&A), for the Huntington Botanical Gardens in San Marino, California. The Conservatory exhibits and this evaluation were funded by the National Science Foundation. Data collection took place in December 2005. The summative evaluation examined visitors’ affective and cognitive experiences in the Conservatory, using exit interviews and focused observations and interviews at select exhibits.
DATE:
TEAM MEMBERS:
Johanna JonesHuntington Botanical Gardens
During half-hour sessions, four third grade girls and four third grade boys from a Long Island elementary school were observed individually while playing an early prototype of a computer game called 'Inventors' Workshop. The procedure involved assessment of student interpretation of the part visuals and renaming of parts once the game had been experienced; suggestions for additional parts; comprehension of the connection of parts; understanding of rotation feature; ability to respond to three different and successively more difficult challenges; ability to invent their own challenge for
Cyberchase produced a Math & Sports unit during Season 6. Focus groups with fourth graders were implemented to assess understanding of sports diagramming and using symbols to represent plays and ball passes. Cyberchase is the Emmy Award-winning mathematics series and website on PBS KIDS GO! using broadcast, web, new media and educational outreach to impact millions nationwide. Designed for children ages 8 to 11 and packed with mystery, humor, and action, Cyberchase's mission is to improve kids' problem-solving and math skills, and inspire them with confidence and enthusiasm toward math. The TV
To prepare for future summative research on the synergy among multiple educational media, the present pilot research explored real-life use of Cyberchase outreach materials. The present pilot study included: a Web survey of 48 outreach providers (representing over 3000 children in 19 states), follow-up phone interviews with 26 of these providers, and in-person observations at two outreach sites, one in New York and one in Massachusetts. With an eye toward future summative research, the resulting data yield conclusions and implications in two broadly defined areas: providers' use of Cyberchase