This Science Learning+ Planning Project will develop a prototype assessment tool (based on a mobile technology platform) to map STEM learning experiences across different learning ecologies (e.g. science centers, mass media, home environment) and to develop research questions and designs for a Phase 2 Science Learning+ proposal. The tool will focus on the impact of the learning ecologies on knowledge, interest, identity and reasoning rather than emphasize learning in a specific content area. The proposing team will develop and conduct a small scale usability study during the planning period, which will inform what is proposed in the Phase 2 research. A key focus of the planning period will be to identify and develop the theoretical constructs (i.e., outcomes) to be measured by the prototype App. As a starting point, the project will start with four of the six strands identified in Learning Science in Informal Environments (National Research Council, Bell et al., 2009): (1) interest triggered by a STEM experience; (2) understanding scientific knowledge; (3) engaging in scientific reasoning; and (4) identifying with the scientific enterprise. Discussion among the project partners during the planning process will revolve around how these strands should be measured in the Phase 2 research across ecologies. The measurement tool will assess the goal(s) that people set as they engage in STEM learning within each ecology and will measure the individuals' duration and level of engagement. The project will strive to utilize measures that: (1) are nonobtrusive; (2) are embedded in STEM experiences; (3) can be used across ecologies; (4) can be scaled for other ecologies than the ones examined in Phase 2 research; and (5) will be easy to use by researchers and practitioners.
DATE:
-
TEAM MEMBERS:
Bradley MorrisJohn DunloskyGreat Lakes Science CenterUniversity of LimerickIdeaStream (UK)Irish Independent newspaper
This report presents the findings from a front-end evaluation for an exhibition about tuna, which is currently under development at the Monterey Bay Aquarium. Visitors were intercepted on the second floor of the Aquarium and invited to view tuna in the big tank from the lower level of the Aquarium and to review, and ultimately select, one of six prototype interpretive panels, all of which were about different aspects of tuna. The evaluation goals for this study were to determine: • what visitors overall reactions are when they view the tuna in the big tank from the lower level of the aquarium
This evaluation of Mysteries of Çatalhöyük was commissioned by the Science Museum of Minnesota to provide objective feedback about the character of visitors’ experiences in this exhibition. The process of investigating visitors’ experiences included assessing and analyzing the extent of their use of the exhibition, awareness and perception of the interpretive messages presented, reactions to selected exhibit features, satisfaction with the experience, and characteristics of the audience who chose to see it; of these topics, the analysis of interpretive messages was considered to have primary
Fifty visitors to SMM were recruited on the exhibit floor of the museum and asked to view the first draft of a seven-minute movie being developed for the Science on a Sphere exhibit. Visitors were brought into a small room, sat down and viewed the movie on a computer laptop. After watching the movie, visitors were asked a series of questions to assess their interest, enjoyment, and particular aspects of the movie. Visitors aged eight and above were eligible to be interviewed.
In this report we detail the results of one phase of formative evaluation on the NOAA funded Ocean-Atmosphere Literacy Partnership – a cooperative partnership between the American Museum of Natural History (AMNH) and The Science Museum of Minnesota (SMM). The American Museum of Natural History produced the first draft of a video program for the Science on a Sphere (SOS) exhibit called Forecast: Tropical Cyclones. The program was designed to inform visitors about tropical cyclones (a.k.a. typhoons, hurricanes) and to illustrate how technological advances in weather observation have allowed
This front end evaluation report for the Dead Sea Scrolls Exhibition is composed of visitor interviews on the museum floor and surveys conducted with visitors to a previous exhibition. Most visitors interviewed had heard of the Dead Sea Scrolls and were interested in learning more about them and the scientific processes involved in interpreting and preserving them. About half the visitors knew approximately when the scrolls were created, but very few had any notion of the vast number of scrolls that have been found. Fortunately for The Science Museum of Minnesota, most visitors were not
This report presents the findings of the summative evaluation of the Science Museum of Minnesota’s Big Back Yard (BBY), with a specific focus on Earthscapes Miniature Golf. Mary McEathron, Amy Grack, and Stacey Grimes, graduate students in the Evaluation Studies program at the University of Minnesota, carried out the evaluation during the summer of 2004. The purposes of the evaluation were to understand visitors’ experiences in the Big Back Yard and the quality of awareness or understanding acquired as a result of that experience. The evaluation was conducted to answer the following evaluation
In order to assess the impact of the exhibition Cells: The Universe Inside Us at the Maryland Science Center an exit questionnaire was administered to museum visitors who had not seen the exhibition as well as those who had seen it. One hundred forty-nine visitors were interviewed between August 7, 2009 and August 19, 2009. Fifty-one visitors were interviewed before they had seen the Cells exhibit (pre-test); ninety-eight people were interviewed after viewing the exhibit (post-test). The following analysis compares what people know about cells before and after seeing the Cells exhibit.
Hidden Villa is a non-profit 1,600-acre organic farm and wilderness preserve dedicated to inspiring a just and sustainable future through multicultural and environmental education programs for children, youth and the community. In 2004, Hidden Villa hired an evaluation specialist to develop and implement an evaluation framework, and to design appropriate evaluation instruments for its environmental education programs. The following report documents in detail the process of and findings from the 2004 evaluation activities with the Hidden Villa Environmental Education program or HVEEP.
This report presents findings from Goodman Research Group's evaluation of the following: (1) The NOVA scienceNOW series, including viewer feedback on Season Three and the knowledge gained from viewing the six new episodes, (2) The NOVA scienceNOW website, and (3) Focus groups conducted at the Science Café conference in June 2008. Includes survey.
Knight-Williams collaborated with five aquaria to solicit the reactions of a random sample of their aquaria members to the PBS broadcast of the Shape of Life series. The collaborating aquaria were located in geographically diverse regions of the country and included: The Seattle Aquarium, Cabrillo Marine Aquarium, Dauphin Island Sea Lab, Shedd Aquarium, and New York Aquarium. The report focuses on questionnaire data provided by both the non-viewer respondents and by viewers of two or more episodes from the series.
This report presents the findings from a summative evaluation of the NSF-funded Wild Music traveling exhibition conducted by Randi Korn & Associates, Inc. (RK&A), for the Science Museum of Minnesota in Saint Paul, Minnesota. The evaluation documents the exhibition’s impact and effectiveness using timing and tracking observations and onsite exit interviews. Data were collected at the North Carolina Museum of Natural Sciences (NCMNS) in July and August 2007 and at the Peggy Notebaert Nature Museum (PNNM) in March and April 2008.