The Learning and Youth Research and Evaluation Center (LYREC) is a collaboration of the Exploratorium, Harvard University, Kings College London, SRI International and UC Santa Cruz. LYREC provides technical assistance to NSF AYS projects, collects and synthesizes their impact data, and oversees dissemination of progress and results. This center builds on the Center for Informal Learning in Schools (CILS) that has developed a theoretical approach that takes into account the particular strengths and affordances of both Out of School Teaching (OST) and school environments. This foundation will permit strengthening the potential of the NSF AYS projects to develop strong local models that can generate valid and reliable data that can guide future investment, design and research aimed at creating coherence across OST and school settings. The overarching questions for the work are: 1. How can OST programs support K-8 engagement and learning in science, and in particular how can they contribute to student engagement with K-8 school science and beyond? 2. What is the range of science learning outcomes OST programs can promote, particularly when in collaboration with schools, IHE's, businesses, and other community partners? 3. How can classroom teachers and schools build on children's OST experiences to strengthen children's participation and achievement in K-12 school science Additionally, the data analysis will reveal: 1. How OST programs may be positioned to support, in particular, high-poverty, female and/or minority children traditionally excluded from STEM academic and career paths; and 2. The structural/organizational challenges and constraints that exist to complicate or confound efforts to provide OST experiences that support school science engagement, and conversely, the new possibilities which are created by collaboration across organizational fields. Data will be gathered from surveys, interviews, focus groups, evaluation reports, and classroom and school data.
The University of Washington’s Museology Program, in partnership with the Woodland Park Zoo and the Learning in Informal and Formal Environments Research Center is developing a model of university-community collaboration where students work with client museums, zoos and aquaria to evaluate exhibits and programs under the guidance of a research mentor. Students will gain experience in audience research and evaluation, as well as in project management, collaboration, and leadership. Staff at participating museums will advance their personal knowledge about visitors and the field of museum evaluation. The project will prepare a new generation of evaluators and museum practitioners through an innovative apprentice-styled laboratory that integrates the strengths of mentoring, fieldwork, academics, and client-centered experiences. Project Advisors include John Falk, Julie Johnson, Randi Korn, Marjorie Schwarzer, and Patterson Williams. Project started January, 2009 with 24 graduate students in the first cadre.
Researchers at Michigan State University, University of Washington, Science Museum of Minnesota, and Museum of Life and Science found that there are clear indicators of learning in Science Buzz (www.sciencebuzz.org), the online museum environment studied as part of the Take 2 project. People who participate in conversations through the Buzz blog demonstrate an interest in science, and they leverage their own experiences and identities in order to share science knowledge with others. Researchers utilized indicators of learning as identified in the National Academies report on Learning Science in Informal Environments. Aspects of learning that were particularly important for an online environment like Science Buzz were interest in science, participating in science through the use of language, and identifying as someone who knows about or uses science. Researchers found that Science Buzz participants had a strong interest in scientific issues, utilized argumentation strategies--an important scientific practice--and identified with the importance of science in their lives. In particular: (1) Interest in scientific issues, caring about scientific issues, identifying personally with scientific issues were commonly evident in Science Buzz; (2) There is widespread use of argumentation in relation to scientific issues, an important scientific practice, although the quality of the scientific reasoning associated with these argumentation practices varies; (3) The co-construction of identity between online participants and the host museum is a potentially powerful outcome, as it suggests that online learning environments can facilitate longer-term relationships; (4) The analytical tools developed by this project advance our ability to understand learning in online environments; (5) While some indicators of learning are present, others, such as reflecting on science or co-constructing science knowledge with others, are not present. For museums, encouraging museum staff to engage digital tools and online participants is relatively easy. However, measuring online activity with regard to complex outcomes like learning is extremely difficult. Perhaps the most useful outcome of the Take 2 project, therefore, is a tool that will enable museums to make sense of online activity in relation to powerful outcomes like learning.
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley
resourceprojectProfessional Development, Conferences, and Networks
This four year project led by The American Association for the Advancement of Sciences (AAAS) will continue fostering interactions among projects funded by the Graduate STEM Fellows in K-12 Education (GK-12)through a series of meetings that include one annual meeting and two special focus meetings every year. The annual meeting will be broad and will target all different GK-12 participants (PIs, Fellows, Teachers, Project Coordinators, Evaluators and Faculty Members). The special focus meetings will target a specific GK-12 group or will explore a theme or issue of special interest to the GK-12 program or GK-12 projects. AAAS also will update the current website and revise and expand its content to provide a resource to the GK-12 community. Some of the additions to the website will be: an e-newsletter, alumni directory, evaluation instruments, ready access to STEM activities and statistical data on projects.
This report presents findings from a joint study carried out by the Museum of Science, Boston Research and Evaluation Department (MOS) and Art Beyond Sight (ABS, formerly Art Education for the Blind) with museum visitors who are blind or have low vision. The purpose of this study was to gather information that can inform the development of pilot museum programs that meet the needs and interests of visitors who are blind or have low vision and to provide professional development for museum professionals. Focus groups were used as the primary data collection method, as they enable idea sharing
The overall goal of the project was to convene a large-scale, open conference on public participation in scientific research, bringing together science researchers, project leaders, educators, technology specialists, evaluators, and others from across many disciplines to discuss advancing the field of PPSR. The conference included three sessions for posters and conversations, and five plenary sessions of presentations. The meeting culminated in an open meeting to explore strategies for large-scale collaborations to support and advance work across this field of practice, through the development
DATE:
TEAM MEMBERS:
The Schoodic Education and Research Center InstituteJoe E Heimlich
The broad purpose of this project is to contribute to capacity-building efforts—to strengthen the evaluation of programs and learning experiences in informal science education (ISE). We focus on improving the quality of summative evaluations, which have been called upon to inform decision-making and practice, contribute knowledge to the field, and help make the case for the value of informal learning. We previously developed a framework that synthesizes key elements of a high-quality summative evaluation. The framework has three dimensions: (a) examine the underlying rationale of the program, exhibition, experience, or intervention being evaluated; (b) balance methodological rigor with sensitivity to the informal context; and (c) prioritize uses of the evaluation by addressing stakeholders’ needs. Evaluators may draw on all three dimensions to provide summary judgments on the value of what was evaluated. We extend our work in two ways: (1) Examine how the framework could be used as a guiding lens for planning or conducting future or current summative evaluations. We will work with partners in informal science institutions to support and document their evaluation activities along the dimensions of evaluation quality, with the intent of improving the framework and creating concrete exemplars of its application in practice. (2) Conceptualize alternative models for enhancing professional training in ISE evaluation. We will research current programs and practices for building technical evaluation capacity, looking for promising and innovative approaches that include apprenticeship or “hands-on” experiences. This 18-month project (January 2015 through June 2016) is funded by the Gordon and Betty Moore Foundation.
This monograph has been created by the TEAMS (Traveling Exhibits At Museums of Science) Collaborative, a group of seven small U.S. science centers, to share experiences, observations, and lessons learned with the broader science museum field. Our intention is to help others who might be interested in forming a collaborative to work though some key issues, most of which have to do with the relationships between collaborative members, rather than more technical matters. We hope that this will provide a vision for others as to how collaboration among science centers can work. The monograph looks
DATE:
TEAM MEMBERS:
Charles TrautmannMark St. JohnDavid Goudy
MarshAccess is an informal science education program based at the Meadowlands Environment Center (MEC) in Lyndhurst, NJ, and funded by the National Science Foundation. MarshAccess seeks to engage largely underserved populations of young and older adults with disabilities, as well as older adults with age-related limitations, in outdoor experiential STEM activities centered on the New Jersey Meadowlands marsh ecosystem. Program modules are designed to increase interest in science, increase scientific literacy, develop a sustained relationship between the MEC and the target audience and audience
DATE:
TEAM MEMBERS:
Hilarie B. DavisBradford T. DaveyRamapo College of New Jersey
This research was commissioned to explore visitors’ experiences in When the Dinosaurs Were Gone (later titled "When Crocodiles Ruled", a temporary exhibition at the Science Museum of Minnesota. As a summative evaluation, the research sought to address several issues and objectives: 1. overall impressions of the exhibition — visitors’ ratings of enjoyment, interest in the information, what they liked most, and what changes they would suggest (or not want) for a traveling version of this exhibit; 2. extent of use of the exhibition — amount of time spent in the exhibition and the extent to which
DATE:
TEAM MEMBERS:
People Places & Design ResearchScience Museum of MinnesotaJolene Hart
The goals of this Pathways Project will be to: 1) learn how to better recruit and sustain deep relationships with seniors and youth; 2)facilitate the roles that these two audiences can play as collaborators in field research and conservation science; 3) study ways that seniors and young people as well as scientists and lay people might interact most effectively while in training and in the field, and 4) study cognitive and affective impacts of such collaborations upon both citizens and professionals.
DATE:
TEAM MEMBERS:
PEER AssociatesNational Audubon Society