The Principal Investigator's Guide: Managing Evaluation in Informal STEM Education Projects (PI Guide) is designed to help principal investigators and other leaders of informal STEM (Science, Technology, Engineering, and Math) education projects integrate evaluation into all phases of project design, development, and implementation. Such projects include exhibits, media projects, websites, community science projects, afterschool programs, festivals, family activities, online games, citizen science projects, and other efforts to help people learn about science in the course of their everyday
The Office for Human Research Protections (OHRP) provides a decision chart as a guide for institutional review boards (IRBs), investigators, and others who decide if an activity is research involving human subjects that must be reviewed by an IRB under the requirements of the U.S. Department of Health and Human Services (HHS) regulations at 45 CFR part 46. OHRP welcomes comment on these decision charts. The charts address decisions on the following: whether an activity is research that must be reviewed by an IRB, whether the review may be performed by expedited procedures, and whether informed
DATE:
TEAM MEMBERS:
U.S. Department of Health & Human Services
In December 2008, the Monterey Bay Aquarium, in partnership with the New England Aquarium and the National Aquarium in Baltimore, hosted a summit of leaders from aquariums across North America and beyond. The intent was to empower aquarium professionals to elevate their collective focus on the relationship between climate change and the ocean, and to develop collaborative strategies for communicating climate change and inspiring solution-‐oriented actions among our institutions and audiences. The summit represented the birth of a community. The three‐day event succeeded in mobilizing 34
The Climate Interpretation Coalition is maturing beyond a set of discrete institutions to become a collective voice for communicating climate change and the ocean. As the three‐year funded NOAA program and the empowerment evaluation end, the question of how to build ongoing communities of support arises. The findings are based upon an interview‐based exploration of individuals who participated in the 2012 Baltimore summit and who represent a broad spectrum of engagement (highly engaged with creating the coalition through to limited engagement in a single summit). The interviews were nested
The overarching purpose of the Climate Literacy Zoo Education Network is to develop and evaluate a new approach to climate change education that connects zoo visitors to polar animals currently endangered by climate change, leveraging the associative and affective pathways known to dominate decision-making. Utilizing a polar theme, the partnership brings together a strong multidisciplinary team that includes the Chicago Zoological Society of Brookfield, IL, leading a geographically distributed consortium of nine partners: Columbus Zoo & Aquarium, OH; Como Zoo & Conservatory, St. Paul, MN; Indianapolis Zoo, IN; Louisville Zoological Garden, KY; Oregon Zoo, Portland, OR; Pittsburgh Zoo & PPG Aquarium, PA; Roger Williams Park Zoo, Providence, RI; Toledo Zoological Gardens, OH, and the organization Polar Bears International. The partnership leadership includes the Learning Sciences Research Institute at the University of Illinois at Chicago, and the Earth System Science Center at Pennsylvania State University. The partnership is joined by experts in conservation psychology and an external advisory board. The primary stakeholders are the diverse 13 million annual visitors to the nine partner zoos. Additional stakeholders include zoo docents, interpreters and educators, as well as the partnership technical team in the fields of learning innovations, technological tools, research review and education practice. The core goals of the planning phase are to a) develop and extend the strong multidisciplinary partnership, b) conduct research needed to understand the preconceptions, attitudes, beliefs, and learning modes of zoo visitors regarding climate change; and c) identify and prototype innovative learning environments and tools. Internal and external evaluations will be conducted by Facet Innovations of Seattle, WA. Activities to achieve these goals include assessments and stakeholder workshops to inventory potential resources at zoos; surveys of zoo visitors to examine demographic, socioeconomic, and technology access parameters of zoo visitors and their existing opinions; and initial development and testing of participatory, experiential activities and technological tools to facilitate learning about the complex system principles underlying the climate system. The long-term vision centers on the development of a network of U.S. zoos, in partnership with climate change domain scientists, learning scientists, conservation psychologists, and other stakeholders, serving as a sustainable infrastructure to investigate strategies designed to foster changes in public attitudes, understandings, and behavior surrounding climate change.
SETAC is funded by the Lifelong Learning Programme of the European Union and emerges out of the need to undertake specific action for the improvement of science education. It regards science education as among the fundamental tools for developing active citizens in the knowledge society. SETAC draws on the cooperation between formal and informal learning institutions, aiming to enhance school science education and active citizenship looking further into the role of science education as a lifelong tool in the knowledge society. On the day of the project’s conclusion, 31 October 2010, after two years of work SETAC contributes the following products and results to the field: 1. “Quality Science Education: Where do we stand? Guidelines for practice from a European experience” This is the concluding manifesto that presents the results of the SETAC work in the form of recommendations for practitioners working in formal and informal science learning institutions; 2. “Teaching and Learning Scientific Literacy and Citizenship in Partnership with Schools and Science Museums” This paper constitutes the theoretical framework of the project and innovative ways of using museums for science education and develop new modes of linking formal and informal learning environments; 3. Tools for teaching and learning in science: misconceptions, authentic questions, motivation. Three specific studies, leading to three specific reports, have been conducted in the context of the project, looking in particular into notions with an important role in science teaching and learning. These are on: Children’s misconceptions; Authentic questions as tool when working in science education; Students’ attitudes and motivation as factors influencing their achievement and participation in science and science-related issues; 4. Activities with schools: SETAC developed a series of prototype education activities which were tested with schools in each country. Among the activities developed between the partners, two have been chosen and are available on-line for practitioners to use and to adapt in their own context. These are: The Energy role game, a role game on Energy invites students to act in different roles, those of the stakeholders of an imaginary community, called to debate and decide upon a certain common problem; MyTest www.museoscienza.org/myTest, which aims to encourage students to engage in researching, reflecting and communicating science-oriented topics; 5. European in-service training course for primary and secondary school teachers across Europe. The training course is designed in such a way as to engage participants in debate and exploration of issues related to science education and active citizenship. The course is open to school teachers, headteachers and teacher trainers from all EU-member and associate countries. Professionals interested can apply for a EU Comenius grant. All the products of the project as well as information about the training course are available at the project website, some of them in more than one languages: www.museoscienza.org/setac
Climate change science is becoming a more frequent and integral part of the middle school curriculum. This project, NASA Data in My Field Trip, proposes to leverage a regional network of Informal Science Institutions (ISIs) committed to climate change education, the Global Climate Change Consortium (GC3). This project will support climate change education in the formal curriculum by creating opportunities for inquiry-based exploration of NASA data and products in class and as part of already established field trip experiences to ISIs. The ISIs of the recently formed GC3 include a broad range of science-based institutions including Carnegie Museum of Natural History (CMNH), Carnegie Science Center (CSC), Phipps Conservatory and Botanical Gardens, National Aviary, and the Pittsburgh Zoo and PPG Aquarium. Partners, Pittsburgh Public Schools and Wilkinsburg School District have respectively 70 and 99% minority populations. NASA Data in My Field Trip will build innovative connections among NASA data and products, ISI resources and experiences, curriculum standards, and educators in formal and informal environments. It has three components: (1) joint professional development for formal and informal educators, (2) in-class pre-field trip data explorations, and (3) the integration of NASA resources into ISI field trip experiences. In the first phase of NASA Data in My Field Trip, CMNH and CSC will pilot NASA resources as central components of middle school climate change field trips as well as in pre-visit experiences. In the second phase, three other GC3 ISIs will tailor the pilot products to their climate change field trips. In both phases, formal and informal educators will participate in joint professional development. Alignment with the school districts' curriculum and formative evaluation is critical at all steps of this project and will guide and inform the implementation of the project through both phases. The success of the project will be measured in terms of (1) educators’ attitudes toward and ability to use NASA resources, (2) the effectiveness of in-class and field trip experiences for students, (3) the development of a community of practice among informal and formal educators, and (4) the adoption of NASA data and products into informal and formal programming outside of the project’s specified reach. Primary strengths of this project are that it brings NASA resources to underserved schools and includes ISIs that have a commitment to climate change education but have not previously connected with NASA or its resources. Techniques developed in this project will be tailored to a diversity of ISIs and can therefore serve as a replicable model for NASA products throughout the ISI field.
DATE:
TEAM MEMBERS:
Kerry HandronEllen McCallieJohn RadzilowiczPittsburgh Public SchoolsWilkinsburg School DistrictPittsburgh Zoo and PPG AquariumNational AviaryPhipps Conservatory and Botanical Gardens
The University of Washington’s Museology Program, in partnership with the Woodland Park Zoo and the Learning in Informal and Formal Environments Research Center is developing a model of university-community collaboration where students work with client museums, zoos and aquaria to evaluate exhibits and programs under the guidance of a research mentor. Students will gain experience in audience research and evaluation, as well as in project management, collaboration, and leadership. Staff at participating museums will advance their personal knowledge about visitors and the field of museum evaluation. The project will prepare a new generation of evaluators and museum practitioners through an innovative apprentice-styled laboratory that integrates the strengths of mentoring, fieldwork, academics, and client-centered experiences. Project Advisors include John Falk, Julie Johnson, Randi Korn, Marjorie Schwarzer, and Patterson Williams. Project started January, 2009 with 24 graduate students in the first cadre.
Children feed alphabet letters to a talking baby dragon, drive a New York City fire truck, paint on a six-foot art wall, and crawl through a challenge course in PlayWorks™ at the Children's Museum of Manhattan (CMOM) in New York. Manhattan’s largest public play and learning center for early childhood marries the skills that children need to succeed in kindergarten with fun stuff that kids love. The Institute of Museum and Library Services (IMLS) funded the project through a 2006 Museums for America grant to support the museum as a center of community engagement and lifelong learning. “PlayWorks™ is a joyful place for learning science, math, reading and other things. We incorporate fun and learning into the whole design to create a scaffold of learning. Families come to the museum to supplement preschool experiences,” said Andy S. Ackerman, CMOM’s executive director. The museum also offers parents, sitters, and other care-providers guidance on engaging their children with the exhibit. Based on the concept that children’s learning and personal growth is rooted in play, the 4,000-square-foot space is divided into five learning areas: Language, Math and Physics, Arts and Science, Imagination and Dramatic Play, and Practice Play (for infants and crawlers).
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley
This report presents findings from a joint study carried out by the Museum of Science, Boston Research and Evaluation Department (MOS) and Art Beyond Sight (ABS, formerly Art Education for the Blind) with museum visitors who are blind or have low vision. The purpose of this study was to gather information that can inform the development of pilot museum programs that meet the needs and interests of visitors who are blind or have low vision and to provide professional development for museum professionals. Focus groups were used as the primary data collection method, as they enable idea sharing
The National Partnerships for Afterschool Science (NPASS) Project was led by The Center for Science Education (CSE) at Education Development Center, Inc. (EDC) in Newton, MA in partnership with the Lawrence Hall of Science (LHS) in Berkeley, CA, with funding from the National Science Foundation (NSF). The NPASS project approach relied on a professional development training and mentorship model to build the capacity of community-based organizations (CBOs) to lead high-quality, hands-on science and engineering activities in their afterschool programming. An overarching project research question