Skip to main content

Community Repository Search Results

resource evaluation Public Programs
In August 2012, the National Museum of Natural History (NMNH) contracted with Audience Focus (AF), a Maryland-­‐based research and evaluation organization, to evaluate visitors’ experiences with the Scientist Is In program. Specifically, AF was asked to design a comprehensive study that would provide insight into the nature of visitors’ engagement with the program, and how participation in the program influenced visitors’ understanding of and curiosity about science topics, awareness of science careers, perceptions of NMNH as a research institution, and recognition of the connections between
DATE:
TEAM MEMBERS: Jeanine Ancelet Kara Hershorin
resource project Public Programs
This project will expand and enhance an initiative that offers zoos, aquariums, and science museums the market research they need to engage and motivate the public on issues related to the ocean and climate change. The three-year project will measure changes in public awareness and action on ocean and climate-related issues. It will integrate these research findings into recommendations offered to staff working at zoos, aquariums, and science museums as well as to the ocean conservation community and provide professional development for staff members at these institutions in order to support and shape public outreach efforts that connect climate change, the ocean and individual actions, especially among our nation's youth.
DATE: -
TEAM MEMBERS: William Mott
resource project Public Programs
In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
DATE: -
TEAM MEMBERS: Robin Meisner David Sobel Susan Letourneau Jessica Neuwirth Valerie Haggerty-Silva Chris Sancomb Camellia Sanford-Dolly Claire Quimby
resource project Public Programs
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?

The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.

The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
DATE: -
TEAM MEMBERS: Nancy Walsh Kathleen Tinworth Andrea Giron Ka Yu Lynn Dierking Megan John Polly Andrews John H Falk
resource project Public Programs
A partnership between Carthage College and the Appalachian Mountain Club has delivered a successful public education and outreach program that merges natural environment topics and astronomy. Over the four years of activity, over 25,000 people have received programming. The effort has trained nature educators, permanent and seasonal AMC staff, and undergraduate physics and astronomy students to integrate diverse topical material and deliver high quality programming to the lay public. Unique to the program is the holistic nature of the material delivered - an 'atypical' astronomy program. Linking observable characteristics of the natural world with astronomical history and phenomena, and emphasizing the unique sequence of events that have led to human life on Earth, the program has changed attitudes and behaviors among the public participants. Successful interventions have included hands-on observing programs (day and night) that link nature content to the observed objects; table-talk presentations on nature/astronomy topics; dark skies preservation workshops; and hands-on activities developed for younger audiences, including schools, camps, and family groups. An extensive evaluation and assessment effort managed by a leading sociologist has demonstrated the effectiveness of the approach, and contributed to continuous improvement in the program content and methods.
DATE: -
TEAM MEMBERS: Douglas Arion
resource research Public Programs
In this article, science center and museum professionals from around the world share ways that they are engaging visitors in hands-on innovation. Work from the following organizations are discussed: Exploratorium, Discovery Center of Idaho, Lawrence Hall of Science, Iridescent, Conner Prairie Interactive History Park, Ideum, Discovery Place, Ontario Science Centre, Bootheel Youth Museum, Science Centre Singapore, Children's Museum of Phoenix, Discovery Museums (Acton, MA), Discovery Center of Springfield, Missouri, Museum of Science, Boston, Questacon--The National Science and Technology
DATE:
TEAM MEMBERS: Emily Schuster
resource project Media and Technology
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
DATE: -
TEAM MEMBERS: Richard Kron Suzanne Gurton Daniel Reichart Sue Ann Heatherly
resource project Media and Technology
In Defense of Food (IDOF) is a media and outreach project based on Michael Pollan's best-selling book of the same title. Through the lens of food science, IDOF is designed to engage diverse audiences in learning about: (1) how science research is conducted, (2) how research findings are used in media, marketing, and public policy, and (3) how to apply food science research in everyday life. IDOF will be created by Kikim Media, an independent production company, broadcast and distributed by PBS and supported by an extensive outreach campaign and interactive website. The project's educational materials will be developed, in part, by the Teacher's College at Columbia University's Center for Food and Nutrition, with dissemination supported by the Coalition for Science After School and by Tufts University's Healthy Kids Out of School initiative, which involves nine of the leading out of school time (OST) organizations, such as Girl Scouts USA, and the National Urban League. The project advisory committee includes highly respected researchers in food, nutrition, and health. IDOF will use an integrated strategy of learning resources, combining a television documentary with online/social media, community outreach, and youth activities. Knight Williams Research Communications will conduct formative and summative evaluation of all major components of the project. The results will advance the informal science community's understanding of how the combination of a documentary with outreach, website/social media, and afterschool activities impacts motivation and learning. The evaluation study will pay special attention to the degree to which participation in the community events, social media/website, and afterschool activities motivates deeper or extended engagement with the subject. Project evaluation results and educational resources will be widely disseminated to the informal science community. IDOF includes a two-hour documentary film that will be produced in both English and Spanish; a community-level outreach campaign focused on reaching underserved audiences who may not watch public television; a set of activities for use in afterschool programs, youth programs and schools; and an interactive and content-rich website with tightly integrated social media tools. IDOF will be nationally broadcast by PBS; the Spanish-language version of IDOF will be broadcast by Vme Television. The ambitious IDOF educational materials and outreach campaign, combined with interactive web and social media, will reach large and diverse audiences. The intended impacts on audiences include increased knowledge and understanding of the scientific process by learning what food scientists do, what techniques they use, and how scientists arrive at their conclusions; the development of critical thinking skills audiences can use when evaluating messages about food and nutrition in media and advertising and when making decisions about what food to buy and eat; and becoming active learners and consumers regarding food. Evaluation results will be widely disseminated to science media producers and the informal science community via professional publications and presentations at conferences. The ultimate value of the In Defense of Food documentary and learning initiative will be to enhance public understanding of the crucial importance of science in people's everyday lives and in shaping dozens of daily decisions.
DATE: -
TEAM MEMBERS: Michael Schwarz
resource project Media and Technology
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
DATE: -
TEAM MEMBERS: Tara Chklovski
resource project Public Programs
This project takes advantage of the charismatic nature of arachnids to engage the public in scientific inquiry, dialogue, and exploration. The project has two specific programs: (1) The development, implementation, and assessment of an informal museum event entitled 'Eight-Legged Encounters' which now has more than 25 associated activity stations. These activities encompass stations relating to (a) classification and systematics (e.g., 'What is an Arthropod', 'Create a Chelicerate', and 'Assemble an Arachnid'), (b) spider-specific stations focused on silk (e.g., 'Build a Burrow', 'Cribellate vs. Ecribellate Silk', 'Weave a Web', and 'Catch a Moth'), and (c) research related stations (e.g., 'Microscope Madness' and 'Community Experiment'). In addition, there is a stand-alone module entitled the 'Path of Predators' that includes an activity booklet and eleven stations that walk participants through the eleven living arachnid orders. Each stations has original artwork backdrops, clay sculptures, trading cards, and collectible stamps (participants place stamps on a phlylogenetic tree depicting the current hypothesis of evolutionary relationships among the eleven orders). Most stations have live animals and prizes are given to participants that complete their stamp booklet. 'Eight-Legged Encounters' has been hosted at the Nebraska State Museum (Morrill Hall) twice, with record-breaking attendance (>800 people in
DATE: -
TEAM MEMBERS: University of Nebraska-Lincoln Eileen Hebets
resource project Public Programs
Who We Are: A network of informal educators, climate scientists, learning scientists and local partners across four cities, dedicated to improving local understanding of and engagement with climate change science. Mission: CUSP aims to foster a network of climate-focused organizations to implement targeted, coordinated, and concentrated educational strategies that explore local climate impacts and community-level responses. What We Do: Unite local organizations committed to addressing the impacts of climate change into collaborative network Use latest climate science and learning science research to inform program development Connect urban residents’ personal interests to larger city systems impacted by climate change, and provide residents opportunities to explore city-wide responses Deliver programs that are targeted (aimed at specific audiences), coordinated (presenting consistent and clear information about the science of climate change), and concentrated (delivered many times, through many programs) Test the hypothesis that when people encounter the same science content in multiple settings, from multiple points of view, they are more likely to understand and remember important concepts What We Offer: A Community of Practice for local organizations, including training on best practices of climate communication and education Provide local organizations with current climate science impacting their city, and latest learning science research Opportunities for city residents to explore local impacts of climate change in every day settings, at neighborhood centers, at schools, online, and at city festivals. Opportunities for city residents to engage with local organizations in community-level responses to climate change
DATE: -
TEAM MEMBERS: The Franklin Institute Raluca Ellis Frederic Bertley Steven Snyder Radley Horton Kevin Crowley
resource research Public Programs
In January 2012, New York Hall of Science (NYSCI) hosted Design-Make-Play: Growing the Next Generation of Science Innovators. The two-day conference brought together leaders of schools, community-based programs, research and development organizations, the funding community, universities, government and business. They gathered at NYSCI to assemble evidence supporting the belief that designing, making and playing can create new pathways into science, technology, engineering and math (STEM), particularly among children. A core argument of Design-Make-Play is that informal learning centers like
DATE:
TEAM MEMBERS: David Kanter