This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
This infographic presents a visual summary of a user study of the InformalScience.org website, which was conducted in 2016. The study used online surveys, task-based interviews, and web analytics to explore the following questions: (1) Who are the site's users and what content do they value? (2) Does the site clearly convey its purpose to visitors? and (3) Are users able to navigate the site and use search tools effectively?
The National Center for Science and Civic Engagement (NCSCE) will conduct a Collaborative Planning project to maximize the collective impact of two well-established national STEM learning networks, National Informal STEM Education Network (NISE Net) and Science Education for New Civic Engagements and Responsibilities (SENCER). Through a strategic collaboration that leverages their respective achievements, resources, and expertise, the combined networks can advance informal science education that engages and empowers citizens and their communities as they address the complex civic challenges. The project will conduct a strategic planning process to envision how to unify two networks to increase a durable and identifiable infrastructure for cross-sector collaboration focused on linking science and civic engagement. It is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
The project objective of the planning process is to create a new and expanded national infrastructure that will increase the capacity of science centers and other informal learning organizations to enhance the public's engagement with science through attention to civic issues, and access new partners, participants, and resources from higher education institutions. The project's core activity will be a three-stage planning process: Phase 1, an assessment of assets, resources, and regional complementarity of the networks, and the development and investigation of key research questions; Phase 2, a planning workshop involving 29 project leaders from both organizations and stakeholders from formal and informal science to identify and develop specific collaborative strategies; and Phase 3, an evaluation and dissemination of the planning results to the networks and the development of a new multi-year project to strengthen the national infrastructure for formal and informal STEM education.
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
NatureStart Network brought together early childhood educators and environmental educators to support nature play, exploration, and inquiry for young children and their families within urban environments. Project partners included the Forest Preserves of Cook County and two established Head Start programs in the Chicago area, Mary Crane Center and El Valor. The foundation of the project was a series of three two-day professional learning sessions that took place over an eighteen month period. Through hands-on, collaborative learning and reflection activities, the participating educators
DATE:
TEAM MEMBERS:
David Becker
resourceprojectProfessional Development, Conferences, and Networks
The Center for Advancement of Informal Science Education (CAISE) is a National Science Foundation (NSF) funded resource center, working in cooperation with the NSF Advancing Informal STEM Learning (AISL) program to build and advance the informal STEM education field. CAISE continues the work it began in 2007--serving professional audiences in informal STEM learning, which includes those working in science centers and museums, zoos and aquariums, parks, botanical gardens and nature centers, events and festivals, libraries, making and tinkering spaces, media (TV, radio, film, social), cyberlearning and gaming, and youth, community, and out-of-school time programs.
What We Do:
CAISE seeks to characterize, highlight, and connect quality, evidence-based informal STEM learning work supported by a diversity of federal, local, and private funders by providing access to over 8,000 (and growing) resources that include project descriptions, research literature, evaluation reports and other documentation on the InformalScience.org website. In addition, CAISE convenes inquiry groups, workshops and principal investigator meetings designed to facilitate discussion and identify the needs and opportunities for informal STEM learning.
In this award, CAISE is also tasked with advancing and better integrating the professional fields of informal STEM learning and science communication by (1) broadening participation in these fields, (2) deepening links between research and practice, and (3) building capacity in evaluation and measurement. These activities are being undertaken by cross-sector task forces of established and emerging who will be responsible for conducting field-level analyses, engaging stakeholders, and creating roadmaps for future efforts. CAISE is also building on existing communication channels for dissemination to the larger field, and through the InformalScience.org website. An External Review Board and Inverness Research are providing oversight of CAISE's program activities and evaluation of the center.
Who We Are:
CAISE operates as a network of core staff housed at the Association of Science-Technology Centers (ASTC) in Washington, D.C. and co-principal investigators and other collaborators at academic institutions and informal STEM education (ISE) organizations across the U.S. Other key collaborators are the American Association for the Advancement of Science's Center for Public Engagement with Science, the National Informal STEM Education Network, and Arizona State University.
In his latest book titled “Communication power”, the famous sociologist of information society Manuel Castells focuses on the way in which power takes shape and acts in information societies, and the role of communication in defining, structuring, and changing it. From the rise of “mass self-communication” to the role of environmental movements and neuropolitics, the network is the key structure at play and the main lens used to analyse the transformations we are witnessing. To support his thesis Castells links media studies, power theory and brain science, but his insistence on networks puts
DATE:
TEAM MEMBERS:
Alessandro Delfanti
resourceevaluationProfessional Development, Conferences, and Networks
The NISE Network Professional Impacts Summative Evaluation is a longitudinal examination of individual professionals over the final three years of NISE Net funding. This investigation is based on the NISE Network goals for professionals and explores how involvement with NISE Net impacts an individual professional’s sense of community, learning about nano, and use of nano educational products and practices. This evaluation primarily included professional partners who were: (1) Informal Science Educators (ISE): Professionals from science museums and children’s museums implementing informal
The Summative Study of the Nano Mini-exhibition took place during the spring and summer of 2012. After being observed during their Mini-exhibition experience, 455 visitors across six different partner institutions participated in surveys and interviews with NISE Net evaluation team members. This report begins by describing the key findings of the study in detail, with additional information about study methods, instruments, and two exploratory sub-studies found in the Appendices.
In the spring of 2014, the Nanoscale Informal Science Education Network (NISE Net) Public Impacts evaluation team conducted a summative study of NanoDays, a nationwide festival of educational programs about nanoscale science, engineering, and technology. In 2014, NanoDays took place from March 29th – April 6th, 2014. The Network’s goals for NanoDays events led to the following summative evaluation questions: 1. What is the projected public reach of NanoDays events in 2014? 2. Are ‘mature’ NanoDays events successful in providing an engaging experience and promoting learning of nano concepts for
The purpose of this document is to consolidate and archive all of the major public reach estimates that have been generated as part of the Network evaluation. Brief descriptions of the counting studies and projection methods used to generate these estimates will be included here, with additional information available in other referenced NISE Network evaluation reports and appendices. Finally, strengths and limitations of these estimates will be discussed, as well as future directions for - and implications of - this work. Over the life of the project, the NISE Network is estimated to have