Formative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of two "Community Conversations" theater and dialogue/discussion events at a) communicating natural gas development-related science content and community issues, and b) promoting audience members' openness to dialogue about natural gas development-related issues.
Following a 2011 report by the National Research Council (NRC) on successful K-12 education in science, technology, engineering, and mathematics (STEM), Congress asked the National Science Foundation to identify methods for tracking progress toward the report's recommendations. In response, the NRC convened the Committee on an Evaluation Framework for Successful K-12 STEM Education to take on this assignment. The committee developed 14 indicators linked to the 2011 report's recommendations. By providing a focused set of key indicators related to students' access to quality learning, educator's
The intent of this project is to use social network methods to study networks of afterschool and informal science stakeholders. It would attempt to create knowledge that improves afterschool programs access to informal science learning materials. This is an applied research study that applies research methods to improving access to and enactment of informal science education programs across a range of settings. The investigators plan to collect data from 600 community- and afterschool programs in California, conduct case studies of 10 of these programs, and conduct surveys of supporting intermediary organizations. The analysis of the data will provide descriptions of the duration, intensity, and nature of the networks among afterschool programs and intermediary agencies, and the diffusion patterns of science learning materials in afterschool programs. The project will yield actionable knowledge that will be disseminated among afterschool programs, intermediary organizations, funding agencies, and policymakers to improve the dissemination and support of afterschool science learning opportunities. The project is focused on free-choice settings where every day the largest numbers of children attend afterschool programs at schools and in other community settings. It seeks information about what conditions are necessary for informal science programs to significantly impact the largest possible number of children in these settings.
DATE:
-
TEAM MEMBERS:
Barbara MeansAnn HouseCarlin LlorenteRaymond McGhee
To help answer questions about the behavior of participants in human-robot systems, we propose the Cognitive Evaluation of Human-Robot Systems (CEHRS) method based on our work with the Personal Exploration Rover (PER). The CEHRS method consists of six steps: (1) identify all system participants, (2) collect data from all participant groups, including the system’s creators, (3) analyze participant data in light of system-wide goals, (4) answer targeted questions about each participant group to determine the flow of knowledge, information, and influence throughout the system, (5) look for
The authors present an exploratory study of Black middle school boys who play digital games. The study was conducted through observations and interviews with Black American middle school boys about digital games as an informal learning experience. The first goal of the study is to understand the cultural context that Black students from economically disadvantaged inner-city neighborhoods bring to playing digital games. The second goal of the study is to examine how this cultural context affects the learning opportunities with games. Third, the authors examine how differences in game play are
DATE:
TEAM MEMBERS:
Betsy James DiSalvoKevin CrowleyRoy Norwood
Front-end and formative evaluation of the Science Museum of Minnesota's Invention, Design, Engineering, and Art (IDEA) Cooperative youth development program was carried out from June 2008 - May 2009. The front-end and formative evaluation activities were guided by four overarching questions. 1. To what extent are youth able to apply IT and engineering process skills to design challenges? Can they come up with multiple solutions to challenges? Are they persistent problem solvers? 2. To what extent does the program provide youth with the necessary resources to help youth prepare for both
DATE:
TEAM MEMBERS:
Amy Grack NelsonMelissa FitzenbergerKathleen MillerClaire Phillippe
All youth in the Science Museum of Minnesota's Kitty Andersen Youth Science Center (KAYSC) are invited to complete a web-based exit survey upon leaving their current team. The survey is the same across all KAYSC teams, with the addition of some questions specific to a team experience and outcomes. This report includes select data from the exit surveys for the Invention, Design, Engineering, and Art (IDEA) Cooperative high school team, called the Invention Crew. The purpose of the exit surveys were to understand youth's overall experience on the IDEA Coop as well as the impact of the IDEA Coop
All youth in the Science Museum of Minnesota's Kitty Andersen Youth Science Center (KAYSC) are invited to complete a web-based exit survey upon leaving their current team. The survey is the same across all KAYSC teams, with the addition of some questions specific to a teamâs experience and outcomes. This report includes select data from the exit surveys for the Invention, Design, Engineering, and Art (IDEA) Cooperative middle school team, called the Design Team. The purpose of the exit surveys were to understand youth's overall experience on the IDEA Coop as well as the impact of the IDEA
The goal of the SISCOM program is to improve science achievement of economically disadvantaged middle school students in science, through the development, implementation, and dissemination of a replicable, model program for use with underserved youth, especially girls, in informal educational settings. A number of programs and interventions geared toward bolstering the STEM interest and achievement of urban youth have been implemented across the country. Key elements that have proven to be successful have been incorporated into the SISCOM program include the longevity of intervention
DATE:
TEAM MEMBERS:
Penny L. Hammrich, Ph.D.Kathy Fadigan, Ed.D.Judy Stull, Ph.D.
Goodman Research Group, Inc. (GRG) conducted a comprehensive multi-method external evaluation of the Design Squad PBS television series and its outreach initiative. Design Squad is a live-action reality television series for 9-12 years-olds that aims to provide hands-on experiences and positive images of engineering through design competitions. The broad evaluation goals were to: 1) assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, 2) document the implementation of the community events resulting
This report describes a summative evaluation of Secrets of Circles, a 2,600 square foot exhibition created by Children's Discovery Museum of San Jose and funded by the National Science Foundation. The exhibition and related programs were designed to highlight the uses of circles and wheels in everyday life. Circles have properties that make them extremely effective as an engineering tool, and they are ubiquitous in cultures around the world. The appendix of this report inclues interview and observation protocols and questionnaires used in this study.
DATE:
TEAM MEMBERS:
Sue AllenChildren's Discovery Museum of San Jose
Too Small to See is a 5,000 square-foot interactive traveling museum exhibition designed to provide hands-on nanotechnology science education to youth age 8 to 13 and adults. It debuted at Disney's Epcot and will reach over three million people during a five-year US tour. This evaluation examines the exhibition’s outcomes and impact on increasing visitors’ awareness of, interest in, engagement with, and understanding of nanoscale science, engineering, and technology. An overarching goal is to document the project’s contribution to the portfolio of federally funded Science Technology
DATE:
TEAM MEMBERS:
Douglas SpencerTina PhillipsTori AngelottiShane MurphyFred ConnerCornell University