Science, technology, engineering, and mathematics(STEM) programs in out-of-school time (OST) are designed to supplement school work, ignite student interest, and extend STEM learning. From interactive museum exhibits to summer-long science camps, opportunities for informal student engagement in STEM learning abound. What difference do these programs make, and how can we improve them? These questions preoccupy educators and funders alike. OST program developers and providers can benefit from understanding why evaluation is critical to the success of STEM OST programs, what data collection
This article examines afterschool science in light of the National Research Council’s comprehensive synthesis report on promoting science learning in informal environments (NRC, 2009). We present the results of our analysis of qualitative case studies of nine state-funded afterschool sites in California, discussing the strengths of these programs against the background of three key site-based constraints—time available for science, staff’s science backgrounds, and instructional materials—as well as the importance of partnerships with outside organizations to support sites in overcoming these
This document describes the Dimensions of Success (DoS), an assessment tool created by researchers at the Program in Education, Afterschool, and Resiliency (PEAR). DoS was created to help out-of-school time programs and researchers monitor and measure quality. It allows observers to collect systemic data along 12 quality indicators to pinpoint the strengths and weaknesses of afterschool science learning experiences.
DATE:
TEAM MEMBERS:
Anahit PapazianAshima ShahCaitlin Rufo-McCormick
Although stakeholders agree that afterschool STEM education can be powerful, there is less agreement on the critical question of which aspects of STEM education the afterschool field is best positioned to support. Hence, in spring 2012, the Afterschool Alliance undertook a study to ask afterschool stakeholders what aspects of STEM learning the field is best positioned to support. The aim of the Afterschool STEM Outcomes Study was to identify consensus views on appropriate and feasible outcomes and indicators for afterschool STEM programs. The study provides a realistic vision of the field’s
In 2009, the North Carolina Virtual Public Schools worked with researchers at the William and Ida Friday Institute to produce and evaluate the use of game creation by secondary students as a means for learning content related to career awareness in Science, Technology, Engineering and Mathematics (STEM) disciplines, with particular emphasis in computer science areas. The study required the development of various forms of multimedia that were inclusive of content and activities delivered in a distance environment via the Internet. The team worked with a game art and design graduate class to
The summative evaluation of the Farming for Fuels classroom program and family event was conducted over two years. Two interim reports were delivered with preliminary results about specific areas of focus. This final report described the overall evaluation study methods and results, and made recommendations for potential revisions and improvements to the program. The evaluator worked with the program team at the Creative Discovery Museum to generate a list of questions to guide the evaluation study. The questions covered each of the major audiences for the program: museum educators, teachers
This paper identifies the need for developing new ways to study curiosity in the context of today's pervasive technologies and unprecedented information access. Curiosity is defined in this paper in a way which incorporates the concomitant constructs of interest and engagement. A theoretical model for curiosity, interest and engagement in new media technology-pervasive learning environments is advanced, taking into consideration personal, situational and contextual factors as influencing variables. While the path associated with curiosity, interest, and engagement during learning and research
DATE:
TEAM MEMBERS:
Marilyn ArnoneRuth SmallSarah ChaunceyH. McKenna
Modern zoological gardens have invested substantial resources in technology to deliver environmental education concepts to visitors. Investment in these media reflects a currently unsubstantiated belief that visitors will both use and learn from these media alongside more traditional and less costly displays. This paper proposes a model that identifies key factors theorized to influence the likelihood of visitors engaging in technology-delivered media. Using data from two case studies of large National Science Foundation-funded projects in zoos, the authors argue key factors in predicting
The Lemelson Center for the Study of Invention and Innovation at the Smithsonian’s National Museum of American History (NMAH) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a formative evaluation for Places of Invention, an exhibition funded by the National Science Foundation. The exhibition aims to stimulate visitors’ thought about how people, resources, and spaces work together to support invention in historic and modern communities. Through formative evaluation, RK&A explores visitors’ use of exhibition prototypes (including barriers to use) and the meanings visitors take away
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Lemelson Center for the Study of Invention and InnovationNational Museum of American HistorySmithsonian Institution
The C2C award addresses the lack of validated instruments to measure teamwork and collaboration in middle and high school students in out of school time (OST) settings by implementing a rigorous four-phase process to develop new assessments. Phase 1 focuses on defining the construct of teamwork and collaboration skills so it aligns with the research literature and is relevant to outcomes in a variety of STEM OST programs. Construct maps are developed during Phase 2 to guide item development. The instruments are piloted in Phase 3 through think-aloud interviews and survey administration with a diverse set of youth and programs. Through an iterative process, items are revised or removed based on their psychometric properties. The final phase is a national field test with a cross-section of STEM OST programs. C2C's intellectual merit is its potential to advance understanding of how to measure teamwork and collaboration skills in STEM OST programs. There is a national call for more measures to evaluate 21st century skills. C2C's creation of instruments to measure teamwork and collaboration skills in STEM OST programs helps to address this gap. The work of C2C addresses broader impacts and benefit society by creating tools to understand the role STEM OST programs play in readying our nation's youth for the STEM workforce. C2C will create instruments validated specifically for this diverse population, allowing programs to understand the role they play in important societal STEM workforce readiness outcomes. C2C also benefits the informal science education field by conceptualizing the construct of teamwork and collaboration within STEM OST programs and developing validated instruments to understand the impact of these programs on youth.
MobiLLab was designed by faculty at the University of Teacher Education in St.Gallen (German: Pädagogische Hochschule St.Gallen (PHSG)) to spark interest in science in secondary school pupils in the German-speaking part of Switzerland. Now in its fourth year of operation, the mobiLLab team would like to evaluate the program’s effectiveness to inform further development. Specifically, we want to better understand how mobiLLab affects pupils’ science and technology interest, attitudes and knowledge development, and how positive changes can be sustained. The background investigation brings
DATE:
TEAM MEMBERS:
University of Teacher Education, St. Gallen, SwithzerlandRebecca Cors
Sci•Tech Today is a brief televised science news program designed to enhance public understanding of current science, engineering and technology. The 3-5 minute segments are researched and presented by Museum of Science staff and mediated by a news anchor of New England Cable News (NECN). The segments are cablecast live from the Museum of Science’s Gordon Current Science & Technology stage and NECN's Needham, Massachusetts studios. Twice a month, the segments feature nanoscale science and engineering research. These segments are produced with support from (1) the Center for High-Rate