This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
Recent work in the informal science education (ISE) field has begun to systematically categorize aspects of learning in a variety of ways. Most notable are the “Framework for Evaluating Impacts of Informal Science Education” (Friedman, A. (Ed.), 2008, henceforth ‘NSF’) and “Learning Science in Informal Environments” (LSIE, National Research Council, 2009, henceforth ‘NRC’). Both frameworks have potential implications for assessment as well as project planning.
In spring 2009, the Denver Museum of Nature & Science (Museum) contracted with JVA Consulting, LLC (JVA) to conduct a comprehensive process and outcome evaluation of the Passport to Health (P2H) program. The Museum designed P2H, originally a three-year program funded by the Colorado Health Foundation (the Foundation), to improve health outcomes for fifth-grade students as well as their families and teachers throughout the Denver metro area. Appendix includes survey.
Two Billion More Coming to Dinner is a 9 minute 32 second long film developed for the Science on a Sphere (SOS) network by the Science Museum of Minnesota (SMM). This film was funded by a Discovery Grant from the University of Minnesota’s Institute on the Environment (IonE). Science Museum of Minnesota staff worked closely with members of IonE’s Global Landscapes Initiative to develop the visualizations and content for this production. Two Billion More Coming to Dinner explores ways of dealing with human’s need to produce enough food for the 9 billion people expected to live on the planet by
A Study of Communication in the NISE Network (Network Communication Study), conducted during the sixth year of the grant, sought to learn how the four primary communication components that were developed in the first 5 years of NISE Net (NanoDays, face-to-face meetings, the regional hub structure, and the nisenet.org website) are functioning within the Network. In particular, the study explored how these components communicate information, ideas, and practices related to NISE Net between and within the three Network tiers.
Creating Museum Media for Everyone (CMME) is a proof-of-concept collaborative project between the Museum of Science (MOS) in Boston, WGBH's National Center for Accessible Media (NCAM) and Ideum (Funded by NSF-DRL, award number 1114549). The project aims to show how digital interactive museum exhibit devices can be designed and developed for visitors who have a wide range of disabilities. Current deliverables include two exemplar exhibition components in which museum visitors will learn STEM concepts by manipulating and analyzing real data. To create these deliverables, CMME utilized an
The Planet Earth Decision Theater (PEDT), funded by NOAA (grant # NA10SEC0080021), will be a major component of the Future Earth exhibition, which opens at the Science Museum of Minnesota (SMM or the Museum) in late October 2011. The theater will operate in two modes: a facilitated show with live actors and an audience response system to engage the audience, and an autorun show with similar content. This evaluation focuses on the live performance part of PEDT. When complete, live performances will take place in SMM’s newly refurbished Science on a Sphere (SOS) space that will include SOS, a