The National Science Foundation (NSF) awarded an Informal Science Education (ISE) grant, since renamed Advancing Informal STEM Learning (AISL) to a group of institutions led by two of the University of California, Davis’s centers: the Tahoe Environmental Research Center (TERC) and the W.M. Keck Center for Active Visualization in Earth Sciences (KeckCAVES). The purpose of the evaluation was to gather feedback from museum professionals and the general public about the proposed 3D visualization project and its related components. Additionally, the study aimed to assess the current understanding
DATE:
TEAM MEMBERS:
University of California, DavisSteven Yalowitz
Assessing science learning in informal environments involves a series of challenges that are difficult to address using traditional assessment practices (National Research Council, 2009). Some of the assessment challenges inherent in informal and afterschool environments include: (a) interactions in these environments are diverse in terms of duration, type of activity, number of people involved; (b) they usually include emerging behavior due to unpredictable interactions with other participants (e.g., peers, family members, and facilitators); and (c) these environments are characterized by a
Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
The Freer Gallery of Art and Arthur M. Sackler Gallery (F|S) contracted Randi Korn & Associates, Inc. (RK&A) to study its visitors with two goals in mind: first, to collect current data about F|S visitors, including demographics and visit characteristics and second, to explore visitors’ experiences at F|S, in particular, what visitors value about their F|S experiences and how visitors rate their experiences in the context of the mission statement and newly articulated impact statement. Two data collection instruments were used for the visitor study: a standardized questionnaire and an in-depth
This report presents the findings from a front-end evaluation for an exhibition being developed by The Tech Museum of Innovation about genetics, health, and technology. Front-end evaluation is conducted to help planners understand visitors’ thoughts and reactions to key themes, ideas, concepts, and activities being developed for an exhibition. Since front-end evaluation highlights both common ground and gaps between visitors and the exhibition’s concept, the evaluation findings may inform the team’s decisions as exhibition development progresses. The evaluation objectives were to: (1)
This is an evaluation study of a new installation of interpretive signage and eight interactives in the Jungle Trails exhibition area of the Cincinnati Zoo and Botanical Garden. The summative evaluation is framed by the overall evaluation question: Does the Jungle Trails area facilitate learning through family interactions? To address this question, four broad sub-questions were determined as indicators of success of the project: 1. Do families engage with the interactives? 2. Do families perceive a difference in the way they interact in Jungle Trails? 3. Does the ‘family approach’ to signage