Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
Recent work in the informal science education (ISE) field has begun to systematically categorize aspects of learning in a variety of ways. Most notable are the “Framework for Evaluating Impacts of Informal Science Education” (Friedman, A. (Ed.), 2008, henceforth ‘NSF’) and “Learning Science in Informal Environments” (LSIE, National Research Council, 2009, henceforth ‘NRC’). Both frameworks have potential implications for assessment as well as project planning.
In spring 2009, the Denver Museum of Nature & Science (Museum) contracted with JVA Consulting, LLC (JVA) to conduct a comprehensive process and outcome evaluation of the Passport to Health (P2H) program. The Museum designed P2H, originally a three-year program funded by the Colorado Health Foundation (the Foundation), to improve health outcomes for fifth-grade students as well as their families and teachers throughout the Denver metro area. Appendix includes survey.
DATE:
TEAM MEMBERS:
JVA Consulting, LLC
resourceevaluationProfessional Development, Conferences, and Networks
A Study of Communication in the NISE Network (Network Communication Study), conducted during the sixth year of the grant, sought to learn how the four primary communication components that were developed in the first 5 years of NISE Net (NanoDays, face-to-face meetings, the regional hub structure, and the nisenet.org website) are functioning within the Network. In particular, the study explored how these components communicate information, ideas, and practices related to NISE Net between and within the three Network tiers.
This report summarizes the processes and findings of a two-year, multimethod evaluation of the Museum of Science & Industry's Mystery at the Museum program. The evaluation's purpose was to assess the program's impact on teachers and students and to guide program improvements.
This Science Learning+ Planning Project will develop a prototype assessment tool (based on a mobile technology platform) to map STEM learning experiences across different learning ecologies (e.g. science centers, mass media, home environment) and to develop research questions and designs for a Phase 2 Science Learning+ proposal. The tool will focus on the impact of the learning ecologies on knowledge, interest, identity and reasoning rather than emphasize learning in a specific content area. The proposing team will develop and conduct a small scale usability study during the planning period, which will inform what is proposed in the Phase 2 research. A key focus of the planning period will be to identify and develop the theoretical constructs (i.e., outcomes) to be measured by the prototype App. As a starting point, the project will start with four of the six strands identified in Learning Science in Informal Environments (National Research Council, Bell et al., 2009): (1) interest triggered by a STEM experience; (2) understanding scientific knowledge; (3) engaging in scientific reasoning; and (4) identifying with the scientific enterprise. Discussion among the project partners during the planning process will revolve around how these strands should be measured in the Phase 2 research across ecologies. The measurement tool will assess the goal(s) that people set as they engage in STEM learning within each ecology and will measure the individuals' duration and level of engagement. The project will strive to utilize measures that: (1) are nonobtrusive; (2) are embedded in STEM experiences; (3) can be used across ecologies; (4) can be scaled for other ecologies than the ones examined in Phase 2 research; and (5) will be easy to use by researchers and practitioners.
DATE:
-
TEAM MEMBERS:
Bradley MorrisJohn DunloskyGreat Lakes Science CenterUniversity of LimerickIdeaStream (UK)Irish Independent newspaper
The MyBEST (Mentoring Youth Building Employable Skills in Technology) project, funded by a grant from the National Science Foundation's Informal Science Education program, concluded its three years of operation in 2006. This youth-based program was intended to provide participants with in-depth learning experiences involving information and design technologies. These experiences had a dual focus: enabling youth participants to gain fluency in using these technologies while showing them how adults apply them in work and academic endeavors. Appendix includes survey.
The purposes of the STUDIO 3D evaluation were to collect information about the impact upon student learning as a result of participating in the STUDIO 3D Project, as well as to elicit information for program improvement. Areas of inquiry include recruiting and retention, impact on project participants, tracking student impacts, and the project as a whole.
The formative evaluation of Season 2 of Design Squad was performed in two parts. Part 1 included a field test conducted by American Institutes for Research in spring 2008. Part 2, conducted by Veridian inSight, included follow-up interviews with teachers whose classrooms participated in the field test. The teacher interviews were conducted in fall of 2008. This document is the Design Squad, Season 2 final evaluation report. It contains the following sections: Section 1: Highlights from the teacher interviews conducted in fall of 2008 by Veridian inSight. Section 2: Findings from the field test
DATE:
TEAM MEMBERS:
Veridian inSight, LLCAmerican Institutes for Research