This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
Recent work in the informal science education (ISE) field has begun to systematically categorize aspects of learning in a variety of ways. Most notable are the “Framework for Evaluating Impacts of Informal Science Education” (Friedman, A. (Ed.), 2008, henceforth ‘NSF’) and “Learning Science in Informal Environments” (LSIE, National Research Council, 2009, henceforth ‘NRC’). Both frameworks have potential implications for assessment as well as project planning.
The Universally Designed Museum Programming project was envisioned as a way to create public programs that are more inclusive of people with disabilities. We used the concepts of universal design and Universal Design for Learning as well as our prior experiences with these topics in exhibition design and nanotechnology programming as a foundation for our work. Through this project, we gained insight into building a community of interest, facilitating a charrette in an inclusive way, using universal design guidelines to develop programs, and measuring the effectiveness of our process.
This tool was created by Museum of Science, Boston Design Challenges educators and the Research and Evaluation team, intended to record observations of children’s engagement in the engineering design process during participation in design-based activities in a science museum setting. It consists of a checklist of behaviors corresponding with steps of the engineering design process, previously developed for the program based on state and national standards, educator input, and past evaluator observations. The behavioral checklist matches to parts of the engineering design process, including
This paper is the first report on an extensive ethnographic study of two professional schools of art and design in the United States. The overall purpose of the study is to identify general principles for how to design learning environments that prepare learners to be creative. First, I document the cultural model of teaching and learning held by the faculty and students, and analyze the pedagogical practices used. This studio model is of interest because it emerged naturally in a community of educational practice. I argue that it is distinct from the two cultural models most familiar to
Poster for 2014 AISL PI Meeting. The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth.