Museums are increasingly engaging with their communities in understanding and addressing the complex questions of our society. How is this effort manifested in museum practice, and what is the impact of this work? Our study attempted to explore the boundaries of these questions by reviewing and synthesizing reports on InformalScience.org. The work was part of the NSF-funded Building Informal Science Education project (BISE). We selected a small set of reports of projects that aligned with our definition of social issues as conditions that are harmful to society, complex and characterized by a
Assessing science learning in informal environments involves a series of challenges that are difficult to address using traditional assessment practices (National Research Council, 2009). Some of the assessment challenges inherent in informal and afterschool environments include: (a) interactions in these environments are diverse in terms of duration, type of activity, number of people involved; (b) they usually include emerging behavior due to unpredictable interactions with other participants (e.g., peers, family members, and facilitators); and (c) these environments are characterized by a
Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
The Universally Designed Museum Programming project was envisioned as a way to create public programs that are more inclusive of people with disabilities. We used the concepts of universal design and Universal Design for Learning as well as our prior experiences with these topics in exhibition design and nanotechnology programming as a foundation for our work. Through this project, we gained insight into building a community of interest, facilitating a charrette in an inclusive way, using universal design guidelines to develop programs, and measuring the effectiveness of our process.
To better help museum visitors make sense of large data sets, also called “Big Data”, this study focused on the types of visual representations visitors recognize, and how they make meaning (or not) of various visuals. Individual adults and youths were shown five different data visualizations (one from each of five categories), one at a time, and asked if the visualization looked familiar and how it was read. This study found that Context and previous experience matters. Participants of all ages are familiar with a wide variety of visual displays of data. If a participant encounters a visual
This report from the National Research Council explores how learning changes the physical structure of the brain, how existing knowledge affects what people notice and how they learn, the amazing learning potential of infants, and the relationship between classroom learning and learning in everyday settings such as community and the workplace. It identifies learning needs and opportunities for teachers and provides a realistic look at the role of technology in education.