Assessing science learning in informal environments involves a series of challenges that are difficult to address using traditional assessment practices (National Research Council, 2009). Some of the assessment challenges inherent in informal and afterschool environments include: (a) interactions in these environments are diverse in terms of duration, type of activity, number of people involved; (b) they usually include emerging behavior due to unpredictable interactions with other participants (e.g., peers, family members, and facilitators); and (c) these environments are characterized by a
Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Educational researchers, scholars, theoreticians, and practitioners define, interpret, and study out-of school science education in various ways. Some use the term informal, while others prefer free-choice, outdoor education, everyday learning or lifelong learning. Preferences reflect theory, settings and practice, but regardless of the terminology, all researchers who are engaged in learning that occurs outside of schools are convinced that a wide range of environments—structured and unstructured—afford various types of engagement and learning. Learning science in such environments has
This article from "The Atlantic" describes ways that teachers are integrating hands-on and experiential STEM learning into the classroom, which include collaboration with informal learning environments through creative field trips.
In spring 2009, the Denver Museum of Nature & Science (Museum) contracted with JVA Consulting, LLC (JVA) to conduct a comprehensive process and outcome evaluation of the Passport to Health (P2H) program. The Museum designed P2H, originally a three-year program funded by the Colorado Health Foundation (the Foundation), to improve health outcomes for fifth-grade students as well as their families and teachers throughout the Denver metro area. Appendix includes survey.
Young people's participation in informal STEM learning activities can contribute to their academic and career achievements, but these connections are infrequently explicitly recognized or cultivated. More systemic approaches to STEM education could allow for students' experiences of formal and informal STEM learning to be aligned, coordinated, and supported across learning contexts. This Science Learning+ planning project brings together stakeholders in two digital badge systems--one in the US and one in the UK--to plan for a study to identify the specific structural features of the systems that may allow for the alignment of learning objectives across institutions. Digital badge systems may offer an inventive solution to the challenge of connecting and building on youth's STEM-related experiences in multiple learning contexts. When part of a defined system, badges could be used to represent and communicate evidence of individual learning, as well as provide youth and educators with evidence-supported indicators for other activities in the system that might be interesting or valuable. Properly designed and supported badge systems could transmit critical information within a network of informal STEM programs and schools that (1) recognize context-dependent, interest-driven learning and (2) provide opportunities to explore those interests across multiple settings. This project advances the field of informal STEM learning in two ways. First, the project documents and analyzes the processes by which two small groups of informal science education organizations and schools negotiate the meaning and value of badges, as proxies for learning objectives, and how they decide to recognize badges awarded by other institutions. This process builds capacity within the target systems while also beginning to identify the institutional, cultural, and material capacity issues that facilitate or constrain the alignment process. Second, the project conducts a pilot study with a small number of youth in the US and UK to investigate factors associated with an individual youth's likelihood of: a) identifying badges of interest; b) connecting the activities of various badge systems to each other and to non-badging institutions, such as school or industry; c) determining which badges to pursue; and d) persisting in a particular badge pathway. Findings from this pilot study will help identify institution- and individual-level factors that might be associated with advancing student interest and progression in STEM fields. Deepening and validating the understanding of those factors and their relative impact on student experiences and outcomes will be the focus of investigations in future studies.
DATE:
-
TEAM MEMBERS:
James DiamondNew York City Hive Learning NetworkMOUSEDigitalMeKatherine McMillan
resourceprojectProfessional Development, Conferences, and Networks
This is a Science Learning+ planning project that will develop a research plan for investigating how applying the principles of embodied cognition to the design of informal learning environments can support young children's (ages 2-6) engagement with, and understanding of, science topics and concepts. While it has been fairly well established that cognition is intertwined with the body's interaction in the physical world, the precise means of applying these ideas to the design of effective learning environments is still emerging. Experimenting with various embodied cognition activities and physical learning configurations to understand what conditions are optimal for informal learning environments for early learners is a major objective of this project. During the planning grant period, the project will identity additional practitioner/research collaborations and will develop research plans for a suite of studies to be enacted by multiple teams of informal learning practitioners and cognitive scientists across the US and UK and that will be submitted as a Phase 2 research. The primary activities of this planning period include organizing a series of workshops that bring together informal learning educators and embodied cognition researchers to engage in deep discussion and design experimentation that will inform the development and refinement of research questions, protocols, and measurement tools. These discussions will be informed by observations of young children as they interact with the River of Grass, an exhibit prototype in which principles of embodied cognition are embedded in its design. The planning period will be led by a collaborative team of informal learning practitioners and cognitive scientists from the US and UK. This group will also oversee plans for the development of a new model for informal STEM research in which a constellation of practitioner/research teams across multiple organizations investigates topics of importance to informal learning practice and research that have the potential to result in a robust body of research that informs the design of informal learning spaces.
Relatively little is known about how Natural History Museums (NHMs) and schools can complement one another to maximize learning among school-age learners. Nor do we fully understand the long-term benefits to learning and engagement with science that NHMs have. In this Science Learning+ project researchers in UK and US universities will work with practitioners in NHMs and school teachers in the UK and the US to address these questions. The project will (a) undertake a critical review of the published and grey literature to examine the contributions to learning and engagement that NHMs have made; (b) develop improved instruments that are common across schools, NHMs and other out-of-school settings to determine the efficacy of learning experiences; devise protocols to explore the possibility of data obtained from museum evaluations being matched with national databases, thus improving our understanding of the consequences of such experiences; (c) map the areas of science curricula (using the latest version of the science National Curriculum in England and the Common Core Standards in the US) that NHMs might most valuably address; d) through researcher-practitioner collaboration review current pedagogical approaches employed by schools and NHMs, with a view to developing and studying new practice models in Phase 2. The project will devise validated instruments (of the sort that are increasingly used in large-scale social psychology studies) and explore whether data obtained from museum visitors can be matched, both in the UK and in the US, onto external datasets (e.g. the National Pupil Database in the UK; Elementary/Secondary Information System in the US).
The CSMC-OMSI Partnership for Public Engagement (COPPE) project was developed to establish a strong and long-lasting partnership between the Center for Sustainable Materials Chemistry (CSMC) and the Oregon Museum of Science and Industry (OMSI). Through participation in this project, COPPE researchers and OMSI educators sought a deeper understanding of each other's profession while simultaneously developing a suite of Informal Science Education (ISE) outreach programs that engage the public in new and enduring ways. These new ISE platforms were developed to enhance public awareness in the areas
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
President Obama announced in April 2013 that the Corporation for National and Community Service (CNCS) would launch a STEM AmeriCorps initiative to build student interest in STEM. A RFA is currently being prepared to be released in the late fall of 2013. This project will engage in quick response research to identify an evaluation and research agenda that can begin to inform the program launch. Thus, the timeframe for informing the initial stages of STEM AmeriCorps is relatively short, and the creation of an evaluation and research agenda is very timely. The products from the RAPID proposal are: (1) a review of the evaluation and research literature on the use of volunteers and/or mentors to build students' interest in STEM; (2) to convene a workshop to identify evaluation and research priorities to guide the initiative; and (3) a summary evaluation agenda that identifies promising directions along with the strength of evidence around key issues.