Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
The free‐choice nature of informal STEM education (ISE) makes rigorous and contextually appropriate evaluation of outcomes challenging. Traditional measures such as surveys and interviews have been widely used in ISE evaluations, but they have limitations: They are typically self‐reports that are susceptible to the reactive effects of measurement, and they tend to intrude upon the participant's learning experience. The ISE field needs measures that capture outcomes in more direct and less obtrusive ways, permitting triangulation with multiple measures on outcomes. In this chapter, we define
We define "informal STEM education" and explain some of the reasons its outcomes are so inherently challenging to evaluate, including the critical need for ecological validity and the fact that many informal learning experiences are low-visibility and opportunistic. We go on to highlight significant advances in the field, starting with the fundamental embracing of learning outcomes that go well beyond narrow measures of knowledge and skills, to include interest, engagement, and identity-building. Within that framework, we note the development of shared constructs and shared instruments
The Field Museum contracted RK&A to conduct a summative evaluation of the Grainger Science Hub and the Discovery Squad Carts, two museum experiences facilitated by educators or trained volunteers. The goals of the study are to explore the extent to which visitors interact with programming in the Science Hub and at Discovery Squad Carts and the nature of those interactions, as well as visitor motivations and takeaways.
How did we approach this study?
RK&A conducted observations in the Science Hub and at Discovery Squad Carts to understand the nature of experiences at each. The
Although discussions of museums often revolve around exhibits, educators in these spaces have the potential to create in-depth, social learning experiences beyond what is possible at exhibits alone. There is still little empirical research, however, to inform how we understand, approach, and improve museum facilitation practices. In this study, we sought to address this gap by quantifying the impact of facilitation by trained educators working with visitors at interactive museum exhibits and comparing this to visitor engagement and learning outcomes for families without educator support. Using
This poster was presented as part of the 2019 AISL PI Meeting. In this project, the New York Hall of Science, in collaboration with the Amazeum (Bentonville, AR), the Tech (San Jose, CA), and the Creativity Labs (Indiana University), is conducting a design-based research study to develop evidence-based guidance about how museums can use narratives to create more equitable and effective engineering experiences for girls. Through iterative activity development, the project team is exploring ways of using narrative elements (such as characters, settings, and problem frames) to communicate a story
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
resourceevaluationProfessional Development, Conferences, and Networks
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
The COMPASS conference will bring together 80 participants for two days in September 2018 at the Exploratorium in San Francisco, CA. The first dissemination will take place in a presentation at the ASTC conference the following month in October 2018. A webinar sharing insights from COMPASS and inviting others to engage will be held in March 2019 hosted by ASTC and accessible by ASTC members and non-members alike. A companion COMPASS e-publication will be released for free download, also in March 2019, with summaries of conference proceedings, key issues identified, case histories of ILAM in
Why Zoos and Aquariums Matter (WZAM3) conference presentaiton slides for the 2018 ASTC Annual Conference (Hartford, CT) and the NAAEE 2018 Annual Conference and Research Symposium (Spokane, WA).
The project asks, “What are the real outcomes of the zoo or aquarium enterprise, both as a visitor destination and as a public voice in public media?” and has the following three aims:
To understand how visitor goals and behavior impact learning.
To understand how the conservation education agenda of most Z/As interlaces with those goals.
To understand how the public situates the voice of Z/As in society.
Project poster presented at the 2019 AISL PI Meeting in Alexandria, VA.
This project creates "data-catcher" exhibits that allow museum visitors to participate in scientific research, contributing data from their interactions while engaged in compelling learning experiences.