Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
The free‐choice nature of informal STEM education (ISE) makes rigorous and contextually appropriate evaluation of outcomes challenging. Traditional measures such as surveys and interviews have been widely used in ISE evaluations, but they have limitations: They are typically self‐reports that are susceptible to the reactive effects of measurement, and they tend to intrude upon the participant's learning experience. The ISE field needs measures that capture outcomes in more direct and less obtrusive ways, permitting triangulation with multiple measures on outcomes. In this chapter, we define
We define "informal STEM education" and explain some of the reasons its outcomes are so inherently challenging to evaluate, including the critical need for ecological validity and the fact that many informal learning experiences are low-visibility and opportunistic. We go on to highlight significant advances in the field, starting with the fundamental embracing of learning outcomes that go well beyond narrow measures of knowledge and skills, to include interest, engagement, and identity-building. Within that framework, we note the development of shared constructs and shared instruments
The STEM Interest and Engagement (STEM IE) Study was a four-year project funded by the National Science Foundation under the auspices of its Advancing Informal STEM Learning (AISL) program that was designed to better understand what types of practices, supports, and opportunities afforded to early adolescent youth: (1) Are especially effective in helping youth experience in-the-moment engagement while participating in ISL activities, and (2) Serve to support growth in STEM interest and aspirations. The study was conducted in a total of nine, STEM-oriented, summer learning programs serving
DATE:
TEAM MEMBERS:
Neil NaftzgerJennifer SchmidtLee ShumowPatrick BeymerJoshua Rosenberg
Parents are vital players in raising youth’s awareness of the value of STEM and in brokering their participation in activities that build STEM competencies.
STEM Next Opportunity Fund is committed to ensuring that every child – especially girls, youth of color, kids in low-income communities, and youth with disabilities – has access to STEM experiences and the social capital that lead to greater opportunities in academics and careers. We believe family engagement is a game changer and offer this white paper to raise awareness of its importance and amplify promising practices.
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
“Reclaiming Digital Futures” is a free guide and associated website for youth organizations to use as they integrate digital learning into their programming and practices. The report is available at DigitalLearningPractices.org.
The report and the associated DigitalLearningPractices.org site contain a cross-section of resources to aid organizations and educators in developing quality programming that integrate technology and youth development. Rather than focusing on efforts to help youth become fluent and skilled in uses of technology simply for the sake of meeting predetermined standards
Since 1992, the WSU Math Corps, a combined mathematics and mentoring program, has worked to make a difference in the lives of Detroit’s children—providing them with the love and support that all kids need in the moment, while empowering them with the kinds of educational opportunities and sense of purpose, that hold the promise of good lives for themselves and a better world for all.
DATE:
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
Although discussions of museums often revolve around exhibits, educators in these spaces have the potential to create in-depth, social learning experiences beyond what is possible at exhibits alone. There is still little empirical research, however, to inform how we understand, approach, and improve museum facilitation practices. In this study, we sought to address this gap by quantifying the impact of facilitation by trained educators working with visitors at interactive museum exhibits and comparing this to visitor engagement and learning outcomes for families without educator support. Using
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden the participation of blind students in STEM fields.
Activities began this summer (2018) with a week-long, residential engineering design program for thirty blind high school students at NFB headquarters in Baltimore. The evaluation focused on perceptions of process and measures of
This poster was presented at the 2019 AISL PI Meeting in Washington, DC. It provides an overview of a project designed to broaden participation of blind students in engineering fields through the development of spatial ability skills and the showcasing of nonvisually accessible teaching methods and techniques.
By using widely-available technologies, this project brings fully online instructional coaching in STEM to out-of-school educators who live too remotely to attend ongoing in-person workshops.
DATE:
TEAM MEMBERS:
Sue AllenPerrin ChickScott ByrdAlexandria BrasiliLiv DetrickLynn FarrinHannah Lakin