In this final chapter, we reflect on four themes that cut across the preceding chapters on evaluating outcomes in informal STEM education (ISE): validity, context, technology, and evaluation capacity building. We also note several topics that we hope will be addressed more extensively in future conversations about evaluation in ISE. These include the ethical responsibilities of evaluators, theory‐based approaches to evaluation, formal training and professional development pathways for evaluators, and funding opportunities and the structural landscape of the field.
The goal of our research is to identify strengths and weaknesses of high school level science fair and improvements that might enhance learning outcomes based on empirical assessment of student experiences. We use the web-based data collection program REDCap to implement anonymous and voluntary surveys about science fair experiences with two independent groups -- high school students who recently competed in the Dallas Regional Science and Engineering Fair and post high school students (undergraduates, 1st year medical students, and 1st year biomedical graduate students) on STEM education
Research misconduct has become an important matter of concern in the scientific community. The extent to which such behavior occurs early in science education has received little attention. In the current study, using the web-based data collection program REDCap, we obtained responses to an anonymous and voluntary survey about science fair from 65 high school students who recently competed in the Dallas Regional Science and Engineering Fair and from 237 STEM-track, post-high school students (undergraduates, 1st year medical students, and 1st year biomedical graduate students) doing research at
This paper describes a follow‐up focus group study for the larger Exhibit Designs for Girls' Engagement (EDGE) project. Grounded in Culturally Responsive Pedagogical theory (CRP), the project aimed to understand the relationship between female responsive designs and girls' engagement at STEM exhibits. After developing a Female‐Responsive Design (FRD) Framework and conducting a large‐scale study to determine the most important design attributes for engaging girls at exhibits, the final step involved a qualitative investigation into those design attributes. Four focus groups with 22 girls aged 8
We examined the conversational reflections of 248 families with 6–11‐year‐old children shortly after they visited a tinkering exhibit. Our aim was to understand the conditions of tinkering and conversational reflection that can enhance STEM learning opportunities for young children. We discuss implications for the design of tinkering and reflection activities that can both reveal and advance STEM learning.
This report details the results of a five-year longitudinal study on the Explainer program at the Exploratorium. Explainers from the summer 1999, fall 1999 and spring 2000 cohorts were interviewed before and after their first semester of work as an Explainer, then followed up with additional interviews three more times at intervals of from one to three years. Additional supplemental data were gathered from a larger set of Explainers via surveys that were administered to these same cohorts before and after their first semester of work, and to a set of Explainer alumni who had been out of the
Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
In this paper, we use the concept of consequential learning to frame our exploration of what makes learning and doing science matter for youth from nondominant communities, as well as the barriers these youth must confront in working toward consequential ends. Data are derived from multimodal cases authored by four females from nondominant communities that present an account of 'science that matters' from their work during their middle school years. We argue that consequential learning in science for these girls involves engaging science with a commitment to their community. This form of
DATE:
TEAM MEMBERS:
Daniel BirminghamAngela Calabrese BartonAutumn McDanielJalah JonesCamryn TurnerAngel Roberts
Making is a recent educational phenomenon that is increasingly occurring in schools and informal learning spaces around the world. In this paper we explore data from maker educators about their experiences with failure. We surveyed maker educators about how they view failure happening with youth in their formal and informal programs and how they respond. The results reveal some concrete strategies that seem to show promise for helping educators increase the likelihood that failure experiences for youth can lead to gains in learning and persistence.
This article summarizes a survey of formal
Traditionally, programs designed for community audiences are designed by the STEM institution or organization seeking to “serve” a given community, using top-down design processes that are framed by the perspectives of the lead organizations, and typically reinforcing dominant cultural norms in STEM and therefore marginalizing certain audiences. Co-design offers an approach that can lead to more robust and sustainable results by developing programs that are culturally responsive, respectful, and inclusive.
About this resource:
This is a practice brief produced by CAISE's Broadening
Broadening participation efforts need to move beyond the programmatic to the institutional. Embedding inclusion throughout an organization’s operations will lead to more comprehensive, better supported, and more impactful and sustainable results.
About this resource:
This is a practice brief produced by CAISE's Broadening Participation in STEM Task Force to help informal STEM education (ISE) and science communication groups reflect on and strengthen their efforts to broaden participation in STEM. It is part of a larger professional development toolkit, developed for those who lead staff
Science educators and communicators must value and appreciate science that already takes place in the community, which may look different than traditional (school-like) representations of science, which have historically excluded many communities. "Community science programs" are designed by community members to advance community priorities and recognize that communities themselves—not just the nearby universities or research labs—are rich with people, resources, and practices that make up science in everyday life.
About this resource:
This is a practice brief produced by CAISE's
DATE:
TEAM MEMBERS:
Angela Calabrese BartonEdna TanDaniel BirminghamCarmen TurnerCenter for Advancement of Informal Science Education (CAISE)