The starting point of the Evaluating Evaluation project was our impression that despite the substantial resources that are spent on the summative evaluation of museums and galleries the research has little impact and largely remains ineffectual.
With support from the Wellcome Trust and the Heritage Lottery Fund, we set out to see why this seems to be the case and to explore whether there are ways in which the impact of summative evaluations on knowledge and practice might be enhanced. To this end, we reviewed a substantial number of reports, undertook a range of interviews and held two
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
This research project led by the Exploratorium will use a combination of tracking and timing, cluster analysis, and focus groups to seek to answer the research question: To what extent and in what ways do female-responsive designs more effectively engage girls at STEM exhibits? This project addresses the need for more research in this area by pioneering the study of potential female-responsive design (FRD) principles for exhibits across a wide variety of STEM topics and exhibit types. This project includes four phases that will build from the work of the PI that developed an initial Female-Responsive Design (FRD) Framework regarding female engagement and learning in STEM -- based on extensive literature review and practitioner interviews. This project will expand on and validate this FRD Framework, with the ultimate goal of having a set of criteria for female-responsive designs (FRD) that effectively engage girls at STEM exhibits. The four phases of the research project are: Phase 1: Track 1000 boys and girls across three institutions using over 300 physics, engineering, and math exhibits to identify which exhibits engage boys and girls equally, and which are less engaging for girls. Phase 2: A panel of experts and girl advisors identify additional female-responsive design principles, expanding on those identified to date in literature and practice. Phase 3: Combining results from the first two phases, the third phase employs statistical analyses to reveal the most effective combinations of design principles for engaging girls across a variety of exhibits. Phase 4: This qualitative phase conducts focus groups with girls to explore how the final FRD Framework works to better engage them, and how their learning differs at exhibits that exemplify the principles in the Framework.