This document provides a brief story about how the Designing our Tomorrow team explored some of their questions about exhibit features by using the C-PIECE Framework: Framework of Collaborative Practices at Interactive Engineering Challenge Exhibits.
This exploratory line of inquiry looked at relationships between exhibit features and visitor groups’ Informed engineering design practices. This brief includes an Introduction, Methods and Findings, Summary, and Implications.
This exploratory line of inquiry was conducted to inform the development of the Designing our Tomorrow exhibit and
This paper provides detailed descriptions of the goals, theoretical perspectives, context, and methods used in A study of collaborative practices at interactive engineering challenge exhibits (the C-PIECE Study), the first of two studies in the Designing Our Tomorrow (DOT) research program. The C-PIECE Study supported foundational and exploratory lines of inquiry related to engineering practices used by families engaging with design challenge exhibits. This paper describes the study background and methods as an anchor to four other products that detail these four specific lines of inquiry and
The purpose of this research was to explore associations between engineering practices included in the C-PIECE framework. In this work, we took particular interest in practices under the Defining a Problem proficiency. Practices under Defining a Problem have great potential to influence the entire exhibit interaction and early observations indicated that visitor groups did not engage frequently in these practices at the informed level, therefore they were seen as an opportunity ripe for study. Through observations, interviews, and video analysis, the DOT research team investigated the
Are you interested in co-creating fun activities that exercise groups’ engineering practices? Are you curious about the types of practices that groups can exercise through exhibits?
The Framework of Collaborative Practices at Interactive Engineering Challenge Exhibits (C-PIECE Framework) provides informal education professionals with a guide when co-developing, designing, facilitating, evaluating and researching engineering design challenge experiences.
This framework was developed with input from inter-generational families, including girls 9 to 14 years old. It was adapted from theory
Implementation of a permanent exhibit and supporting programs exploring themes of labor, immigration, and the changing nature of work and community in New Bedford’s commercial fishing industry.
To produce "More Than a Job: Work and Community in New Bedford’s Commercial Fishing Industry," a permanent exhibit, digital exhibits, K-12 curriculum materials, and significant public programming exploring themes of labor and immigration, and the changing nature of work and community in New Bedford's commercial fishing industry.
Very little is known about the experiences of people with learning disabilities in informal learning environments such as science centers and museums. This project will describe the ways in which engagement and intrinsic motivation for learning are and are not supported for visitors with learning disabilities, and build capacity for informal STEM education practitioners to apply this learning for the benefit of those with learning disabilities as well as any visitor who needs more support in the context of self-directed learning. Broadening participation science, technology, engineering and math (STEM) is a core goal of the National Science Foundation and its Advancing Informal STEM Learning (AISL) program. This project pursues this goal with a focus on young people with learning disabilities. As the largest group of individuals with disabilities in the United States, people with learning disabilities make up an estimated 20% of the U.S. population. Science professions offer many life- and work-related opportunities for individuals with learning disabilities, and the flexible experiences of informal learning spaces offer important opportunities to promote participation, engagement in and motivation for science. This work represents the next generation of accessible design to broaden participation in, and impacts of, informal STEM learning opportunities. This project will generate guidelines and resources to support inclusive design for this group of visitors. Resources will include a Toolkit of Visual Assets that can be shared digitally and in print with youth with learning disabilities, informal STEM practitioners, and the learning disability research and practice community.
The project will develop empirical knowledge to support informal STEM practitioners to better facilitate the inclusion of youth with learning disabilities. Using the lens of Self-Determination Theory as an explanatory framework, this research will be pursued in three phases. Self-Determination Theory describes the psychological needs that must be met, such as autonomy and feelings of efficacy, to create an environment that supports individuals' engagement in self-motivated behaviors. Phase 1 will be an exploratory study describing the engagement and motivation of adolescents (ages 10-17) with learning disabilities when experiencing varied STEM exhibits. This first phase will adapt validated scales, employ an existing observation protocol, and conduct stimulated recall interviews with youth. Phase 2 will explore, develop and investigate design strategies to improve the intrinsic motivation of youth with learning disabilities at educational STEM exhibits. This second phase will involve a set of experimental studies in which design strategies related to intrinsic motivation are manipulated to inform principles of inclusive design for visitors with learning disabilities. As in the previous phase, Phase 2 will adapt validated scales and employ an existing observation protocol. Phase 3 will focus on design charrettes in which researchers and practitioners work with high school students with learning disabilities in a co-design process. The charrettes will generate guidelines and case examples of exhibit components using Universal Design for Learning to balance varying design priorities and effectively, inclusively design exhibits for this population. This third phase will rely on qualitative coding of co-design charette artifacts, field notes and researcher reflections; member checking will play an important role in the coding process. Dissemination efforts for this project will target youth with learning disabilities, informal STEM education practitioners, and the broader field of learning disability researchers and practitioners. In addition to the exhibit design guidelines and Toolkit described above, the project will publish peer reviewed articles and develop manuscripts aimed at educational research and practice.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
National priorities recommend the U.S. fortify a culture of innovation by encouraging broader participation in invention and STEM. The Game Changers is an Innovations in Development exhibition project with embedded research that advances knowledge about how museum exhibits can activate STEM-related inventive identities among the public. The project is a collaboration between the Smithsonian's Lemelson Center for the Study of Invention and Innovation at the National Museum of American History (NMAH-LC), educational researchers, an exhibition design firm, and community based organizations. While the Game Changers exhibition theme of inventiveness in sports provides an initial spark for broad audience interest and engagement, its ultimate intent is to foster and enhance inventive identity among diverse audiences, particularly girls and young women ages 10-17, African American youth ages 10-17, and people of all ages with disabilities. Visitors will be met by a brief introductory display to launch their journey from passive learner to active inventor. A diverse array of athletes and inventors provide relevant motivational exemplars and ask visitors "How will YOU Change the Game?" Examples of invention challenges include, applying the principles of physics and materials science to aid in designing a safer helmet and exploring computational fluid dynamics to design a faster swimsuit. Throughout the exhibition experience, visitors will draw on an array of STEM skills and knowledge essential to sports, including physiology, kinesiology, and biomechanical engineering, physics, biomimicry, robotics, computer science, data analysis, and virtual and augmented reality. Throughout the project, the team will work with priority audiences, starting with front-end research and evaluation; progressing iteratively through stages of formative research, design, and evaluation; and conducting summative evaluation to ensure that the STEM-based content and design strategies are impacting inventive identity and meeting audiences' interests and needs. In coordination with the exhibition development and evaluation teams, educational researchers will iteratively explore and develop a model for innovative identity development in informal learning environments.
Educational psychologists from Old Dominion University and Temple University will collaborate closely with the NMAH-LC team, exhibition design-fabrication firm Roto, and evaluators from Randi Korn & Associates to adapt a theoretical model of identity from a formal education setting to an informal learning context. In the model, identity is conceptualized as a complex dynamic system, with interdependent internal and external elements (ontological/epistemological beliefs; self-perceptions; purpose and goals; perceived action possibilities) and reciprocal influences in a process of continuous emergence. Using design based research and a previously developed coding manual, the team will iteratively apply, test, and further advance the inventive identity development model, a set of inventive identity indicators for future research and development, and a list of exhibition design techniques for activating inventive, STEM-based identity development in informal learning environments. The research team will prioritize diverse audiences for iterative cycles and focus groups, including participants from the Girl Scouts of the Nation's Capital, Smithsonian Accessibility Program, Smithsonian's Anacostia Community Museum, and YMCA of Washington, DC. The exhibition's research, evaluation, and design outcomes will be disseminated widely across the AISL field and through project collaborators.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
For thousands of years, Native Hawaiian/Pacific Islander (NHPI) seafarers have successfully utilized systemic observation of their environment to traverse vast expanses of open ocean and thrive on the most remote islands on earth. Developing NHPI trust in the scientific enterprise requires building connections that bridge the values and concepts of 'ike kupuna (traditional knowledge) with scientific knowledge systems and contemporary technology. This project will develop and research a pop-up science exhibit that connects indigenous Hawaiian knowledge with contemporary Western science concepts. The exhibit will show how community knowledge (that is consistent with underlying scientific principles and natural laws) has informed innovation by indigenous peoples. This community-initiated and developed project will begin with a single pop-up exhibit designed to incorporate several hands-on culture-based STEM activities that integrate traditional and modern technologies. For example, the exhibit may cover indigenous systems of star navigation for ocean voyaging, systems of netting for food and water containers, or systems of home design with local and natural materials. This project seeks to develop preliminary evidence of the effectiveness of such an approach for supporting rural Hawaiian youths' STEM engagement, understanding, and personal connections to Native Hawaiian STEM knowledge. Findings from this pilot and feasibility study will inform the development of a larger pop-up science center grounded in indigenous Hawaiian STEM knowledge, and advance intellectual knowledge around culturally sustaining pedagogy by helping informal STEM education practitioners understand community initiated and developed STEM exhibits.
This pop-up science center pilot will be led by a local Hawaiian community organization, INPEACE, in collaboration with several local community members and other community-based organizations. The preliminary research will iteratively explore whether and how an existing Hawaiian culture-based framework can be used to design hands-on STEM exhibits to enhance rural learner engagement, depth of STEM knowledge, and connection to Native Hawaiian STEM knowledge. Research efforts led by Kamehameha Schools, which has a long history of conducting research from an indigenous worldview, will engage 120 learners from various rural communities across Hawaii, from which 40 will be pre-selected middle-school youth, and 80 individuals will be from public audiences of learners ages 12 and up. Through a series of observations, interviews, pre and post surveys with validated instruments, and focus groups, the research will probe: (1) The learners' thoughts on the science practice and its relevance to old and new Hawaii and modern society. (2) The level at which related STEM topics have been understood, and (3) The learners' perceptions about their connection to Native Hawaiian STEM knowledge. Results from this pilot study will inform a future pop-up science center development project, and add to the scarce literature on community-driven, culturally sustaining exhibition development.
This Pilots and Feasibility Studies project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As new technologies continue to dominate the world, access to and participation in science, technology, engineering, mathematics (STEM), and computing has become a critical focus of education research, practice, and policy. This issue is exceptionally relevant for American Indians, who remain underrepresented as only 0.2% of the STEM workforce, even though they make up 2% of the U.S. population. In response to this need, this Faculty Early Career Development Program (CAREER) project takes a community-driven design approach, a collaborative design process in which Indigenous partners maintain sovereignty as designers, to collaboratively create three place-based storytelling experiences, stories told in historical and cultural places through location-based media. The place-based storytelling experiences will be digital installations at three culturally, politically, and historically significant sites in the local community where the public can engage with Indigenous science. The work is being done in partnership with the Northwestern Band of the Shoshone Nation (NWBSN).
The principal investigator and the NWBSN will investigate: (a) what are effective strategies and processes to conduct community-driven design with Indigenous partners?; (b) how does designing place-based storytelling experiences develop tribal members' design, technical, and computational skills?; (c) how does designing these experiences impact tribal members' scientific, technological, and cultural identities? The goals are to establish a process of community-driven design, build infrastructure to support this process, and understand how this methodological approach can result in culturally-appropriate ways to engage with science through technology. The principal investigator will work with the tribe to complete three intergenerational design cycles (a design cycle is made up of multiple design iterations). Each design cycle will result in one place-based storytelling experience. The goal is to include roughly 15 youth (ages 6-18), 10 Elders, and 10 other community members (i.e. members ages 18-50, likely parents) in each design cycle (35 tribal members total). Some designers are likely to participate in multiple design cycles. The tribe currently has 48 youth ages 6-18 and the project aims to engage at least 30 across all three design cycles. Over four years of designing three different experiences, the NWBSN aims to recruit at least 100 tribal members (just under 20% of the tribe) to make contributions (as designers, storytellers, or to provide cultural artifacts or design feedback).
This CAREER award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This front-end evaluation study is part of Designing Our Tomorrow: Mobilizing the Next Generation of Engineers, a five-year project (2018–2023) led by the Oregon Museum of Science and Industry (OMSI) with the support of the National Science Foundation (NSF, DRL-1811617) and project partners: Adelante Mujeres, the Biomimicry Institute, and the Fleet Science Center. The Designing Our Tomorrow (DOT) project seeks to promote and strengthen family engagement and engineering learning via compelling exhibit-based design challenges, presented through the lens of sustainable design exemplified by
Science centres have been identified as an important resource in encouraging teenagers to choose higher education in science and technology. This is of interest to society, since there seems to be a problem in getting sufficient numbers to do so. And accomplishing this is sometimes described as a fatal question for a nation’s future prosperity and development. Still, there is an international trend where teenagers fail to visit science centres.
Through research, little is known about what is interesting or useful to the public, as well as how to reach those who are ‘unengaged’. Considering
The Brooklyn Botanic Garden (BBG) and Brooklyn Academy of Science and the Environment (BASE) contracted RK&A to conduct an evaluation of their partnership’s progress and outcomes over three years. The goal of the summative evaluation is to explore students, families, and teachers’ perceptions of and relationship to BBG and the BBG-BASE partnership. The evaluation also explored attitudes and understandings of how to engage in nature exploration, scientific inquiry, and environmental stewardship in a meaningful way.
How did we approach this study?
RK&A developed questionnaires to be