The Multi-Site Public Engagement with Science—Synthetic Biology (MSPES) initiative was an Innovations in Development project funded by the National Science Foundation (DRL-1421179) through the Advancing of Informal STEM Learning program (AISL). MSPES promoted public engagement with science (PES)—a model of mutual dialogue and learning between public and scientist audiences—through the creation and distribution of PES kits to nearly 200 informal science education sites around the country. Kits included two types of learning experiences: (1) forum programs during which scientists and teen or
During the school year of 2017-2018, Fairchild Tropical Botanic Garden (Fairchild) implemented the second year of a four-year project entitled: Growing Beyond Earth (GBE). NASA is providing funding support for project implementation as well as an external project evaluation. The evaluation activities conducted this year were focused on understanding project implementation and assessing project outcomes using data collected between September 2017 and May 2018. This report’s findings and accompanying recommendations inform next year’s project implementation and evaluation activities.
DATE:
TEAM MEMBERS:
Catherine RaymondMarion LitzingerCarl LewisAmy Padolf
Exploration Place, with funding from the National Aeronautics and Space Administration (NASA), contracted RK&A to conduct a summative evaluation of Design Build Fly, an exhibition and program series that explores what happens behind-the-scenes in Wichita’s aircraft plants. The goals of the study were to identify how visitors use the exhibition, explore what meaning visitors make from Design Build Fly, and understand to what extent visitors’ meaning-making aligns with intended outcomes.
How did we approach this study? RK&A conducted timing and tracking observations of visitors to the
The Collaboration for Ongoing Visitor Experience Studies (COVES) is designed to unite science centers across the country to systematically collect, analyze, and report on visitor experience data. We envision a collaborative museum community seeking to better understand and improve the visitor experience. We believe that studying the visitor experience in science centers—who visits a particular museum, why they visit, what they experience during their visit, and how they react to different aspects of their experience—can help organizations learn about their visitors, make evidence-based
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Museum of Science, Boston (MOS) and Boston University (BU) will conduct a Pilot and Feasibility Study project that leverages the current Living Laboratory (LL) model and expand it to engage high school students (teens) in experimental psychology research, science communication and science education activities. In LL, which is now an extensive network of museums and university researchers across the country, scientists and museum staff collaborate to engage children in studies on the museum floor and educate caregivers about the research. Multi-site implementation and evaluation of LL has also documented positive impacts for undergraduate researchers. Many sites are eager to extend these benefits to high school students by engaging them as practitioners within the model and by providing them with opportunities to engage in current research, education and communication, thereby helping to foster stronger youth identities with science and its applications in society. This project expands a ten-year LL partnership between MOS and BU to: 1) pilot a program in which high school students both conduct scientific research and engage the public in learning about science; 2) explore strategies for museums and universities to collaboratively engage, support and mentor high school students in science research, communication and education activities; 3) document curricular, other programmatic, and evaluation materials; and 4) convene professional participants to provide feedback on pilot materials, and assess the viability of implementing similar programs at additional sites. Guided by developmental evaluation, these activities will generate knowledge for the field, and act to increase professional capacity to integrate experiences for teens at multiple LL sites in future projects. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Designing Our Tomorrow project will develop a framework for creating exhibit-based engineering design challenges and expand an existing model of facilitation for use in engineering exhibits. The project seeks to broaden participation in engineering and build capacity within the informal science education (ISE) field while raising public awareness of the importance of sustainable engineering design practices. The project focuses on girls aged 9-14 and their families and is co-developed with culturally responsive strategies to ensure the inclusion and influence of families from Latino communities. The project will conduct research resulting in theory-based measures of engineering proficiencies within an exhibit context and an exhibit facilitation model for the topic area of engineering. Based on the research, the project will develop an engineering design challenge framework for developing design challenges within an exhibit context. As the context for research, the project will develop a bilingual English/Spanish 2,000-square foot traveling exhibition designed to engage youth and families in engineering design challenges that advance their engineering proficiencies from beginner to more informed, supported by professional development modules and a host-site training workshop introducing strategies for facilitating family engineering experiences within a traveling exhibition. The project is a collaboration of Oregon Museum of Science and Industry with the Biomimicry Institute, Adelante Mujeres, and the Fleet Science Center.
Designing Our Tomorrow builds on a theory-based engineering teaching framework and several previous NSF-funded informal education projects to engage families in compelling design challenges presented through the lens of sustainable design exemplified by biomimicry. Through culturally-responsive co-development and research strategies to include members of Latino communities and provide challenges that highlight the altruistic, creative, personally relevant, and collaborative aspects of engineering, the Designing Our Tomorrow exhibition showcases engineering as an appealing career option for women and helps families support each other's engineering proficiencies. To better understand and promote engineering learning in an ISE setting, the project will conduct two research studies to inform and iteratively develop effective strategies. In the first study, measurement development will build on prior research and practice to design credible and reliable measures of engineering proficiency, awareness, and collaboration, as well as protocols for use in exhibit development and the study of facilitation at engineering exhibits, and future research. The second study will explore the effects of facilitation on the experience outcomes.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Design Squad Maker project, a collaboration of WGBH Public Television (WGBH) and the New York Hall of Science (NySci), will research and develop engineering design projects that provide evidence for how to integrate informal learning spaces with digital public media assets. The project will be designed to provide accessible, motivating pathways for children aged 8-11 in pursuing and completing ambitious, fully realized engineering design projects. The project will build on WGBH's existing Design Squad model for using media to engage kids in informal engineering activities and NySCI's expertise in facilitating children's unique design processes in museum settings. By developing and studying new strategies for supporting children's use of the design process, Design Squad Maker will address critical issues in engineering education and informal learning that remain relatively unexplored. Project research will contribute to the emerging literature on "connected learning" by building new knowledge about how children's design activities can be sustained and supported over time and across multiple contexts, such as science museums and homes. Drawing on existing research in the learning sciences and engineering education, the project seeks to advance knowledge about the role of museums, maker spaces, and digital technology in sustaining children's learning in engineering. The project will use a design-based research approach, a research and development process whereby educational designers collaborate with learning scientists. Museum practitioners will collaborate with research staff and media developers to design, test, and improve digital resources, facilitation strategies, and parent engagement strategies to support children through an entire design process. The research and development process will result in digital resources and approaches in a flexible toolkit, which will be used when assessing the project's scale-up potential at 10 museum/maker spaces. The project will conduct a summative evaluation, assessing the project's intended impacts with children, parents, and staff at museums/maker spaces across the country. The toolkit will be nationally disseminated through national partners that include the Association of Science-Technology Centers, Maker Education, the National Association for Family, School, and Community Engagement, and engineering education organizations. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop a collaborative program to connect and prepare researchers from divergent disciplines to communicate science to publics of all ages in three distinct informal environments: pop-ups at community events, experiential learning with problem solving events for youth, and presentations at a science museum. It will study the effects of this program on the identity and motivations of STEM researchers and evaluate the short and medium-term outcomes for public audiences. Project partners include, The STEAM Factory, OHI/O Informal Learning in Tech Program, and the Center of Science and Industry (COSI) all located in Columbus, Ohio.
The primary goals of this project are as follows. 1) Develop a collaborative program that connects and prepares researchers from divergent disciplines to creatively and effectively communicate science to people of all ages. 2) Evaluate the short and medium-term learning outcomes across different informal learning settings. 3) Study the effect of this collaborative program on the motivations and identify of the researchers. The specific research question is: In what ways do researchers motivations and identities further develop because of these collaborative experiences with divergent perspectives? A mixed method approach will be used. Data will be collected and analyzed from 3 cohorts of researchers who implement programs in different informal learning settings. A series of pre- and post interviews with scientists will be designed to answer the research question above. Interviews will be grounded in self-determination theory. Later reflective surveys will serve as triangulation for the data.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sathya GopalakrishnanJustin MeyerRachel KajfezArnab Nandi
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This travel grant focuses on broadening participation in STEM learning and advancing scholarship and practice related to Public Participation in STEM Research (PPSR). In PPSR, members of the public participate voluntarily in scientific processes, addressing real-world problems in ways that may include formulating research questions, conducting scientific experiments, collecting and analyzing data, interpreting results, making new discoveries, developing technologies and applications, and solving complex problems. Currently, participation in many PPSR projects does not often reflect the full range diversity in the nation. The Citizen Science Association (CSA), an organization that seeks to support the rigorous and ethical practice of citizen science--a form of PPSR--across a broad range of issues and communities, brings together PPSR practioners and scholars biennially. The CSA conference, to be held March 13-17, 2019, in Raleigh, North Carolina, will build networks and capacities to support scholarship and practice across the full range of citizen science and across diverse populations.
This travel grant supports 75 participants, 25 local and 50 national, from groups underrepresented in STEM, who are actively engaged in community-based environmental science and have not previously attended a CSA conference. Community-based environmental science projects, which often occur in minority communities, are increasingly relying on PPSR approaches, including engaging public participants in STEM learning through technology and the development of data literacies. Through this travel grant, the 2019 CSA conference will bring together the expertise and experiences of practioners and scholars from citizen science and community-based environmental science projects. The conference will facilitate four days of interactions and mutual learning with significant time for iterative reflection and active discussion to make the sessions personally relevant and meaningful. This intentionally allows for identifying areas of both commonalities and tensions across citizen science and community-based environmental science projects, with time to work through various approaches and issues with colleagues for greater learning. The interactions should allow for meaningful discussion of goals, theory, methods, recruitment and retention and other aspects of projects that make a difference in the success of projects. The structure of the conference includes panels, presentations, poster sessions, and discussion to increase the quality and extent of PPSR and community-based environmental science practice.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The pilot and feasibility study will develop instructional workshops for an adult population of quilters to introduce them to computational thinking. By leveraging pre-existing social structures, skill sets, and engagement in quilting, the researchers hope to help participants develop computer science and computational thinking knowledge and skills. The long-term goal is to broaden public awareness of computational thinking and build links between computer science and other areas of interest. By leveraging the social structure and existing skills held by practicing quilters, the workshops have the potential to reach an audience of millions of quilters around the nation and worldwide, the majority of whom are adult women. The research will be developed and tested with two groups: the Orlando Modern Quilt Guild in Orlando, FL, and an informally gathered quilting class in the Worcester, MA area. Outcomes for the project include workshop materials that can be used in a variety of quilting group contexts nationwide, a deeper understanding of the processes and mechanisms for adult computer science education through crafts, and evaluation of the pilot workshop focused on the impact on participants' engagement, self-identity, and learning for computational thinking. The research especially focuses on leveraging pre-existing knowledge, interests, and social structures to draw connections to computational thinking, and studying how this impacts participants' self-described identity, attitude, and engagement with computer science. The project also assesses a novel method for teaching computational thinking that has potential for broad applicability in a variety of social and creative hobbies. Participants will use and modify generative design software that creates quilt designs and, in doing so, learn how creative interests can be expanded through computer science. By focusing on the hobby of quilting, which is not typically associated with computer science, the knowledge built through designing and evaluating the research offers strategies for altering public perception of computer science. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Research in Service to Practice project examines how informal place-based collaborative learning can support local communities' planning processes related to current environmental changes. As a part of this study workshops will be conducted in 8 communities that have a range of planning mandates based on recent extreme environmental changes such as drought/wildfires, flooding, invasive species, or loss of native wildlife. Place-based adaptation workshops will be designed to be locally relevant and empower people to learn and act on their newly acquired understandings. Local community collective actions may include a range of decisions (e.g., infrastructure changes such as building defenses against sea level rise in coastal communities or improving the quality of roads to withstand higher temperatures.) Collective action may also lead to community wide behavioral changes such as individuals using less water or farmers planting different crops. The study will focus on the efficacy of the methods used in 8 workshops in communities throughout the country. Research objectives include: 1) identifying experts' belief about the most critical components of successful workshops; 2) Understanding of prior workshop outcomes and 3) test hypothesized effective practices and understand how learning takes place and collective action does or does not take place. The project addresses key AISL solicitation priorities including strategic impact on the field of informal STEM learning, advancing collaboration, and building professional capacity. It engages both public and professional audiences as described in the solicitation. Public audiences include stakeholders in each of the 8 communities such as community environmental groups, NGOs, businesses, landowners, and local government planners. Professional audiences include the workshop scientists and facilitators who will be trained in the experimental workshop approach. The project builds upon and expands the existing AISL portfolio of science communication projects such as science cafes, science festivals, science media, and library based projects. This is a collaborative project of EcoAdapt and Virginia Tech with participants from the National Parks Conservation Association, the Desert Research Institute, and the Wildlife Conservation Society and others. The research will progress through two phases. Phase 1 is designed to identify consensus-based effective practices for promoting learning and action in adaptation workshops. It includes a Delphi study to synthesize beliefs about effective practices held by experienced workshop facilitators across the United States. Phase 2 includes iterative design and research of eight adaptation workshops in various communities with a range of planning mandates and recent extreme weather experience. By iteratively revising the workshop design, the study will elucidate how different workshop components influence participant learning, individual behavioral intentions, and subsequent efforts toward collective action. The overall research design will examine the relationships of pedagogical and collaborative techniques to learner outcomes and collective action. Many of these lessons are likely relevant to other collaborative informal science learning contexts. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project will research the educational impact of social robots in informal learning environments, with applications to how social robots can improve participation and engagement of middle-school girls in out-of-school computer science programs in under-resourced rural and urban areas. The use of robots to improve STEM outcomes has focused on having learners program robots as tools to accomplish tasks (e.g., play soccer). An alternate approach views robots as social actors that can respond intelligently to users. By designing a programmable robot with social characteristics, the project aims to create a culturally-responsive curriculum for Latina, African American, and Native American girls who have been excluded by approaches that separate technical skill and social interaction. The knowledge produced by this project related to the use and benefits of social programmable robots has the potential to impact the many after-school and weekend programs that attempt to engage learners in STEM ideas using programmable robot curricula.
The project robot, named Cozmo, will be programmed using a visual programming language and will convey emotion with facial expressions, sounds, and movements. Middle school girls will engage in programming activities, collaborative reflection, and interact with college women mentors trained to facilitate the course. The project will investigate whether the socially expressive Cozmo improves computer science outcomes such as attitudes, self-efficacy, and knowledge among the middle school female participants differently than the non-social version. The project will also investigate whether adding rapport-building dialogue to Cozmo enhances these outcomes (e.g., when a learner succeeds in getting Cozmo to move, Cozmo can celebrate, saying "I can move! You're amazing!"). These questions will be examined research conducted with participants in multi-session after-school courses facilitated by Girl Scout troops in Arizona. The project will disseminate project research and resources widely by sharing research findings in educational and learning science journals; creating a website with open source code for programming social robots; and making project curriculum and related guidelines available to Girl Scouts and other educational programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.