“Monkeying Around: Digital Media and Parent/Child Engagement Resources to Increase Preschool Computational Thinking” is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. WGBH, a leading producer of educational STEM media, developed prototypes of videos and hands-on activities around the project’s computational thinking learning goals for young children. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative
Twenty-first century skills are vital for preparing youth for careers in science, technology, engineering, and math (STEM) fields. STEM out-of-school time (OST) programs play an important role in helping youth develop these skills, particularly the teamwork skills necessary for the growing collaborative nature of STEM jobs. However, there is a lack of appropriate measures to evaluate this key programmatic outcome in STEM OST settings. This dissertation research addresses the lack of measures through the development of an instrument to assess team communication skills in middle and high school
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This guide offers insight into community engagement practices and activity development from our making and equity project, Making Connections. It includes documentation and recommendations for work that is designed to engage community partners as equal partners, and is written most of all for other practitioners.
Ruff Family Science is an exploratory project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. More specifically, the project is undertaking a research and design process to create prototype
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The theme of this conference project by the New York Hall of Science will be exploring how to better design exhibits to promote "public engagement with science." Here, "public engagement with science" refers to opportunities that go beyond traditional approaches to the public understanding of science. The event will invite professionals to consider how to shift exhibit designs toward engaging visitors with STEM in ways that emphasize the intersection of STEM innovation with visitors' daily lives, their personal agency, and their interdependence with their personal social networks and the institutions that advance STEM knowledge and innovation. The conference and its pre- and post-conference activities will bring together curators, exhibition developers, community outreach professionals, museum administrators, and learning scientists from the United States and Canada. They will work together to identify design principles and key obstacles to designing exhibits that can better help science museums achieve two goals: 1) making visitors' diverse and personal questions, concerns, and perspectives central to their experience of the exhibits; and 2) engaging visitors as contributors to the exhibit experience in ways that make their contributions visible and consequential. During this two-day event attendees will consider how exhibits can support broader and more diverse public participation in critical debates about the roles of STEM discovery and innovation in society. The effort is grounded in recent work on public engagement with science; on reorganizing museums to become sites for participation and contribution by visitors, and particularly by institutions' local communities; and on making and engineering design programming within museums. The goal is to chart a course toward a vision of the future of science museums in which they maintain their status as sources of trusted information, while also fulfilling their potential as sites of genuine participation and social interaction, in which visitors make meaningful contributions to the substance and workings of the museum floor while also engaging with, learning about and holding themselves accountable to the core concepts and practices of the STEM disciplines. The conference will build the capacity and collaborative engagement of a network of science centers whose work is central to achieving the museum field's ultimate goal of engaging the public of all ages in learning STEM in informal environments. The conference and associated activities will be evaluated by staff at the New York Hall of Science, with oversight by an external advisory committee of research and development professionals. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Over the last decade there has been significant growth in the number of afterschool programs that offer science activities to youth. Measuring the quality and contributions of these programs to youth learning is important to both the afterschool organizations and the communities that support them, including participating youth and their families. To address the range and evolving interests and capacities of all young people within a community, there are, by necessity, a wide range of types of afterschool science programming. Such programming may vary by focus (e.g., botany, astronomy, computer science, engineering, or zoology), structure (e.g., hands-on, place-based, on-line, or in partnership with local industry) and other factors. Across the range of programming, there are different intended learning goals and opportunities for students. For these reasons, a range of measurement tools are needed to monitor the quality and outcomes of wide range of afterschool science programs. To explore the current state of evaluation and measurement tools for use in afterschool science programs, the University of Washington, in partnership with the Afterschool Alliance and the National Girls Collaborative, will design and host a conference for afterschool STEM leaders, researchers, and evaluators. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This conference is grounded in the programmatic priorities and strategies of afterschool organizations. The goals of the conference are to (a) articulate and map the range of intended outcomes of afterschool STEM programs; (b) identify how existing measurement and evaluation tools map on to intended outcomes; and (c) identify overlaps, complementarities, and gaps in the available tools in order to provide guidance to (i) practitioners on how and why to select current evaluation tools and (ii) researchers on directions for future tool development. Tangible convening products include:
*A detailed, visual representation ("intended outcomes map") of the range of outcomes afterschool programs are seeking to achieve, related to student learning, educator capacity, program quality, family impacts, learning ecosystems connectivity;
*A taxonomy of current evaluation instruments aligned to these outcomes, with an explanation of how they overlap or differentiate both methodologically and theoretically;
*The identification of the areas where further work is needed, including further specification of learning outcomes and future development of evaluation tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Pilot and Feasibility study will investigate strategies for enhancing the mathematics in museum-based making and tinkering activities and lay the foundation for a full research study on broadening family participation in mathematics through making. This proposal builds directly on the NSF-funded Math in the Making convening. During this convening, questions about how to authentically highlight and enhance the mathematics in making and tinkering experiences, and how different math-enhancement approaches might influence learner experiences and outcomes, emerged as critical issues for researchers, educators, and mathematicians alike. The project aims to provide a practical lens to help researchers and educators connect topics across STEM with making and tinkering experiences. The project also seeks to advance theoretical understandings of museum-based learning by exploring ways that activity design and facilitation strategies influence how visitors understand the nature and goals of the experience and, in turn, how these visitor experiences shape learning outcomes. The project is designed to explore the most promising of these math-enhancement strategies in more depth, to propose as a next project and develop a theoretical framework for understanding and describing how these strategies influence how families understand and engage with the mathematics in maker experiences. Through several culturally-responsive approaches developed in collaboration with community-based organizations, the project will research how mathematics in maker experiences influences participant engagement and learning. The project will culminate in the design of a research study. Reports and resources developed by the project will be broadly disseminated to researchers, mathematicians, and educators. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Exploratorium in San Francisco, in collaboration with social science researchers at Arizona State University and Rutgers University, will conduct a two-year Pilots and Feasibility Studies project that will test a new model for integrating museum exhibits with public participation in scientific research, called Exhibit-Based PPSR (E-PPSR). The team will create a mini-exhibition about social psychology that (a) engages science museum visitors in investigating and reflecting on social factors that promote cooperation or not, (b) builds public awareness of the science of social psychology and (c) generates valid data for academic research in this area.
The Exploratorium will build on its long history of creating participatory exhibits that engage visiting groups in social science learning and in self-reflective metacognition. This expands beyond the typical lab-in-the-museum in which individual visitors interact with researchers' laptops or simple props. The model takes the exhibit experiences further, injecting the dimension of public participation in social psychology research. By voluntarily and anonymously contributing demographic and response data, large numbers of people from mixed-age groups will help social scientists gain new insights into cooperation among a broader sample of humanity than are usually studied in university labs. The E-PPSR lab is always available, rather than open only when a researcher is present. The model also incorporates research on learning and assesses the effect of E-PPSR on social science learning experiences. Do museum visitors build greater conceptual understanding of the social science by contributing to real research and seeing their own responses within the larger dataset? Do they attend more deeply to debriefing activities when they have contributed their own data? The three main deliverables include: 1) a prototype Exhibit-based PPSR laboratory at the Exploratorium comprised of one exhibit for gaining informed consent, three 'Data-Catcher' exhibits modified to record anonymous responses when visitors opt-in to contributing to social psychological research, and one debriefing exhibit. A back-end database will send data to the academic researchers; 2) evaluation studies that test the E-PPSR model. The studies will assess the success of debriefing approaches, the effectiveness of recruitment and the impact of E-PPSR on learning. The team will publish a journal article describing the E-PPSR model and academic research findings. The team will also organize a conference session with others in the museum field who manage in-house academic research laboratories; and 3) a report by the academic partners describing the impact of the project on their research program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Informal STEM education needs high quality program evaluation. Research is particularly needed on the relationship between STEM outcomes and positive youth development (PYD) / socio-emotional learning (SEL). This pilot and feasibility project involves a collaboration between experts in STEM education, out-of-school time programs (OST), PYD, SEL, evaluation, and program development. STEM Scouts helps youth grow in character and develop skills using experiential activities and interaction with STEM professionals. This project expands the implementation of the Systems Evaluation Protocol (SEP), an evidence-based approach to evaluation planning.
The goals are to: 1) develop a theory of change for STEM Scouts highlighting the relationship between STEM outcomes and PYD/SEL outcomes; 2) pilot enhancements to the SEP (System Mapping, Ecosystem Modeling, and Model Validation); and, 3) determine the feasibility of conducting a national STEM Scouts study. STEM Scouts leadership and project researchers will work through the SEP to generate a stakeholder map, logic model, and pathway model (PM). Five STEM Scouts Labs across the country will participate in focus groups where they will complete SM to identify the system in which the Lab exists (e.g., stakeholders and decision-makers), review and revise their system maps, identify key outcomes and connections in the PM, and discuss how the PM reflects their STEM Scouts experiences. It is hypothesized the enhanced SEP will enable the working group to better understand factors hindering or enabling program and evaluation feasibility and success. Findings will be disseminated to the evaluation/research community, OST program providers/developers and the public.
This project is funded by the National Science Foundation's Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Gathering evidence for the long-term impact of programs for youth on their involvement in STEM studies and careers continues to be a challenge, especially for program interventions happening in earlier stages of development (e.g., elementary, middle, high-school years. Work that focuses on mechanisms for mitigating these challenges is important. The conference and associated activities aim to build a research action agenda that is rooted in practice to support better understanding of the long-term impacts of informal STEM programs for girls provided by cultural institutions, along with methods and approaches for measuring them. The project team will use a collaborative co-design approach to establish a STEM for Girls Research Alliance. The Alliance will include three levels of participants, with different levels of commitment: a core planning group (CPG) of 8-10 people, approximately 20-25 participating members (PM) and 50-60 interested stakeholder group representatives (SGR). The project team will utilize face-to-face meetings, digital engagement strategies, and surveys to develop the agenda and solicit multiple rounds of feedback and input. The CPG, consisting of leaders and representatives from state-based STEM for Girls organizations that are part of the National Girls Collaborative Project (NGCP) and members of the New York State STEAM for Girls Collaborative, will be responsible for setting priorities and guiding the action agenda. The PM will include representatives (educators and researchers) from informal STEM programs at cultural institutions that participate in the state-based collaboratives. The PM will be regularly consulted on important aspects of the action agenda that relate to their work. Finally, the SGR will include representatives from several audiences that are being served by or work with the participating members: girls and young women, parents, educators, funders, researchers and employers. The SG will be engaged via focus groups virtually or at national meetings to which these individuals attend.
To support broader involvement of professionals working in this sector, a comprehensive digital engagement plan using web and social media networks will be developed. The plan will utilize a consistent hashtag, #STEMeffect, allowing participants to follow the conversation across social media platforms. Social media platforms to be utilized will include Twitter, Instagram, Facebook, LinkedIn, Google+, Snapchat and others. More than 60,000 people will be engaged via the networks of the NY STEAM Collaborative, NGCP, WSKG Public Media and project partners. A robust research action plan will position researchers to further explore the role of informal STEM education experiences in shaping the career choices of girls and identify where there are breaks in the hoped-for pathways to STEM college and careers. It also will benefit informal STEM organizations by yielding information that will help them to fine-tune their programs for girls and young women. Ultimately, contributions to the knowledge base will result in broadened participation of girls and women in STEM programs and careers. This work is funded by the Advancing Informal STEM Learning (AISL) program as part of its strategy to enhance learning in informal environments and support innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Lynda KennedyAlicia SantiagoBabette Moeller
This poster, which was presented at the Visitor Studies Association Conference in 2017, shares methods, working definitions and frameworks, and lessons-learned from Developing Guidelines for Designing Challenging and Rewarding Interactive Science Exhibits (DRL-1612577). Through design-based research, this project is investigating the emotional state of “productive struggle,” an intensive, fruitful state of exhilaration and challenge characterized by high levels of physiological arousal along with the experience of negative emotions. The project pushes beyond the positive range of emotional