This project develops and examines place-based learning using mobile augmented reality experiences for rural families where museums and science centers are scarce yet where natural resources are rich with outdoor trails, parks, and forestlands. The collaborative research team, with members from rural libraries, outdoor learning centers, learning scientists at Penn State University, and rural communities in Pennsylvania, will develop augmented reality and mobile learning resources for families and children aged from 4 to 12. The goal is to help people see what is not visible in real-time in order to learn about life and earth sciences based on local watersheds, trees, and seasonal cycles that are familiar and relevant to rural communities. To accomplish this goal, the project team will create scientifically meaningful experiences for rural families and children in their out-of-school time through three iterations of research and design. Although there is evidence that augmented reality can support learning, little empirical research has been conducted to determine what makes one type of augmented learning experience more effective than others in outdoor learning spaces. This project will produce research findings on the utility of augmented reality for science learning with families and youths outdoors. This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants
Through a four-year design-based research study, researchers will investigate three research questions. (1) How can outdoor learning experiences be enhanced with augmented reality and digital resources in ways that make science more visible and interesting?; (2) How do different forms of augmentations on trails and in gardens support science learning? 3) What social roles do children and parents play in supporting each other's science learning and connections to rural communities? Data collection includes video-recordings of children and families in the outdoors, learning analytics of people's behavior, and interviews with rural families. The project's research design will allow for the development of theory, which supports rural families learning science within and about their communities. At the end of the project, the team will offer generalizable design principles for technologically-enhanced informal learning for outdoor displays, gardens, and trails.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This project examines the conditions in which families and young learners most benefit from "doing science and math" together among a population that is typically underserved with respect to STEM experiences--families experiencing poverty. This project builds on an existing program called Teaching Together that uses interactive parent-child workshops led by a museum educator and focused on supporting STEM learning at home. The goal of these workshops is to increase parents'/caregivers' self-perception and ability to serve as their child's first teacher by supporting learning and inquiry conversations during daily routines and informal STEM activities. Families attend a series of afternoon and evening workshops at their child's preschool center and at a local children's museum. Parents/Caregivers may participate in online home learning activities and museum experiences. The project uses an experimental design to test the added value of providing incremental supports for informal STEM learning. The study uses an experimental design to address potential barriers parents/caregivers may perceive to doing informal STEM activities with their child. The project also explores how the quantity and quality parent-child informal learning interactions may relate to changes in children's science and mathematics knowledge during the pre-kindergarten year. The project partners include the Children's Learning Institute at the University of Texas Health Science Center at Houston and the Children's Museum of Houston.
The project is designed to increase understanding of how parents/caregivers can be encouraged to support informal STEM learning by experimentally manipulating key aspects of the broader expectancy-value-cost motivation theory, which is well established in psychology and education literatures but has not been applied to preschool parent-child informal STEM learning. More specifically, the intervention conditions are designed to identify how specific parent supports can mitigate potential barriers that families experiencing poverty face. These intervention conditions include: modeling of informal STEM learning during workshops to address skills and knowledge barriers; materials to address difficulties accessing science and math resources; and incentives as a way to address parental time pressures and/or costs and thereby improve involvement in informal learning activities. Intervention effects will be calculated in terms of effect sizes and potential mediators of change will be explored with structural equation modeling. The first phase of the project uses an iterative process to refine the curriculum and expand the collection of resources designed for families of 3- to 5-year-olds. The second phase uses an experimental study of the STEM program to examine conditions that maximize participation and effectiveness of family learning programs. In all, 360 families will be randomly assigned to four conditions: 1) business-as-usual control; 2) the Teaching Together core workshop-based program; 3) Teaching Together workshops + provision of inquiry-based STEM activity kits for the home; and 4) Teaching Together workshop + activity kits + provision of monetary incentives for parents/caregivers when they document informal STEM learning experiences with their child. The interventions will occur in English and Spanish. A cost analysis across the interventions will also be conducted. This study uses quantitative and qualitative approaches. Data sources include parent surveys and interviews, conversation analysis of home learning activities, parent photo documentation of informal learning activities, and standardized assessments of children's growth in mathematics, science, and vocabulary knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Over the last decade there has been significant growth in the number of afterschool programs that offer science activities to youth. Measuring the quality and contributions of these programs to youth learning is important to both the afterschool organizations and the communities that support them, including participating youth and their families. To address the range and evolving interests and capacities of all young people within a community, there are, by necessity, a wide range of types of afterschool science programming. Such programming may vary by focus (e.g., botany, astronomy, computer science, engineering, or zoology), structure (e.g., hands-on, place-based, on-line, or in partnership with local industry) and other factors. Across the range of programming, there are different intended learning goals and opportunities for students. For these reasons, a range of measurement tools are needed to monitor the quality and outcomes of wide range of afterschool science programs. To explore the current state of evaluation and measurement tools for use in afterschool science programs, the University of Washington, in partnership with the Afterschool Alliance and the National Girls Collaborative, will design and host a conference for afterschool STEM leaders, researchers, and evaluators. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This conference is grounded in the programmatic priorities and strategies of afterschool organizations. The goals of the conference are to (a) articulate and map the range of intended outcomes of afterschool STEM programs; (b) identify how existing measurement and evaluation tools map on to intended outcomes; and (c) identify overlaps, complementarities, and gaps in the available tools in order to provide guidance to (i) practitioners on how and why to select current evaluation tools and (ii) researchers on directions for future tool development. Tangible convening products include:
*A detailed, visual representation ("intended outcomes map") of the range of outcomes afterschool programs are seeking to achieve, related to student learning, educator capacity, program quality, family impacts, learning ecosystems connectivity;
*A taxonomy of current evaluation instruments aligned to these outcomes, with an explanation of how they overlap or differentiate both methodologically and theoretically;
*The identification of the areas where further work is needed, including further specification of learning outcomes and future development of evaluation tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Pilot and Feasibility study will investigate strategies for enhancing the mathematics in museum-based making and tinkering activities and lay the foundation for a full research study on broadening family participation in mathematics through making. This proposal builds directly on the NSF-funded Math in the Making convening. During this convening, questions about how to authentically highlight and enhance the mathematics in making and tinkering experiences, and how different math-enhancement approaches might influence learner experiences and outcomes, emerged as critical issues for researchers, educators, and mathematicians alike. The project aims to provide a practical lens to help researchers and educators connect topics across STEM with making and tinkering experiences. The project also seeks to advance theoretical understandings of museum-based learning by exploring ways that activity design and facilitation strategies influence how visitors understand the nature and goals of the experience and, in turn, how these visitor experiences shape learning outcomes. The project is designed to explore the most promising of these math-enhancement strategies in more depth, to propose as a next project and develop a theoretical framework for understanding and describing how these strategies influence how families understand and engage with the mathematics in maker experiences. Through several culturally-responsive approaches developed in collaboration with community-based organizations, the project will research how mathematics in maker experiences influences participant engagement and learning. The project will culminate in the design of a research study. Reports and resources developed by the project will be broadly disseminated to researchers, mathematicians, and educators. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Exploratorium in San Francisco, in collaboration with social science researchers at Arizona State University and Rutgers University, will conduct a two-year Pilots and Feasibility Studies project that will test a new model for integrating museum exhibits with public participation in scientific research, called Exhibit-Based PPSR (E-PPSR). The team will create a mini-exhibition about social psychology that (a) engages science museum visitors in investigating and reflecting on social factors that promote cooperation or not, (b) builds public awareness of the science of social psychology and (c) generates valid data for academic research in this area.
The Exploratorium will build on its long history of creating participatory exhibits that engage visiting groups in social science learning and in self-reflective metacognition. This expands beyond the typical lab-in-the-museum in which individual visitors interact with researchers' laptops or simple props. The model takes the exhibit experiences further, injecting the dimension of public participation in social psychology research. By voluntarily and anonymously contributing demographic and response data, large numbers of people from mixed-age groups will help social scientists gain new insights into cooperation among a broader sample of humanity than are usually studied in university labs. The E-PPSR lab is always available, rather than open only when a researcher is present. The model also incorporates research on learning and assesses the effect of E-PPSR on social science learning experiences. Do museum visitors build greater conceptual understanding of the social science by contributing to real research and seeing their own responses within the larger dataset? Do they attend more deeply to debriefing activities when they have contributed their own data? The three main deliverables include: 1) a prototype Exhibit-based PPSR laboratory at the Exploratorium comprised of one exhibit for gaining informed consent, three 'Data-Catcher' exhibits modified to record anonymous responses when visitors opt-in to contributing to social psychological research, and one debriefing exhibit. A back-end database will send data to the academic researchers; 2) evaluation studies that test the E-PPSR model. The studies will assess the success of debriefing approaches, the effectiveness of recruitment and the impact of E-PPSR on learning. The team will publish a journal article describing the E-PPSR model and academic research findings. The team will also organize a conference session with others in the museum field who manage in-house academic research laboratories; and 3) a report by the academic partners describing the impact of the project on their research program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Informal STEM education needs high quality program evaluation. Research is particularly needed on the relationship between STEM outcomes and positive youth development (PYD) / socio-emotional learning (SEL). This pilot and feasibility project involves a collaboration between experts in STEM education, out-of-school time programs (OST), PYD, SEL, evaluation, and program development. STEM Scouts helps youth grow in character and develop skills using experiential activities and interaction with STEM professionals. This project expands the implementation of the Systems Evaluation Protocol (SEP), an evidence-based approach to evaluation planning.
The goals are to: 1) develop a theory of change for STEM Scouts highlighting the relationship between STEM outcomes and PYD/SEL outcomes; 2) pilot enhancements to the SEP (System Mapping, Ecosystem Modeling, and Model Validation); and, 3) determine the feasibility of conducting a national STEM Scouts study. STEM Scouts leadership and project researchers will work through the SEP to generate a stakeholder map, logic model, and pathway model (PM). Five STEM Scouts Labs across the country will participate in focus groups where they will complete SM to identify the system in which the Lab exists (e.g., stakeholders and decision-makers), review and revise their system maps, identify key outcomes and connections in the PM, and discuss how the PM reflects their STEM Scouts experiences. It is hypothesized the enhanced SEP will enable the working group to better understand factors hindering or enabling program and evaluation feasibility and success. Findings will be disseminated to the evaluation/research community, OST program providers/developers and the public.
This project is funded by the National Science Foundation's Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Gathering evidence for the long-term impact of programs for youth on their involvement in STEM studies and careers continues to be a challenge, especially for program interventions happening in earlier stages of development (e.g., elementary, middle, high-school years. Work that focuses on mechanisms for mitigating these challenges is important. The conference and associated activities aim to build a research action agenda that is rooted in practice to support better understanding of the long-term impacts of informal STEM programs for girls provided by cultural institutions, along with methods and approaches for measuring them. The project team will use a collaborative co-design approach to establish a STEM for Girls Research Alliance. The Alliance will include three levels of participants, with different levels of commitment: a core planning group (CPG) of 8-10 people, approximately 20-25 participating members (PM) and 50-60 interested stakeholder group representatives (SGR). The project team will utilize face-to-face meetings, digital engagement strategies, and surveys to develop the agenda and solicit multiple rounds of feedback and input. The CPG, consisting of leaders and representatives from state-based STEM for Girls organizations that are part of the National Girls Collaborative Project (NGCP) and members of the New York State STEAM for Girls Collaborative, will be responsible for setting priorities and guiding the action agenda. The PM will include representatives (educators and researchers) from informal STEM programs at cultural institutions that participate in the state-based collaboratives. The PM will be regularly consulted on important aspects of the action agenda that relate to their work. Finally, the SGR will include representatives from several audiences that are being served by or work with the participating members: girls and young women, parents, educators, funders, researchers and employers. The SG will be engaged via focus groups virtually or at national meetings to which these individuals attend.
To support broader involvement of professionals working in this sector, a comprehensive digital engagement plan using web and social media networks will be developed. The plan will utilize a consistent hashtag, #STEMeffect, allowing participants to follow the conversation across social media platforms. Social media platforms to be utilized will include Twitter, Instagram, Facebook, LinkedIn, Google+, Snapchat and others. More than 60,000 people will be engaged via the networks of the NY STEAM Collaborative, NGCP, WSKG Public Media and project partners. A robust research action plan will position researchers to further explore the role of informal STEM education experiences in shaping the career choices of girls and identify where there are breaks in the hoped-for pathways to STEM college and careers. It also will benefit informal STEM organizations by yielding information that will help them to fine-tune their programs for girls and young women. Ultimately, contributions to the knowledge base will result in broadened participation of girls and women in STEM programs and careers. This work is funded by the Advancing Informal STEM Learning (AISL) program as part of its strategy to enhance learning in informal environments and support innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Lynda KennedyAlicia SantiagoBabette Moeller
This poster, which was presented at the Visitor Studies Association Conference in 2017, shares methods, working definitions and frameworks, and lessons-learned from Developing Guidelines for Designing Challenging and Rewarding Interactive Science Exhibits (DRL-1612577). Through design-based research, this project is investigating the emotional state of “productive struggle,” an intensive, fruitful state of exhilaration and challenge characterized by high levels of physiological arousal along with the experience of negative emotions. The project pushes beyond the positive range of emotional
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Museum of Science, Boston (MOS) and Boston University (BU) will conduct a Pilot and Feasibility Study project that leverages the current Living Laboratory (LL) model and expand it to engage high school students (teens) in experimental psychology research, science communication and science education activities. In LL, which is now an extensive network of museums and university researchers across the country, scientists and museum staff collaborate to engage children in studies on the museum floor and educate caregivers about the research. Multi-site implementation and evaluation of LL has also documented positive impacts for undergraduate researchers. Many sites are eager to extend these benefits to high school students by engaging them as practitioners within the model and by providing them with opportunities to engage in current research, education and communication, thereby helping to foster stronger youth identities with science and its applications in society. This project expands a ten-year LL partnership between MOS and BU to: 1) pilot a program in which high school students both conduct scientific research and engage the public in learning about science; 2) explore strategies for museums and universities to collaboratively engage, support and mentor high school students in science research, communication and education activities; 3) document curricular, other programmatic, and evaluation materials; and 4) convene professional participants to provide feedback on pilot materials, and assess the viability of implementing similar programs at additional sites. Guided by developmental evaluation, these activities will generate knowledge for the field, and act to increase professional capacity to integrate experiences for teens at multiple LL sites in future projects. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Designing Our Tomorrow project will develop a framework for creating exhibit-based engineering design challenges and expand an existing model of facilitation for use in engineering exhibits. The project seeks to broaden participation in engineering and build capacity within the informal science education (ISE) field while raising public awareness of the importance of sustainable engineering design practices. The project focuses on girls aged 9-14 and their families and is co-developed with culturally responsive strategies to ensure the inclusion and influence of families from Latino communities. The project will conduct research resulting in theory-based measures of engineering proficiencies within an exhibit context and an exhibit facilitation model for the topic area of engineering. Based on the research, the project will develop an engineering design challenge framework for developing design challenges within an exhibit context. As the context for research, the project will develop a bilingual English/Spanish 2,000-square foot traveling exhibition designed to engage youth and families in engineering design challenges that advance their engineering proficiencies from beginner to more informed, supported by professional development modules and a host-site training workshop introducing strategies for facilitating family engineering experiences within a traveling exhibition. The project is a collaboration of Oregon Museum of Science and Industry with the Biomimicry Institute, Adelante Mujeres, and the Fleet Science Center.
Designing Our Tomorrow builds on a theory-based engineering teaching framework and several previous NSF-funded informal education projects to engage families in compelling design challenges presented through the lens of sustainable design exemplified by biomimicry. Through culturally-responsive co-development and research strategies to include members of Latino communities and provide challenges that highlight the altruistic, creative, personally relevant, and collaborative aspects of engineering, the Designing Our Tomorrow exhibition showcases engineering as an appealing career option for women and helps families support each other's engineering proficiencies. To better understand and promote engineering learning in an ISE setting, the project will conduct two research studies to inform and iteratively develop effective strategies. In the first study, measurement development will build on prior research and practice to design credible and reliable measures of engineering proficiency, awareness, and collaboration, as well as protocols for use in exhibit development and the study of facilitation at engineering exhibits, and future research. The second study will explore the effects of facilitation on the experience outcomes.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This workshop is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will conduct an in-person participatory workshop designed to broaden participation in STEM. The project is designed to build the capacity of informal science institutions (ISIs) and their partners to use evidence-based collaborative project management practices and culturally responsive approaches to manage complex partnership efforts. The workshop will develop structure and provide tools for effective collaborative project management between ISIs including science centers and museums, and their research and community partners. To guide the workshops, participants will explore some core dimensions of culture to understand audiences, communities traditionally underserved by informal STEM institutions, and institutional differences. Participants will leave with concrete, actionable plans that will enable them to more effectively bring their collaboration plans to fruition. The project will develop resources including a playbook of project management templates, video vignettes, and summaries of relevant research findings and lessons from the field. Proceedings and resources from the workshop will be shared online with the field and ultimately archived on informalscience.org.
Conference participants will build the human resource expertise, infrastructure, and capacity needed to develop and maintain lasting partnerships that will further their institutions' aspirations to broaden participation in STEM. The project brings together an experienced, multidisciplinary team from informal science education and private industry professionals to advance knowledge of the skills and tools needed for managing complex collaborations between researchers, practitioners, and community stakeholders that will increase their effectiveness when working with diverse audiences. During the workshop, participants will think through their current project work by using a defined collaborative project management process to build a foundation of understanding and trust. Upon completion of the Institute, participants will have: (1) a shared purpose and goals that represent the interests of all parties; (2) identified some cross cultural and organizational differences that need to be accommodated for successful collaboration; (3) fostered joint decision making based on objective steps vs priorities of one organization; and (4) clarified deliverables of their project and how to measure success; (5)identified individual roles and responsibilities within their collaboration.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
There are many reasons to be curious about the way people learn, and the past several decades have seen an explosion of research that has important implications for individual learning, schooling, workforce training, and policy.
In 2000, How People Learn: Brain, Mind, Experience, and School: Expanded Edition was published and its influence has been wide and deep. The report summarized insights on the nature of learning in school-aged children; described principles for the design of effective learning environments; and provided examples of how that could be implemented in the classroom.
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine