Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.
One way to encourage youth to pursue training in the STEM fields and enter the STEM workforce is to foster interest and engagement in STEM during adolescence. Informal STEM Learning Sites (ISLS) provide opportunities for building interest and engagement in the STEM fields through a multitude of avenues, including the programming that they provide for youth, particularly teens. Frequently, ISLS provide opportunities to participate in volunteer programs, internships or work, which allow teens both to learn relevant STEM knowledge as well as to share that knowledge with others through opportunities to serve as youth educators. While youth educator programs provide rich contexts for teens to engage as both learners and teachers in these informal STEM environments, research to date has not yet identified the relationship between serving as youth educators and STEM engagement. Thus, the goal of this project is to document the impact of youth educators on visitor learning in ISLS and to identify best practices for implementing youth educator programs. The project studies STEM interests and engagement in the youth participants and the visitors that they interact with at six different ISLS in the US and UK. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This project examines youth educator experiences related to STEM identity, educational aspirations, and motivation. The project also identifies outcomes that the youth educators have on visitors to ISLS in terms of knowledge, interest, and engagement in STEM. The specific aims are: 1) Outcomes for Teens - To measure the longitudinal impact of participation in an extended youth educator experience in an ISLS; 2) Outcomes for Visitors - To compare visitor engagement with and learning from exhibits in ISLS when they interact with a youth educator, relative to outcomes of interacting with an adult educator or no educator; and 3) Outcomes Across Demographics and STEM Sites - To examine differences in visitor engagement based on participant characteristics such as socio-economic status (SES), age, gender, and ethnicity and to compare outcomes of youth educator experiences across different types of ISLS. This research, which draws on expectancy value theory and social cognitive theory, will follow youth participants longitudinally over the course of 5 years and use latent variable analyses to understand the impact on the youth educators as well as the visitors with whom they interact. Importantly, the results of this research will be used to develop best practices for implementing youth educator programs in ISLS and the results will be disseminated to both academic and practice-based communities.
This project has clear and measurable broader impacts in a variety of ways. First, the project provides guidance to improve programming for youth in ISLS, including both the sites involved directly in the research and to the larger community of ISLS through evaluation, development, and dissemination of best practices. Additionally, this project provides rigorous, research-based evidence to identify and describe the outcomes of youth educator programs. This study directly benefits the participants of the research, both the visiting public and the youth educators, through opportunities to engage with science. The findings speak to issues of access and inclusivity in ISLS, providing insight into how to design environments that are welcoming and accessible for diverse groups of learners. Finally, this project provides evidence for best practices for ISLS in developing programs for youth that will lead to interest in and pursuit of STEM careers by members of underrepresented groups.
DATE:
-
TEAM MEMBERS:
Adam Hartstone-RoseMatthew IrvinKelly Lynn MulveyElizabeth ClemensLauren ShenfeldAdam RutlandMark WinterbottomFrances BalkwillPeter McOwanKatie ChambersStephanie TylerLisa Stallard
From 2013-2016, Pacific Science Center, implemented the Exploring Earth Systems Sciences (EESS) project with the purpose of developing and delivering scripted demonstrations utilizing the Science On a Sphere (SOS) technology in order to promote understanding of and increase interest in Earth systems sciences. Specifically, the grant allowed the Science Interpretation team to research and write 20-minute presentations, targeted towards visitors aged 11 and older, about nine unique topics such as: climate change, weather, seasons, or the Polar Regions. Staff were then provided training in
Brooklyn Botanical Garden, Brooklyn NY
Audience Research for a New Garden, 2016
The Brooklyn Botanic Garden (BBG) contracted Randi Korn & Associates, Inc. (RK&A), to conduct a study of visitors to the Discovery Garden. The goal of this study was to assess the successes and challenges of the exhibition and accompanying interactive elements to support the BBG in improving the Discovery Garden.
How did we approach this study?
RK&A used three methodologies to address the study objectives, based on specific outcomes developed by BBG for the Discovery Garden. Data were collected through
This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
Mathematics is a notoriously disliked subject; there is so little stigma associated with being "bad at math", that educated adults openly describe themselves in this way. There are many reasons for math's unpopularity; chief among them is that school mathematics seldom offers opportunities to engage with the richness of this potentially fascinating subject. As a result, the mathematics education pipeline in the United States is more often a filter than a pump, siphoning students out rather than bringing them along. Children have libraries to help them fall in love with literature: where do they get a chance to fall in love with math? This project presents a unique opportunity to study children engaged with mathematics in an informal setting, the Minnesota State Fair, facilitated by mathematically knowledgeable volunteers. The Math On-a-Stick mathematical playground provides a place for children to engage with mathematics by exploring patters, asking quantitative questions, and investigating shape and space to mathematize their play. The project will observe and videotape this engagement to inform the design of mathematical learning environments in a variety of outside of school time settings, such as after school programs and summer camps, that are accessible to a wider range of the population. This project is co-funded by the EHR Core Research (ECR) and Advancing Informal STEM Learning (AISL) programs. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in three thematic areas: STEM learning and learning environments, broadening participation, and STEM workforce development. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will investigate three research questions: (1) How does the design of various parts of the exhibit differently support rich mathematical interactions between children and mathematicians? (2) How do children engage different parts of the exhibit? How do differences in engagement relate to (a) exhibit design and (b) prior mathematical experience? (3) How do exhibit volunteers, mathematicians, and caregivers interact to support (or undermine) students' mathematical play? The project will use participant observation and videography to capture visitors' activities through the exhibit, analyzing them as qualitative case studies.
This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Using hand-held mobile devices this project would test specialized Signing Glossaries for Science Exhibits (SGSE). The glossaries are developed from 5000 unique signing terms specific to the science in 6 partner institutions and designed to reach families with at least one member, ages 5-12+, who is deaf or hard of hearing and uses American Sign Language (ASL) for communication. The project would demonstrate the potential effectiveness of the venue-specific signing glossaries to enhance access to STEM learning during visits to informal STEM learning environments such as aquariums, botanical gardens, natural history museums, nature centers, science museums, and zoos.
While utilizing existing domain specific signing terms, the project will adapt and improve on their use in content specific informal science venues to increase the opportunity for the target audience to both enjoy and benefit from the wide array of informal science learning opportunities available to this group. The research should reveal how this approach might benefit those with other types of disabilities. The research questions are designed to understand both how family members might interact with a hearing disabled family member as well as how the disabled individual might learn more about a variety of STEM content in a setting that is not domain specific but uses the influence of science exhibits to inform, engage and interest members of the public generally.
Domain specific signing dictionaries have been developed, many by this PI, to address access to content specific topics in STEM. This proposal extends this concept to informal learning environments that are content specific to increase the opportunity for those with hearing disabilities to increase their capability to both enjoy informal science learning venues and to understand more of what these venues provide in terms of science learning.
Roots of Wisdom (also known as Generations of Knowledge; NSF-DRL #1010559) is a project funded by the National Science Foundation that aims to engage Native and non-Native youth (ages 11-14) and their families in Traditional Ecological Knowledge (TEK) and western science within culturally relevant contexts that present both worldviews as valuable, complementary ways of knowing, understanding, and caring for the natural world. The Oregon Museum of Science and Industry (OMSI) and its partner organizations, The Indigenous Education Institute (IEI), The National Museum of the American Indian (NMAI
Roots of Wisdom (also known as Generations of Knowledge) is a 5-year project funded by the National Science Foundation (NSF-DRL #1010559) in support of a cross-cultural reciprocal collaboration to develop a traveling exhibit, banner exhibit, and education resources that bring together Traditional Ecological Knowledge (TEK) and western science. The summative evaluation for public audience impacts was conducted by the Lifelong Learning Group (COSI, Columbus, OH), in collaboration with Native Pathways (Laguna, NM).