This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
resourceprojectProfessional Development, Conferences, and Networks
Each year, millions of Americans visit science centers and museums, children’s museums, zoos, aquariums, nature centers, planetariums, and similar institutions. Recognized as trusted and popular places for educational and leisure experiences, these institutions are uniquely capable of engaging people across a spectrum of beliefs, experiences, and identities on topics related to science, technology, engineering, and mathematics (STEM), as well as addressing pressing societal problems related to science, technology, and innovation. However, the potential impacts of these institutions are largely dependent on the skills, knowledge, and abilities of the professionals working at them. Following the onset of the COVID-19 pandemic and the need to shift the nature of work, the informal STEM learning workforce was dramatically impacted. The recent period of disruption is a time for innovation. The field is well-positioned to promote new models of professional learning and development that are grounded in the values and practices of informal learning. This project will benefit local communities across the United States and society at large by advancing the capacity of science-engagement professionals to respond to societal needs, concerns, and interests more effectively through their institutions’ exhibitions, education and learning programs, and various forms of public engagement (e.g., community outreach events, supports for teachers/educators and schools). Led by the Association of Science and Technology Centers in collaboration with the Center of Science and Industry’s Center for Research and Evaluation and Oregon State University’s STEM Research Center, this work will build on the Informal STEM Learning (ISL) Professional Competency Framework developed and validated with prior National Science Foundation funding. Competency frameworks are increasingly used across many sectors to identify the suite of skills, knowledge, and capabilities necessary to be successful in a particular area of work. Given dramatic changes to the ISL workplace in the last two years, there is an even stronger potential for the Framework, particularly if newly developed supports can link the Framework to the current, emerging, and continuing needs of the workforce.
Guided by a systematic process for designing training and instructional materials, this project will first capture changes in the ways diverse informal STEM learning professionals describe, pursue, and achieve competencies to produce a revised Framework. Next, the project will collaboratively develop companion resources with diverse professionals through a series of participatory design workshops, using a sequential and iterative approach. The resources are expected to include indicators of professional competencies, self-assessments, training tools, and other types of resources that have the potential to significantly advance the professional learning (as undertaken by individuals and institutions) and the professional development capacity (as provided by institutions, associations, and other organizations) of the informal STEM learning field. Next, the project will share final products–including a refreshed website that hosts the updated Framework and newly-developed suite of tools–with professional association and network partners who can disseminate directly to the institutions and professionals who are developing and practicing these competencies. The project will gather evidence from a small number of early adopters, providing data on specific use-case scenarios. Finally, the project will document the potential impact of the Framework on the field by measuring how the Framework is perceived by informal STEM learning professionals as usable, useful, and beginning to be “in-use." Over time—and with increased use—the Framework and its companion resources hold the promise of contributing to the opening of the field to professionals with identities currently underrepresented through more transparent expectation and clearer growth pathways.
Diversity, equity, access, inclusion, and belonging-related change is often difficult to achieve in organizations. In the context of Informal STEM Learning (ISL), this results in inequitable opportunities for both ISL professionals and learners to engage in STEM environments and experiences. For people to thrive in these settings, creative and innovative approaches that address historical and current realities of intersectional marginalization and inequitable norms within informal STEM institutions are necessary to disrupt conventions, institutional barriers, and patterns of inequities. TERC and the Detroit Zoological Society will develop and implement an ISL Equity Resource Center (the Center). The Center will advance equity within the ISL field by cultivating a multi-sector, diverse learning community that designs and conducts evidence-based research and practice, including but not limited to equity-focused leadership, decision-making, theory, methods, project topic selection and design, and budget management.
The Center will cultivate lasting change in the ISL and broader STEM learning ecosystem via (a) sharing more inclusive, culturally relevant, and responsive ISE research and practice; (b) identifying scalable, equity-focused research findings useful in ISL programming; and (c) promoting greater public awareness of the importance of broadening participation in STEM. The Center's primary stakeholders are ISL professionals, including researchers, practitioners, and evaluators. The Center will maintain and expand a digital infrastructure to support innovation and sharing across the ISL field. Through its combined efforts, the Center will raise the visibility and impact of ISL equity-focused research and practice and its contributions to the overall STEM endeavor. The Center will also organize and host the biennial AISL Awardee Meeting. The Center is funded by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Stephen AlkinsDiane MillerLisette Torres-GeraldPati Ruiz
resourceprojectProfessional Development, Conferences, and Networks
The National Girls Collaborative Project and Education Development Center are convening “Advancing the Conversation on Scaling National Informal STEM Programs,” a two-and-a-half day knowledge-building conference that brings together key stakeholders in informal STEM education (ISE) to examine what scale looks like across informal learning settings. Currently, there is not a common definition or set of dimensions related to what it means to scale programs in informal learning settings. Approaches to scale in ISE too often center on the perspectives and needs of people who are developing and spreading programs while less consideration is given to the realities of those responsible for operationalizing programs in hyper-local contexts. This conference approaches the question of scale from the perspective of the program implementers, who are the beneficiaries of capacity building and serve as facilitators of these scaled programs. The conference also gives voice to program developers, researchers, evaluators, and funders of national informal STEM programs who study and support scale in education. The aim of the conference is to develop a new framework for scale in ISE that centers partnership and capacity building of informal educators. Such an approach to scale addresses issues of local access and diversity, equity, and inclusion, and promotes sustainability of ISE in high-need communities.
Conference discussions challenge three common misperceptions of scale across ISE: (1) simple spread and replication of turnkey programs lead to effective scale in ISE; (2) definitions of scale derived from formal learning settings should be used to scale across ISE; and (3) scale across ISE should be defined by program developers and those that seek to study it. Participants with a wide range of perspectives and who represent a diversity of organizational types will attend the conference and work together to articulate scaling success factors, barriers, diversity, equity, and inclusion strategies, and intended outcomes, distilling themes, questions, and concerns about current approaches to evaluating and researching scale in ISE. Together, conference participants will co-create a framework for scale in ISE which will define new and expanded dimensions of scale that center on capacity building and diversity, equity, and inclusion, as well as a Program Developer’s Guide for scaling ISE programs through the lens of the framework. These products will increase the knowledge and capacity of informal learning organizations involved in nationally scaled initiatives, STEM-rich institutions wanting to scale their own locally developed programs, informal STEM researchers and evaluators, and the broader field of ISE including program funders. Conference findings will be broadly disseminated through publications, conferences, and a national webinar co-hosted by the National Girls Collaborative Project and Education Development Center.
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
Across the United States, individuals, organizations, and communities are wrestling with a wide array of challenging and persistent science, technology, engineering, and mathematics (STEM)-related problems. A few examples include ensuring more equitable access to STEM careers; building capacity for rural libraries to support STEM learning; and supporting greater cyber literacy among youth. The good news is that thousands of individuals, organizations, and communities are coming up with great ideas for how to confront these problems; many of them supported by the NSF. Unfortunately, most will encounter significant roadblocks to success along the way, but not because of bad ideas. Most change agents falter along the lengthy and often convoluted pathway between idea and successful execution because they bump up against barriers they do not expect or know how to overcome. This Pilot and Feasibility Study will create Learning Solutions, a multi-platform program designed to support those people and entities engaged in work that cultivates the public's understanding of, engagement with, and interest in STEM fields and STEM-related information. First, the project will systematically identify the real, but often unspoken issues that individuals, organizations, and communities run into as they work to bring about significant and impactful STEM-related change. Then, the project will assemble, curate, and make digitally available a collection of tools, resources and strategies designed to help someone understand and resolve these kinds of issues if and when they arise. By better understanding the experiences of change agents, the challenges they face, and the creative learning solutions they enact, this project will ensure that more change agents successfully access the learning know-how they need, when they need it, in curated, easy-to-digest formats. This award is funded by the Advanced Informal STEM Learning program which contributes to STEM engagement and literacy, workforce development, and educational success via supporting new approaches to and evidence-based understanding of STEM learning in informal environments. Learning Solutions will build capacity and will help more professionals successfully bring more good ideas to fruition.
The target audience for this Pilot & Feasibility phase of Learning Solutions will be STEM professionals working at the intersection of STEM and society across diverse sectors. It will focus on change agents -- individuals who want to be or who already are engaged in community-based, action-oriented STEM-related change projects, whether acting on their own, within an organization, or as part of a broader community of organizations. To achieve the goal of making STEM-related change easier to accomplish, Learning Solutions will implement a multi-step process. With input from five Critical Advisors, 20 Key Informants, and ultimately hundreds of change agents, project staff will: 1) Utilize an iterative process of in-depth interviews and broadly disseminated surveys to identify the major understandings, skills and processes that current and past STEM-related change agents have experienced as impediments to their success; 2) Determine how best to describe and categorize these issues across diverse problem spaces; 3) Select twelve issues, based on which are the most frequently mentioned and/or perceived to be the most critical or challenging, and research and curate the best and most authoritative resources responsive to these dozen issues; and finally, 4) Use a variety of platforms (e.g., social media, traditional media, digital and in print publications, podcasts, panels, and group presentations) and utilization metrics to ensure effective digital delivery of potential solutions to the selected issues. By the project's end, we will have identified some of the key challenges the STEM-related change agents who work in communities across America regularly encounter, as well as the feasibility of developing a mechanism for helping those change agents discover preexisting and readily accessible resources to assist them in resolving those challenges.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
John H FalkElysa CorinStacey Sheehan
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with each other, and with schools. At the same time, good working practice by schools, teachers, STEM educators and institutions that involves and engages local communities was discovered, showing the diversified modes of connection which could enhance the sustainability of STEM ecosystem.
We trust that this three-year study with its associated digital maps, provides a useful resource for schools, teachers, students, parents, STEM educators and education policy makers in Hong Kong.
This three-year research and implementation project empowers middle school LatinX youth to employ their own assets and funds of knowledge to solve community problems through engineering. Only 7% of adults in the STEM job cluster are of Hispanic/Latino origin. There is a continuing need for filling engineering jobs in our current and future economy. This project will significantly broaden participation of LatinX youth in engineering activities at a critical point as they make career decisions. Design Squad Global LatinX expands on a tested model previously funded by NSF and shown to be successful. It will enable LatinX youth to view themselves as designers and engineers and to build from their strengths to expand their skills and participation in science and engineering. The project goals are to: 1) develop an innovative inclusive approach to informal engineering education for LatinX students that can broaden their engineering participation and that of other underrepresented groups, (2) to galvanize collaborations across diverse local, national, and international stakeholders to create a STEM learning ecosystem and (3) to advance knowledge about a STEM pedagogy that bridges personal-cultural identity and experience with engineering knowledge and skills. Project deliverables include a conceptual framework for a strength-based approach to engineering education for LatinX youth, a program model that is asset based, a collection of educational resources including a club guide for how to scaffold culturally responsive engineering challenge activities, an online training course for club leaders, and a mentoring strategy for university engineering students working with middle school youth. Project partners include the global education organization, iEARN, the Society of Women Engineers, and various University engineering programs.
The research study will employ an experimental study design to evaluate the impact on youth participating in the Design Squad LatinX programs. The key research questions are (1) Does participation increase students' positive perceptions of themselves and understanding of engineering and global perspectives? (2) To what extent do changes in understanding engineering vary by community (site) and by student characteristics (age, gender, ethnicity)? (3) Do educators and club leaders increase their positive perceptions of youths' funds of knowledge and their own understanding of engineering? and (4) Do university mentors increase their ability to lead informal engineering/STEM education with middle school youth? A sample from 72 local Design Squad LatinX clubs with an enrollment of 10-15 students will be drawn with half randomly assigned to the participant condition and half to the control condition. Methods used include pre and post surveys, implementation logs for checks on program implementation, site visits to carry out observations, focus groups with students and interviews with adult leaders. Data will be analyzed by estimating hierarchical linear models with observations. In addition, in-situ ethnographically-oriented observations as well as interviews at two sites will be used to develop qualitative case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
A large body of research highlights the benefits of storybooks for children's learning. In the context of preschool classrooms, the use of storybooks to engage young children in STEM is a frequent topic of practitioner-oriented articles. There is also an increasing number of informal STEM education (ISE) projects exploring how to leverage storybooks to engage young children and their families in different STEM content domains. While there is universal excitement for the potential of storybooks in ISE, there is an acknowledgment of a critical need for more cross-project sharing, more research, and more efforts to synthesize and share findings. This award will catalyze new research studies and partnerships to advance efforts in ISE contexts, including the role of books in the overall learning experience or program, how books are selected or designed, and how the reading is facilitated by teachers and families. Participants will be educators and researchers working with or studying family learning for preschool-age children (three to five years) using early childhood fiction books as a tool for engaging families in STEM topics and skills.
Storybook STEM will be implemented in four phases: (1) pre-convening activities to plan, synthesize existing resources, engage a broader group of educators and researchers beyond convening attendees, and prepare convening participants to maximize the value of the in-person discussions; (2) in-person convening to catalyze cross-project discussions, outline promising practices, and identify questions and ideas for the future; (3) evaluation of the impact and value of the convening, from the perspective of participants and a project steering committee; and (4) dissemination of findings and recommendations to educators and researchers within and beyond the ISE field. Outcomes include: (1) documenting current and past work in ISE and other fields; (2) summarizing key recommendations and resources from the reading, literacy, and early childhood development fields; and (3) outlining promising directions for future work.
The findings from this project will provide a critical resource to help broadening participation efforts be more effective and inclusive for audiences across the country. Research studies motivated by the convening will address the lack of empirical work on storybooks as a tool for ISE programs and advance the ISE field's knowledge of how to integrate these books effectively. Because storybooks are a highly accessible and almost universally used family learning resource, the topic of the convening will be relevant to a wide range of audiences and will help educators broaden access to ISE for traditionally underserved and under-resourced communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The project will develop and research the ways in which maker education activities can be leveraged to support intergenerational learning in hyper-vulnerable populations, such as families with an incarcerated parent. Maker education is often linked to STEM learning and uses hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. Research has shown that maker education activities support STEM learning and creativity, the development of STEM identities and dispositions, and create pathways towards STEM careers. The project will develop a series of project activities including bringing Science, Technology, Engineering, and Mathematics (STEM) learning experts to a women's minimum-security facility for lectures on research and a set of workshops exploring maker activities for the incarcerated women and their children. By researching trauma-informed maker practices for families with an incarcerated parent, the project will develop research findings related to and practical resources for supporting these practices in other informal STEM learning contexts.
While evidence shows that maker pedagogy can be effective in supporting STEM learning for diverse populations, little is known about how it might support STEM learning for incarcerated women and their children. The project will investigate: (1) the everyday STEM practices of incarcerated women and their children and how these practices can be supported and extended through maker activities; (2) how incarcerated women and their children are perceived with respect to STEM and the impact these perceptions have on developing STEM identities; and (3) what design principles for developing STEM learning emerge through the project research. Program activities and related research will be designed and researched through the collaboration of incarcerated women, university researchers from the project university partners, the Saint Louis University Prison Program, and the Federal Correctional Institution-Camp (Greenville Women's Minimum Security Facility). The project will use Social Design Experimentation (SDE) as the primary research method, which is used to design and study education interventions on site. SDE is unique in that participants, researchers and other stakeholders collaborate to meet the goals of the project and related research. Project deliverables, which will be widely disseminated to researchers and educators, will include articles in peer-reviewed and educator publications, strategies and design principles for developing maker education opportunities for hyper-vulnerable populations, and practical recommendations for a maker kit to facilitate STEM maker education activities and family interaction.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums, science centers, zoos and other informal science education (ISE) institutions often focus on the idea of "authenticity" to engage the public. Authenticity includes providing something real, original, or even awe-inspiring to the visitor or learner--be it an object, a context, or an experience. While those educators, exhibit designers, and program developers who work in ISE settings often recognize authenticity as an important part of many informal learning experiences, this may be simply be an assumption driven by tradition in practice versus a strategy supported by evidence. This project seeks to better understand how and/or why "the real thing" may (or may not be) important for supporting informal science learning. By examining what is already known about authenticity and learning, the project will inform best practices in ISE as well as point to gaps in knowledge that might need further research. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This research synthesis takes a systematic approach to identify and compile both theoretical and empirical literature to better understand the role authenticity may play in supporting informal science learning. This project will gather ISE literature related to the effects of "authenticity" on learner outcomes, and will look to neighboring disciplines such as psychology, anthropology, media studies, linguistics, marketing and others to seek relevant theoretical perspectives and empirical work that might further understanding of the potential role of authenticity in ISE. The initial phase of the project will focus on gathering theoretical perspectives and positions that help explain the value or importance (or perhaps non-importance) of "realness" as it relates to learning, interest, and experience. A panel of experts from multiple disciplines will convene to help identify key perspectives and frameworks that may clarify the role or impacts of authenticity. A second phase focuses on gathering and assessing empirical studies that support (or refute) the relevant perspectives and theories identified from the initial multi-disciplinary foray into authenticity. To ensure breadth and depth of review, the PIs, research librarians, graduate students, and special topics classes will engage in identifying, evaluating, summarizing, and synthesizing the relevant research (including gray literature) to produce an initial synthesis report that will be reviewed by select experts from the earlier panel. A second convening of practitioners (exhibit developers, educators, program designers, etc.) will be used to further contextualize the findings in ways that may better inform current practices in providing effective ISE. The resulting products include a peer-reviewed research synthesis and a practitioner handbook.
The proposed project's Broader Impacts lie in the potential to inform ISE practice in exhibit and program design and in the delivery of ISE-related experiences. Although the importance of the authenticity of an object or experience may ultimately be determined by the individual, this study will be able to provide guidance to help practitioners and scholars in making sometimes difficult design choices. Such insights may also inform other learning environments (e.g. the classroom) as well as other disciplinary areas (e.g. history, anthropology, art).
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.