Education Development Center, Inc. (EDC) received a grant to develop a STEM Evaluation Community from the National Science Foundation (NSF). The primary goal of this project is to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects, specifically in the area of STEM education and outreach.
In response to a need for support for evaluation capacity, articulated by those who evaluate NSF programs and projects, the STEM Evaluation Community planned to connect evaluators across directorates
The informal science education (ISE) sector has an important role to play in addressing current societal issues, including changes in environmental conditions, systemic poverty, and societal responses to natural and manmade disasters. These complex social problems require engaging all sectors of society in deep discussions around science, engineering, technology, and mathematics (STEM) and inclusion, diversity, equity, and access (IDEA). To do this, ISE professionals need training in how to bring in diverse perspectives, support inclusive learning, and provide equal access to institutional policymaking, practices and systems. People from different backgrounds within informal science institutions (ISIs) and local communities bring new perspectives, identify new needs, and foster innovation. This broadening of perspectives is critical to address the complex social problems of the 21st century. A key part of the needed transformations in informal science institutions is the preparation of change agents within the ISE sector capable of reimagining what just and equitable informal science institutions might look like. iPAGE 2.0 is an NSF Advancing Informal STEM Learning (AISL) Innovations in Development project conducted by the Science Museum of Minnesota and the Garibay Group in concert with 27 ISIs from across the US. The overarching goal of the project is to support transformative change toward IDEA in the ISE sector. The project is based on an extension service model of knowledge diffusion which seeks to bridge the knowledge-to-action gap by creating intermediaries that can translate research into practical innovations that can be used by practitioners in ISIs. The project brings together teams of strategically placed individuals within ISIs and prepares them to work with their colleagues to enact research-based practices and practical organizational changes toward greater equity and diversity. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This ISE professional development initiative will work with annual first-year cohorts consisting of leadership teams from 4-6 ISIs. Each new cohort will spend 11 days together in a 5-day institute and three 2-day colloquia either virtually or at the Science Museum of Minnesota. Individuals and teams will adapt, implement, and refine ideas, strategies, and tools from the iPAGE 2.0 framework for use within their specific ISI context and broader professional networks and engage in ongoing communication and consultation with the iPAGE 2.0 community. All individuals on the team will develop skills, such as communication and collaboration expertise, to function as change agents acting to transform their organizations with respect to inclusion, diversity, equity, and access (IDEA) in STEM. Participants from previous cohorts will continue their roles as change agents and enhance learning in the iPAGE 2.0 community by sharing what they have learned at iPAGE 2.0 colloquia. The iPAGE 2.0 framework focuses on developing participants' understanding of 1) how structural inequalities function to reproduce social advantage and disadvantage within ISIs and the ISE sector; 2) the barriers, supports, and transmission vectors that contribute to or inhibit a continued shift in the sector toward IDEA within a network of practitioners, organizations, evaluators and researchers; and 3) how to prepare and support diversity change agents within the network. The project will employ a creative evaluation approach that combines developmental, principles-focused, arts-based, and transformative evaluation and an interactive, mixed-methods research study grounded in culturally responsive methodologies to address central questions concerning individual, organizational, and sector change. The project's primary audience is ISE professionals, and the secondary audience is researchers and evaluators working within the ISE sector. The project will work directly with an estimated 122 individuals from 27 ISIs.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Across the United States, individuals, organizations, and communities are wrestling with a wide array of challenging and persistent science, technology, engineering, and mathematics (STEM)-related problems. A few examples include ensuring more equitable access to STEM careers; building capacity for rural libraries to support STEM learning; and supporting greater cyber literacy among youth. The good news is that thousands of individuals, organizations, and communities are coming up with great ideas for how to confront these problems; many of them supported by the NSF. Unfortunately, most will encounter significant roadblocks to success along the way, but not because of bad ideas. Most change agents falter along the lengthy and often convoluted pathway between idea and successful execution because they bump up against barriers they do not expect or know how to overcome. This Pilot and Feasibility Study will create Learning Solutions, a multi-platform program designed to support those people and entities engaged in work that cultivates the public's understanding of, engagement with, and interest in STEM fields and STEM-related information. First, the project will systematically identify the real, but often unspoken issues that individuals, organizations, and communities run into as they work to bring about significant and impactful STEM-related change. Then, the project will assemble, curate, and make digitally available a collection of tools, resources and strategies designed to help someone understand and resolve these kinds of issues if and when they arise. By better understanding the experiences of change agents, the challenges they face, and the creative learning solutions they enact, this project will ensure that more change agents successfully access the learning know-how they need, when they need it, in curated, easy-to-digest formats. This award is funded by the Advanced Informal STEM Learning program which contributes to STEM engagement and literacy, workforce development, and educational success via supporting new approaches to and evidence-based understanding of STEM learning in informal environments. Learning Solutions will build capacity and will help more professionals successfully bring more good ideas to fruition.
The target audience for this Pilot & Feasibility phase of Learning Solutions will be STEM professionals working at the intersection of STEM and society across diverse sectors. It will focus on change agents -- individuals who want to be or who already are engaged in community-based, action-oriented STEM-related change projects, whether acting on their own, within an organization, or as part of a broader community of organizations. To achieve the goal of making STEM-related change easier to accomplish, Learning Solutions will implement a multi-step process. With input from five Critical Advisors, 20 Key Informants, and ultimately hundreds of change agents, project staff will: 1) Utilize an iterative process of in-depth interviews and broadly disseminated surveys to identify the major understandings, skills and processes that current and past STEM-related change agents have experienced as impediments to their success; 2) Determine how best to describe and categorize these issues across diverse problem spaces; 3) Select twelve issues, based on which are the most frequently mentioned and/or perceived to be the most critical or challenging, and research and curate the best and most authoritative resources responsive to these dozen issues; and finally, 4) Use a variety of platforms (e.g., social media, traditional media, digital and in print publications, podcasts, panels, and group presentations) and utilization metrics to ensure effective digital delivery of potential solutions to the selected issues. By the project's end, we will have identified some of the key challenges the STEM-related change agents who work in communities across America regularly encounter, as well as the feasibility of developing a mechanism for helping those change agents discover preexisting and readily accessible resources to assist them in resolving those challenges.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
John H FalkElysa CorinStacey Sheehan
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this pilot and feasibility study is to increase participation in informal STEM learning in rural Idaho through Stories of Fire, a program based on personal narratives of wildland fire. Idaho is a rural state, with an average population of just 19 people per square mile, the fourth lowest population density in the United States. The state is experiencing increasingly severe wildfire, and effective responses to such environmental change require a better understanding of the underlying science. Contextualizing science learning, making connections between everyday lives and a sense of place can engage learners and bring about a better understanding of wildfire. This project will bring together a science communicator, a narratologist, a fire ecologist, and a specialist on emotions and public lands. They will work collaboratively with informal educators based in rural areas of Idaho underrepresented in STEM fields. Rural areas are rich in knowledge based on years of cumulative observations, cultural beliefs, and practices shared through community networks. This project builds on these rural assets while addressing the challenges rural populations face. The project addresses broadening participation in STEM through narrative practices that encourage more diverse ways of knowing, being, and representing science.
This research study will explore: 1) what mechanisms of narrative (storytelling) most effectively integrate individuals? personal experiences and accurate STEM content in fire science communication, and 2) what audience-centered approaches best facilitate narrative approaches to informal STEM learning. This project engages four levels of participants over four phases of research and programming: 1) The research team will interview and analyze the narratives of 40 Frontliners (e.g., wildland firefighters and evacuees) from the inland Northwest region with first-hand experience with wildfire. 2) They will conduct a narrative workshop to train 20 informal STEM Educators from across the state on audience-centered approaches that facilitate participant storytelling about fire. 3) Educators will pilot their own narrative-based informal science learning programs with program participants in their rural home communities across the state, 4) A professional podcaster will create two podcasts modeled on our research findings for public audiences reached through media.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teresa CohnLeda KobziarJennifer LadinoErin James
In informal science contexts, the word tinkering describes a learning process that combines art, science, and technology through hands-on inquiry. With the growth in popularity of the making and tinkering movements nationwide, these practices are increasingly making their way into early childhood environments where they have great promise to positively impact the early STEM learning experiences of young children. This 2-day conference hosted at the Exploratorium in San Francisco will bring together stakeholders exploring applications of tinkering in informal early childhood environments. The conference will provide opportunities to explore the role, value, and challenges associated with implementing meaningful tinkering interventions in learning environments serving young children. The project seeks to 1) Convene stakeholders from the tinkering and early childhood programs; and 2) further the exploration and evolution of practitioner and researcher knowledge about tinkering in early childhood contexts. The long-term goal is to support more young children being introduced to STEM learning through tinkering's adaptable approaches to STEM-learning that align with the developmental needs of this young population.
This project will collaboratively analyze and document the state of the field of STEM-rich tinkering in informal early childhood contexts. Additionally, the project will deepen relationships across the early childhood tinkering ecosystem. Additional outcomes include an effort to provide tangible resources to the field highlighting current promising practices and future opportunities for development. The conference will also provide an understanding of how tinkering interventions may contribute to the development of STEM interest, identity and learning amongst early childhood audiences. Finally, the conference will bring together research and practitioners to explore how tinkering in early childhood settings can be used effectively to meet the needs of diverse learners including learners from underserved and underrepresented communities. The project will recruit a total of 75 participants with backgrounds in the field of tinkering and STEM learning, early childhood research, and professional development practices representing a diverse set of institutions and organizations. Research questions for the conference will focus on: 1) What types of supports and professional development do early childhood educators need to facilitate early STEM learning through tinkering? 2) What types of built environment and hands-on materials best support young children's ability to learn STEM content and practices through tinkering? 3) What types of strategies best support caregiver involvement in young children's learning? 4) What is the role of early childhood tinkering in young children?s STEM learning, interest, and identity development? 5) How can culturally and linguistically sustaining pedagogies be used to ensure equity across a diversity of young learners and their families? To answer these research questions the project will use qualitative methods before, during and post-conference. Research methods will include a landscape analysis identifying needs of participants, surveys, observations and informal interviews with participants.
This Conference award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Mentoring is a widely accepted strategy for helping youth see how their interests and abilities fit with education and career pathways; however, more research is needed to better understand how different approaches to mentoring impact youth participants. Near-peer mentoring can be a particularly impactful approach, particularly when youth can identify with their mentors. This project investigates three approaches to near-peer mentoring of high-school-aged Hispanic youth by Hispanic undergraduate mathematics majors. Mentoring approaches include undergraduates' visits to high school classrooms, mathematics social media, and a summer math research camp. These three components of the intervention are aimed at facilitating enjoyment of advanced mathematics through dynamic, experiential learning and helping high school aged youth to align themselves with other doers of mathematics on the academic stage just beyond them, i.e., college.
Using a Design-Based Research approach that involves mixed methods, the research investigates how the three different near-peer mentoring approaches impact youth participants' attitudes and interests related to studying mathematics and pursuing a career in mathematics, the youth's sense of whether they themselves are doers of mathematics, and the youth's academic progress in mathematics. The project design and research study focus on the development of mathematical identity, where a mathematics identity encompasses a person's self-understanding of himself or herself in the context of doing mathematics, and is grounded in Anderson (2007)'s four faces of identity: Engage, Imagine, Achieve, and Nature. The study findings have the potential to uncover associations between informal interactions involving the near-peer groups of high school aged youth and undergraduates seen to impact attitudes, achievement, course selection choices, and identities relative to mathematics. It also responds to an important gap in current understandings regarding effective communication of mathematics through social media outlets, and results will describe the value of in-person mathematical interactions as well as online interactions through social media. The study will result in a model for using informal near-peer mentoring and social media applications for attracting young people to study and pursue careers in STEM. This project will also result in a body of scripted MathShow presentations and materials and Math Social Media content that will be publicly available to audiences internationally via YouTube and Instagram.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Aaron WilsonSergey GrigorianXiaohui WangMayra Ortiz
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will research core methods of science documentary film production and impact on audience engagement and understanding. The findings from this study will be used to later produce a film on how the CRISPR genome editing technology will shape agriculture, ecology, and the natural world. The research study and film to be produced will be a collaboration of science communication practitioners and researchers. The intended outcomes are to improve effective science filmmaking and increase impact on audiences. Many people rely on documentary film and videos for science information outside of formal learning environments. Research has shown that video programming can reduce knowledge gaps between those of higher and lower levels of education. But there is little research with findings about what makes a particular style of storytelling effective for engagement and learning outcomes. A recent report of the National Academies of Sciences, Engineering and Medicine identified a significant shortage of social science research with directly applicable lessons for filmmakers. This project addresses this need by providing new frameworks for research and methods to produce science documentaries. Project partners are iBiology, a producer of video resources for learning, and science communication researchers at the University of Wisconsin-Madison.
This project will examine two key questions: 1) In a science documentary film, how does the diversity of the scientists profiled and the use of a narrator shape audiences? perception of content and scientists? and 2) What are effective methods in science filmmaking to visualize the invisible (i.e. explain scientific phenomena that are not easily visualized)? The project begins by testing a recently produced film, Human Nature, that tells the story of the discovery of CRISPR (genome editing), told by the scientists who led the effort. Phase 1 testing will include screenings, focus groups, and experiments run through Amazon Mechanical Turk to test what features of the film (editorial voice and visualization styles) are most effective for communicating scientific content. In Phase 2 video test clips will be produced using a combination of narration and visualization strategies. An experimental design run through Amazon Turk will randomly assign participants to watch a clip using different combinations. Researchers will use this data to parse out what effect seems to be related to particular narration and visualization choices. This quantitative experimental data will be supplemented by qualitative data from focus groups with participants with a diverse range of science experience and demographic backgrounds. Researchers will design a survey-embedded experiment with a U.S. nationally representative sample to see how well the findings translate and change in a broader population.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Dietram ScheufeleSarah GoodwinElliot Kirschner
The Apsáalooke (Crow Indian) Nation in Montana, as well as other Indigenous communities across the United States, disproportionally experience negative consequences from water-related environmental hazards, such as contaminated water. In this project, fifth- and sixth-grade Apsáalooke youth will act as change agents through investigating water issues in their communities and presenting findings to their communities. They will conduct this water-related research in the context of an informal summer program designed to integrate Indigenous and Western perspectives on science. For example, youth will learn the cultural significance of water sites while also practicing methods for collecting and analyzing data relative to those sites, guided by Apsáalooke elders and science professionals. During the summer program, Indigenous high school students and tribal college students will mentor the youth. To develop this program, the project team will conduct interviews with elders and Apsáalooke community members in scientific fields to determine the desired features of a program that integrates Indigenous and Western science. They will use the findings from these interviews to develop a multimedia toolkit, which includes a set of comprehensive materials that will enable other researchers and informal educators to implement similar programs. This toolkit will include information about water science and water quality, lesson plans and related resources for the summer program, professional development materials to prepare the high school youth to act as mentors, handouts for family members to facilitate at-home engagement with their children, and more. The project team will research how the implementation of the toolkit influences the participants' water-related knowledge and attitudes toward science. The toolkit, and the associated empirical findings, will be disseminated widely through local, regional, and national professional networks that serve American Indians.
Montana State University, in partnership with Little Big Horn College, will implement and research an informal summer program for Apsáalooke youth in the fifth and sixth grades, as well as a mentorship program for Indigenous high school students and tribal college students. The older students will participate in a four-week internship program in which they learn about conducting water research and facilitating science activities that foreground Apsáalooke perspectives and cultural practices. The high school and tribal college students will partner with Apsáalooke elders and science professionals to facilitate and implement a two-week summer program for the fifth- and sixth-grade youth. This program will use the toolkit materials that were previously developed in consultation with elders and other community stakeholders. Regression analyses of validated pre- and post-surveys, as well as inductive analyses of interviews with stakeholders, will be used to study how the mentoring program affects the high school and tribal college students' attitudes toward science and career interests, and how the summer program affects the fifth- and sixth-graders' water-related knowledge. The research team will also study how youth participation in the program affects their family and community members' water-related knowledge. This project will result in a multimedia toolkit, freely available to the public and widely disseminated through professional networks, which specifies how other informal educators and researchers can implement similar mentorship programs and summer programs for Indigenous youth. Ultimately, this project will broaden participation through resulting in empirically-tested materials that advance practice in informal education for Indigenous youth and their communities. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (science, technology, engineering, and mathematics) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.
Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Loren SmithMark ScallionHeather Starck
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This two-year Pilots and Feasibility project seeks to build knowledge and strategic impact in the informal STEM learning field by studying how and why science-education-art collaborations yield impactful informal STEM learning experiences. By design and implementing interactive and participatory experiences for adult audiences, this project will build knowledge about how to help communities learn about environmental science and apply scientific knowledge to environmental decision-making in their lives.
The project's two overarching research questions are: (1) What are the essential elements of collaboration among scientists, educators, and artists that support learning about adaptation in a changing environment? (2) In what ways do designed, participatory, informal science learning experiences support participant learning? This pilot project will: a) develop methods for facilitating and assessing collaboration among scientists, educators, and artists; b) pilot and refine approaches for engaging scientists, educators, and artists with community members for high quality participatory experiences focus on learning about adaptation to environmental change in informal learning settings; c) pilot and refine methods to measure the outcomes for community participants on knowledge about environmental change and its application to problems in their everyday lives. This project is innovative in bridging a diverse body of scholarship in order to study the process of collaboration and the specific ways interdisciplinary collaborations foster learning. Because informal STEM learning settings often combine the work of multiple disciplines, examining the process and outcomes of collaborative, participatory STEM learning has the potential to deliver widely applicable guidance for achieving more impactful educational outcomes.
The proposed project will broaden participation by engaging adult members of environmentally vulnerable communities in participatory STEM activities and will improving individual and community well-being by delivering tools for future decision-making. The collaborative project will build valuable partnerships and capacity between disparate sectors of society, allowing co-learning and co-production of knowledge. Results will be published in scholarly journals as well as shared with community participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Amy LesenSameer HonwadAma RoganCalvin Mackie
This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a series of mobile apps to guide families through sequenced sets of videos and hands-on activities. To support families at home it would also develop a new library model to build librarians' computational thinking content knowledge and self-efficacy so they can support parents' efforts with their children. Computational thinking is a an increasingly critical skill for learning and success in the workforce. It includes the ability to identify problems, brainstorm and generate solutions and processes that can be communicated and followed by computers or humans. There are few projects that introduce computational thinking to young children. Very little research has been done on the ways that parents can facilitate children's engagement in CT skills. And developing a model that trains and supports librarians to become virtual coaches of parents as they engage with their children in CT, will leverage and build the expertise of librarians. The project's target audience includes parents and children living in rural areas where access to CT learning may be very limited. Project partners include the EDC, a major research organization, the American Library Association, and BUILD, a national association that promotes collaborations across library, kindergarten readiness, and public media programming.
The formative research study asks: 1) What supports do parents of preschoolers in rural communities need in order to effectively engage in CT with their children at home? and 2) How can libraries in rural communities support joint CT exploration in family homes? The summative research study asks: 3) how can an intervention that combines media resources, mobile technology, and library supports foster sustained joint parent/child engagement and positive attitudes around CT? Researchers will develop a parent survey, adapting several scales from previously developed instruments that ask parents to report on children's use of CT-related vocabulary and CT-related attitudes and dispositions. Survey scales will assess librarians' attitudes towards CT, as well as their self-efficacy in supporting parents in CT in a virtual environment. During the formative study, EDC will pilot-test survey scales with 30 parents and 6 librarians in rural MS and KY. Analyses will be primarily qualitative and will be geared toward producing rapid feedback for the development team. Quantitative analyses will be used on parent app use, using both time query and back-end data, exploring factors associated with time spent using apps. The summative study will evaluate how the new media resources and mobile technology, in combination with the library virtual implementation model, support families' joint engagement with CT, and positive attitudes around CT. The researchers will recruit 125 low-income families with 4- to 5-year-old children in rural MS and KY to participate in the study. They will randomly assign families within each library to the full intervention condition, including media resources, mobile technology, and library support delivered through the virtual implementation model, or the media and mobile-technology-only condition. This design will allow researchers to understand more fully the additional benefit of library support for rural families' sustained engagement, and conversely, see the comparative impact of a media- and mobile-technology only intervention, given that some families might not be able to access virtual or physical library support.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Refugee youth are particularly vulnerable to STEM disenfranchisement due to factors including limited or interrupted schooling following displacement; restricted exposure to STEM education; and linguistic, cultural, ethnic, socioeconomic, and racial minority status. Refugee youth may experience a gap in STEM skills and knowledge, and a conflict between the identities necessary for participation in their families and communities, and those expected for success in STEM settings. To conduct research to better understand these challenges, an interrelated set of activities will be developed. First, youth will learn principles of physics and computing by participating in cosmic ray research with physicists using an instructional approach that builds from their home languages and cultures. Then youth periodically share what they are learning in the cosmic ray research with their parents, siblings, and science teachers at family and community science events. Finally, youth conduct reflective research on their own STEM identity development over the course of the project. Research on learning will be conducted within and across these three strands to better understand how refugee youth develop STEM-positive identities. This project will benefit society by improving equity and diversity in STEM through (1) creating opportunities for refugee youth to participate in physics research and to develop computing skills and (2) producing knowledge on STEM identity development that may be applied more broadly to improve STEM education. Deliverables from this project include: (a) research publications on STEM identity and learning; (b) curriculum resources for teaching physics and computing to multilingual youth; (c) an online digital storytelling exhibit offering narratives about belonging in STEM research which can be shared with STEM stakeholders (policy makers, scientists, educators, etc.); and (d) an online database of cosmic ray data which will be available to physicists worldwide for research purposes. This Innovations in Development proposal is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This program is designed to provide multiple contexts, relationships, and modes across and within which the identity work of individual students can be studied to look for convergence or divergence. To achieve this goal, the research applies a linguistic anthropological framework embedding discourse analysis in a larger ethnography. Data collected in this study include field notes, audio and video recordings of naturalistic interactions in the cosmic ray research and other program activities, multimodal artifacts (e.g., students' digital stories), student work products, interviews, and surveys. Critically, this methodology combines the analysis of identity formation as it unfolds in moment-to-moment conversations (during STEM learning, and in conversations about STEM and STEM learning) with reflective tasks and the production of personal narratives (e.g., in digital stories and interviews). Documenting convergence and divergence of STEM identities across these sources of data offers both methodological and theoretical contributions to the field. The research will offer thick description of the discursive practices of refugee youth to reveal how they construct identities related to STEM and STEM disciplines across settings (e.g., during cosmic ray research, while creating digital stories), relationships (e.g., peer, parent, teacher), and the languages they speak (e.g., English, Swahili). The findings will be of potential value to instructional designers of informal learning experiences including those working with afterschool, museums, science centers and the like, educators, and scholars of learning and identity.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Tino NyaweloJohn MatthewsJordan GertonSarah Braden