This paper describes a follow‐up focus group study for the larger Exhibit Designs for Girls' Engagement (EDGE) project. Grounded in Culturally Responsive Pedagogical theory (CRP), the project aimed to understand the relationship between female responsive designs and girls' engagement at STEM exhibits. After developing a Female‐Responsive Design (FRD) Framework and conducting a large‐scale study to determine the most important design attributes for engaging girls at exhibits, the final step involved a qualitative investigation into those design attributes. Four focus groups with 22 girls aged 8
This three-year research and implementation project empowers middle school LatinX youth to employ their own assets and funds of knowledge to solve community problems through engineering. Only 7% of adults in the STEM job cluster are of Hispanic/Latino origin. There is a continuing need for filling engineering jobs in our current and future economy. This project will significantly broaden participation of LatinX youth in engineering activities at a critical point as they make career decisions. Design Squad Global LatinX expands on a tested model previously funded by NSF and shown to be successful. It will enable LatinX youth to view themselves as designers and engineers and to build from their strengths to expand their skills and participation in science and engineering. The project goals are to: 1) develop an innovative inclusive approach to informal engineering education for LatinX students that can broaden their engineering participation and that of other underrepresented groups, (2) to galvanize collaborations across diverse local, national, and international stakeholders to create a STEM learning ecosystem and (3) to advance knowledge about a STEM pedagogy that bridges personal-cultural identity and experience with engineering knowledge and skills. Project deliverables include a conceptual framework for a strength-based approach to engineering education for LatinX youth, a program model that is asset based, a collection of educational resources including a club guide for how to scaffold culturally responsive engineering challenge activities, an online training course for club leaders, and a mentoring strategy for university engineering students working with middle school youth. Project partners include the global education organization, iEARN, the Society of Women Engineers, and various University engineering programs.
The research study will employ an experimental study design to evaluate the impact on youth participating in the Design Squad LatinX programs. The key research questions are (1) Does participation increase students' positive perceptions of themselves and understanding of engineering and global perspectives? (2) To what extent do changes in understanding engineering vary by community (site) and by student characteristics (age, gender, ethnicity)? (3) Do educators and club leaders increase their positive perceptions of youths' funds of knowledge and their own understanding of engineering? and (4) Do university mentors increase their ability to lead informal engineering/STEM education with middle school youth? A sample from 72 local Design Squad LatinX clubs with an enrollment of 10-15 students will be drawn with half randomly assigned to the participant condition and half to the control condition. Methods used include pre and post surveys, implementation logs for checks on program implementation, site visits to carry out observations, focus groups with students and interviews with adult leaders. Data will be analyzed by estimating hierarchical linear models with observations. In addition, in-situ ethnographically-oriented observations as well as interviews at two sites will be used to develop qualitative case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Mary Haggerty
resourceprojectProfessional Development, Conferences, and Networks
STEAM, the use of art as a context and tool for science education, is currently a hot topic in the science education field. In almost all instances of study and practice, it involves the use of science-themed or science-informed art in science education. As such, it does not take advantage of the majority of artistic output that does not have an obvious connection to science. The National Academies of Sciences, Engineering and Medicine recently called for more research to expand the "limited but promising" evidence that integrating arts and humanities with science education leads to better learning. The goal of this 2.5-day conference is to bring together representatives of both art and science groups to have a shared discussion around how non-scientific art can influence science education in theory, and how we can apply empirical results to the theory. For purposes of this conference, "non-science art" is defined as art that was not inspired by science. Conference attendees will include researchers (art and science education researchers) and practitioners (artists, art museum interpreters, and science educators). The conference will take place during the 2020 Black Creativity exhibition at the Museum of Science and Industry, Chicago. It is anticipated that by holding the conference at that time the audience for the conference and its impact will be informed by more diverse attendance.
The conference will be implemented starting with a pre-conference reading. Attendees will be sent a copy of the white paper from the Art as a Way of Knowing report for background reading and also asked to contribute to a Google Document that describes their various contexts. Each day of the conference will focus on a theme -- state of the field and possibilities and research -- and be comprised of large and small group interactions. Attendees will be invited from the ranks of practitioners, researchers and educators in the art and science education fields; several slots will be available for open (non-invited) participants. Key outcomes include: (a) a summary of all the research that has been conducted on using non-science art in science education, (b) starting points for building a theory on why non-science art can be used in science education; and (c) a list of specific research topics that would help inform, advance, and test the theory. In addition to assessing satisfaction with the conference, evaluation will also include a one-year post conference survey to investigate impact of participation in the conference.
This conference will generate products that will give guidance to both researchers and practitioners who want to use art in science education. These products include a white paper synthesizing the discussion and appendices that include raw transcripts and a bibliography of resources. Another product is a roadmap to create interventions that can be studied, which should lead to a stronger, more rigorous theory of practice about how art can be integrated into science education.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
There are several critical reasons to understand and support interest development in early childhood: (a) as a primary motivator of engagement and learning; (b) interest development in preschool predicts important learning outcomes and behaviors in early elementary school; and (c) early childhood interests motivate ongoing interest development. Thus, there is growing recognition that interest is not just important but fundamental to education and learning. Head Start on Engineering (HSE) is a multi-component, bilingual (Spanish/English), family-focused program designed to (1) foster long-term interest in the engineering design process for families with preschool children from low-income backgrounds and (2) support family development and kindergarten readiness goals. The HSE program, co-developed with the Head Start community, provides families with developmentally appropriate, story-based engineering design challenges for the home and then connects these to a system of strategically aligned Informal STEM Education (ISE) experiences and resources. This current project, HSE Systems, builds on a previous HSE Pathways project which (a) established that participating families develop persistent engineering-related interests; (b) highlighted the value that the Head Start community has for the program and partnership; and (c) generated a novel, systems perspective on early childhood interest development. The aim of HSE Systems is to develop and test a model of early childhood STEM engagement and advance knowledge of how the family as a system develops interest in STEM from preschool into kindergarten.
Through the Design Based Implementation Research (DBIR) process, the team will iteratively refine and improve the HSE program and theory of change using ongoing feedback and data from staff, families, and partners. It is also designed to explore program impacts on family interest development over a longer period, as children enter kindergarten. The DBIR work will focus primarily on the program model questions, while the case study research will focus on the family interest questions, with both strands informing each other. The initial work is organized around a series of feedback and design-testing cycles to gather input from families and other stakeholders, update the program components and activities in collaboration with families and staff, and prepare for full implementation. During the next phase, the team will implement the full program model with six Head Start classrooms and track family experiences and interest development into kindergarten. During final implementation phase, the team will finish data collection, conduct retrospective analysis with all the data, and update the program model and theory of change.
This project will directly address the AISL program goals by broadening access to early childhood informal STEM education for low-income communities, with a focus on Spanish-speaking families, and building long-term skills and learning dispositions to support STEM learning inside and outside of school. Beyond the topic of engineering, HSE supports Head Start school readiness and child and family development goals, which are the foundation of lifelong success.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
A large body of research highlights the benefits of storybooks for children's learning. In the context of preschool classrooms, the use of storybooks to engage young children in STEM is a frequent topic of practitioner-oriented articles. There is also an increasing number of informal STEM education (ISE) projects exploring how to leverage storybooks to engage young children and their families in different STEM content domains. While there is universal excitement for the potential of storybooks in ISE, there is an acknowledgment of a critical need for more cross-project sharing, more research, and more efforts to synthesize and share findings. This award will catalyze new research studies and partnerships to advance efforts in ISE contexts, including the role of books in the overall learning experience or program, how books are selected or designed, and how the reading is facilitated by teachers and families. Participants will be educators and researchers working with or studying family learning for preschool-age children (three to five years) using early childhood fiction books as a tool for engaging families in STEM topics and skills.
Storybook STEM will be implemented in four phases: (1) pre-convening activities to plan, synthesize existing resources, engage a broader group of educators and researchers beyond convening attendees, and prepare convening participants to maximize the value of the in-person discussions; (2) in-person convening to catalyze cross-project discussions, outline promising practices, and identify questions and ideas for the future; (3) evaluation of the impact and value of the convening, from the perspective of participants and a project steering committee; and (4) dissemination of findings and recommendations to educators and researchers within and beyond the ISE field. Outcomes include: (1) documenting current and past work in ISE and other fields; (2) summarizing key recommendations and resources from the reading, literacy, and early childhood development fields; and (3) outlining promising directions for future work.
The findings from this project will provide a critical resource to help broadening participation efforts be more effective and inclusive for audiences across the country. Research studies motivated by the convening will address the lack of empirical work on storybooks as a tool for ISE programs and advance the ISE field's knowledge of how to integrate these books effectively. Because storybooks are a highly accessible and almost universally used family learning resource, the topic of the convening will be relevant to a wide range of audiences and will help educators broaden access to ISE for traditionally underserved and under-resourced communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The project will develop and research the ways in which maker education activities can be leveraged to support intergenerational learning in hyper-vulnerable populations, such as families with an incarcerated parent. Maker education is often linked to STEM learning and uses hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. Research has shown that maker education activities support STEM learning and creativity, the development of STEM identities and dispositions, and create pathways towards STEM careers. The project will develop a series of project activities including bringing Science, Technology, Engineering, and Mathematics (STEM) learning experts to a women's minimum-security facility for lectures on research and a set of workshops exploring maker activities for the incarcerated women and their children. By researching trauma-informed maker practices for families with an incarcerated parent, the project will develop research findings related to and practical resources for supporting these practices in other informal STEM learning contexts.
While evidence shows that maker pedagogy can be effective in supporting STEM learning for diverse populations, little is known about how it might support STEM learning for incarcerated women and their children. The project will investigate: (1) the everyday STEM practices of incarcerated women and their children and how these practices can be supported and extended through maker activities; (2) how incarcerated women and their children are perceived with respect to STEM and the impact these perceptions have on developing STEM identities; and (3) what design principles for developing STEM learning emerge through the project research. Program activities and related research will be designed and researched through the collaboration of incarcerated women, university researchers from the project university partners, the Saint Louis University Prison Program, and the Federal Correctional Institution-Camp (Greenville Women's Minimum Security Facility). The project will use Social Design Experimentation (SDE) as the primary research method, which is used to design and study education interventions on site. SDE is unique in that participants, researchers and other stakeholders collaborate to meet the goals of the project and related research. Project deliverables, which will be widely disseminated to researchers and educators, will include articles in peer-reviewed and educator publications, strategies and design principles for developing maker education opportunities for hyper-vulnerable populations, and practical recommendations for a maker kit to facilitate STEM maker education activities and family interaction.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums, science centers, zoos and other informal science education (ISE) institutions often focus on the idea of "authenticity" to engage the public. Authenticity includes providing something real, original, or even awe-inspiring to the visitor or learner--be it an object, a context, or an experience. While those educators, exhibit designers, and program developers who work in ISE settings often recognize authenticity as an important part of many informal learning experiences, this may be simply be an assumption driven by tradition in practice versus a strategy supported by evidence. This project seeks to better understand how and/or why "the real thing" may (or may not be) important for supporting informal science learning. By examining what is already known about authenticity and learning, the project will inform best practices in ISE as well as point to gaps in knowledge that might need further research. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This research synthesis takes a systematic approach to identify and compile both theoretical and empirical literature to better understand the role authenticity may play in supporting informal science learning. This project will gather ISE literature related to the effects of "authenticity" on learner outcomes, and will look to neighboring disciplines such as psychology, anthropology, media studies, linguistics, marketing and others to seek relevant theoretical perspectives and empirical work that might further understanding of the potential role of authenticity in ISE. The initial phase of the project will focus on gathering theoretical perspectives and positions that help explain the value or importance (or perhaps non-importance) of "realness" as it relates to learning, interest, and experience. A panel of experts from multiple disciplines will convene to help identify key perspectives and frameworks that may clarify the role or impacts of authenticity. A second phase focuses on gathering and assessing empirical studies that support (or refute) the relevant perspectives and theories identified from the initial multi-disciplinary foray into authenticity. To ensure breadth and depth of review, the PIs, research librarians, graduate students, and special topics classes will engage in identifying, evaluating, summarizing, and synthesizing the relevant research (including gray literature) to produce an initial synthesis report that will be reviewed by select experts from the earlier panel. A second convening of practitioners (exhibit developers, educators, program designers, etc.) will be used to further contextualize the findings in ways that may better inform current practices in providing effective ISE. The resulting products include a peer-reviewed research synthesis and a practitioner handbook.
The proposed project's Broader Impacts lie in the potential to inform ISE practice in exhibit and program design and in the delivery of ISE-related experiences. Although the importance of the authenticity of an object or experience may ultimately be determined by the individual, this study will be able to provide guidance to help practitioners and scholars in making sometimes difficult design choices. Such insights may also inform other learning environments (e.g. the classroom) as well as other disciplinary areas (e.g. history, anthropology, art).
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Research on how museum staff are trained continues to emerge. Training varies considerably across institutions and typically includes observations, shadowing, and trial and error. While museum educators put high value on increasing visitor-centered participatory experiences, engagement based on acquisition-based theories of learning is still common among floor staff, even after training. Facilitating learning about science, technology, engineering, and mathematics (STEM) topics in ways that support visitors in constructing their own understanding is difficult, especially since floor staff/facilitators may be working simultaneously with children and adults of a range of ages, backgrounds, and goals. This project will advance understanding of how to facilitate open-ended learning experiences in ways that engage visitors in practices that align with the STEM disciplines. The project will result in an evidence-based facilitation framework and training modules for training informal science educators. The work is grounded in constructivist theories of learning and identity work and focuses on visitors constructing understanding of STEM topics through active engagement in the practices of STEM. This model also results in learning experiences in informal settings that are mutually reinforcing with the goals of schools. This research is being conducted through an established researcher-practitioner partnership between MOXI, the Wolf Museum of Exploration + Innovation and the University of California at Santa Barbara (UCSB).
The two primary goals of the work are to (1) enable visitors to better engage in STEM practices (practice-based learning) and (2) investigate the role of training in helping facilitators develop the practice-based facilitation strategies needed to support visitors' learning. STEM content in this study is physical science. Prior work resulted in two tools that constitute part of a facilitation framework (a practices-by-engagement matrix and three facilitation pathways) which help educators identify appropriate goals based on how the visitor is engaging with exhibits. The development of the final tool in the framework, facilitation strategies, and the refinement of the first two tools will be done using a design-based implementation research (DBIR) approach. Data collection and analysis will be directed and completed by research-practitioner teams of UCSB graduate students (researchers) and MOXI educators (practitioners); MOXI educators will be both participants and researchers. Data collection activities include: video data using point-of-view cameras worn by visitors and educators; interviews of educators and visitors; observations of the training program; and educator reflections. In the final year, a small field test will be done at six sites, representing different types of museums. Interviews and reflections comprise the data collection at the field sites.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums in the US receive approximately 55 million visits each year from students in school groups. Field trip visits to an art museum have been found to positively impact critical thinking skills, empathy and tolerance - an increase that can be even more significant for youth from rural or high-poverty regions. While field trips are popular, especially at science museums, there have been no experimental studies about their impact on STEM career choices and interests, much less any which used a culturally sensitive and responsive approach. Given the resources put into field trips, this study investigates if causal links can be drawn between museum experiences and impact on youth. The Museum of Science & Industry uses a Learning Labs approach for engaging its visitors. These "Learning Labs" are facilitated experiences that run roughly an hour. Currently there are 12 lab topics. This study focuses on MedLab--one of the learning labs--as the setting for the research. MedLab is designed for on-site and online experience using ultra-sophisticated and highly versatile technology in challenges taken from research on the top healthcare issues that face adolescents in their communities.
This study is informed by research and theory on Social Cognitive Career Theory (SCCT) and Racial and Ethnic Identity. The former describes a process many follow when thinking about career options, broadly. The latter describes how people see themselves in the world through their membership with a racial and/or ethnic group. Both processes can collectively influence STEM career choices. This study follows an embedded mixed-method design. The quantitative portion includes an experimental, pre/post/delayed post-test design of both educators and their students using multiple measures taken mostly from previously published instruments. The qualitative portion includes observation rubrics of MedLab sessions along with interviews and focus groups with staff, educators, students and families that take place both within and outside of the museum. This is an experimental study of moderate size of both heterogeneous teacher and student populations in real world settings. It involves comparing youth and educators that participate in MedLab with those who do not. By conducting research that looks at each community through the lens of their unique experiences, the research will measure their impact more sensitively and authentically, addressing a gap in current literature on informal science, technology, engineering, or mathematics (STEM) career education with diverse students.
This study is funded by the Advancing Informal STEM Learning (AISL) program and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Research Coordination Networks (RCNs) are a type of National Science Foundation (NSF) project that advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries.
NSF's Advancing Informal STEM Learning (AISL) program welcomes submissions of RCN proposals that advance AISL goals through the sharing of ideas, knowledge, and practices. RCNs are an additional avenue for considering strategic
The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.
The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.
Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Patrik LundhAndrea BeesleyTimothy PodkulCarrie Allen
resourceprojectProfessional Development, Conferences, and Networks
This project will consider how research on imaginative thinking, and perspectives on the role of imagination in STEM practice and STEM education, can be systematically applied to support STEM learning in museum contexts. Common conceptions of science as non-imaginative are persistent, but scholarship across disciplines suggests critical roles for imagination, both in the practice of STEM and in shaping learners' perceptions of themselves as part of STEM. Further, evidence from the fields of neuroscience, psychology, child development and education suggests ways that imagination can be fostered and improved, and that these understandings could be applied to the design of museum experiences in order to improve STEM outcomes.
The activities of this project, led by the Museum of Science, Boston, both synthesize and generate knowledge at the intersections of imagination, STEM, and education practice in ways that are actionable for museum professionals. Activities include: a literature review, a document review, and a survey of ISE professionals; an in-person convening of STEM professionals (researchers, practitioners, educators and others); and the development and dissemination of products designed to inform future project development. The goals of the project are to: 1) prompt conversations about imaginative thinking across the Informal Science Education (ISE) field, and between ISE and other fields; 2) identify priority areas for research and development that can advance the field's understandings at the intersections of imagination, STEM, and learning; and 3) catalyze future research and development efforts that can advance the field. The intent is for the integration scholarship on imagination, STEM, and learning within museums' research and development efforts to lead to projects that describe, test, and refine theoretical frameworks and concrete strategies for supporting imaginative thinking among public audiences through exhibitions, programs, and other designed experiences.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.