This white paper examined the process of evaluating a new Growth Mindset youth program developed for youth in Grades 3-5 in the Northwest suburb communities in Dundee Township, IL.
DATE:
TEAM MEMBERS:
Luci HanstedtDrew Glassford Mike LoPrestiMallory NamoffRobert Tai
This guidebook will help you plan your action project. The initial brainstorm pages will help you consider where to start, and the Action Project Framework will navigate you through steps to get to your destination: the completion of your project!
This project focuses on environmental health literacy and will explore the extent to which diverse rural and urban youth in an out-of-school STEM enrichment program exhibit gains in environmental health literacy while engaged in learning and teaching others about community resilience in the face of changing climates. Science centers and museums provide unique opportunities for youth to learn about resilience, because they bring community members together to examine the ways that current science influences local decisions. In this project, teams of participating youth will progress through four learning modules that explore the impacts of changing climates on local communities, the local vulnerabilities and risks associated with those changes, possible mitigation and adaptation strategies, and building capacities for communities to become climate resilient. After completion of these modules, participating youth will conduct a resilience-focused action project. Participants will be encouraged to engage peers, families, friends, and other community stakeholders in the design and implementation of their projects, and they will gain experience in accessing local climate and weather data, and in sharing their findings through relevant web portals. Participants will also use various sensors and web-based tools to collect their own data.
This study is guided by three research questions: 1) To what extent do youth develop knowledge, skills, and self- efficacy for developing community resilience (taken together, environmental health literacy in the context of resilience) through participation in museum-led, resilience-focused programming? 2) What program features and settings foster these science learning outcomes? And 3) How does environmental health literacy differ among rural and urban youth, and what do any differences imply for project replication? Over a two- year period, the project will proceed in six stages: a) Materials Development during the first year, b) Recruitment and selection of youth participants, c) Summer institute (six days), d) Workshops and field experiences during the school year following the summer institute, e) Locally relevant action projects, and f) End- of-program summit (one day). In pursuing answers to the research questions, a variety of data sources will be used, including transcripts from youth focus groups and educator interviews, brief researcher reflections of each focus group and interview, and a survey of resilience- related knowledge. Quantitative data sources will include a demographic survey and responses to a self-efficacy instrument for adolescents. The project will directly engage 32 youth, together with one parent or guardian per youth. The study will explore the experiences of rural and urban youth of high school age engaged in interactive, parallel programming to enable the project team to compare and contrast changes in environmental health literacy between rural and urban participants. It is anticipated that this research will advance knowledge of how engagement of diverse youth in informal learning environments influences understanding of resilience and development of environmental health literacy, and it will provide insights into the role of partnerships between research universities and informal science centers in focusing on community resilience.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This project is a retrospective study to explore the long-term impact of STEM programming. The study follows up with participants to ask questions like "Where are they now? What mattered? What difference did it make? and What’s next?"
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden their participation in STEM fields. The goals of the project include:
Contribute to the knowledge base of effective practices regarding informal STEM education for the blind, particularly relating to the development of spatial reasoning abilities.
Educate families, blind
The National Building Museum contracted RK&A to conduct an evaluation Investigating Where We Live (IWWL), a long-running program that has brought together creative youth in the Washington, D.C. area every summer since 1996 to explore, document, and interpret the local built environment. The study goal was to examine program strengths and challenges to help NBM strategically plan for the program’s future.
How did we approach this study?
To hear a variety of perspectives on the program, RK&A conducted in-depth telephone interviews with a number of stakeholders with different
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.
The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.
Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The PEAR Institute: Partnerships in Education and Resilience at McLean Hospital and Harvard Medical School conducted a year-long study of the Tulsa Regional STEM Alliance (TRSA). Funded by the Overdeck Family Foundation, STEM Next Opportunity Fund, and the Charles and Lynn Schusterman Family Foundation, this study is the first of its kind among 68 national and international STEM Ecosystems.
DATE:
TEAM MEMBERS:
Kristin Lewis-WarnerPatricia AllenGil Noam
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
This is a summary description of the 2018 Summer Science Camp offered by the Morgridge Institute for Research at the Discovery Building on the UW-Madison campus. The camp has been offered annualy since 2007, and the 2018 evaluation produced some specific ideas for improving the camp. Since 2007, more than 300 students from rural Wisconsin high schools have attended the camp. This population has less access to the many educational advantages that regular internet access affords their urban counterparts. The science camp team is exploring how to carry out a study of camp alumni.