In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This white paper examined the process of evaluating a new Growth Mindset youth program developed for youth in Grades 3-5 in the Northwest suburb communities in Dundee Township, IL.
DATE:
TEAM MEMBERS:
Luci HanstedtDrew Glassford Mike LoPrestiMallory NamoffRobert Tai
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
The purpose of this study is to thoroughly describe a program designed to strengthen the pipeline of Latino students into post-secondary science, technology, engineering, and mathematics (STEM) education, and present evaluation data to assess multiyear effectiveness. The program includes a suite of interventions aimed at students and families, and was implemented in a low-income school cluster with a high Latino population in metro Atlanta. Our intervention includes a high school and middle school mentoring program, STEM-focused extracurricular activities (summer camps, research and community
DATE:
TEAM MEMBERS:
Diley HernandezMarion UsselmanShaheen RanaMeltem AlemdarAnalia Rao
resourceresearchProfessional Development, Conferences, and Networks
In our efforts to sustain U.S. productivity and economic strength, underrepresented minorities (URM) (for the purpose of this paper defined as persons of African American, Hispanic American, and Native American racial/ethnic descent), provide an untapped reservoir of talent that could be used to fill technical jobs. Over the past 25 years, educational diversity programs have encouraged and supported URM pursuing STEM degrees. Yet, their representation in STEM still lags far behind that of White, non-Hispanic men.
To understand the reasons why this is occurring, the American Association for
DATE:
TEAM MEMBERS:
Yolanda S. GeorgeVirginia Van HorneShirley M. Malcom
Informal science learning (ISL) organizations that are successful at providing meaningful science, technology, engineering, arts, and mathematics (STEAM) experiences for Latino children, youth, and their families share some common traits. They have leaders and staff who believe in the importance of developing culturally relevant models and frameworks that meet the needs and acknowledge the legacy of STEAM in Latino communities. Such organizations are willing to take risks to create experiences that are culturally meaningful, garner funding and implement programs by working closely with their
DATE:
TEAM MEMBERS:
Cheryl JuarezVerónika NúñezExploratorium
This project, an NSF INCLUDES Design and Development Launch Pilot, managed by the University of Nevada, Reno, addresses the grand challenge of increasing underrepresentation regionally in the advanced manufacturing sector. Using the state's Learn and Earn Program Advanced Career Pathway (LEAP) as the foundation, science, technology, engineering and mathematics (STEM) activities will support and prepare Hispanic students for the region's workforce in advanced manufacturing which includes partnerships with Truckee Meadows Community College (TMCC), the state's Governor's Office of Economic Development, Charles River Laboratories, Nevada Established Program to Stimulate Competitive Research (Nevada EPSCoR) and the K-12 community.
The expected outcomes from the project will inform the feasibility, expandability and transferability of the LEAP framework in diversifying the state's workforce locally and the STEM workforce nationally. Formative and summative evaluation will be conducted with a well-matched comparison group. Dissemination of project results will be disseminated through the Association for Public Land-Grant Universities (APLU), STEM conferences and scholarly journals.
DATE:
-
TEAM MEMBERS:
David ShintaniJulie EllsworthKarsten HeiseRobert StachlewitzRegina Tempel
resourceprojectProfessional Development, Conferences, and Networks
This award supports a conference and related activities which will bring together researchers, higher education administrators, industry representatives, members of professional societies, and other community members to design collective impact initiatives to improve the retention and continuation of Hispanics, women, and other underrepresented groups in STEM fields. Retention and continuation to the next step in their educational careers is a particular challenge for underrepresented minorities and first-generation students, whether in community college, four-year institutions, or graduate programs (Ishitani 2006, Sowell et al. 2015). The conference focuses explicitly on this critical issue, and will identify potential remedies that can scale across different types of institutions, communities, and underrepresented groups.
This conference will employ a collective impact, networked improvement approach to help fill this gap and engage the broader community. This approach offers a means of identifying and agreeing upon shared, measurable objectives, mechanisms for coordination across individuals and organizations, a commitment to contrast and comparison, and an ethic of continuous improvement. Drawing from the extant literature and recommendations from a wide array of stakeholders, the team will propose measurable strategies for Alliances and the National INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Network that can be implemented, tested, enhanced, and expanded. The workshop team will draw on evidence-based knowledge, leveraging findings from disciplinary and interdisciplinary fields and from differing types of institutions and educational levels to determine whether strategies identified can yield large-scale progress towards INCLUDES goals. Results will inform the INCLUDES Alliances and the backbone organization supporting the Alliances.
DATE:
-
TEAM MEMBERS:
Marjorie ZatzAnn GatesDeborah Santiago
resourceprojectProfessional Development, Conferences, and Networks
Jobs are growing most rapidly in areas that require STEM knowledge, causing business leaders to seek skilled American workers now and in the near future. Increase in the number of students pursuing engineering degrees is taking place but the percentages of underrepresented students in the engineering pipeline remains low. To address the challenge of increasing the participation of underrepresented groups in engineering, the National Society of Black Engineers, the American Indian Science and Engineering Society, the Society of Hispanic Professional Engineers, and the Society of Women Engineers have formed the 50K Coalition, a collaborative of over 40 organizations committed to increasing the number of bachelors degrees awarded to women and minorities from 30,000 annually to 50,000 by 2025, a 66% increase. The 50K Coalition is using the Collective Impact framework to develop an evidence-based approach that drives management decision-making, improvements, sharing of information, and collective action to achieve success. The first convening of the 50K Coalition in April, 2016, brought together 83 leaders of the engineering community representing 13 professional societies with over 700,000 members, deans of engineering, minority engineering and women in engineering administrators from 11 leading colleges of engineering, and corporate partners representing six global industries. Consensus was reached on the following Common Agenda items: 1.) Undergraduate support and retention; 2.) Public awareness and marketing; 3.) K-12 support; 4.) Community College linkages; 5.) Culture and climate. The Coalition will encourage member organizations to develop new programs and scale existing programs to reach the goal.
The Coalition will use shared metrics to track progress: AP® Calculus completion and high school graduation rates; undergraduate freshmen retention rates; community college transfer rates and number of engineering degrees awarded. The 50K Coalition will develop the other elements of the Collective Impact framework: Infrastructure and effective decision-making processes that will become the backbone organization with a focus on data management, communications and dissemination; a system of continuous communication including Basecamp, website, the annual Engineering Scorecard, WebEx hosted meetings and convenings; and mutually reinforcing activities such as programs, courses, seminars, webinars, workshops, promotional campaigns, policy initiatives, and institutional capacity building efforts. The National Academy of Sciences study, Expanding Underrepresented Minority Participation: America's Science and Technology Talent at the Crossroads recommended that professional associations make recruitment and retention of underrepresented groups an organizational goal and implement programs designed to reach that goal by working with their membership, academic institutions and funding agencies on new initiatives. While these types of organizations work together now in a variety of ways, the relationships are one-on-one. The 50K Coalition brings together, for the first time professional societies, engineering schools, and industry to consider what mutually reinforcing activities can most effectively encourage students from underrepresented groups to complete calculus and graduate from 4-year engineering programs.
DATE:
-
TEAM MEMBERS:
Karl ReidBarry CorderoSarah EcohawkKaren Horting
resourceprojectProfessional Development, Conferences, and Networks
This one-year Collaborative Planning project seeks to bring together an interdisciplinary planning team of informal and formal STEM educators, researchers, scientists, community, and policy experts to identify the elements, activities, and community relationships necessary to cultivate and sustain a thriving regional early childhood (ages 3-6) STEM ecosystem. Based in Southeast San Diego, planning and research will focus on understanding the needs and interests of young Latino dual language learners from low income homes, as well as identify regional assets (e.g., museums, afterschool programs, universities, schools) that could coalesce efforts to systematically increase access to developmentally appropriate informal STEM activities and resources, particularly those focused on engineering and computational thinking. This project has the potential to enhance the infrastructure of early STEM education by providing a model for the planning and development of early childhood focused coalitions around the topic of STEM learning and engagement. In addition, identifying how to bridge STEM learning experiences between home, pre-k learning environments, and formal school addresses a longstanding challenge of sustaining STEM skills as young children transition between environments.
The planning process will use an iterative mixed-methods approach to develop both qualitative and quantitative and data. Specific planning strategies include the use of group facilitation techniques such as World Café, graphic recording, and live polling. Planning outcomes include: 1) a literature review on STEM ecosystems; 2) an Early Childhood STEM Community Asset Map of southeast San Diego; 3) a set of proposed design principles for identifying and creating early childhood STEM ecosystems in low income communities; and 4) a theory of action that could guide future design and research. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.