This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
As an emerging field of theory, research, and practice, STEAM (Science, Technology, Engineering, Arts and Mathematics) has received attention for its efforts to incorporate the arts into the rubric of STEM learning. In particular, many informal educators have embraced it as an inclusive and authentic approach to engaging young people with STEM. Yet, as with many nascent fields, the conceptualization and usage of STEAM is somewhat ambivalent and weakly theorized. On the one hand, STEAM offers significant promise through its focus on multiple ways of knowing and new pathways to equitable
The National Building Museum contracted RK&A to conduct an evaluation Investigating Where We Live (IWWL), a long-running program that has brought together creative youth in the Washington, D.C. area every summer since 1996 to explore, document, and interpret the local built environment. The study goal was to examine program strengths and challenges to help NBM strategically plan for the program’s future.
How did we approach this study?
To hear a variety of perspectives on the program, RK&A conducted in-depth telephone interviews with a number of stakeholders with different
Libraries can provide unique opportunities for rural youth and communities. Phase III of the STAR Library Network will be a collaboration with 12 rural school districts in largely Latinx communities to address the challenges faced by rural youth, particularly English Language Learners. The project will use a coordinated and tested strategy to establish three learning pathways in public libraries: science learning spaces with exhibits, library programs, and science kits. These resources will provide learners with art-rich STEM learning opportunities.
Partners
Project partners include the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation, and Twin Cities Public Television. The project will rely significantly on expertise from the Latinx community.
Project Plan
Building on an established librarian training model, the project will introduce library staff to the STEAM content and guide them in developing their own STEAM Learning Pathways. The project will draw on existing professional infrastructure from the ALA and the Institute for Learning Innovation’s established community of practice. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project.
The Research
The research team will study the efficacy of each pathway, alone and in tandem, on participant’s interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews, and case studies. The results should yield a model for nationwide application and contribute insights for the formal education sector.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This program will derive knowledge on extreme weather and its concepts to be shared with youth in the Boston and Kansas City areas. Subsequently, the youth will share this knowledge by displaying it as art work on the rapid transit systems. The art projects will culminate in broad-based exhibition at the end of each group's sessions. The project will involve 200 youth per region resulting in an impact of 1000 youth per year, 80 adult mentors and 20,000 adult transportation riders in learning about extreme weather concepts. Participant organizations are the University of Mass-Boston, University of Mass-Lowell, The Massachusetts College of Art, the University of Kansas Center for Research Inc., and the Goodman Research Group Inc.
The goals of this project are to bring the topic of extreme weather to the foreground by educating youth and in turn having them educate a selected group of adults that use the rapid transit system. Groups of youths will learn about the topic through a series of meetings with mentors who are experts on the issues around extreme weather. The youth will derive their own art-works with their interpretation. These art-works will be displayed on the rapid transit systems in New England (Merrimack Valley and Worcester regions) and the Mid-West (Topeka and Kansas City areas). Using a quasi-experimental mixed methodology (demographics, bus ridership, initial level of science awareness, and interest) the goal is to understand science learning outcomes associated with the creation and public display of youth art. Research questions of importance in this regard are 1. In what ways does blending art with the science enhance youth learning about extreme weather concepts? 2. To what extent does youth art support adult learning of science? and 3. How does regional context affect learning about extreme weather?
Broader impacts will result from the youth diversity as well as the diversity of riders of the rapid transit systems where the art of extreme weather is displayed.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert ChenLois HetlandJill LohmeierStephen MisholSteven SchrockClaudia Bode
Informal science learning (ISL) organizations that are successful at providing meaningful science, technology, engineering, arts, and mathematics (STEAM) experiences for Latino children, youth, and their families share some common traits. They have leaders and staff who believe in the importance of developing culturally relevant models and frameworks that meet the needs and acknowledge the legacy of STEAM in Latino communities. Such organizations are willing to take risks to create experiences that are culturally meaningful, garner funding and implement programs by working closely with their
DATE:
TEAM MEMBERS:
Cheryl JuarezVerónika NúñezExploratorium
A collaboration of TERC, MIT, The Woods Hole Oceanographic Institution and community-based dance centers in Boston, this exploratory project seeks to address two main issues in informal science learning: 1) broadening participation in science by exploring how to expand science access to African-American and Latino youth and 2) augmenting science learning in informal contexts, specifically learning physics in community-based dance sites. Building on the growing field of "embodied learning," the project is an outgrowth in part of activities over the past decade at TERC and MIT that have investigated approaches to linking science, human movement and dance. Research in embodied learning investigates how the whole body, not just the brain, contributes to learning. Such research is exploring the potential impacts on learning in school settings and, in this case, in out of school environments. This project is comprised of two parts, the first being an exploration of how African-American and Latino high school students experience learning in the context of robust informal arts-based learning environments such as community dance studios. In the second phase, the collaborative team will then identify and pilot an intervention that includes principles for embodied learning of science, specifically in physics. This phase will begin with MIT undergraduate and graduate students developing the course before transitioning to the community dance studios. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The goal of this pilot feasibility study is to build resources for science learning environments in which African-American and Latino students can develop identities as people who practice and are engaged in scientific inquiry. Youth will work with choreographers, physicists and educators to embody carefully selected physics topics. The guiding hypothesis is that authentic inquiries into scientific topics and methods through embodied learning approaches can provide rich opportunities for African-American and Latino high school-aged youth to learn key ideas in physics and to strengthen confidence in their ability to become scientists. A design- based research approach will be used, with data being derived from surveys, interviews, observational field notes, video documentation, a case study, and physical artifacts produced by participants. The study will provide the groundwork for producing a set of potential design principles for future projects relating to informal learning contexts, art and science education with African American and Latino youth.
DATE:
-
TEAM MEMBERS:
Folashade Cromwell SolomonTracey WrightLawrence Pratt
The Art of Science Learning, Phase 2 was an NSF-funded research and development project to investigate the value of incorporating arts-based learning techniques in STEM-related group innovation processes. The project team created a new, arts-infused innovation curriculum in consultation with leading national practitioners in the arts, creativity, and innovation, then deployed that curriculum in “innovation incubators” in San Diego, Chicago, and Worcester (Mass.) in partnership with informal STEM institutions in those cities. At each incubator, diverse members of the public (from high school
DATE:
TEAM MEMBERS:
Peter LinettSteve ShewfeltNicole BaltazarNnenna OkekeDreolin FleisherEric LaPlantMadeline SmithChloe Chittick PattonSarah LeeHarvey Seifter