This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Explora Science Center and Children's Museum of Albuquerque will conduct “Roots: supporting Black scholars in STEAM,” a project to increase Explora’s relationships with and relevance to Albuquerque’s Black communities and increase opportunities for Black students in Albuquerque to pursue STEAM. The project is designed to foster a holistic, place-based approach to K–16 STEAM learning that incorporates a growth mindset and highlights the contributions of community members, particularly Black STEAM professionals. The museum will collaborate on project activities with the Mexico Black Leadership Council, the Greater Albuquerque Housing Partnership/Casa Feliz, the Community School at Emerson Elementary, and Sandia National Laboratories’ Black Leadership Committee.
The Children’s Museum will collaborate with six Hartford Public Library branches, three Hartford Family Centers, and the Connecticut Children’s Medical Center to provide hands-on Science, Technology, Engineering, Arts, and Mathematics (STEAM) - based programs to over 1,000 local 3 to 14-year old children and their care givers. Program design and development will include planning for field trips to the museum. All participants will be given age-specific, supplemental STEAM materials to continue their learning activities at home, and families can attend more than one week of library programs, or more than three Saturdays of family center programs. The goal will be to help urban Hartford youths find new pathways toward responsible citizenry and fiscal stability.
KID Museum will develop and test a framework for working with community organizations to design learning experiences and create a facilitation guide for integrating cultural appreciation with maker-based learning. Building on its established Cultural Days programming, the museum will partner with four organizations that represent the region's largest ethnic populations. Together, they will plan, design, prototype, and refine new programs and experiences for children ages 4 to 14 and their families. The project team will adapt an IMLS-funded STEM-expert co-development model to develop and present cultural programs both at the museum and in the community. The project team will evaluate and refine the programs through visitor surveys. The museum will share the resulting framework and facilitation guide with other informal learning spaces to support the implementation of similar programs.
Building on program assessments and feedback, the Plains Art Museum will scale up its youth leadership-building program, Buzz Lab. The paid summer internship program engages teens in student-led, project-based learning in art and science. The program inspires the teens to lead community change while highlighting the art museum's role in addressing community needs. The program centers around the museum's pollinator garden, and the next phase of the project will engage interns with new and diverse project partners and guest speakers. For example, the interns will help find creative ways to streamline Buzz Lab projects for mass appeal and engage citizens around the pollinator crisis. The museum will also create a support network for interns entering post-secondary education programs by leveraging relationships with regional universities. Project assessment will be responsive to intern feedback so the teens become co-collaborators on the program's future.
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.
The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The National Building Museum contracted RK&A to conduct an evaluation Investigating Where We Live (IWWL), a long-running program that has brought together creative youth in the Washington, D.C. area every summer since 1996 to explore, document, and interpret the local built environment. The study goal was to examine program strengths and challenges to help NBM strategically plan for the program’s future.
How did we approach this study?
To hear a variety of perspectives on the program, RK&A conducted in-depth telephone interviews with a number of stakeholders with different
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and
Informal science learning (ISL) organizations that are successful at providing meaningful science, technology, engineering, arts, and mathematics (STEAM) experiences for Latino children, youth, and their families share some common traits. They have leaders and staff who believe in the importance of developing culturally relevant models and frameworks that meet the needs and acknowledge the legacy of STEAM in Latino communities. Such organizations are willing to take risks to create experiences that are culturally meaningful, garner funding and implement programs by working closely with their
DATE:
TEAM MEMBERS:
Cheryl JuarezVerónika NúñezExploratorium
Maker Corps is a program delivered by the Maker Education Initiative (Maker Ed) to increase organizational capacity to develop and deliver maker programing. Since its inception in 2013, the program has grown to support over 100 organizations by providing professional development, connections to a community of other maker educators and individualized support. Over time the program elements have changed in response to feedback from participants, collaboration with evaluators and shifts in focus for Maker Ed’s goals. In the spirit of maker education – tinkering, observing, responding, iterating –