The North Carolina Museum of Natural Sciences will partner with North Carolina State University to improve the evaluation skills of informal science education providers. The project team will create a community of practice for 54 science museums across North Carolina by implementing a series of regional professional development workshops. The workshops will be designed to create a shared sense of purpose for programming and evaluation, build capacity among science museum educators to evaluate their programs, and establish a set of common metrics and methodologies for the evaluation of informal science learning across the state. The project will produce a practitioner's guide that will describe the collaborative process, lessons learned, and ways other informal science organizations can use identified evaluation goals and metrics.
The Discovery Museums will develop and implement a continuous improvement process to improve the impact of its STEM programming by strengthening staff skills in using evaluation data. The project will begin with a series of training sessions for learning programs staff based on feedback from youth regarding the quality of the museum's program delivery and an assessment of staff competencies in positive youth development. Participating staff will benefit from a deeper understanding of data and the ability to build ongoing evaluation and positive youth development practices into their program presentations in a way that supports Social-Emotional Learning outcomes. The project will potentially result in a process and set of tools to quantify the impact of STEM programming that can be shared with other informal learning organizations.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
DATE:
-
TEAM MEMBERS:
Namulen Bayarsaihan
resourceresearchProfessional Development, Conferences, and Networks
Developing a growth mindset has been identified as a key strategy for increasing youth achievement, motivation, and resiliency (Rattan et al. 2015). At its core, growth mindset describes the idea that one’s abilities can change through using new learning strategies and receiving appropriate mentoring (Dweck 2008). In contrast, a fixed mindset relates to the idea that ability is inherent and cannot be changed. We have taken up the concept of growth mindset and developed it specifically for the context of STEAM (science, technology, engineering, art, and math), a growing area of focus in both in
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
DATE:
-
TEAM MEMBERS:
Kris Scopinich
resourceprojectProfessional Development, Conferences, and Networks
The Lawrence Hall of Science will build the capacity of staff from different programmatic departments to systematically evaluate their programs in strategic alignment with the museum's newly revised Theory of Action. Based on best practices in evaluation capacity building, the museum will create a strategic plan for evaluation that provides ongoing opportunities for staff to engage in evaluation practice. To build capacity and foster a culture of continuous improvement, program teams will participate in a variety of activities such as trainings to build knowledge about evaluation; meetings to discuss purpose and methods of evaluation; group inquiry about evaluation measures, outcomes, and data; and conducting evaluation with support from evaluators. Project outcomes for museum staff will include increased knowledge of evaluation design; increased skill in designing and conducting evaluation; ongoing and continuous use of evaluation data to improve decision making and programs; and enthusiasm for evaluation as part of the process of strategic learning.
The Paine Art Center and Gardens will address challenges facing arts education in the region, in particular the low retention rate of new visual and performing arts teachers in the first five years of entering the field. Previous community-based planning sessions determined that arts integration is a compelling and relevant strategy to address the needs of new teachers and arts education. The project will support the development and implementation of the ArtsCore Laboratory, a new dedicated classroom at the Paine, which facilitates teacher collaboration, experimentation, and art activities for students. The laboratory will be designed and equipped to foster interdisciplinary activities and learning styles, with an emphasis on connecting STEM education with arts education. A new educator-in-residence program, the ArtsCore Experience, will offer a professional development program for teachers. The initiatives are a collaboration between the museum and the University of Wisconsin Oshkosh, the Oshkosh Area School District, and more than seven additional school districts.
The Academy of Natural Sciences of Drexel University will integrate unaccredited, home-based preschool care providers and the low-income families they serve into Philadelphia's initiative to increase the number of preschool education facilities and make high-quality pre-K instruction available to all children (Universal Pre-K). The project outputs include: an interdisciplinary pre-K curriculum that fosters knowledge and skill building in science, math, and literacy as well as positive social-emotional development; professional development workshops and one-on-one training with museum educators for childcare staff, followed by networking and alliance-building; and seven free Celebrate Pre-K Learning Days at the museum for families to learn about the importance of school readiness in science, math, and literacy and practice using free family learning kits that support these skills. The new citywide partnership, managed by the museum, is called Science and Literacy for Success and is supported by a robust number of partnerships with local social service and education agencies.
This workshop is funded through the "Dear Colleague Letter: Principles for the Design of Digital Science, Technology, Engineering, and Mathematics (STEM) Learning Environments (NSF 18-017)." In today's educational climate, organizations are creating physical learning spaces for hands-on STEM activities, often called makerspaces, co-working spaces, innovation labs, or fablabs. These spaces have evolved to be interdisciplinary centers that personalize learning for individual, diverse learners in collaborative settings. When designed well, these physical spaces create communities that contextualize learning around participants' goals and thus address STEM learning in a dynamic and integrated way. Participation in these learning environments encourages the cultivation of STEM identities for young people and can positively direct their career trajectories into STEM fields. This workshop will bring together a community of collaborators from multiple stakeholder groups including academia, public libraries, museums, community based organizations, non-profits, media makers and distribution channels, and educators within and beyond K-12 schools. Led by the University of Arizona, and held at Biosphere 2, an international research facility, participants will engage in activities that invite experimentation with distributed learning technologies to examine ways to adapt learning to the changing technological landscape and create robust, dynamic online learning environments. The workshop will culminate in a synthesis of design principles, assessment approaches, and tools that will be shared widely. Partnerships arising from the workshop will pave the way for sustained efforts in this area that span research and practice communities. Outcomes will address research and development of the next generation of digitally distributed learning environments.
The three day workshop convening will provide a unique forum to (1) exchange innovative ideas and share challenges and opportunities, (2) connect practical and research-based expertise and (3) form cross-institutional and cross-community partnerships that envision, propose, and implement opportunities for collecting and analyzing data to systematically inform the collective understanding. Participation-based activities will include design-based experiences, participatory activities, demonstrations of works in progress, prototyping, creative pitching, practitioner lightning talks, small group breakouts, hands-on design activities, and an 'unconference' style synthesis of bold ideas. Participants will be invited to experiment with distributed learning technologies. Five focus areas for the workshop include (1) inclusivity of learning spaces that invite multiple perspectives and full participation, (2) documenting learning in ways that are linked to outcomes and impacts for all learners, (3) implementing the use of new technologies in diverse settings, such as the workforce, (4) interpersonal interactions and peer-to-peer learning that may encourage a STEM career-path, and, (5) methods for collecting and analyzing data at the intersection of people, the learning environment, and new technologies at multiple levels. Outcomes of the workshop will serve to advance knowledge regarding critical gaps and opportunities and identify and characterize models of collaboration, networking, and innovation that operate within and across studio-based STEM learning environments.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
The STAR Library Network (STAR Net) utilizes webinars as a key tool in its suite of professional learning opportunities relating to STEM learning in libraries. Traditionally, continuing education for library staff has taken place in person, such as at conferences and workshops. While these touch points provide crucial face-to-face networking opportunities, highly interactive webinars provide learning conversations that help bridge the gap between frameworks and resources to practical application in daily practice. Through webinars, STAR Net shares ideas, demonstrates activities, and engages
How can we begin to chart a course toward a future for science museums in which we maintain our status as sources of trusted information, while also fulfilling our potential as sites of genuine participation and social interaction? In 2019, with funding from the National Science Foundation, the New York Hall of Science hosted a three day conference to discuss new and equitable approaches to exhibit design. With leading exhibit designers, educators, researchers, and community engagement specialists, we began to rethink the exhibit design process, toward a goal of helping our museums become more