At the end of the NISE Network’s 10th year, the Evaluation workgroup created a reflection document to describe how we managed the evaluation of the NISE Network, one of the largest informal education networks ever formed. This document goes into specifics of how we set up our team, what impacts we decided to measure, and what methods we used to collect data on a national scale. It also talks about ethical considerations we took into account and how we shared our work with multiple audiences. This reflection document is not meant to be a prescriptive "how-to" manual, but an example of one
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [apprentices]. During the fifth regional workshop in San Francisco, CA, the NFB operated two different programs simultaneously: one program for youth and a second program for their parents/caregivers. A third program, for the Exploratorium staff, was conducted earlier to prepare the museum staff to assist with the youth program. A separate report
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [mentors]. During the fourth regional workshop in Phoenix, AZ, the NFB operated three different programs simultaneously: one program for youth, a second program for their parents/caregivers, and a third program for teachers of the visually impaired. A fourth program, for Arizona Science Center staff, was conducted earlier to prepare the museum staff
SRI International and the Carnegie Foundation for Advancement of Teaching will jointly lead a workshop with the dual goals of supporting INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Launch Pilots during their first year and contributing to plans for a National Backbone. The workshop will strengthen and deepen the potential for rapid, continuous improvement cycles within and across INCLUDES networks. To do so, they will combine the expertise of SRI and Carnegie in improvement science, rapid analytics, and fostering networks of researchers and practitioners to engage participants in conducting a complete improvement cycle within and across INCLUDES Launch Pilots.
The workshop will have three phases. A first phase, conducted online, will share expertise related to each of the four parts of a complete improvement cycle: (1) problem definition, (2) data collection, (3) formative evaluation, and (4) effective communication. This first phase will combine an initial presentation with facilitated, online opportunities to interactively engage in the topics. A second phase, conducted face-to-face, will work intensively with teams from INCLUDES networks to improve their operational and long-term plans. The third phase will reflect and report on the workshop and contribute plans to build capacities for the National Backbone organization. Through the combination of these three phases, they will support the first-year work of INCLUDES teams and also refine understanding of how a national network could combine online and face-to-face elements to advance INCLUDES efforts. The workshop team will create and disseminate resources that are immediately useful to INCLUDES and related projects, and the workshop will openly coordinate with other workshops to achieve synergies. The online offerings will be open, broadly advertised, and permanently available. The lessons learned regarding plans for a national backbone will be disseminated broadly. In addition to participants from INCLUDES networks, additional stakeholders will be invited to both phases so as to shape the future plans to achieve broader impacts aligned with overall INCLUDES goals.
DATE:
-
TEAM MEMBERS:
Timothy Podkul
resourceprojectProfessional Development, Conferences, and Networks
The University of Georgia, Florida International University, Savannah State University, Clark Atlanta University and Fort Valley State University will lead this Design and Development Launch Pilot to address enhancing recruitment, retention, productivity and satisfaction of historically underrepresented minority (URM) undergraduate students who enroll in STEM graduate programs at primarily white (PWI) and research intensive (RI) universities. This project was created in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address the STEM education practices for retaining and educating URM undergraduate STEM students at our nation's research intensive universities (RIs). This project, NSF INCLUDES: An Integrated Approach to Retain Underrepresented Minority Students in STEM Disciplines, has the potential to advance a collaborative approach by a group of organizations to improve the success of URM undergraduates in STEM disciplines.
The collaborating universities will work together for the purposes of empowering URM students to more effectively navigate STEM undergraduate and graduate education at minority serving institutions (MSIs) and PWIs, and for transforming the culture of PWIs and RIs. The team plans to use evidence-based approaches to gain insights into cultural differences that impact the success of URM STEM students. Three interventions will be included in the pilot study: (1) undergraduate URM student exchanges between MSIs and PWIs, (2) collaborative inquiry to engage URM students in social science research about issues and experiences of under-representation in STEM, and (3) the adaptation of resources from the Center for the Integration of Research, Teaching and Learning (CIRTL) to train STEM faculty to embrace diversity and improve teaching in diverse classroom settings. The project team plans to develop strategies to scale approaches and develop an alliance of institutions to maximize potential project outcomes.
DATE:
-
TEAM MEMBERS:
Suzanne BarbourJuan GutierrezMichelle CookJoachim WaltherTimothy BurgJaideep ChaudharyShekhar BhansaliSarwan DhirMohamad Mustafa
resourceresearchProfessional Development, Conferences, and Networks
The National Academies’ Science and Technology for Sustainability Program (STS) in the division of Policy and Global Affairs was established to encourage the use of science and technology to achieve long-term sustainable development. The goal of the STS program is to contribute to sustainable improvements in human well-being by creating and strengthening the strategic connections between scientific research, technological development, and decision-making. The program concentrates on activities with the following attributes:
• Cross-cutting in nature, requiring expertise from multiple
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine
A skilled workforce is critical in high-quality out-of-school time (OST) programs (Smith, Devaney, Akiva & Sugar, 2009). However, the workshops commonly used to train OST staff are not adequately preparing practitioners to deliver quality programs that can benefit youth(Durlak & Weissberg, 2007; Smith et al, 2009).
DATE:
TEAM MEMBERS:
Femi VanceEmily SalvaterraJocelyn Atkins MichelsenCorey Newhouse
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
The National Center for Science and Civic Engagement (NCSCE) will conduct a Collaborative Planning project to maximize the collective impact of two well-established national STEM learning networks, National Informal STEM Education Network (NISE Net) and Science Education for New Civic Engagements and Responsibilities (SENCER). Through a strategic collaboration that leverages their respective achievements, resources, and expertise, the combined networks can advance informal science education that engages and empowers citizens and their communities as they address the complex civic challenges. The project will conduct a strategic planning process to envision how to unify two networks to increase a durable and identifiable infrastructure for cross-sector collaboration focused on linking science and civic engagement. It is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
The project objective of the planning process is to create a new and expanded national infrastructure that will increase the capacity of science centers and other informal learning organizations to enhance the public's engagement with science through attention to civic issues, and access new partners, participants, and resources from higher education institutions. The project's core activity will be a three-stage planning process: Phase 1, an assessment of assets, resources, and regional complementarity of the networks, and the development and investigation of key research questions; Phase 2, a planning workshop involving 29 project leaders from both organizations and stakeholders from formal and informal science to identify and develop specific collaborative strategies; and Phase 3, an evaluation and dissemination of the planning results to the networks and the development of a new multi-year project to strengthen the national infrastructure for formal and informal STEM education.
NatureStart Network brought together early childhood educators and environmental educators to support nature play, exploration, and inquiry for young children and their families within urban environments. Project partners included the Forest Preserves of Cook County and two established Head Start programs in the Chicago area, Mary Crane Center and El Valor. The foundation of the project was a series of three two-day professional learning sessions that took place over an eighteen month period. Through hands-on, collaborative learning and reflection activities, the participating educators
DATE:
TEAM MEMBERS:
David Becker
resourceevaluationProfessional Development, Conferences, and Networks
The NISE Network Professional Impacts Summative Evaluation is a longitudinal examination of individual professionals over the final three years of NISE Net funding. This investigation is based on the NISE Network goals for professionals and explores how involvement with NISE Net impacts an individual professional’s sense of community, learning about nano, and use of nano educational products and practices. This evaluation primarily included professional partners who were: (1) Informal Science Educators (ISE): Professionals from science museums and children’s museums implementing informal
Since 2011, the Community for Advancing Discovery Research in Education (CADRE), housed at Education Development Center, has been collaborating with the National Science Foundation on a series of national and regional STEM Smart meetings, which bring together educators, advocates, policy makers, and STEM thought leaders. Particularly useful resources resulting from these meetings are easy-to-read STEM Smart Briefs on a number of STEM education issues.