At the end of the NISE Network’s 10th year, the Evaluation workgroup created a reflection document to describe how we managed the evaluation of the NISE Network, one of the largest informal education networks ever formed. This document goes into specifics of how we set up our team, what impacts we decided to measure, and what methods we used to collect data on a national scale. It also talks about ethical considerations we took into account and how we shared our work with multiple audiences. This reflection document is not meant to be a prescriptive "how-to" manual, but an example of one
The purpose of this report is to summarize the findings from the Years 6-10 (2010-2015) Nanoscale Informal Science Education Network (NISE Net) summative evaluation studies and to discuss factors that contributed to the achievement of NISE Net’s goals. The report centers on summative evaluation findings, while also including major project output data and corroborating findings from the Years 6-10 NISE Net research studies. By synthesizing findings across studies, this summary evaluation report provides a high-level description of the cross-cutting and integrated knowledge generation efforts
The National Science Foundation (NSF) Climate Change Education Partnership Alliance (CCEPA) is a consortium made up of the six Phase II Climate Change Education Partnership (CCEP-II) program awardees funded in FY 2012. Collectively, the CCEPA is establishing a coordinated network devoted to increasing the adoption of effective, high quality educational programs and resources related to the science of climate change and its potential impacts. The establishment of a CCEPA Coordination Office addresses the need for a coordinating body that leverages and builds upon the CCEPA projects' individual initiatives. The CCEPA Coordination Office facilitates interactions to leverage a successful network of CCEP-II projects and individuals engaged in increasing climate science literacy. The efforts of the Coordination Office advance knowledge and understanding of how to effectively network related, but different, projects into a cohesive enterprise. The goal is to coordinate a functional network, where the whole is greater than the sum of the parts.
The CCEPA Coordination Office at the University of Rhode Island is helping to move the CCEPA network forward on a number of key initiatives that strengthen it, reduce duplication, and enhance its overall impact. An important role of the Coordination Office is the facilitation of the transfer of best practices between projects. An effective network forges collaborations and establishes communities of practice through network working groups, building intellectual capital network-wide. The CCEPA Coordination Office has a key role in assisting the CCEPA project PIs and staff to disseminate the results of their work. Partnerships with other relevant societies and organizations assist the Coordination Office in identifying opportunities and synergies for sharing, disseminating, and leveraging network products as well as best practices that emerge as Earth system science education models and tools are evaluated. This endeavor broadens the collective impact of the individual projects across the country.
Produced by the Climate Change Education Partnership (CCEP) Alliance, the "Climate Change Education: Effective Practices for Working with Educators, Scientists, Decision Makers and the Public" guide provides recommendations for effective education and communication practices when working with different types of audiences. While effective education has been traditionally defined as the acquisition of knowledge, Alliance programs maintain a broader definition of “effective” to include the acquisition and use of climate change knowledge to inform decision-making.
The CCEP Alliance is supported
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [apprentices]. During the fifth regional workshop in San Francisco, CA, the NFB operated two different programs simultaneously: one program for youth and a second program for their parents/caregivers. A third program, for the Exploratorium staff, was conducted earlier to prepare the museum staff to assist with the youth program. A separate report
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [mentors]. During the fourth regional workshop in Phoenix, AZ, the NFB operated three different programs simultaneously: one program for youth, a second program for their parents/caregivers, and a third program for teachers of the visually impaired. A fourth program, for Arizona Science Center staff, was conducted earlier to prepare the museum staff
Science belongs everywhere. Although informal science learning typically takes place in the bright spots of society—our museums, botanical gardens, and science centers—some science educators are creating programs for individuals who live in the darker parts of our communities, such as prisons. Over 2 million people are in prison in the United States, with a national recidivism level of over 70%. Yet men and women who are incarcerated can also participate in science learning and contribute to conservation projects.
Keystone Connect Network is a proposed regional broadband network whose purpose is to increase educational opportunities and generate business growth. The backbone of this plan is the Pennsylvania Research and Education Network's (PennREN), a next generation high-speed internet network, managed by KINBER, which educational institutions can use to train their students and create new learning opportunities; and business can create new products and connect with their customers.
The primary goal of the STEM Evaluation Community project is to increase the capacity of evaluators to produce high quality, conceptually sound, methodologically appropriate evaluations of NSF programs and projects. The project will contribute to the exploration of innovative new approaches for determining the impact of NSF programs and projects, promote the usefulness of NSF program and project evaluations, and help to expand the theoretical foundations for evaluating STEM education, workforce, and outreach initiatives. The STEM Evaluation Community will serve as a focal point for evaluation capacity building with and across the NSF programs that fund STEM education, workforce and outreach activities, bringing people and ideas together, facilitating dialogue, sharing resources, offering opportunities for dissemination and more. The resulting connected system of evaluators will promote social innovation through a lively, dynamic evaluation professional community in which NSF program and project evaluators will share their work, learn from each other, and, ultimately, leverage and enhance the existing evaluation capacity building infrastructure that has been developed for specific NSF programs and audiences, thus charting a course to build further evaluation capacity across NSF.
The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) intiative supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Cincinnati, lead for a tri-state (OH, KY, IN) project, will convene a three-day conference to convene national and local experts to explore the best practices that support the development of a backbone organization in the context of using a social innovation model for broadening participation in STEM. The intent is to strengthen the network among participants and leverage learning from the Cincinnati Strive experience with collective impact across the Midwest and beyond.
Results from the NextLivesHere: Social Change Innovation Summit, will be disseminated in the tri-state region through the Greater Cincinnati STEM Collaborative (GCSC and the Ohio STEM Learning Network (OSLN). National dissemination will occur through informal and formal STEM professional organizations and publications as well as through participation in the NSF-developed national backbone organization.
DATE:
-
TEAM MEMBERS:
Kathie MaynardRoss MeyerShiloh TurnerGeoffrey ZimmermanGisela Escoe
resourceprojectProfessional Development, Conferences, and Networks
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of California-Irvine (UCI), in partnership with the University of California-San Diego and the University of California-Davis will convene a state-wide conference on inclusion in science, technology, engineering and mathematics (STEM) higher education. The California STEM INCLUDES Conference and Network will share best practices for promoting STEM inclusion and provide an infrastructure to further these practices and track the outcomes. The purpose of the conference is to form a backbone for a large regional network in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative.
The five goals of the conference are to:
--increase California educator awareness of demographic gaps in STEM participation and the research on factors influencing such participation gaps;
--engage participants in discussion of promising practices for increasing STEM inclusion
--broaden the impact of existing successful programs for STEM inclusion, through program modification and replication, scale-up, and increased collaboration;
--create a mechanism for sustained discussion, sharing and collaboration around STEM inclusion across California institutions;
--create central repository and common standards for reporting on STEM inclusion and implementation program impact for the state.
Approximately 340 individuals serving a broad cross-section of California's K-12, higher education, public, private and non-profit constituencies will participate in 2 ½ days of intense dialogue on topics such as data and research, successful implementations and sustainable networks for collaboration and sharing. The conference will be held in Spring 2017.
DATE:
-
TEAM MEMBERS:
Michael DenninSarah Eichhorn
resourceprojectProfessional Development, Conferences, and Networks
SRI International and the Carnegie Foundation for Advancement of Teaching will jointly lead a workshop with the dual goals of supporting INCLUDES (Inclusion across the Nation of Communities of Learners that have been Underrepresented for Diversity in Engineering and Science) Launch Pilots during their first year and contributing to plans for a National Backbone. The workshop will strengthen and deepen the potential for rapid, continuous improvement cycles within and across INCLUDES networks. To do so, they will combine the expertise of SRI and Carnegie in improvement science, rapid analytics, and fostering networks of researchers and practitioners to engage participants in conducting a complete improvement cycle within and across INCLUDES Launch Pilots.
The workshop will have three phases. A first phase, conducted online, will share expertise related to each of the four parts of a complete improvement cycle: (1) problem definition, (2) data collection, (3) formative evaluation, and (4) effective communication. This first phase will combine an initial presentation with facilitated, online opportunities to interactively engage in the topics. A second phase, conducted face-to-face, will work intensively with teams from INCLUDES networks to improve their operational and long-term plans. The third phase will reflect and report on the workshop and contribute plans to build capacities for the National Backbone organization. Through the combination of these three phases, they will support the first-year work of INCLUDES teams and also refine understanding of how a national network could combine online and face-to-face elements to advance INCLUDES efforts. The workshop team will create and disseminate resources that are immediately useful to INCLUDES and related projects, and the workshop will openly coordinate with other workshops to achieve synergies. The online offerings will be open, broadly advertised, and permanently available. The lessons learned regarding plans for a national backbone will be disseminated broadly. In addition to participants from INCLUDES networks, additional stakeholders will be invited to both phases so as to shape the future plans to achieve broader impacts aligned with overall INCLUDES goals.