Inverness Research has been the external evaluator for CAISE for the past eight years. The year 8 and year 9 report, along with a brief executive summary, highlights findings from the external evaluation of CAISE for this award period, along with comparison data gathered from the previous years’ evaluation efforts. Our evaluation findings show that CAISE is important infrastructure for the ISE field, addressing important needs in the field through resources that are well known, high-quality, widely used, well-designed, accessible, valued and trustworthy.
This evaluation report highlights finding on the evaluation of the Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with NSF, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments, Oregon State University, Science Museum of Minnesota, Visitor Studies Association, KQED Public Media, Advisors and other collaborators. CAISE is working to support ongoing improvement of, and NSF investments in, the national infrastructure for informal
The University of Washington, the Exploratorium, the Education Development Center, Inverness Research, and the University of Colorado - Boulder have come together to form a Research+Practice (R+P) Collaboratory. The Collaboratory seeks to address and reframe the gap between research and practice in K-12 STEM education. This gap persists despite decades of work by many leading organizations, associations, and individuals. Attempts to close the gap have generally focused on creating resources and mechanisms that first explain or illustrate "what research says" and then invite educators to access and integrate findings into practice. Recently, however, attention has turned to the ways in which the medical sciences are addressing the gap between research and clinical practice through the developing field of "translational research." In medicine, the strategy has been to shift the focus from adoption to adaptation of research into practice. Implicit in the notion of adaptation is a bi-directional process of cultural exchange in which both researchers and practitioners come to understand how the knowledge products of each field can strengthen the professional activities in the other. Along these lines, the R+P Collaboratory is working with leading professional associations and STEM improvement efforts to leverage their existing knowledge and experience and to build sustainable strategies for closing the gap. Activities include:
Collecting, creating and synthesizing translational research resources to expand STEM educators' and educational leaders' access and awareness to current relevant research.
Supporting multiple opportunities for cross-sector (research and practice; education and social sciences; formal and informal) meetings to foster critical engagement and cultural exchange.
Testing, documenting and innovating new resources and mechanisms at Adaptation Sites and disseminating both products and results through the R+P Resource Center.
The R+P Collaboratory is developing an online 'Go-To' Resource Center website that houses the resources collected, created, and curated by the Collaboratory. The Resource Center also has significant 'Take-Out' features, with all materials meta-tagged so that they can be automatically uploaded, reformatted, and integrated into the existing communication and professional development mechanisms (e.g., newsletters, digests, conferences, and websites) of a dozen leading professional associations within a Professional Association Partner Network.
In light of new and emerging standards in the STEM disciplines, the Collaboratory is focusing its work on four salient and timely bodies of research: (a) STEM Practices, (b) Formative Assessment, (c) Cyberlearning, and (d) Learning as a Cross-Setting Phenomenon. Special emphasis is being placed on research and practice that focuses on the learning of children and youth from communities historically underrepresented in STEM fields.
The work of the R+P Collaboratory includes research and evaluation of its own efforts through studies aimed at answering the following questions:
How are Collaboratory resources and engagement activities accessed, experienced and leveraged by participants?
What resources, mechanisms and learning contexts support cultural exchange among STEM education researchers and practitioners?
What new kinds of practices result when research-based evidence is adapted into evidence-based practices, and how does it change learning opportunities for K-12 aged children?
How can effective strategies, mechanisms and resources of the Collaboratory be scaled and adapted to new contexts?
This article makes a case for the importance of brokering future learning opportunities to youth as a programmatic goal for informal learning organizations. Such brokering entails engaging in practices that connect youth to events, programs, internships, individuals and institutions related to their interests to support them beyond the window of a specific program or event. Brokering is especially critical for youth who are new to an area of interest: it helps them develop both a baseline understanding of the information landscape and a social network that will respond to their needs as they
This project supports the Broader Impacts and Outreach Network for Institutional Collaboration (BIONIC), a national Research Coordination Network of Broader Impacts to support professionals who assist researchers to design, implement, and evaluate the Broader Impacts activities for NSF proposals and awards. All NSF proposals are evaluated not only on the Intellectual Merit of the proposed research, but also on the Broader Impacts of the proposed work, such as societal relevance, educational outreach, and community engagement. Many institutions have begun employing Broader Impacts support professionals, but in most cases, these individuals have not worked as a group to identify and share best practices. As a consequence, there has been much duplication of effort. Through coordination, BIONIC is expected to improve efficiency, reduce redundancy, and have significant impact in several areas: 1) Researchers will benefit from an increased understanding of the Broader Impacts merit review criterion and increased access to collaborators who can help them design, implement, and evaluate their Broader Impacts activities; 2) Institutions and research centers will increase their capacity to support Broader Impacts via mentoring for Broader Impacts professionals and consulting on how to build Broader Impacts support infrastructure, with attention to inclusion of non-research-intensive universities, Historically Black Colleges and Universities, and Hispanic- and Minority-Serving Institutions that may not have the resources to support an institutional Broader Impacts office; and 3) NSF, itself, will benefit from a systematic and consistent approach to Broader Impacts that will lead to better fulfillment of the Broader Impacts criterion by researchers, better evaluation of Broader Impacts activities by reviewers and program officers, and a system for evaluating the effectiveness of Broader Impacts activities in the aggregate, as mandated by Congress and the National Science Board. Through its many planned activities, BIONIC will ultimately help advance the societal aims that the Broader Impacts merit review criterion was meant to achieve.
The main goals of the project will be accomplished through the four specific objectives: 1) Identify and curate promising models, practices, and evaluation methods for the Broader Impacts community; 2) Expand engagement in, and support the development of, high-quality Broader Impacts activities by educating current and future faculty and researchers on effective practices; 3) Develop the human resources necessary for sustained growth and increased diversity of the Broader Impacts community; and 4) Promote cross-institutional collaboration and dissemination for Broader Impacts programs, practices, models, materials, and resources. BIONIC will facilitate collaborative Broader Impacts work across institutions, help leverage previously developed resources, support professional development, and train new colleagues to enter into the Broader Impacts field. This project will improve the quality and sustainability of Broader Impacts investments, as researchers continue to create unique and effective activities that are curated and broadly disseminated. BIONIC will create a network designed to assist NSF-funded researchers at their institutions in achieving the goals of the Broader Impacts Review Criterion. In so doing, BIONIC will promote Broader Impacts activities locally, nationally, and internationally and help to advance the Broader Impacts field.
This award is co-funded by the Divisions of Molecular and Cellular Biosciences and Emerging Frontiers in the Directorate for Biological Sciences and by the Division of Chemistry in the Directorate for Mathematics and Physical Sciences.
Brokering Youth Pathways was created to share tools and techniques around the youth development practice of “brokering” or connecting youth to future learning opportunities and resources.
This toolkit shares ways in which various out-of-school educators and professionals have approached the challenge of brokering. It provides a framework, practice briefs and reports that focus on a particular issue or challenge and provide concrete examples, as well as illustrate how project partners partners worked through designing new brokering routines in partnership with a research team.
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
The National Science Foundation (NSF) Climate Change Education Partnership Alliance (CCEPA) is a consortium made up of the six Phase II Climate Change Education Partnership (CCEP-II) program awardees funded in FY 2012. Collectively, the CCEPA is establishing a coordinated network devoted to increasing the adoption of effective, high quality educational programs and resources related to the science of climate change and its potential impacts. The establishment of a CCEPA Coordination Office addresses the need for a coordinating body that leverages and builds upon the CCEPA projects' individual initiatives. The CCEPA Coordination Office facilitates interactions to leverage a successful network of CCEP-II projects and individuals engaged in increasing climate science literacy. The efforts of the Coordination Office advance knowledge and understanding of how to effectively network related, but different, projects into a cohesive enterprise. The goal is to coordinate a functional network, where the whole is greater than the sum of the parts.
The CCEPA Coordination Office at the University of Rhode Island is helping to move the CCEPA network forward on a number of key initiatives that strengthen it, reduce duplication, and enhance its overall impact. An important role of the Coordination Office is the facilitation of the transfer of best practices between projects. An effective network forges collaborations and establishes communities of practice through network working groups, building intellectual capital network-wide. The CCEPA Coordination Office has a key role in assisting the CCEPA project PIs and staff to disseminate the results of their work. Partnerships with other relevant societies and organizations assist the Coordination Office in identifying opportunities and synergies for sharing, disseminating, and leveraging network products as well as best practices that emerge as Earth system science education models and tools are evaluated. This endeavor broadens the collective impact of the individual projects across the country.
Produced by the Climate Change Education Partnership (CCEP) Alliance, the "Climate Change Education: Effective Practices for Working with Educators, Scientists, Decision Makers and the Public" guide provides recommendations for effective education and communication practices when working with different types of audiences. While effective education has been traditionally defined as the acquisition of knowledge, Alliance programs maintain a broader definition of “effective” to include the acquisition and use of climate change knowledge to inform decision-making.
The CCEP Alliance is supported
This INCLUDES award to the Quality Education for Minorities (QEM) Network will focus on building STEM research and teaching capacity of Historically Black Colleges and Universities (HBCUs) and Tribal Colleges and Universities (TCUs). HBCUs and TCUs share the impact of disparities that affect their communities and are constantly seeking STEM research and education solutions to engage students and prepare them to be fully involved in developing innovative and effective remedies that will address these disparities. The QEM Design & Development Launch Pilot (DDLP) Project is a collaboration that will provide an underpinning for broadening the participation of institutions involved in improving the enrollment and retention of minority students in science, technology, engineering, and mathematics (STEM). To be competitive in a future global economy, the Nation must make a larger investment in the STEM education of its underrepresented groups, including, males and persons with disabilities. Failure to make such an investment can weaken our STEM infrastructure and inhibit the continuity of the Nation as a world leader in STEM.
The project's initial partners consist of five HBCUs (Morehouse College, Morgan State University, Spelman College, Tuskegee University, and University of Maryland Eastern Shore) and two TCUs (Aaniiih Nakoda College and United Tribes Technical College) with the aim of expanding to 12 institutions as well as adding business/industry partners and STEM-focused professional societies. The goals of the DDLP project are to: (1) build and sustain an alliance to increase the participation of African Americans and Native Americans in STEM education, research, and the workforce; (2) strengthen the STEM research, instructional, and mentoring capacities of partner HBCUs and TCUs; and (3) develop and promote broadening participation (BP) practices to address academic and professional career needs of African American and Native American males to significantly increase their representation in STEM. The QEM DDLP will implement evidence-based and data-driven approaches to developing research, education, and mentoring activities that can be tailored to institutional needs and context. The resulting outcome will be an increase in the capacities of HBCUs and TCUs in STEM that will position these institutions for sustained contributions to national broadening participation initiatives.
DATE:
-
TEAM MEMBERS:
Shirley McBayLeander McDonaldLaura-Lee DavidsonEugene DeLoatchJuliette Bell
resourceprojectProfessional Development, Conferences, and Networks
This collaboration between two Historically Black Colleges and Universities (HBCUs) will form a networked improvement community located within the Piedmont Region of North Carolina. In close partnership with community colleges and civic organizations, the project will reach families and students that lead to broader participation of underrepresented groups in science, technology, engineering, and mathematics (STEM) fields. The overall goal is to build and sustain a scalable, inquiry-based network with the purpose of increasing the academic success of underrepresented ethnic minorities and women in the STEM continuum. By engaging in culturally relevant socio-environmental frameworks, project outcomes will positively impact student retention, knowledge, and quantitative skills in STEM across socio-economic divides and STEM disciplines.
The Launch Pilot phase will focus on evidence-based teaching and learning approaches for middle school students. The core structure of the network will serve as a platform to launch and guide other age- and level-specific educational instruction, research, and assessment initiatives. Student understanding of the nature of science will be enhanced by adapting structure, behavior, and function (SBF) theory and system thinking hierarchical (STH) models. Ultimately, the network will represent a driver for social innovation that positively impacts broadening participation in STEM.