Researching the Value of Educator Actions for Learning (REVEAL) is an NSF-funded research project, led by the Oregon Museum of Science and Industry (OMSI) in collaboration with TERC and Oregon State University (OSU), which studied the impact of science center staff facilitation strategies at math exhibits. Building on and using exhibits from Design Zone—an interactive math exhibition which engaged visitors in exploring algebraic relationships and functions—the study was designed to add to the scant existing literature about the impact of staff facilitation on visitors. The study also aimed to
This document is a list of culturally responsive research resources developed by the Researching the Value of Educator Actions for Learning (REVEAL) project.
National Air and Space Museum, Washington DC
Summative Evaluation for Educational Program, 2016
The National Air and Space Museum (NASM) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of Science in Pre-K, an onsite and online teacher professional development program that NASM developed for the District of Columbia Public Charter Schools’ (DCPS). The program supports preschool teachers in teaching science through exploration and problem solving. This evaluation is a continuation of a planning and evaluation project initiated in 2013. In 2013, RK&A
The Roads Taken Conference Report provides information and results from the virtual conference held in October and November 2016.
Representatives from ten long-standing youth programs, experts in out-of-school time (OST) youth programming, and researchers participated in the Roads Taken virtual conference in October and November 2016, funded by the National Science Foundation (DRL-1644479). Participants collaboratively developed a Program Profile template with dual purposes: a tool for practitioners and a tool for researchers. As the first phase the three-part plan, Program Profiles will
Science, Technology, Engineering, and Mathematics (STEM) education and workforce development in the US are critical for global competitiveness and national security. However, the U.S. is facing a decrease in entrants to the STEM workforce which is not shared evenly across demographics. Specifically, women, underrepresented minorities, and people with disabilities obtain STEM degrees and enter the STEM workforce at levels significantly below their demographic representation in the U.S. The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities. This conference focuses on collective impact as a strategy to address the broadening participation challenge. Collective impact is distinguished from collaboration in that the alliances require a backbone organization to succeed. The goal of this project is to organize a conference to inform backbone organizations toward broadening participation in STEM education and the workforce.
The conference takes place at the University of California, San Diego January 20-22, 2017 and brings together Project Investigators from the Design and Development pilots, along with stakeholders in broadening participation in STEM on a local, regional, and national scale. The overarching goal of the conference is to develop the knowledge base of participants in the application of the collective impact model, and the role of backbone organizations to address specific issues and transition points of the STEM pipeline. Conference participants include K-12, community college, and university representatives; leaders in graduate education, policy makers and private sector employers. The conference includes plenary sessions, flash presentations, and interactive workgroups engaged in the development of collective impact approaches to problems in Broadening Participation in STEM. Workgroups share their insights, and audience feedback is electronically curated via Twitter and Storify. To respond in real time to participant questions or insights this conference uses the innovative platform, IdeaWave, to solicit, sort and value ideas from the attendees before, during, and after the conference. Conference results are integrated into a final report to inform the NSF INCLUDES Alliances backbone organizations. The intellectual merit of the project is that it advances knowledge about the barriers to broadening participation in STEM education and the workforce, the collective impact model, and the role of the backbone organization to guide the vision and strategy, and support the activities, evaluation, and communication of the NSF INCLUDES Alliances. The broader impact of this project is that it benefits society by informing backbone organizations, which leads to broadening participation of the STEM workforce and ultimately increases U.S. global competitiveness and national security.
DATE:
-
TEAM MEMBERS:
Kim Barrett
resourceprojectProfessional Development, Conferences, and Networks
The National Science Foundation's (NSF)Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Akron will convene a two-day conference to develop a backbone organization to support the preparation and advancement of underrepresented minorities K-12 through careers in the biosciences, a high growth area for engineering (biomechanics, biometrics and biomaterials). This conference draws on the expertise of a wide range of organizations, professional associations, K-20+, community based organizations, industry and museums. The intent is to strengthen the network among participants and leverage learning on how to engage youth in the biosciences.
The results of this first conference will be a white paper that will be disseminated to several professional societies that outlines a backbone infrastructure for addressing both short-term and longer-term aspects of an NSF INCLUDES alliance centered on bioengineering, biomechanics, biomedical engineering and biomaterials.
DATE:
-
TEAM MEMBERS:
Brian DavisCarin HelferRouzbeh Amini
resourceprojectProfessional Development, Conferences, and Networks
This project will develop, organize and host a Conference to assist in the planning of the NSF INCLUDES (Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science) Alliances and National Network. The focus of this project is the design and implementation of program evaluations necessary for the INCLUDES Alliances and National Network. The conference will be the first to emphasize the multiple scales at which evaluations occur for programs that include components based at single institutions, at interdisciplinary centers/institutes within larger institutions, at alliances/partnerships between several institutions and at entities with a national scope. As the INCLUDES Alliances and National Network will operate across multiple scales, the proposed Conference will provide guidance on the technical aspects of designing and planning multi-scale evaluations.
The target audience for the activities are those individuals involved in current INCLUDES projects, those considering collaborating in such projects and STEM educators considering inclusion of formal evaluation in their projects. The overall goals are to (i) enhance the knowledge of the participants about evaluation methods; (ii) present the experiences of individuals who have successfully developed alliances and carried out evaluation efforts for these; and (iii) provide advice regarding evaluation methods for those planning to participate in future requests for INCLUDES Alliances and/or the National Network. The methods proposed include three components: (a) an initial webinar open to the broad community of STEM educators to introduce key concepts and vocabulary concerning evaluation methods; (b) a pre-Conference Tutorial with 30 participants to provide a one-day overview of modern methods in evaluation and connect these to projects suggested by the participants; and (c) a two-day Conference with 80 participants including as speakers leading experts on program evaluation as well as leaders of programs in STEM education that have operated at multiple scales. Virtual participation will be integrated throughout the three components of the project and a formal evaluation of the project will be carried out using the Systems Evaluation Methodology that has been in use at the host NSF-sponsored Center (NIMBioS) for many years.
DATE:
-
TEAM MEMBERS:
Louis GrossSuzanne LenhartErnest BrothersPamela Bishop
This award supports a conference that will inform the design of "backbone" organizations for the NSF INCLUDES (Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science) program. NORC at the University of Chicago (an independent research institution that delivers reliable data and rigorous analyses to guide programmatic and policy decisions) and TERC (a nonprofit education research and development organization based in Cambridge, MA, dedicated to improving STEM learning for all) collaborate on Envisioning Impact, a two-part in-person and virtual event that will inform the design of INCLUDES Alliance and National Network backbone organizations.
The objectives of the conference are to: (1) facilitate a shared vision of impact for INCLUDES broadening participation projects and program; (2) stimulate discourse on key elements of a shared measurement system for continuous improvement and outcome assessment; and (3) inform decisions on the infrastructure and priority services INCLUDES backbone organizations will provide to assist grantees (and others) in assessing progress towards collective impact. The conference will bring members of three communities together: PIs and evaluators of INCLUDES Design and Development Launch Pilots; investigators and evaluators of other NSF-supported broadening participation alliances, extension projects, and other collective efforts to support inclusion and diversity in STEM; and members of prior and extant NSF-supported knowledge-networking, collaboratory, and resource network initiatives. Members of these communities will collaborate in two separate events: an in-person, 1.5 day conference, and a follow-on virtual Video Hall that will allow a larger number of participants to engage, over a one week period, in facilitated community discourse around short video narratives produced by each project.
DATE:
-
TEAM MEMBERS:
Kevin BrownSarah-Kathryn McDonaldJoni Falk
In this chapter from the book, "Fostering Active Prolonged Engagement: The Art of Creating APE Exhibits," we describe the methods and results from an array of studies designed to assess active, prolonged engagement in science museum visitors.
National Science Foundation (NSF) awarded an Informal Science Education (ISE) grant, since renamed Advancing Informal STEM Learning (AISL) to a group of institutions led by two of the University of California, Davis’s centers: the Tahoe Environmental Research Center (TERC) and the W.M. Keck Center for Active Visualization in Earth Sciences (KeckCAVES). Additional partner institutions were the ECHO Lake Aquarium and Science Center (ECHO), Lawrence Hall of Science (LHS) at the University of California, Berkeley, and Audience Viewpoints Consulting (AVC). The summative evaluation study was
Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those improvements.
DATE:
TEAM MEMBERS:
Allison TracyLinda CharmaramanIneke CederAmanda RicherWendy Surr
resourceprojectProfessional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This conference proposal represents the first phase of a larger three-phase participatory research project that will use communities of interest as a vehicle for solving problems of common concern about designing youth-based STEM programs. It will set the stage for research over the next 10-25 years about the long-term impact of a variety of youth programs on STEM learning and career aspirations. Through a virtual format, the Association of Science-Technology Centers will bring together two representatives from ten long-standing youth programs, experts in the field of out-of-school time youth programming, and researchers to collaboratively develop a program profile template for measuring the impact of youth programming. The program profile template will help identify specific characteristics that will capture the influence of youth programs on their participation in out-of-school STEM activities.
The program profile template will be the main outcome from the conference. It will serve as the foundation for designing long-term impact studies that support the needs of program staff interested in improving youth programming in informal environments. It will also allow program staff and researchers to document and share intellectual capital, compare goals and features across programs, and support network efforts among informal agencies worldwide. The program profile template will be shared online through informalscience.org, the Association of Science-Technology Centers' communities of practice networks, and through other out-of-school-time national organizations.