This project supports the Broader Impacts and Outreach Network for Institutional Collaboration (BIONIC), a national Research Coordination Network of Broader Impacts to support professionals who assist researchers to design, implement, and evaluate the Broader Impacts activities for NSF proposals and awards. All NSF proposals are evaluated not only on the Intellectual Merit of the proposed research, but also on the Broader Impacts of the proposed work, such as societal relevance, educational outreach, and community engagement. Many institutions have begun employing Broader Impacts support professionals, but in most cases, these individuals have not worked as a group to identify and share best practices. As a consequence, there has been much duplication of effort. Through coordination, BIONIC is expected to improve efficiency, reduce redundancy, and have significant impact in several areas: 1) Researchers will benefit from an increased understanding of the Broader Impacts merit review criterion and increased access to collaborators who can help them design, implement, and evaluate their Broader Impacts activities; 2) Institutions and research centers will increase their capacity to support Broader Impacts via mentoring for Broader Impacts professionals and consulting on how to build Broader Impacts support infrastructure, with attention to inclusion of non-research-intensive universities, Historically Black Colleges and Universities, and Hispanic- and Minority-Serving Institutions that may not have the resources to support an institutional Broader Impacts office; and 3) NSF, itself, will benefit from a systematic and consistent approach to Broader Impacts that will lead to better fulfillment of the Broader Impacts criterion by researchers, better evaluation of Broader Impacts activities by reviewers and program officers, and a system for evaluating the effectiveness of Broader Impacts activities in the aggregate, as mandated by Congress and the National Science Board. Through its many planned activities, BIONIC will ultimately help advance the societal aims that the Broader Impacts merit review criterion was meant to achieve.
The main goals of the project will be accomplished through the four specific objectives: 1) Identify and curate promising models, practices, and evaluation methods for the Broader Impacts community; 2) Expand engagement in, and support the development of, high-quality Broader Impacts activities by educating current and future faculty and researchers on effective practices; 3) Develop the human resources necessary for sustained growth and increased diversity of the Broader Impacts community; and 4) Promote cross-institutional collaboration and dissemination for Broader Impacts programs, practices, models, materials, and resources. BIONIC will facilitate collaborative Broader Impacts work across institutions, help leverage previously developed resources, support professional development, and train new colleagues to enter into the Broader Impacts field. This project will improve the quality and sustainability of Broader Impacts investments, as researchers continue to create unique and effective activities that are curated and broadly disseminated. BIONIC will create a network designed to assist NSF-funded researchers at their institutions in achieving the goals of the Broader Impacts Review Criterion. In so doing, BIONIC will promote Broader Impacts activities locally, nationally, and internationally and help to advance the Broader Impacts field.
This award is co-funded by the Divisions of Molecular and Cellular Biosciences and Emerging Frontiers in the Directorate for Biological Sciences and by the Division of Chemistry in the Directorate for Mathematics and Physical Sciences.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by developing a suite of digital tools designed to support positive messaging around skill-based education and careers and to improve mentors' communication with middle school-aged youth mentees. Maintaining U.S. economic advantage requires attracting talent to high-growth, high-demand skill-based, STEM-related careers that are traditionally attained through Career and Technical Education (CTE). Replacing old negative perceptions with new, more accurate messages about CTE and then reaching youth with these messages before high school is essential. Career-focused mentoring is a vehicle for delivering these messages and supporting youth exploration of CTE as a possible path for their own lives. Investigators will explore the hypothesis that through strong connections between those best positioned to articulate industry needs (mentors) and those most receptive to filling that need (mentees), this project will improve youth awareness and interest in CTE and the rewarding careers that are available to them. Research and development activities will be carried out collaboratively in informal learning environments in Boston and New York City that serve middle school-aged youth from underrepresented communities, through career-focused mentoring programs. The project team, led by media producers of the WGBH Education Foundation, includes market researchers and communications strategists at Global Strategy Group, learning scientists at Education Development Center, and mentorship program partners at SkillsUSA, Learning for Life's Middle School Explorer Clubs, and Boy Scouts of America's Scoutreach. If promising, the career-focused mentoring programs of SkillsUSA, Learning for Life, and Boy Scouts of America will incorporate the messaging roadmap and digital tools to support their mentoring curricula, which impact greater than one million youth in each year.
In the first phase of research, investigators will study perceptions of STEM-focused CTE from a nationwide sample of 800 middle school-aged youth and 30 mentors from skill-based STEM industries. In the second phase, investigators will work with six program leaders and 30 mentors from SkillsUSA, Explorer Clubs, Scoutreach, and other mentoring programs to document the needs of mentors for support as they enter into the mentoring process. The third phase will engage mentorship program leaders and 36 mentors in the iterative development of a suite of digital tools that would support positive messaging around skill-based education and careers and that would improve mentors' communication with youth mentees. In addition, a pre-post mentorship program pilot study will explore the promise of the digital tools for effectively supporting mentor-mentee communications that improve youth awareness and interest in STEM-focused CTE and skill-based, STEM-related careers. Thirty six mentors and 288 of their youth mentees will participate in the pilot study. Data sources for research include interviews and surveys of program leaders, mentors, and mentees, as well as tracking mentor activity within the online digital tool environment. This research would advance knowledge of how mentors influence disadvantaged youth perceptions of and interest in CTE and skill-based, STEM career pathways, in which there is currently little evidence as to how mentor preparation shapes ability to positively impact youth outcomes. Major outcomes will include a) deeper understandings of youth and mentor perceptions of CTE and mentors' needs for supporting their work with mentees, b) a messaging roadmap and digital tools that prepare mentors for their work with middle school youth, and c) empirical findings regarding the potential of the digital tools for effectively supporting mentor-mentee communications that improve youth's awareness and interest in CTE and skill-based, STEM-related careers. Outcomes will be shared widely to research, education, and industry communities, locally and nationally, through social media, partner networks, conference presentations, and research publications. An advisory board will provide independent review on the project activities.
The historical under-representation of diverse youth in environmental science education is inextricably connected to access and identity-related issues. Many diverse youth with limited previous experience to the outdoors as a source for learning and/or leisure may consider environmental science as ‘unthinkable’. This is an ethnographic study of 16 diverse high school youths’ participation, none of who initially fashioned themselves as ‘outdoorsy’ or ‘animal people’, in a four-week summer enrichment program focused on herpetology (study of reptiles and amphibians). To function as ‘good’
A focus group study was conducted with purposefully sampled student participants solving an engineering design challenge during a one-week engineering summer camp held at a research-intensive university in the southeast. The goal of the study was to further understand the student experience and ascertain the perceived value of an informal learning environment for students engaged in an engineering design challenge. Emergent themes are provided to illustrate the primary challenges related to the engineering design challenge and the aspects of the engineering summer camp that were beneficial to
DATE:
TEAM MEMBERS:
Cameron DensonMatthew LammiTracy Foote WhiteLaura Bottomley
This paper examines STEM-based informal learning environments for underrepresented students and reports on the aspects of these programs that are beneficial to students. This qualitative study provides a nuanced look into informal learning environments and determines what is unique about these experiences and makes them beneficial for students. We provide results of a qualitative research study conducted with the Mathematics, Engineering, Science Achievement (MESA) program, an informal learning environment that has proven to be effective in recruiting, retaining and encouraging
DATE:
TEAM MEMBERS:
Cameron DensonChandra Austin StallworthChristine HaileyDaniel Householder
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceevaluationMuseum and Science Center Programs
The 5-year longitudinal study on Iridescent's Family Science Learning model was conducted with 2,173 participants from 9 schools and museum sites in Los Angeles and New York City. Participants were underserved elementary school students and their parents. Families met once a week for 5 weeks in a row. Five families (~20 participants) came for all 5 years.
Each program implementation was coordinated by Iridescent team members. The goal of this study was to:
* To identify scalable methods of engaging underserved audiences in STEM.
* To identify sustainable methods of supporting long-term
A PowerPoint slide presentation given by John Kania, Global Managing Director from FSG on collective impact at the June 3, 2015 National Science Foundation INCLUDES Achieving Scale for Inclusion in STEM Director's Workshop.
DATE:
TEAM MEMBERS:
John Kania
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
The National Center for Science and Civic Engagement (NCSCE) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of its SENCER-ISE project partnerships. SENCER-ISE is an initiative that brings partners from higher education (HE) together with partners from informal science education (ISE) to create projects that engage audiences in science using the lens of civic engagement. SENCER funded 10 partnerships over three years—six through the National Science Foundation (DRL #1001795) and four through the Noyce Foundation. Previously, RK&A conducted a formative
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly