This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
resourceprojectProfessional Development, Conferences, and Networks
This three-year project focuses on professional research experiences for middle and high school STEM teachers through investigations of the Great American Biotic Interchange (GABI). Each year 10 teachers (in diverse fields including biology, chemistry, earth and environmental sciences, and oceanography) and three to five professional paleontologists will participate in a four-phase process of professional development, including: a (1) pre-trip orientation (May); (2) 12 days in Panama in July collecting fossils from previously reported, as well as newly discovered, sites; (3) a post-trip on-line (cyber-enabled) Community of Practice; and (4) a final wrap-up at the end of each cohort (December). In addition, some of the teachers may also elect to partner with scientists in their research laboratories, principally located in California, Florida, and New Mexico. The partners in Panama are from the Universidad Autónoma de Chiriquí (UNACHI), including faculty and students, as well as STEM teachers from schools in Panama. Teachers that participate in this RET will develop lesson plans related to fossils, paleontology, evolution, geology, past climate change, and related content aligned with current STEM standards.
The GABI, catalyzed by the formation of the Isthmus of Panama during the Neogene, had a profound effect on the evolution and geography of terrestrial organisms throughout the Americas and marine organisms globally. For example, more than 100 genera of terrestrial mammals dispersed between the Americas, and numerous marine organisms had their interoceanic distributions cut in half by the formation of the Isthmus. Rather than being considered a single event that occurred about 4 million years ago, the GABI likely represents a series of dispersals over the past 10 million years, some of which occurred before full closure of the Isthmus. New fossil discoveries in Panama resulting from the GABI RET (Research Experiences for Teachers) are thus contributing to the understanding of the complexity and timing of the GABI during the Neogene.
This award is being co-funded with the Office International and Integrative Activities.
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
A survey-based needs assessment at the University of Nebraska-Lincoln, a research- intensive land grant university, explored ways to meet the goal of increasing science, technology, engineering, and mathematics (STEM) outreach. 40% of surveyed faculty reported barriers to doing STEM outreach. Over 50% of faculty reported an inability to individually resolve barriers to STEM outreach in ways that ensure broader community engagement in their research through outreach. Using a Sociological lens, the current study examined institutional-level barriers and enablers to faculty engaging in outreach
DATE:
TEAM MEMBERS:
Kiyomi DeardsSaundra FrerichsPatricia Wonch HillJulia McQuillan
resourceresearchProfessional Development, Conferences, and Networks
We present an assessment of the Engage program, a graduate-student-created and led training program at the University of Washington. Using a pre-course/post-course study design, we examined student ability to deliver a short presentation appropriate for a public audience. Based on both self-assessments and assessments by external reviewers, we show that Engage trainees had an increase in their ability to employ effective communication techniques.
DATE:
TEAM MEMBERS:
Melissa ClarksonJuliana HoughtonWilliam ChenJessica Rodhe
resourceresearchProfessional Development, Conferences, and Networks
There is a significant under-representation of women in STEM which is damaging societal progress for democratic, utilitarian, and equity reasons. However, changing stereotypes in STEM requires a solution denied by the problem — more visible female role models. Science communicators are critical to curate the conditions to bypass this Catch 22. We propose that enhancing self-efficacy for female scientists and engineers to mentor others will generate more supportive workplaces. Similarly, enhancing self-efficacy for public engagement improves the visibility of diverse female role models for
The employment demands in STEM fields grew twice as fast as employment in non-STEM fields in the last decade, making it a matter of national importance to educate the next generation about science, engineering and the scientific process. The need to educate students about STEM is particularly pronounced in low-income, rural communities where: i) students may perceive that STEM learning has little relevance to their lives; ii) there are little, if any, STEM-related resources and infrastructure available at their schools or in their immediate areas; and iii) STEM teachers, usually one per school, often teach out of their area expertise, and lack a network from which they can learn and with which they can share experiences. Through the proposed project, middle school teachers in low-income, rural communities will partner with Dartmouth faculty and graduate students and professional science educators at the Montshire Museum of Science to develop sustainable STEM curricular units for their schools. These crosscutting units will include a series of hands-on, investigative, active learning, and standards-aligned lessons based in part on engineering design principles that may be used annually for the betterment of student learning. Once developed and tested in a classroom setting in our four pilot schools, the units will be made available to other partner schools in NH and VT and finally to any school wishing to adopt them. In addition, A STEM rural educator network, through which crosscutting units may be disseminated and teachers may share and support each other, will be created to enhance the teachers’ ability to network, seek advice, share information, etc.
This application requests support to enable a team of experienced science educators and biomedical and behavioral health network scientists to develop and implement the Worlds of Connections curriculum. Most middle school students are familiar with patient care-related health careers (e.g., nurses, dentists, surgeons), but few know about emerging careers in network science that can be leveraged to improve population health. This innovative and research-based science program is strategically designed to increase awareness of, understanding of, and interest in the important role of network science for health. This project will design learning activities that incite interest in network science applications to biomedical and public health research. The long- term goal is to enhance the diversity of the bio-behavioral and biomedical workforce by increasing interest in network science among members of underrepresented minority communities and to promote public understanding of the benefits of NIH-funded research for public health. The goal of this application is to identify and create resources that will overcome barriers to network science uptake among underserved minority middle school youth. The central hypothesis is that the technology-rich field of network science will attract segments of today’s youth who remain uninterested in conventional, bio-centric health fields. Project activities are designed to improve understanding of how informal STEM experiences with network science in health research can increase STEM identities, STEM possible selves, and STEM career aspirations among youth from groups historically underrepresented in STEM disciplines at the center of health science research (Aim 1) and create emerging media resources via augmented reality technologies to stimulate broad interest in and understanding of the role of network science in biomedical and public health research (Aim 2). A team led by University of Nebraska-Lincoln sociologists will partner with the University of Nebraska at Omaha; state museums; centers for math, science, and emerging media arts; NIH-funded network scientists; educators; community learning centers at local public schools; learning researchers; undergraduates; software professionals; artists; augmented reality professionals; storytellers; and evaluation experts to accomplish these goals and ensure out of school learning will reinforce Next Generation Science Standards. The Worlds of Connections project is expected to impact 35,250 youth and 20,570 educators in Lincoln and Omaha, Nebraska by: adding network science modules to ongoing 6th-8th-grade afterschool STEM clubs in community learning centers; adding network science for health resources to a summer graduate course on “activating youth STEM identities” for sixth to twelfth grade STEM teachers; connecting teachers with local network scientists; creating free, downloadable, high-quality emerging media arts-enhanced stories; and publishing peer-reviewed research on the potential of network science to attract youth to health careers. Coupled with the dissemination plan, the project design and activities will be replicable, allowing this project to serve as a model to guide other projects in STEM communication.
PUBLIC HEALTH RELEVANCE:
The lack of public understanding about the role of network science in the basic biological and social health sciences limits career options and support for historically underrepresented groups whose diverse viewpoints and questions will be needed to solve the next generation of health problems. The Worlds of Connections project will combine network science, social science, learning research, biology, computer science, mathematics, emerging media arts, and informal science learning expertise to build a series of monitored and evaluated dissemination experiments for middle school science education in high poverty schools. Broad dissemination of the curriculum and project impacts will employ virtual reality technologies to bring new and younger publics into health-related STEM careers.
DATE:
-
TEAM MEMBERS:
Julia McquilanGrace Stallworth
resourceprojectProfessional Development, Conferences, and Networks
This broadening participation project will focus on a regional workshop aimed at increasing Historically Black Colleges and Universities' (HBCUs) capacity to develop high quality proposals for future competitions of various programs in the Division of Research on Learning. The proposed effort will occur through three specific steps involving a: (1) pre-workshop webinar to introduce and lay the foundation for the opportunity; (2) full two-day workshop to engage participants in a rigorous grant-writing exercise; and (3) post workshop follow-up to provide ongoing support and proposal development guidance. Through a theory-driven process, the goal is to establish some degree of conformity for maximizing grant productivity around strategies and ideas shown to be effective in retaining students in the STEM pipeline.
The multi-tiered workshop will establish a launching pad for increasing attendees' capacity to build on prior knowledge and use best practices to improve future grant writing efforts. Specialized activities will help prepare HBCUs to increase their contributions to diversifying the future STEM workforce, support innovation and creativity in STEM fields, expand networking strategies, and promote opportunities to learn. Central to this capacity-building effort will be a focus on understanding the current research context and expectations for competitive participation in funding opportunities offered by NSF. This, in turn, will align with the Foundation's strategic direction for broadening participation in STEM through meaningful cutting-edge STEM education research. Resources from the workshop will be made available online to facilitate broader dissemination of information beneficial to HBCUs and other education institutions engaging in broadening participation efforts.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.
This workshop series, convened by the Kavli, Rita Allen, Packard and Moore Foundations, was intended to view the entire system of people who support scientists’ engagement and communication efforts in order to explore how this system can be most effective and sustainable. The discussions examined where this system is thriving, the limits people within the system face and what can be done to ensure their efforts are commensurate with the demand for quality communication and engagement support.
Conducted over four closely scheduled workshops in late 2017 and early 2018, the convenings brought