This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Underrepresented minorities (URMs) are less than 10% of engineering faculty, despite comprising nearly a third of the nation's population. A common explanation for their disproportionate representation, at the engineering faculty level, is related to a lack of access to effective mentorship from other faculty. This NSF INCLUDES Design and Development Launch Pilot project will expand a new mentoring and advocacy-networking paradigm to bring together two stakeholder groups: (1) underrepresented minorities (URMs) who are engineering faculty and (2) well-regarded (primarily non-URM) emeriti/retired engineering faculty. A previously-funded NSF project found that this mentor-mentee pairing was viewed favorable by both parties and beneficial, particularly by the URM engineering faculty. Because of these results, the investigators proposed to scale, test, and evaluate the approach on a broader scale by creating national infrastructural network partners to help increase capacity to serve a greater number of URM engineering faculty and to introduce tele-mentoring and training models to serve URM faculty who work in remote geographical locations with very little access to mentors.
The project will use a multi-phased phenomenological, mixed method research design to gain greater understanding of the ways in which the URM faculty and emeriti faculty experience the opportunities afforded by the project. Further, the investigators plan to collect data to examine how project participants perceive and experience conventional, direct communications (e.g., telephone calls, e-mail, and in-person meetings)through the mentoring process versus the use of Embodied Conversational Agents (ECAs), anthropomorphic interface agents that engage a user in real-time dialogue by using verbal-nonverbal channels to emulate the in-person experience. This project has the potential to broaden participation in the engineering professoriate and opens up new possibilities for supporting URM engineering faculty.
DATE:
-
TEAM MEMBERS:
Comas HaynesValerie ConleySylvia MendezKinnis GoshaRosario Gerhardt
Charles Darwin is largely unknown and poorly understood as a historical figure. Similarly, the fundamental principles of evolution are often miss-stated, misunderstood, or entirely rejected by large numbers of Americans. Simply trying to communicate more facts about Darwin, or facts supporting the principles of evolution is inadequate; neither students nor members of the public will care or retain the information. On the contrary, building facts into a one-on-one conversational narrative creates an memorable opportunity to learn. Here, we create a digital-media, self-guided question and answer
DATE:
TEAM MEMBERS:
David J. LampeBrinley KantorskiJohn Pollock
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will develop and test intergenerational science media resources for parents that are participating in adult education programs and their young children. The materials will build on the research-based and successful children's television program, Fetch with Ruff Ruffman. The target audience includes parents enrolled in adult education programs who lack a high school diploma or are in English as a Second Language classes. These resources will support parents' engagement in science activities with their children both in the adult education settings as well as at home. Adult and family educators will receive professional development resources and training to support their integration of the parent/child activities. Project partners include the National Center for Families Learning, Kentucky Educational Television, and Alabama Public Television,
The goals of the Ruff Family Science project are to: (1) investigate adult education settings that feature an intergenerational learning model, in order to learn about the unique characteristics of adults and families who are enrolled in these programs; (2) examine the institutional circumstances and educator practices that support joint parent/child engagement in science; (3) iteratively develop new prototype resources meet the priorities and needs of families and educators involved in intergenerational education settings; and (4) develop the knowledge needed to create a fuller set of materials in the future that will motivate and support diverse, low-income parents to investigate science with their children. The research strategy is comprised of three main components: Phase 1: Needs Assessment: Determine key motivations and behaviors common to adult education students who are also parents; surface obstacles and assets inherent in these parents' current practices; and examine the needs and available resources for supplementing parents' current engagement in family science learning. Phase 2: Prototype Development: Iteratively develop two prototype Activity Sets, along with related educator supports and training materials, designed to promote joint parent-child engagement with English and Spanish-speaking families around physical science concepts. Phase 3: Prototype Field Test: Test how the two refined prototype Activity Sets work in different educational settings (adult education, parent education, and parent and child together time). Explore factors that support or impede effective implementation. Sources of data for the study include observations of adult and parent education classes using an expert interview protocol, focus groups, adult and family educator interviews, and parent surveys.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
This essay seeks to explain what the “science of science communication” is by doing it. Surveying studies of cultural cognition and related dynamics, it demonstrates how the form of disciplined observation, measurement, and inference distinctive of scientific inquiry can be used to test rival hypotheses on the nature of persistent public conflict over societal risks; indeed, it argues that satisfactory insight into this phenomenon can be achieved only by these means, as opposed to the ad hoc story-telling dominant in popular and even some forms of scholarly discourse. Synthesizing the evidence
The organization and functioning of research have radically changed over the last 10 or 20 years, as a result of a determined political action. The activism of some scientists, during this period, has failed to significantly alter this trend. So far. Today, New Public Management is triumphant. It has been implemented by a category of former scientists who have become administrators, evaluators, organizers. As a result, the prime role of scientific publications is no longer to exchange scientific information but to allow a measure of scientific production, and to rank the principal
The Badges for College Credit project designs and researches: (1) a digital badge system that leads to college credit as the context for investigating how to integrate badges with learning programs; (2) how to assess learning associated with badges; and (3) how badges facilitate learning pathways and contribute to science identity formation. The project is one of the first efforts to develop a system to associate informal science learning with college credit. The project will partner with three regional informal science institutions, the Pacific Science Center, the Future of Flight, and the Seattle of Aquarium, that will facilitate activities for participants that are linked to informal science learning and earning badges. The project uses the iRemix platform, a social learning platform, as a delivery system to direct participants to materials, resources, and activities that support the learning goals of the project. Badges earned within the system can be exported to the Mozilla Open Badges platform. Participants can earn three types of badges, automatic (based on participation), community (based on contributions to building the online community), and skill (based on mastery of science and communication) badges. Using a learning ecologies framework, the project will investigate multiple influences on how and why youth participate in science learning and making decisions. Project research uses a qualitative and quantitative approach, including observations, interviews, case studies, surveys, and learning analytics data, and data analytics. Project evaluation will focus on the nature and function of the collaboration, and on the scale-up aspects of the innovation and expansion, by: (1) analyzing and documenting effective procedures,and optimal contexts for the dissemination of the model and (2) by analyzing the collaboration between informal science organizations and higher education.
DATE:
-
TEAM MEMBERS:
Carrie TzouKaren LennonAmanda GoertzGray Kochlar-Lindgren
The Science Source Pathways Project will conduct initial work designing and testing a new model for providing news on STEM related topics to the rural and Native American communities in Montana. This project will enhance understanding of how the communication of scientific research reaches and impacts underrepresented audiences. A collaborative model will be developed between the environmental journalism program at the University of Montana and various local television, radio, and online media outlets that are either operated by or reach Native Americans on reservations and throughout the state. Project deliverables include a survey and analysis of current science reporting reaching this audience; and production and testing of prototype science news stories for dissemination on various platforms (print, radio, TV, web). The development of science news pieces will be led by graduate students in the School of Journalism under the careful guidance and mentorship of experienced professors. This project will enhance the communication and amount of STEM content delivered to underserved groups, and provide diverse opportunities for them to engage in STEM related environmental issues that affect their local communities.
One challenge in scaling up effective educational programs is how to adjust implementation to local contexts. One solution that the authors Penuel, Fishman, Cheng, and Sabelli propose is “design-based implementation research,” (DBIR) in which researchers and practitioners collaboratively identify problems and strategies during implementation while learning from this process to support innovations in new contexts.