Amid calls from scientific leaders for their colleagues to become more effective public communicators, this study examines the objectives that scientists’ report drive their public engagement behaviors. We explore how scientists evaluate five specific communication objectives, which include informing the public about science, exciting the public about science, strengthening the public’s trust in science, tailoring messages about science, and defending science from misinformation. We use insights from extant research, the theory of planned behavior, and procedural justice theory to identify
In its program, “Maximizing Lifelong Learning Opportunities: Innovative Strategies for Science Museums,” the American Museum of Natural History sought to develop, implement and assess a series of online and face-to-face adult learning courses, that shared the name “Our Earth’s Future” and focused on the topic of climate change. An external evaluation of this effort was conducted by Rockman et al, an independent evaluation firm that specializes in the evaluation of informal science learning programs. This research effort builds on prior knowledge gained from studies of adult learning programs
DATE:
TEAM MEMBERS:
Jennifer BorlandRuth CohenDebra TillingerMaria Janelli
As part of the National Science Foundation (NSF) funding for the In Defense of Food project directed by Kikim Media, the independent evaluation firm Knight Williams Inc.1 conducted a summative evaluation of the project’s key deliverables, which included: a PBS television broadcast program, an outreach effort, and an educational curriculum. This report (Study 2 of 3) focuses on the outreach effort.
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at the University of Colorado. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at DePaul University. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Eric HamiltonKatherine McMillanPriya Mohabir
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.
This summative report evaluates the accessibility and efficacy of a project website as a tool for teaching ecosystem science. Edu ran a qualitative study with twelve participants in order to determine the overall usability and learnability of IntotheRift.org – an online textbook offering a virtual field trip to Lake Tanganyika in East Africa. The goal of the study – identify usability issues and also what currently works well. A learnability study focused on learners’ increase in awareness of ecosystem concepts and research scientists working in Lake Tanganyika. An efficacy study evaluated
DATE:
TEAM MEMBERS:
Douglas SpencerSasha MinskyJediah Graham
resourceprojectWebsites, Mobile Apps, and Online Media
The Baltimore Symphony Orchestra (BSO), in collaboration with the Psychology Department of the University of Maryland Baltimore County (UMBC) and Octava (a technology company), are conducting a pilot exploratory research project to assess the effectiveness of delivering informal science learning (ISL) to adult audiences through live music in a concert hall environment. The first half of the study is being timed to coincide with the 2016 annual meeting in Baltimore of the League of American Orchestras. Audiences will be introduced to the core idea that symmetry is a central concept both in science and in music, and they will experience these ideas via the orchestral music of pieces such as Aaron Copland's Appalachian Spring and Beethoven's Symphony. No. 5. The project goals are: to test whether and the extent to which informal STEM learning can occur among adults (ages 18+) during live orchestral performances and how the science content may enhance the audience experience; and to develop assessment tools for measuring audience learning and retention of scientific concepts delivered in connection with live musical performances both through interactive technology and through traditional program notes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The pilot study will investigate the interaction of key variables related to the audience composition, the learning formats (use of app technology, program notes, or not), and the science concepts. The tablet application technology, under continued development by Octava, presents unobtrusive program notes that act as a concert companion in real time as a concert proceeds. The mixed methods research methodology will produce quantitative and qualitative data using pre- and post-test instruments and focus group interviews. A follow-up questionnaire will be sent to participants six weeks after the performances to ascertain whether what was learned was retained over a period of time. Dissemination of project findings will be to professionals in science, science education and music fields.
DATE:
-
TEAM MEMBERS:
Jessica AbelLinda BakerTonya RoblesCarol Bogash
The National Association of Hispanic Nurses (NAHN), in association with the Hispanic Communications Network (HCN), proposes to address the shortage of bilingual professionals in all health fields by recruiting and interviewing bilingual role models and arranging to broadcast those interviews nationwide. Leveraging HCN’s nationally broadcast health education radio shows, whose cumulative audiences are larger than
NPR’s “All Things Considered,” this project has the potential to reach one out of every three US Hispanics during its first five years. This media campaign is intended to inspire Hispanic parents to encourage their children to study science and aspire to careers in the biomedical professions. It is also intended to inspire and empower Spanish-speaking adults from all walks of life to consider careers in the health professions. All broadcasts will tie to NAHN’s interactive website so that students and adults interested in changing careers can find mentors and educational resources. NAHN will also use Youtube, Facebook, mobile phone applications, and other new and popular social media technologies to reach a broad cross-section of English speaking youth and young adults. In addition to the national media outputs, attendees at NAHN’s annual conferences will have the opportunity to receive training in public speaking and media relations so they can more effectively use local media in their own communities to address health disparities and promote careers in the biomedical and health professions. NAHN will develop a standardized, bilingual Toolkit for public presentations. The Toolkit will include a PowerPoint presentation embedded with video containing gender and other- stereotype-busting role model interviews with Hispanic nurses; links to an online database of volunteer mentors; and a bilingual terminology packet that will aid nurses in creating linguistic and cognitive bridges between audience and professional knowledge bases. We expect that the refined Toolkit will empower nurses and other health professionals to become more effective public health educators and career role models during their presentations at community health events, career fairs, achievement clubs, and school assemblies. An Advisory Committee of other health organizations, professionals, and advocates will recommend Role Models and provide periodic feedback. Bilingual independent evaluators associated with the UC Berkeley School of Public Health will conduct qualitative and quantitative formative, iterative, and summative evaluations throughout the project. Their recommendations and findings will be incorporated into the project design and deliverables and shared with relevant fields.
Previous studies on public engagement with science have identified various difficulties in the encounters between experts and lay people. However, there is a scarcity of research investigating expert-youth interaction. In this paper we focus on the interactive framings of an informal PES event. Based on a case study involving a climate change panel discussion and a simultaneous online chat, both aimed at young people, we discuss the multiplicity of framing. Further, we look for “misbehaviours” which challenge the rationality and norms of the event. Our findings indicate that the frame of
Public opinions toward emergent technologies may be highly dependent on the manner in which people are introduced to these technologies for the very first time. In this light, understanding how such first introductions are related to adolescents’ information seeking behaviors and their developing opinions may be particularly interesting because this target public can be considered to be not only future users of the technology but also future decision makers of its development. The present paper presents a case study of the introduction of ecogenomics among 246 adolescents who were asked to
DATE:
TEAM MEMBERS:
Mark BosRoy KloetCees KoolstraJaap Willems