This is the third of three guides for media practitioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on steps for conducting media research and research protocals.
This is the second of three guides for media practitioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on ways to identify your missing audience.
This is the first of three guides for media practioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on possible practices for creating an audience research collaboration for media professionals, evaluators and communication researchers.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
This Pilot and Feasibility study will build foundational knowledge about basic aspects of STEM webcams in the United States (US) from the perspectives of both practitioners and viewers. Thousands of webcams available to the public are operated by STEM organizations, such as zoos, museums, and government agencies. Learning theory suggests that STEM webcams, especially those with accompanying interpretive tools, have the potential to offer rich informal learning opportunities. However, yet no research has quantified any aspect (cognitive, behavioral, or emotional) of viewer outcomes. This study will be the first to develop baseline data regarding cognitive, behavioral, and emotional aspects of perceived viewer experience. Project activities include:
An inventory of STEM webcams that exist in the US, the STEM disciplines they represent, learning and engagement tools they employ, the number of viewers they reach, and the resources required for their operation
A survey of webcam operators, their STEM education goals, implementation strategies, and evaluation results; and
Surveys and interviews gathering data on viewers demographics and potential increase in curiosity, interest, knowledge, and behavior toward the STEM subject. This research will provide foundational knowledge for the STEM-education and research community that quantifies and describes many facets of the population of STEM webcams in the inventory.
Research activities will take place in three distinct phases, with Phase 1 laying the groundwork for Phases 2 and 3. Phase 1: The project team will conduct a systematic internet search for all identifiable STEM related webcams. Phase 2 (operator-focused): An online survey of practitioners of webcams operated by US-based STEM organizations will be conducted using Qualtrics software. Likert scales will be used. Various hypotheses will be tested regarding webcam program objectives, operations, and evaluations from the perspective of program operators or practitioners. Phase 3 (viewer-focused): Surveys and interviews with likely viewers of STEM webcams. Using the webcam inventory built in Phase 1, the team will collaborate with 20 informal STEM institutions that agree to survey their constituents to test hypotheses regarding webcam viewing practices, such as why and how viewers watch, and perceived outcomes of viewing, such as perceived influence on their interest, attitudes, knowledge, or behavior. The findings from this study will be widely shared with informal STEM institutions and webcam operators. It will provide foundational data for future experimental studies.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this pilot and feasibility study is to increase participation in informal STEM learning in rural Idaho through Stories of Fire, a program based on personal narratives of wildland fire. Idaho is a rural state, with an average population of just 19 people per square mile, the fourth lowest population density in the United States. The state is experiencing increasingly severe wildfire, and effective responses to such environmental change require a better understanding of the underlying science. Contextualizing science learning, making connections between everyday lives and a sense of place can engage learners and bring about a better understanding of wildfire. This project will bring together a science communicator, a narratologist, a fire ecologist, and a specialist on emotions and public lands. They will work collaboratively with informal educators based in rural areas of Idaho underrepresented in STEM fields. Rural areas are rich in knowledge based on years of cumulative observations, cultural beliefs, and practices shared through community networks. This project builds on these rural assets while addressing the challenges rural populations face. The project addresses broadening participation in STEM through narrative practices that encourage more diverse ways of knowing, being, and representing science.
This research study will explore: 1) what mechanisms of narrative (storytelling) most effectively integrate individuals? personal experiences and accurate STEM content in fire science communication, and 2) what audience-centered approaches best facilitate narrative approaches to informal STEM learning. This project engages four levels of participants over four phases of research and programming: 1) The research team will interview and analyze the narratives of 40 Frontliners (e.g., wildland firefighters and evacuees) from the inland Northwest region with first-hand experience with wildfire. 2) They will conduct a narrative workshop to train 20 informal STEM Educators from across the state on audience-centered approaches that facilitate participant storytelling about fire. 3) Educators will pilot their own narrative-based informal science learning programs with program participants in their rural home communities across the state, 4) A professional podcaster will create two podcasts modeled on our research findings for public audiences reached through media.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teresa CohnLeda KobziarJennifer LadinoErin James
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.