The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed
This report presents findings of the Latina SciGirls mixed methods study, investigating the experiences of young Latinas participating in informal STEM programs across the U.S. that utilized the SciGirls educational model (including the SciGirls Seven strategies) and augmented with materials and practices intended to better serve Hispanic girls. The project was led by Twin Cities Public Television with funding from the National Science Foundation as an AISL Innovations in Development project. The STEM-related identity framework and research model used to guide this investigation is presented
Knight Williams, Inc. completed a summative evaluation report that addresses: (i) the reach and breadth of the Latina SciGirls broadcast program and online components compared to project expectations; (ii) the impact of the Family Fiesta events that incorporated use of SciGirls videos, in-person role models, and hands-on activities as experienced by the girls, family members, and role models that participated in the events; and (iii) the partners’ Latina SciGirls programs and how they used and reflected on the value of the SciGirls resources.
How can creators of STEM learning media reach underserved parents and children, and support the kinds of playful STEM interactions that are foundational for future STEM learning?
This research report summarizes findings from a pilot study of Cyberchase: Mobile Adventures in STEM, a program that uses mobile text messaging and short videos to encourage hands-on family learning among low-income Latino families.
In the study, 95 mostly Latino families received weekly text messages with video clips from the popular children's series Cyberchase, and fun activities to do with their
RUFF FAMILY SCIENCE is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. The project is using a research and design process to create an implementation model and prototype resources (digital media, hands-on activities, and supports for educators) to build new knowledge about the potential for digital media to inspire and support intergenerational science learning among vulnerable families.
WGBH and Education Development Center, Inc. (EDC)
DATE:
TEAM MEMBERS:
Mary HaggertyHeather LavigneJessica AndrewsAlexia RaynalMarion GoldsteinJaime Gutierrez
This project will produce a four-part mini-series on African American Language (AAL) designed for television broadcast as well as for formal and informal public educational distribution. This mini-series addresses the social, cultural, and educational issues related to the most prominent, the most controversial, and the most misunderstood dialect in the history of American English--African American Language. Dialect prejudice, linguistic profiling, and language-based discrimination continue to be "so commonly accepted, so widely perceived as appropriate, that it must be seen as the last back door to discrimination. And the door is still wide open" (Lippi-Green 2012:73). By presenting the history, development, diversity, and symbolic role of language in the lives of African Americans, this documentary series helps to counteract the persistent misinformation and misinterpretation circulated about the language of African Americans. The series builds on the popular public reception to the one-hour documentary, Talking Black in America: The Story of African American Language, and includes the following episodes: 1) the historical and contemporary development of African American Language; 2) the diversity of language use among African Americans based on region, age, status, education, and style; 3) the use of language in expressive performance, including preaching, comedy, music, hip hop, spoken word, and other expressive genres; and 4) the role of language differences in educational achievement. A website accompanying the series will include a variety of educational resources, including streaming, discursive chapters with integrated vignettes from the episodes, additional commentary and background, activities, and discussion questions for each episode, with further online materials for education. The documentary and accompanying activities constitute an important milestone in the effort to educate the public about language diversity in American society.
No dialect in the history of American English has been more prominent, more controversial, and more misunderstood than African American Language, and dialect prejudice, linguistic profiling, and language discrimination still intensely affect speakers of this variety. By presenting the history, development, diversity, and symbolic role of language in the lives of African Americans, this documentary series will help to counteract the persistent misinformation circulated about African American Language. This series and the accompanying online materials offer an important milestone in the effort to educate the public about language diversity that can help to reduce linguistic discrimination in American society.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Familiarity with statistical and data literacy is important in many areas of modern life, but there is little research on how adults continue to build mathematical literacy beyond formal schooling. Mass media science news stories contain much data, assuming that adults will understand the content.This 4-year project will first map the landscape of adult statistical literacy in the US, particularly as it relates to news consumption. The second phase will build on results from the first phase through a longitudinal study. In the third phase, the project will develop a range of experiments to manipulate mathematical explainers embedded in STEM news stories and test techniques with adult audiences, with the goal of identifying the attributes and affordances that best improve confidence and competence in the underlying math principles and their meaning to news stories. in addition to the research, project components include 12 broadcast video and social media pieces each year that will form the basis for testing with audiences, a one-day symposium for professional science journalists, and a written best practice guide that summarizes key findings and implications for practitioners.
Critical research questions are: How do mathematical competence and confidence differ among different segments of the adult population? How can STEM journalists improve adult mathematical competence and confidence through their reporting techniques? Phase 1 of the research will be a landscape review of mathematical content in the news including a baseline study of adult statistical literacy. Phase 2 will be a longitudinal study with news audiences recruited to participate in a panel study. Phase 3 will be iterative testing of the digital content based on the findings from Phases 1 and 2 and will use both focus groups and online testing. External evaluation will be conducted by TERC including an evaluation of the symposium for professional journalists.
The broader impacts of this project are twofold: the science videos created will be broadcast and made available free to a national audience including those in rural areas; and the training of science journalists has the potential for multiple, long term impact by increasing their ability to communicate statistics meaningfully to their readers/viewers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Despite the ubiquity of Artificial Intelligence (AI), public understanding of how it works and is used is limited This project will research, design, and develop innovative approaches focusing on Artificial Intelligence (AI) for under-represented youth ages 14-24. Program components include live social media chats with AI leaders, app development, journalistic investigations of ethical issues in machine learning, and review of AI-based consumer products. Youth Radio is a non-profit media and tech organizations that provides youth with skills in STEM, journalism, arts, and communications. They engage 250 youth annually through free after-school classes and work shifts. Participants are 90% youth of color and 80% low income. Project partners include the MIT Media Lab which developed App Inventor which allows novice users to build fully functional apps. Staff from Google will serve as a project advisor on the curriculum. The project has exceptional national reach through the dissemination of its media and apps through national outlets such as NPR and Teen Vogue as well as various platforms including online, on-air, as well as presentations, publications, and training tools. The project broadens participation by engaging these low income youth of color in developing skills critical to the workforce of the future. It will help prepare an upcoming generation of Artificial Intelligence creators, users, and consumers who understand the technology and embrace and encourage its potential.It will give them the necessary knowledge and opportunities for careers in an AI-driven future.
This project is grounded in sociocultural learning theory and practice and is interdisciplinary by design. The theoretical framework holds that Computational Thinking plus Critical Pedagogy leads to Critical Computational Literacy. Also, Digital Age Civics plus Participatory Culture leads to Civic Imagination helping youth build a better world through technology. The driving research questions include: What do underrepresented youth understand about AI and its role in society? What are the ethical dilemmas posed by AI from their vantage point? What are the features of an engaging ethics-centered pedagogy with AI? What impact do the AI products developed by the youth have on the target audience? The research design will use ethnographic techniques and design research to study and analyze youth learning. Data sources will include baseline surveys, audio recordings and transcriptions from learning sessions with the participants, research analytic memos, focus group interviews, student-generating artifacts of learning and finished products, etc. The design-based approach will enable systematic, evidence-based iteration on the initiative's activities, pedagogical approach and products. An independent summative evaluation will provide complementary data and perspective to triangulate with the research findings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Elisabeth SoepEllin O'LearyHarold Abelson
This conference grant will support professional development at Jackson WILD. Jackson WILD (formerly the Jackson Hole Wildlife Film Festival) is the premier industry conference for science and natural history documentary filmmakers and distributors, bringing the world's top factual storytellers together with inspiring STEM (Science, Technology, Engineering, Mathematics) professionals at a biennial industry conference and juried film festival. This project supports a robust thematic strand of professional development within the conference focused on strategies for making the science of science communication more accessible to an industry that has significant influence over the accuracy, quality and quantity of STEM stories reaching mainstream audiences through popular media.
The conference grant strategies are scaffolded upon the results of Jackson WILD's previous two conference awards which have employed multiple interventions aimed at 1) understanding how science communication expertise is perceived and gained by media content creators, 2) identifying the demographics and professional development needs of both emerging and seasoned STEM storytellers, and 3) finding pathways to enhance science communication expertise for STEM professionals seeing to increase their reach to public audiences. The current conference grant will build upon lessons learned and offer thematic professional development programming advancing science communication literacy and best practices among media professionals and STEM communicators. The 2019 Jackson WILD industry conference will also further expand the cross-industry STEM media fellows program, which offers professional development and cohort-building opportunities to emerging professionals in both STEM and media fields. The driving theory of change is that access to research-informed professional development and increased science communication fluency among content creators and STEM communicators results in products (i.e. documentary programs, podcasts, social media content, etc.) that are in better alignment with evidence-based best practices for communicating STEM topics to lay audiences. Therefore, the resulting media products will be more effective in engaging and educating those audiences, resulting in increased STEM literacy and informal STEM learning. To extend the reach and impact of the conference, the program content will be available on line via streaming videos and podcasts on various channels. Investing in professional development for science media professionals will strength the ecosystem of quality STEM media and help support public engagement in STEM more broadly. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins