The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed
RUFF FAMILY SCIENCE is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. The project is using a research and design process to create an implementation model and prototype resources (digital media, hands-on activities, and supports for educators) to build new knowledge about the potential for digital media to inspire and support intergenerational science learning among vulnerable families.
WGBH and Education Development Center, Inc. (EDC)
DATE:
TEAM MEMBERS:
Mary HaggertyHeather LavigneJessica AndrewsAlexia RaynalMarion GoldsteinJaime Gutierrez
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with each other, and with schools. At the same time, good working practice by schools, teachers, STEM educators and institutions that involves and engages local communities was discovered, showing the diversified modes of connection which could enhance the sustainability of STEM ecosystem.
We trust that this three-year study with its associated digital maps, provides a useful resource for schools, teachers, students, parents, STEM educators and education policy makers in Hong Kong.
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with
DATE:
TEAM MEMBERS:
Siu Po LeeDavid FosterThe Croucher Foundation
Fostering greater inclusion in science creates benefits for both science and society. In this Innovations and Development project, the University of Utah will investigate how to sustain and scale the STEM Ambassador Program (STEMAP), begun in 2016 with AISL funding. STEMAP developed an innovative process to train scientists to engage members of the public, who cannot or do not gain access to science via conventional science education venues (such as museums, schools, zoos), by implementing activities in non-traditional settings. The 65 scientists trained by the initial STEMAP effort effectively engaged in over 45 settings including an affordable housing development, a youth residential treatment center, a state prison, a cooking class, a daycare facility, and several senior centers. The number of scientists applying to the program quickly exceeded STEMAP's capacity. Other institutions expressed interest in replicating the training. This project will explore strategies for scaling and sustaining public engagement training to support more scientists who can engage more people in more venues. Outcomes will serve to inform the broader implementation of STEMAP and the efforts of other public engagement programs, many of which face similar scaling and sustainability challenges.
Scaling and sustaining public engagement of science (PES) programs is a central challenge for many in the informal science learning community. This project will explore strategies to scale and sustain the STEM Ambassador Program. Research questions include: (1) How do different program formats increase or restrict program capacity and engagement outcomes? (2) What benefits accrue to scientists and their institutions by participating in public engagement in science activities that might serve as motivators to continue these activities? (3) Are funding and organizational models developed in business and other professional settings applicable to sustaining these programs? To address scalability, this project will explore the effectiveness of three dissemination formats: (1) the creation of a mentorship program for in-person trainees, (2) a train-the-trainer approach, and (3) online training with in-person mentorship. The project team will create an evaluation toolkit with participant surveys, rubrics for observers, and "on-the-spot" assessment tools developed under AISL Award 1811022 to assess the effectiveness of engagement activities delivered by trainees in each of the three formats. To address sustainability, the project team will document the values of public engagement training to both the participating scientists and their institutions via surveys and interviews. Consultants from the business sectors will create a PES Campus Council to explore possible financial, organizational, and leadership plans that will help sustain engagement efforts. Outcomes will be published in peer-reviewed journals and compiled into a dissemination framework to inform actions to scale and sustain STEMAP and other public engagement of science programs to engage more hard-to-reach audiences. Inverness Research will serve as the project's external evaluator.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project will research and develop the Circuit, a mobile phone and web-based application that will empower families and the general public to discover the broad spectrum of informal Science, Technology, Engineering and Mathematics (STEM) opportunities that exist in most communities. These informal STEM resources include science and children's museums, science and computer camps, maker spaces, afterschool programs, citizen science and much more. There is currently no "one-stop" searching for these resources. Instead, participants must conduct multiple, inefficient Internet searches to find the sought for STEM resources. The Circuit will enable users to efficiently search a rich informal STEM database, identifying resources by location, geography, age levels, science discipline, type of program and other factors. The Circuit builds on SciStarter, an existing online platform that connects thousands of prospective and active citizen scientists to citizen science projects. SciStarter has made possible the collection and organization of several thousand citizen science projects that would otherwise be scattered across the web. The Circuit will build on SciStarter's technical achievements in the citizen science sector, while systematically encompassing the offerings of established national networks. By integrating existing networks of informal STEM resources, the app will afford the public with unrivaled access to informal STEM opportunities, while collecting data that reveals patterns of engagement towards understanding factors of influence between different types of STEM experiences.
The app will provide researchers with new opportunities for researching how families and adults participate in the ecosystem of informal STEM resources in their communities. The Circuit will develop web tools to aggregate and organize digital content from trusted, currently siloed, informal STEM networks of content providers. These include science festivals, science and children's museums, the American Association for the Advancement of Science (AAAS), and Discover Magazine (3 million readers), the largest general interest science publication. Each content partner will feed the app with information directly or through their membership and encourage adoption of The Circuit within their respective communities. The project will design digital tools, including APIs (application program interfaces) to acquire and share digital content, embeddable tools to record and analyze data about movement, engagement, and persistence across domains, and social media tools and related APIs to distribute, track, and analyze content, engagement and demographics. (An API is a code that allows two software programs to communicate with each other.) The project will conduct small-scale, proof-of-conduct studies, to test the viability of the platform to support future, independent full-scale research. An analytics dashboard will be designed and tested with partners, researchers, and evaluators to ensure access to data on patterns of visits, clicks, referrals, searches, "joins," bookmarks, shares, contributions, user-locations, persistence, and more, within and across domains. Because each partner will feed their analytics into the shared dashboard, this will provide unprecedented and much-needed data to advance research in informal STEM learning. The Circuit will allow the tracking of patterns of engagement across networks and programs. Anonymized analytics of behavioral data from end users of The Circuit will support new approaches to advance evidence-based understanding of connected informal STEM learning by exhibiting engagement patterns across informal STEM domains. Through volunteer participation by the public, the Circuit will explore the geographic and demographic patterns of participants in the system, and derive important design lessons for its own and future efforts to create curated systems of connected learning across STEM education in informal settings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
A large body of research highlights the benefits of storybooks for children's learning. In the context of preschool classrooms, the use of storybooks to engage young children in STEM is a frequent topic of practitioner-oriented articles. There is also an increasing number of informal STEM education (ISE) projects exploring how to leverage storybooks to engage young children and their families in different STEM content domains. While there is universal excitement for the potential of storybooks in ISE, there is an acknowledgment of a critical need for more cross-project sharing, more research, and more efforts to synthesize and share findings. This award will catalyze new research studies and partnerships to advance efforts in ISE contexts, including the role of books in the overall learning experience or program, how books are selected or designed, and how the reading is facilitated by teachers and families. Participants will be educators and researchers working with or studying family learning for preschool-age children (three to five years) using early childhood fiction books as a tool for engaging families in STEM topics and skills.
Storybook STEM will be implemented in four phases: (1) pre-convening activities to plan, synthesize existing resources, engage a broader group of educators and researchers beyond convening attendees, and prepare convening participants to maximize the value of the in-person discussions; (2) in-person convening to catalyze cross-project discussions, outline promising practices, and identify questions and ideas for the future; (3) evaluation of the impact and value of the convening, from the perspective of participants and a project steering committee; and (4) dissemination of findings and recommendations to educators and researchers within and beyond the ISE field. Outcomes include: (1) documenting current and past work in ISE and other fields; (2) summarizing key recommendations and resources from the reading, literacy, and early childhood development fields; and (3) outlining promising directions for future work.
The findings from this project will provide a critical resource to help broadening participation efforts be more effective and inclusive for audiences across the country. Research studies motivated by the convening will address the lack of empirical work on storybooks as a tool for ISE programs and advance the ISE field's knowledge of how to integrate these books effectively. Because storybooks are a highly accessible and almost universally used family learning resource, the topic of the convening will be relevant to a wide range of audiences and will help educators broaden access to ISE for traditionally underserved and under-resourced communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Funded by the National Science Foundation (NSF), Amazon Adventure is an Innovations in Development project directed by Pacific Science Center in partnership with: SK Films; Rutgers, The State University of New Jersey; Embodied Games; and the Howard Hughes Medical Institute’s Tangled Bank Studios. The project deliverables produced during the grant period include a giant screen film, live stage presentation for use at informal science education (ISE) institutions, and educational resources.
The centerpiece of the project, the Amazon Adventure film, is a 45-minute giant screen film shown in
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins
Robots and robotics excite and challenge youths and adults. Unfortunately, the cost of purchasing robots or building useful robots is prohibitive for many low resource individuals and groups. This project will relieve this expense and provide an opportunity for resource limited individuals to experience the thrilling aspects of robotics by building a computer game that simulates robotic action. This project uses co-robotics wherein the participating player programs an avatar to assist in a symbiotic manner to achieve the goals of the game and participant. The game will provide access to the ideas and concepts such as programing, computational thinking and role assumption. The overarching goals are (1) to engage low-resource learners in STEM education through robotics in out-of-school spaces, and (2) to update the field of robotics-base STEM education to integrate the co-robotics paradigm.
This project is designed to gain knowledge on how co-robotics can be used in the informal education sector to facilitate the integration of computational science with STEM topics and to expand the educational use of co-robotics. Because the concept of co-robotics is new, a designed-based research approach will be used to build theoretical knowledge and knowledge of effective interventions for helping participants learn programing and computational thinking. Data will be collected from several sources including surveys, self-reports, in game surveys, pre and post-tests. These data collection efforts will address the following areas: Technology reliability, Resolution of cognitive tension around co-play, Accelerate discovery and initial engagement, Foster role-taking and interdependence with co-robots, Investigate social learning, and Validate measures using item response theory analysis. The DBR study questions are:
1.What design principles support the development of P3Gs that can effectively attract initial engagement in a free-choice OST space that offers large numbers of competing options? 2.What design principles support a P3G gameplay loop that enables learning of complex skills, computational thinking and co-robotics norms, and building of individual and career interest over the course of repeated engagement?
3.What design principles support P3Gs in attaining a high rate of re-engagement within low-resource OST settings? 4.What kinds of positive impact can P3Gs have on their proximal and distal environment? In addition, the project will research these questions about design: 1.What technical and game design features are needed to accommodate technological interruption? 2.What design elements or principles mitigate competition for cognitive resources between real-time play and understanding the co-robotic's behavior in relation to the code the player wrote for it? 3.What design elements are effective at getting learners in OST settings to notice and start playing the game? 4.What designs are effective at encouraging learners to engage with challenging content, particularly the transition from manual play to co-play? 5.What design elements help players develop a stake in the role the game offers? 6.What social behaviors emerge organically around a P3G prototype that is not designed to evoke specific social interactions?
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
It is estimated that there could be 40 billion earth-sized planets orbiting in the habitable zones of stars in the Milky Way. Major advances in long range telescopes have allowed astronomers to identify thousands of exoplanets in recent decades, and the discovery of new exoplanets is a now a common occurrence. Public excitement for the discoveries grown alongside these discoveries, thus opening new possibilities for inspiring a new generation of scientists and engineers that may dream of one day visiting these planets. This project investigates the use of interactive, intelligent educational technologies to generate interest in STEM by allowing learners to explore and even create their own exoplanets. Research will occur across several informal learning contexts, including summer camps, after school programs, planetarium shows, and at home. The approach is based on the idea of "What if?"questions about Earth (e.g., "What if the Moon did not exist?"), designed to trigger interest in STEM and frame exploratory and elaborative discussions around hypothetical science questions that are subsequently linked to the search for habitable exoplanets. Learners are able to interact with and explore scientifically accurate simulations of alternative versions of Earth, while making observations and posing explanations for what they see. Technology-based informal learning experiences designed to act as triggers for and sustainment of interest in STEM have the potential to plug the leaky STEM pipeline, and thus have profound implications for the future of science and technology in the United States.
The project seeks to advance the science of designing technologies for promoting interest in STEM and informal astronomy education in several ways. First, the project will develop simulations for exploratory learning about astronomy and planetary science. These simulations will present hypothetical worlds based on what-if questions and feasible models of known exoplanets, thus giving learners a chance to better understand the challenges of finding a habitable world and learning about what is needed to survive there. Second, a new PBS NOVA Lab will be developed that will focus on Exoplanet education. This web-based activity has the potential to reach millions of learners and will help them understand how planets are formed and the requirements for supporting life. Learners who use the lab will have an opportunity to invent their own exoplanets and export them for first-person exploration. Third, researchers on the project will design and implement Artificial Intelligence-based pedagogical agents to support learning and promote interest. These agents will inhabit the simulations with the learner, acting as a coach and guide, and be designed to be culturally responsive and personalized based on learner preferences. Fourth, interactive exoplanet-focused planetarium shows, that will involve live interaction with simulations, will take place at the Fiske Planetarium (Boulder, CO). Finally, the project will develop a server-based infrastructure for tracking and supporting long term development of interest in STEM. This back-end will track fine-grained behaviors, including movement, actions, and communications in the simulations. Such data will reveal patterns about how interest develops, how learners engage in free-choice learning activities, and how they interact with agents and peers in computer simulations. A design-based research methodology will be employed to assess the power of these different experiences to trigger interest and promote learning of astronomy. A range of different pathways for interest in STEM will therefore be considered and assessed. Research will measure the power of these experiences to trigger interest in STEM and promote re-engagement over time. Innovation lies in the use of engaging and intelligent technologies with thought-provoking pedagogy as a method for extended engagement of diverse young learners in STEM. Project research and educational resources will be widely disseminated to researchers, designers developers and the general public via peer-reviewed research journals, conference presentations, informal STEM education networks of science museums, children's museums, Fab Labs, and planetariums, and public media such as public television's NOVA science program website.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
H Chad LaneNeil CominsJorge Perez-GallegoDavid Condon