This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Design Squad Maker project, a collaboration of WGBH Public Television (WGBH) and the New York Hall of Science (NySci), will research and develop engineering design projects that provide evidence for how to integrate informal learning spaces with digital public media assets. The project will be designed to provide accessible, motivating pathways for children aged 8-11 in pursuing and completing ambitious, fully realized engineering design projects. The project will build on WGBH's existing Design Squad model for using media to engage kids in informal engineering activities and NySCI's expertise in facilitating children's unique design processes in museum settings. By developing and studying new strategies for supporting children's use of the design process, Design Squad Maker will address critical issues in engineering education and informal learning that remain relatively unexplored. Project research will contribute to the emerging literature on "connected learning" by building new knowledge about how children's design activities can be sustained and supported over time and across multiple contexts, such as science museums and homes. Drawing on existing research in the learning sciences and engineering education, the project seeks to advance knowledge about the role of museums, maker spaces, and digital technology in sustaining children's learning in engineering. The project will use a design-based research approach, a research and development process whereby educational designers collaborate with learning scientists. Museum practitioners will collaborate with research staff and media developers to design, test, and improve digital resources, facilitation strategies, and parent engagement strategies to support children through an entire design process. The research and development process will result in digital resources and approaches in a flexible toolkit, which will be used when assessing the project's scale-up potential at 10 museum/maker spaces. The project will conduct a summative evaluation, assessing the project's intended impacts with children, parents, and staff at museums/maker spaces across the country. The toolkit will be nationally disseminated through national partners that include the Association of Science-Technology Centers, Maker Education, the National Association for Family, School, and Community Engagement, and engineering education organizations. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop a collaborative program to connect and prepare researchers from divergent disciplines to communicate science to publics of all ages in three distinct informal environments: pop-ups at community events, experiential learning with problem solving events for youth, and presentations at a science museum. It will study the effects of this program on the identity and motivations of STEM researchers and evaluate the short and medium-term outcomes for public audiences. Project partners include, The STEAM Factory, OHI/O Informal Learning in Tech Program, and the Center of Science and Industry (COSI) all located in Columbus, Ohio.
The primary goals of this project are as follows. 1) Develop a collaborative program that connects and prepares researchers from divergent disciplines to creatively and effectively communicate science to people of all ages. 2) Evaluate the short and medium-term learning outcomes across different informal learning settings. 3) Study the effect of this collaborative program on the motivations and identify of the researchers. The specific research question is: In what ways do researchers motivations and identities further develop because of these collaborative experiences with divergent perspectives? A mixed method approach will be used. Data will be collected and analyzed from 3 cohorts of researchers who implement programs in different informal learning settings. A series of pre- and post interviews with scientists will be designed to answer the research question above. Interviews will be grounded in self-determination theory. Later reflective surveys will serve as triangulation for the data.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sathya GopalakrishnanJustin MeyerRachel KajfezArnab Nandi
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This Research in Service to Practice project will study how visual immersion and interactivity in augmented reality (AR) affects visitors' engagement and understanding of science. The research involves creating different versions of an AR exhibit to communicate paleontology research from the La Brea Tar Pits to the general public. Different versions of the exhibit will be compared to learn how design choices for immersion and interactivity impact visitors' engagement and understanding of science. The result of this study should be a model to follow for similar public exhibits, as well as design principles that generalize to AR experiences for a broader range of informal learning environments. This project will also demonstrate and report on specific AR mechanisms that help visitors understand the scientific process and increase knowledge about paleontology research.
The study includes a user-centered design and evaluation process with both formative and comparative studies. This project investigates two high-level design factors for mobile AR: visual immersion and interactivity. These impact the learning experience and the development so extensively that multiple versions are seldom compared. These factors also have unique considerations for informal settings, such as how to balance immersion against situational awareness (e.g., 3D viewers reduce field of view). One goal of this project is to systematically compare qualitatively different AR designs that convey equivalent science content and study these tradeoffs empirically. The second goal is to leverage these findings to publicly release an AR experience that promotes engagement, increases understanding of science, and reduces scientific misconceptions. This research will also contribute to understanding usability and logistical issues for different AR designs for public, outdoor, informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Emily LindseyBenjamin NyeGale SinatraWilliam Swartout
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Research in Service to Practice project examines how informal place-based collaborative learning can support local communities' planning processes related to current environmental changes. As a part of this study workshops will be conducted in 8 communities that have a range of planning mandates based on recent extreme environmental changes such as drought/wildfires, flooding, invasive species, or loss of native wildlife. Place-based adaptation workshops will be designed to be locally relevant and empower people to learn and act on their newly acquired understandings. Local community collective actions may include a range of decisions (e.g., infrastructure changes such as building defenses against sea level rise in coastal communities or improving the quality of roads to withstand higher temperatures.) Collective action may also lead to community wide behavioral changes such as individuals using less water or farmers planting different crops. The study will focus on the efficacy of the methods used in 8 workshops in communities throughout the country. Research objectives include: 1) identifying experts' belief about the most critical components of successful workshops; 2) Understanding of prior workshop outcomes and 3) test hypothesized effective practices and understand how learning takes place and collective action does or does not take place. The project addresses key AISL solicitation priorities including strategic impact on the field of informal STEM learning, advancing collaboration, and building professional capacity. It engages both public and professional audiences as described in the solicitation. Public audiences include stakeholders in each of the 8 communities such as community environmental groups, NGOs, businesses, landowners, and local government planners. Professional audiences include the workshop scientists and facilitators who will be trained in the experimental workshop approach. The project builds upon and expands the existing AISL portfolio of science communication projects such as science cafes, science festivals, science media, and library based projects. This is a collaborative project of EcoAdapt and Virginia Tech with participants from the National Parks Conservation Association, the Desert Research Institute, and the Wildlife Conservation Society and others. The research will progress through two phases. Phase 1 is designed to identify consensus-based effective practices for promoting learning and action in adaptation workshops. It includes a Delphi study to synthesize beliefs about effective practices held by experienced workshop facilitators across the United States. Phase 2 includes iterative design and research of eight adaptation workshops in various communities with a range of planning mandates and recent extreme weather experience. By iteratively revising the workshop design, the study will elucidate how different workshop components influence participant learning, individual behavioral intentions, and subsequent efforts toward collective action. The overall research design will examine the relationships of pedagogical and collaborative techniques to learner outcomes and collective action. Many of these lessons are likely relevant to other collaborative informal science learning contexts. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project will research the educational impact of social robots in informal learning environments, with applications to how social robots can improve participation and engagement of middle-school girls in out-of-school computer science programs in under-resourced rural and urban areas. The use of robots to improve STEM outcomes has focused on having learners program robots as tools to accomplish tasks (e.g., play soccer). An alternate approach views robots as social actors that can respond intelligently to users. By designing a programmable robot with social characteristics, the project aims to create a culturally-responsive curriculum for Latina, African American, and Native American girls who have been excluded by approaches that separate technical skill and social interaction. The knowledge produced by this project related to the use and benefits of social programmable robots has the potential to impact the many after-school and weekend programs that attempt to engage learners in STEM ideas using programmable robot curricula.
The project robot, named Cozmo, will be programmed using a visual programming language and will convey emotion with facial expressions, sounds, and movements. Middle school girls will engage in programming activities, collaborative reflection, and interact with college women mentors trained to facilitate the course. The project will investigate whether the socially expressive Cozmo improves computer science outcomes such as attitudes, self-efficacy, and knowledge among the middle school female participants differently than the non-social version. The project will also investigate whether adding rapport-building dialogue to Cozmo enhances these outcomes (e.g., when a learner succeeds in getting Cozmo to move, Cozmo can celebrate, saying "I can move! You're amazing!"). These questions will be examined research conducted with participants in multi-session after-school courses facilitated by Girl Scout troops in Arizona. The project will disseminate project research and resources widely by sharing research findings in educational and learning science journals; creating a website with open source code for programming social robots; and making project curriculum and related guidelines available to Girl Scouts and other educational programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. In this Innovations and Development project, Child Trends, in collaboration with Ivanhoe Broadcast News, will expand the reach of the Child Trends News Service, and rigorously evaluate its impact on viewers. The News Service aims to build the public's knowledge of, and appreciation for, social science research and to encourage adoption of research-informed parenting practices associated with positive child development--particularly among Latino parents. First produced in 2017 through a NSF proof of concept grant, the Child Trends News Service covers actionable, child-focused, social science research. By featuring this research on local TV news, the project expands access to evidence-based parenting recommendations. As of February 2018, 89 stations had subscribed to the News Service, including eight stations in the top 25 Latino-serving TV markets that reach 38% of all Hispanic TV Households in those 25 markets. This project is a response to the challenges faced by U.S. children, of whom more than one in five live in poverty. The focus on Latino parents is in response Latinos' increasing share of all children, and that Latino children are disproportionately poor, in comparison to their peers. The project will examine the impact of the News Service on parents who view the news reports in their homes, as well as Latino parents viewing the News Service as part of their participation in the Abriendo Puertas (Opening Doors) community-based parenting program. This research will contribute to the knowledge base of what we know about how people access and use science, technology, engineering and math (STEM) information across settings.
The overarching aim of this project is to leverage commercial television news to reach populations who have historically been underrepresented in STEM education and careers. The goals of the project are to:
1. Build and manage an interdisciplinary collaborative, including news media professionals, researchers, practitioners in organizations serving at-risk families, and experts in STEM communications and Latino studies.
2. Leverage mass media news outlets to deliver social science research on children to at-risk populations, with a focus on reaching Latino parents.
3. Advance the field of informal STEM learning by exploring how the public interacts with actionable research on child development to inform their knowledge, attitudes and behaviors.
4. Expand the reach and application of the news products through strategic outreach to other stakeholders in the child development field including programs serving under-served families.
To accomplish these goals, the project will further strengthen an Advisory Panel to inform content development, study design, interpretation of findings, dissemination of study results, and the transition of the project after the NSF grant period. The project will continue to provide eight (both in English and Spanish) stories each month to TV stations and strategically grow the reach in top Latino markets. The editorial process will be informed by surveys of Latino parents to identify topics of interest. Through a random-assignment impact study with local TV news audiences from diverse racial/ethnic groups, the project will evaluate the impact of the News Service. The project will use formative research methods to refine messaging and examine the potential for repurposing the videos through a parenting program for Latino parents.
The Child Trends News Service seeks broader impacts in three areas: increasing the public's scientific literacy and engagement with science and technology; increasing partnerships between academia, industry, and others; and improving the well-being of individuals in society.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The team of Associated Universities Inc. (AUI), Michigan State University (MSU), California Academy of Science (the Academy), Astronomical Society of the Pacific (ASP), and Association of Universities for Research in Astronomy (AURA), will bring together experts in astronomy, STEM education, and planetarium show production. This work will tell the story of the people and places that make "big astronomy" possible, particularly the search for exoplanets and understanding of how planets form. The show and related materials will be presented in dozens of venues around the USA and internationally. Through a planetarium show and learning experiences that extend beyond the theater, the team will take visitors to extreme sites of the NSF ground-based observatories on the mountains of Chile and meet the diverse people who enable amazing discoveries in astronomy. In addition, the project develops the Dome+ model, which ensures engagement does not end with the planetarium. Dome+ will include additional content, weekly virtual sessions with STEM professionals, and a suite of closely linked outreach activities. Dome+ will serve as a model to extend engagement and increase the impact of future planetarium shows. Project goals include 1) increasing awareness of the research in astronomy being made at the NSF-funded observatories in Chile, 2) increasing awareness and interest in diverse STEM career opportunities at large observatories and related institutions in the USA, 3) increasing knowledge of science enabled by big observatories, 4) increasing Latinx perceptions as someone who can have a career at a major observatory, and 5) developing the Dome+ model and identify best practices for implementation. Iterative and summative evaluation of the project by collaborators at MSU will address four main questions: How does the Dome+ model affect visitors' perceptions of diversity of careers in STEM? How does the Dome+ model affect visitors' interest and understanding of Chile as an ideal observing location for astronomy? How does the Dome+ model support visitors' interest and understanding of the science of exoplanets? How do planetariums implement Dome+, and how does implementation affect the outcomes for visitors? The impact assessment component of this project takes places in four phases. The goals of the first phase are to leverage the expertise of the research team to inform the creation of the planetarium show and to set up a robust research agenda to be achieved in Years 2-4 of the project. The goals of the second phase are to collect preliminary data from visitors on their responses to planetarium show content and to use this information to advise on edits to the show and to develop the content and format of the web-portal and educational materials. The goal of the third phase is to then collect data on how effectively the technology-rich environments of the three components of the Dome+ model (planetarium show, web-portal, educational materials) work in concert to reach the intended goals of changing visitors' perceptions of diversity in STEM, engaging visitors with astronomy content on exoplanets, and exposing visitors to the wonders of astronomy research in Chile. The goal of the fourth phase is to perform data analysis, synthesize findings and make recommendations for future implementations of the Dome+ model for practitioners. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Antarctic Dinosaurs project aims to leverage the popularity and charisma of dinosaurs to inspire a new generation of polar scientists and a more STEM (Science, Technology, Engineering, Mathematics)-literate citizenry. The project, centered on a giant screen film that will reach millions of theatrical viewers across the U.S., will convey polar science knowledge through appealing, entertaining media experiences and informal learning programs. Taking advantage of the scope of research currently taking place in Antarctica, this project will incorporate new perspectives into a story featuring dinosaurs and journey beyond the bones to reveal a more nuanced, multi-disciplinary interpretation of paleontology and the profound changes the Antarctic continent has endured. The goals of the project are to encourage young people to learn about Antarctica and its connection to the rest of the globe; to challenge stereotypes of what it means to participate in science; to build interest in STEM pursuits; and to enhance STEM identity.
This initiative, aimed particularly at middle school age youth (ages 11-14), will develop a giant screen film in 2D and 3D formats; a 3-episode television series; an "educational toolkit" of flexible, multi-media resources and experiences for informal use; a "Field Camp" Antarctic science intervention for middle school students (including girls and minorities); fictional content and presentations by author G. Neri dealing with Antarctic science produced for young people of color (including non-readers and at-risk youth who typically lack access to science and nature); and presentations by scientists featured in the film. The film will be produced as a companion experience for the synonymous Antarctic Dinosaurs museum exhibition (developed by the Field Museum, Chicago, in partnership with the Natural History Museum of Los Angeles County, Discovery Place, Charlotte, NC, and the Natural History Museum of Utah). Project partner The Franklin Institute will undertake a knowledge-building study to examine the learning outcomes resulting from exposure to the film with and without additional experiences provided by the Antarctic Dinosaurs exhibition and film-related educational outreach. The study will assess the strategies employed by practitioners to make connections between film and other exhibits, programs, and resources to improve understanding of the ways film content may complement and inspire learning within the framework of the science center ecosystem. The project's summative evaluation will address the process of collaboration and the learning impacts of the film and outreach, and provide best practices and new models for content producers and STEM educators. Project partners include film producers Giant Screen Films and Dave Clark Inc.; television producer Natural History New Zealand (NHNZ); Discovery Place (Charlotte, NC); The Franklin Institute; The Field Museum; The Natural History Museum of Utah (The University of Utah); author G. Neri; and a team of scientists and diversity advisers. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project has co-funding support from the Antarctic section of the Office of Polar Programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
With snow providing water for about 2 billion people worldwide and playing a major role in the Earth's climate through its high albedo and insulation properties, on-going alterations in global snow resources pose real and extremely expensive societal adaptation/mitigation problems. The project goals are to:
Create opportunities for the public to learn about the vital role that snow plays in climate, water resources, and human lives.
Produce a better understanding of how culture affects informal Science, Technology, Engineering, Mathematics (STEM) learning.
The deliverables include:
An outreach program in Alaska that will visit 33 remote native villages;
A 2,000 square foot traveling exhibition on snow produced by the Oregon Museum of Science and Industry (OMSI) and exhibited at two additional museums during the life of the award;
Learning research, which will examine how the wide variation of cultural relationships to snow impacts learning in museum exhibitions. Each of these components will be evaluated over the course of the project. The travelling exhibition will tour to three museums per year for eight years, with an anticipated cumulative audience of over one million.
The focus on snow will highlight a fascinating yet under-appreciated part of the Earth system. The project aims to educate the public about snow and to produce a more informed and thoughtful public in the face of potential expensive and difficult snow-related societal decisions. Through informative displays, graphics, models, and other material, the project will engage traditionally under-served communities (at Native/remote villages) in Alaska, where a strong cultural connection to snow exists, as well as communities across the U.S. where the connection to snow can range from strong to weak. Across this cultural gradient, the project will explore through oral interviews and surveys the public response to various types and designs of informal science learning (ISL) displays, attempting to isolate and control for the effect of cultural vs. individual response to the materials. Informal learning theory specifies using front-end exploration of individual visitor-content relationships to guide exhibit design. This project's research goal expands that approach to include the effects of cultural engagement with a topic to develop more general tools to guide and improve the design process. The project is led by the University of Alaska Fairbanks (UAF) in collaboration with OMSI researchers from the COSI (Center of Science and Industry), Center for Research and Evaluation (CRE), and evaluators at the Goldstream Group. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project has co-funding support from the Office of Polar Programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will research and produce science media based on the role that interest, motivations, identify, and values play in engaging diverse, millennial audiences in a dynamic media environment. Using a design-based research approach the project team will develop Millennial Science Media Engagement Profiles (a set of categories describing different audience types who engage with science media in different ways). It will design and test science media content (text, audio, graphics, video), placement and platform use for millennials; and make conclusions around science media storytelling and outreach tactics that spark interest and engagement, the precursors to learning. Broader impacts include contributing significant new knowledge about millennials interest and engagement in science while they are at a stage in life making critical career decisions. It will also provide a model for other science media producers providing new protocols for creating targeted digital media for this specific audience. And further impacts include reaching a large national audience through social media. The project is a collaboration between KQED and researchers at Texas Tech.
The research will focus on the distinctive experience and interest of "millennial" science consumers. It builds on a previously funded national survey and series of focus groups with millennials looking at their science media preferences versus other generations. With these survey results this project will build profiles of millennial audiences based on two factors: level of science curiosity and level of science media engagement. The researchers will use a previously validated Science Curiosity Scale. The Millennial Profiles will be validated in two ways: through performance-based survey questions and through internet audience behavior analysis using existing digital analysis tools. KQED will produce different science media content and send it to certain groups conducting A/B testing to validate profiles online. The profile assumptions will continue to be tested until the team can effectively predict the kinds of science content that different profile groups prefer. The research will use a study protocol used in other domains to bridge the gap between lab and real-world settings. The protocol involves four steps: initial hypothesis development; ante experimental simulation; real-world communication; and ex post experimental simulations. Following the profile validation, the protocol will be used to test the efficacy of new KQED Science content, testing the variables that contribute to millennial engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Engagement is the cornerstone of learning in informal science education. During free-choice learning in museums and science centers, visitor engagement shapes how learners interact with exhibits, navigate through exhibit spaces, and form attitudes, interests, and understanding of science. Recent advances in multimodal learning analytics are creating novel opportunities for expanding the range and richness of measures of visitor engagement in free-choice settings. In particular, multimodal learning analytics offer significant potential for integrating multiple data sources to devise a composite picture of visitors' cognitive, affective, and behavioral engagement. The project will center on providing a rich empirical account of meaningful visitor engagement with interactive tabletop science exhibits among individual visitors and small groups, as well as uncovering broader tidal patterns in visitor engagement that unfold across exhibit spaces. A key objective of the project is creating models and practitioner-focused learning analytic tools that will inform the best practices of exhibit designers and museum educators. This project is funded by the Advancing Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, AISL funds research and innovative approaches and resources for use in a variety of settings. The research team will conduct data-rich investigations of visitors' learning experiences with multimodal learning analytics that fuse the rich multichannel data streams produced by fully-instrumented exhibit spaces with the data-driven modeling functionalities afforded by recent advances in machine learning and educational data mining. The research team will conduct a series of visitor studies of naturalistic engagement in solo, dyad, and group interactions as visitors explore interactive tabletop science exhibits. The studies will utilize eye trackers to capture visitors' moment-to-moment attention, facial expression analysis and quantitative field observations to track visitors' emotional states, trace logs generated by exhibit software, as well as motion-tracking sensors and coded video recordings to capture visitors' behavioral interactions. The studies will also use conversation recordings and pre-post assessment measures to capture visitors' science understanding and inquiry processes. With these multimodal data streams as training data, the research team will use probabilistic and neural machine learning techniques to devise learning analytic models of visitor engagement. The project will be conducted by a partnership between North Carolina State University and the North Carolina Museum of Natural Sciences. The research team will 1) design a data-rich multimodal visitor study methodology, 2) create the Visitor Informatics Platform, a suite of open source software tools for multimodal visitor analytics, and 3) launch the Multimodal Visitor Data Warehouse, a curated visitor experience data archive. Together, the multimodal visitor study methodology, the Visitor Informatics Platform, and the Multimodal Visitor Data Warehouse will enable researchers and practitioners in the informal science education community to utilize multimodal learning analytics in their own informal learning environments. It is anticipated that the project will advance the field of informal STEM learning by extending and enriching measures of meaningful visitor engagement, expanding the evidence base for visitor experience design principles, and providing learning analytic tools to support museum educators. By enhancing understanding of the cognitive, affective, and behavioral dynamics underlying visitor experiences in science museums, informal science educators will be well-positioned to design learning experiences that are more effective and engaging. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
James LesterJames MinogueJonathan RoweNorth Carolina Museum of Natural Sciences