This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The goal of our project is to develop strategies that effectively engage autistic adolescents in informal STEM learning opportunities that promote the self-efficacy and interest in STEM careers that will empower them to seek out career opportunities in STEM fields.
The research aims are to:
1. Identify evidence-based strategies to engage autistic youth in informal STEM learning opportunities that are well matched to their attentional profiles:
Hypothesis 1: Pedagogical strategies vary in how engaging they are for people with diverse attentional profiles; people with more focused
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Collaborative robots – cobots – are designed to work with humans, not replace them. What learning affordances are created in educational games when learners program robots to assist them in a game instead of being the game? What game designs work best?
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Through Project BUILD, a STAR Library Network (STAR Net) program funded by the National Science Foundation, the American Society of Civil Engineers (ASCE) and the Space Science Institute’s National Center for Interactive Learning (NCIL) offered the virtual Dream, Build, Create program which consisted of (1) the award-winning documentary Dream Big: Engineering Our World and (2) five live-streamed panels of diverse engineers (Dream Teams) who shared their stories of what it means to be an engineer.
The external evaluation, conducted by Education Development Center (EDC), aimed to examine how
Research shows that algebra is a major barrier to student success, enthusiasm and participation in STEM for under-represented students, particularly African-American students in under-resourced high schools. Programs that develop ways to help students master algebra concepts and a belief that they can perform algebra may lead to more students entering engineering careers. This project will provide an online engineering program to support 9th and 10th grade Baltimore City Public Schools students, a predominantly low-income African-American cohort, to develop concrete goals of becoming engineers. The goals of the program are to help students with a growing interest in engineering to maintain that interest throughout high school. The project will also support students aspire to an engineering career. The project will develop in students an appreciation of requisite courses and skills, and increase self-efficacy in mathematics. The project will also develop a replicable model of informal education capable of reinforcing the mathematical foundations that students learn during the school day. Additionally, the project will broaden participation in engineering by being available to students during out-of-school time and by having relaxed entrance criteria compared to existing opportunities in supplemental engineering curricula. The project is a collaboration between the Baltimore City Public Schools, Johns Hopkins University Applied Physics Laboratory, Northrop Grumman Corporation, and Expanded School-Based Mental Health programs to support students both during and after participation. The project will benefit society by providing skills that will allow high school students to become members of tomorrow's highly trained STEM workforce.
The research will test whether an informal, scaffolded online algebra-for-engineering program increases students' mastery and self-efficacy in mathematics. The research will advance knowledge regarding informal education by applying Social Cognitive Career Theory as a framework for measuring program impact. The theoretical framework will aid in identifying mechanisms through which students with interest in engineering might persist in maintaining this interest through high school via algebra skill mastery and increased self-efficacy. The project will recruit 200 youth from the Baltimore City Public Schools to participate in the project over three years. Qualitative data will be collected to assess how student and school socioeconomic factors impact implementation, student engagement, and outcomes. The research will answer the following questions: 1) What effect does program participation have on math mastery? 2) What direct and indirect effects do program completion and supports have on students' mathematics self-efficacy? 3) What direct and indirect effects do program components have on engineering career goals by the end of the program? 4) What direct and indirect effects does math self-efficacy have on career goals? 5) To what extent are the effects of program participation on engineering career goals mediated by math self-efficacy and engineering interest? 6) How do school factors relate to the implementation of the program? 7) What socioeconomic-related factors relate to the regularity and continuation of student participation in the program? The quantitative methods of data analysis will employ descriptive and multivariate statistical methods. Qualitative data from interviews will be analyzed using an emergent approach and a coding scheme guided by theoretical constructs. Project results will be communicated to scholars and practitioners. The team will also share information through school newsletters and parent communication through Baltimore City Public Schools.
This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. The project will develop and research an integrated package of high-quality, widely accessible media and other outreach materials designed to engage middle school youth, educators, and libraries in learning about viruses in relation to COVID-19. There is an immediate need to provide youth with accurate, engaging, and accessible materials to help them understand the basic biology underlying the COVID-19 pandemic, including the routes of COVID-19 transmission and mechanisms to prevent its spread. This is particularly important for those without science backgrounds or interests so that the rumors, hearsay, and gossip circulating among youth can be replaced with research-based information. Since 2007, the project team and partners have focused on developing and studying new ways of educating youth and the public about biology, virology, and infectious disease. The project will develop a web-accessible package of customizable graphics, illustrated stories, and essays--all of which can be easily incorporated into free-choice and directed on-line learning as well standards-based lesson plans for Grades 6-8. These resources will be disseminated broadly and at no cost to youth and educators of all kinds, including schools, libraries, museums, and other established networks for formal and informal science education. The project web package will be linked to multiple websites that serve as important educational resources on science and virology for youth, the general public, and educators. A prominent university press will publish and promote the illustrated stories and support distribution of 7,000 free copies.
The project will conduct research examining how richly-illustrated science narratives impact youth understanding of and curiosity about science. The research will help develop the foundation for better understanding how to educate youth about COVID-19 (and future pandemics) while generating new knowledge about effective methods for public science outreach during a major unanticipated natural event. For formative evaluation, the project will use an innovative rapid response feedback method. Youth will be invited to provide timely, specific comments on the serialized stories through a curated portal. As new excerpts are related online, different questions will be posed to youth who are selected because of specific characteristics (e.g., low or high initial science interest). These data will guide story development in real time and provide a mechanism to gauge the story appeal, comprehensibility, and initial impacts. The project will address two research questions: (1) How effective are illustrated stories in having positive impacts among participants on COVID-19 knowledge, science identity, attitudes, and interest in science careers?; and (2) How do story lines and characters have differential impacts on virus knowledge, epidemiology, and youth attitudes towards science and science careers? To conduct this research, the project will conduct online surveys using adapted items from prior research conducted by the project team. Additional items will assess COVID-19 knowledge, attitudes, personal experiences with the virus, well-being, and exposure to public health messaging about the virus. Research findings will be shared widely to inform the field about new ways delivering science education content during the advent of rapidly evolving global and educational challenges.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Judy DiamondJulia McQuillanPatricia Wonch HillElizabeth VanWormer
The purpose of this study is to develop an instrument to assess civic scientific literacy measurement (SLiM), based on media coverage. A total of 50 multiple-choice items were developed based on the most common scientific terms appearing in media within Taiwan. These questions covered the subjects of biology (45.26%, 22 items), earth science (37.90%, 19 items), physics (11.58%, 6 items) and chemistry (5.26%, 3 items). A total of 1034 students from three distinct groups (7th graders, 10th graders, and undergraduates) were invited to participate in this study. The reliability of this instrument
DATE:
TEAM MEMBERS:
Carl-Johan RundgrenShu-Nu Chang RundgrenYuen-Hsien TsengPei-Ling LinChun-Yen Chang
The videogames industry has been flourishing. In 2010 in America alone, total consumer spending on the games industry totaled $25.1 billion (Siwek, 2010), surpassing both the music industry ($15.0 billion) and box office movies ($10.5 billion). It is also one of the fastest growing industries in the U.S. economy. From 2005 to 2010, for example, the videogames industry more than doubled while the entire U.S. GDP grew by about 16 percent. The amount of time young people spend with entertainment media in general is staggering. Youth aged 8 to 18 years old consume about 10.45 hours per day of