The Brooklyn Botanic Garden (BBG) and Brooklyn Academy of Science and the Environment (BASE) contracted RK&A to conduct an evaluation of their partnership’s progress and outcomes over three years. The goal of the summative evaluation is to explore students, families, and teachers’ perceptions of and relationship to BBG and the BBG-BASE partnership. The evaluation also explored attitudes and understandings of how to engage in nature exploration, scientific inquiry, and environmental stewardship in a meaningful way.
How did we approach this study?
RK&A developed questionnaires to be
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. The goal of this award is to advance understanding of how children's science podcasts can provide families with information to help ease children's anxiety and fears during a pandemic. The project's hypothesis is that through listening to Brains On! coronavirus-related episodes, children will increase their understanding of science concepts related to the pandemic. As they gain this understanding, it is predicted that their overall fear and anxiety about the pandemic will diminish, they will feel empowered to ask pandemic-related questions and will engage in more science- based conversations with their family members. The project will develop three Brains On! podcast episodes focused specifically on the COVID-19 pandemic for kids aged 5 to 12 and their families. The research questions include:
How and to what extent do Brains On!'s coronavirus-based episodes help children and their families understand and talk about science-related pandemic topics? What kind of conversations are sparked by these episodes?
What kinds of questions do children have after listening to the Brains On! coronavirus episodes and what are the reasons for their questions? What can the questions tell us about the impact of listening on kids' science engagement and learning?
What resources do parents need to answer children's questions and help them understand science topics related to the pandemic?
This project is a collaboration between a media producer, Minnesota Public Radio and researchers at The Science Museum of Minnesota. Brains On! already has a large listening audience, with 7 million downloads a year, and more than 200,000 unique listeners a month and these new episodes are likely to increase listenership further. The research findings will be quickly disseminated to a wide range of audiences that can immediately apply the findings to create media and other coronavirus-related educational resources for families.
The PI's prior NSF funded projects have found that previous Brains On! podcasts with a range of STEM content increase the number and sophistication of the science questions children ask and lead to science-based conversations with family members. This project will study the impacts in relation to a singular topic, COVID-19. Three online surveys of Brains On! listeners (families with children ages 5 - 12 years old) will be conducted. The first survey to be conducted as soon as the project begins will focus on parents reflecting on what information is needed at that stage of the pandemic. Two additional listener surveys will occur immediately after new COVID-19 podcast episodes are released. These surveys will ask content-specific questions to understand how well the episode conveys that information to children and their families, what conversations were sparked from the content, and what additional information needs families have. Prior to administering each of the three surveys, video-based think-aloud interviews with 10 families will test and revise survey questions.
Survey participants will be recruited using language in Brains On! episodes, social media, website, and newsletters. A sample size of around 1,000 for each of the surveys is planned (based on a 95% confidence interval and ±3% sampling error). Analyses will include descriptive statistics and thematic coding of open-ended survey questions. Subgroup samples, when large enough will look at differences in responses by demographic variables (e.g. race/ethnicity, household income, highest level of education in the household, an adult in the household with a STEM career, gender of child, geographic location). The researchers and Brains On! staff will work together to identify how the findings can be applied to the development of subsequent coronavirus-related episodes and shared with the ISE field to further support families? education and information needs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The primary objective of this study is to document how people learn the science of the COVID-19 pandemic in real time, how they activate this scientific knowledge towards informed decision making, and how these processes change over time. This study is intended to produce additional insights on how such learning is shaped by equity concerns and contextual factors. For example, researchers will document how the ways in which people learn the science of COVID-19 are mediated by the sources of information they have access to and leverage, as well as what supports them in doing so. The research will further document how people leverage their understandings of COVID-19, alongside other forms of knowledge and concerns in their decision-making. This study may serve a crucial role in aiding the public understanding of where structural points of informational failure might occur. It may also reveal where and how the public engages or resists community action strategies to mitigate spread and suffering through when, how and why they gather, share, and make sense of scientific data. This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL and ECR programs in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act.
This research will draw upon a conceptual framework of consequential learning and a methodological framework of narrative inquiry. Sixty participants in Lansing, Michigan and Seattle, Washington will participate over the course of one year in cyclical interviews, focus group conversations and experience sampling approaches. Documents and resources named and used by the participants in their learning will be collected and analyzed. Attention will be paid to science learning in the following areas as the primary focus: a) the science of SARS-CoV-2 and the relationship between virus and disease, b) viral transmission, and c) origination, replication and spread. A key focus will also be how people use scientific data and evidence-based explanations when developing understandings and making decisions with respect to the pandemic. This research is urgent and timely because the COVID-19 pandemic is projected to occur in multiple waves over approximately 18 months. Insights may produce basic understanding about rapid science learning, policy strategies, school-based practices and resources for use within current and future waves. Socioscientific crises differentially impact people, with effects felt more significantly by vulnerable people. Thus, this study will address the urgent call for investigation into factors and experiences of low-income individuals and families who are trying to educate themselves on continually changing data during an international health crisis.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. COVID-19 presents a national threat to the health of children and families, presenting serious implications for the mental and physical health of children. Child development scientists have already warned of increasing stress levels among the U.S. child population, especially those in low-income families of color. In addition, Latino children are disproportionately impoverished, and benefit from culturally relevant information. Parents and caregivers need to be armed with effective science-based strategies to improve child prospects during this global crisis. Harnessing well-established partnership (including with local TV news partners and parent-serving organizations) strengthens the potential for broad impacts on the health and well-being of children and families during the COVID-19 pandemic. As the pandemic persists, widely disseminating accurate research-based strategies to support parents and families, with a focus on low-income Latino parents, is crucial to meeting the needs of the nation's most vulnerable during this global crisis. The award addresses this urgent need by producing research-based news videos on child development for distribution on broadcast television stations that reach low income Latino parents. The videos will communicate research-based recommendations regarding COVID-19 in ways that are relatable to Latino parents and lead to positive parenting during this pandemic. A "how to" video will also be produced showing parents how to implement some of the practices. Project partners include Abriendo Puertas, the largest U.S. parenting program serving low-income Latinos, and Ivanhoe Broadcasting.
Research questions include: 1) What information do parents need (and potentially what misinformation they are being exposed to)? 2) What are they sharing? 3) How does this vary geographically? 4) Can researchers detect differences in public engagement in geographic areas where TV stations air news videos as compared to areas that don't? This project will use data and communication science research strategies (e.g. natural language processing from online sites where parents are asking questions and sharing information) to inform the content of the videos and lead to the adoption of featured behaviors. Data from web searches, public Facebook pages, and Twitter posts will be used to gain a window into parents' main questions and concerns including information regarding hygiene, how to talk about the pandemic without frightening their children, or determining veracity of what they hear and see related to the pandemic.
This organic approach can detect concerns that parents may be unlikely to ask doctors or discuss in focus groups. Methodologically, the researchers will accomplish this by natural language analysis of the topics that parents raise; the words and phrases they use to talk about specific content; and any references to external sources of information. Where possible, the researchers will segment this analysis by geography to see if there are geographical differences in information needs and discourse. A research brief will share new knowledge gained with the field on how to respond to national emergencies, such as the COVID-19 pandemic, using local TV news and reinforcement of messages across contexts. The findings from this award will provide a knowledge base that can be utilized to better inform responses to national emergencies in the future. By broadly disseminating these findings through a research brief, the project?s innovative research will advance the field of communication science.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This RAPID award is made by the AISL program in the Division of Research on Learning in the Directorate for Education and Human Resources, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. COVID-19 presents a national threat to the health of children and families, presenting serious implications for the mental and physical health of children. This project addresses two critical aspects of the impact on COVID-19 on families: (a) the large-scale shift to at-home learning based on nationwide school closures and (b) the critical need for families to understand the basic science of virus transmission and prevention. To address these needs, the project team will develop a series of STEM activities for families with children in grades K-6 that make use of items readily available in most households. The activities help children and their families learn about viruses, virus transmission, and virus prevention while also developing other STEM-skills, particularly related to engineering design. Importantly, the project team also considers the emotional well-being of children and families during the disruption of the COVID-19 pandemic. Led by researchers from Indiana University and Binghamton University, and experts in educational resource development from Science Friday (a non-profit organization dedicated to increasing the public's access to science and scientific information through podcasts, digital videos, original web articles, and educational resources for teachers and informal educators) the project is further supported by partnerships with the New York Hall of Science, Amazeum (AR), the Gulf of Maine Research Institute (ME), The Tech Museum of Innovation (CA), the Indiana State Museum, and Kopernik Observatory Science Center (NY). The activities will be shared with families through live-streamed web sessions that introduce the activity, give tips to adults for facilitation, share a bit on related STEM careers and engage the audience in dialog about the activity and their current experiences. Versions of the sessions that are recorded will be edited and include closed-captioning and subtitles in multiple languages before being posted on platforms such as YouTube.
This project uses a design-based research approach to investigate strategies for enabling families to actively engage with STEM while home and away from their traditional institutions during a period of crisis. The research components focus on:
Engagement: How do families engage in the activity tasks, in terms of processes, practices, and use of resources? Who participated, why did they choose to participate and how did they engage (including modification of activities)? What barriers prevented interested families from completing activities?
Impact: How did the activities change participants? feelings of: a) efficacy around STEM and b) connectedness/ isolation, during extended school closures?
The Activities: Which activities had the greatest uptake? How many activity ideas were submitted by those outside of the team? What was the age/content focus of each of these activities?
The researchers will analyze social media data (including data on resource downloads and use of tracked links, YouTube and Facebook views, comment threads during livestreams and Likes/Shares/Follows across social media sites) to refine and improve the activities and programming as well as learn about the ways families are engaging in the activities. The researchers will solicit survey responses from website visitors to gather more information on participants, why they participated, how they engaged and how the activities impacted participants? efficacy around STEM and their feelings of connectedness or isolation. The researchers will also ask participants to submit images, videos and text that describes what they are making and their process along the way. Analysis of this data would lead to insights on how children and families use STEM language and practices; how children and families ask questions and use COVID-19-related and other information as part of their design work; and how ideas are formed, shaped and refined as families engage in design and making. While the project focuses on a unique opportunity to collect data on family STEM engagement as families respond to disruptions from the COVID-19 pandemic, this project and its findings will provide a knowledge base that can be utilized to inform future responses to national emergencies, other work aimed at promoting family learning at home, and approaches to supporting children in open-ended problem solving.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
AHA! Island is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking (CT) concepts and practices. Education Development Center (EDC), WGBH’s research partner for the project, conducted an impact study with 108 English-speaking families (4- to 5-year-old children and their families) to test the promise of this CT learning intervention.
DATE:
TEAM MEMBERS:
Marisa WolskyHeather LavigneJessica AndrewsAshley Lewis-PresserLeslie CuellarRegan VidiksisCamille Ferguson
The data collection procedure and process is one of the most critical components in a research study that affects the findings. Problems in data collection may directly influence the findings, and consequently, may lead to questionable inferences. Despite the challenges in data collection, this study provides insights for STEM education researchers and practitioners on effective data collection, in order to ensure that the data is useful for answering questions posed by research. Our engineering education research study was a part of a three-year, NSF funded project implemented in the Midwest
DATE:
TEAM MEMBERS:
Ibrahim YeterAnastasia Marie RynearsonHoda EhsanAnnwesa DasguptaBarbara FagundesMuhsin MeneskeMonica Cardella
Computational Thinking (CT) is an often overlooked, but important, aspect of engineering thinking. This connection can be seen in Wing’s definition of CT, which includes a combination of mathematical and engineering thinking required to solve problems. While previous studies have shown that children are capable of engaging in multiple CT competencies, research has yet to explore the role that parents play in promoting these competencies in their children. In this study, we are taking a unique approach by investigating the role that a homeschool mother played in her child’s engagement in CT
For the past two decades, researchers and educators have been interested in integrating engineering into K-12 learning experiences. More recently, computational thinking (CT) has gained increased attention in K-12 engineering education. Computational thinking is broader than programming and coding. Some describe computational thinking as crucial to engineering problem solving and critical to engineering habits of mind like systems thinking. However, few studies have explored how computational thinking is exhibited by children, and CT competencies for children have not been consistently defined
Informal learning environments such as science centers and museums are instrumental in the promotion of science, technology, engineering, and mathematics (STEM) education. These settings provide children with the chance to engage in self-directed activities that can create a of lifelong interest and persistence in STEM. On the other hand, the presence of parents in these settings allows children the opportunity to work together and engage in conversations that can boost understanding and enhance learning of STEM topics. To date, a considerable amount of research has focused on adult-child
The Miami Children’s Museum (MCM) contracted RK&A to conduct a summative evaluation of the Construction Zone exhibition, which was funded in part by IMLS. The evaluation focused on understanding the overall experience for walk-in visitors to the exhibition. It also explored visitor experiences with three specific exhibits with attention to problem-solving, experimentation with building materials, and collaboration.
How did we approach this study?
RK&A used two methodologies to evaluate the exhibition: interviews and focused observations. RK&A conducted 51 open-ended interviews with a
Children’s storybooks are a ubiquitous learning resource, and one with huge potential to support STEM learning. They also continue to be a primary way that children learn about the world and engage in conversations with family members, even as the use of other media and technology increases. Especially before children learn to read, storybooks create the context for in-depth learning conversations with parents and other adults, which are the central drivers of STEM learning and development more broadly at this age. Although there is a body of literature highlighting the benefits of storybooks