The goals of the project were to build an understanding about the perception of career and technical education (CTE) as an option for middle school students in pursuing skill-based STEM-related careers, and to use that information to develop an innovative suite of digital tools designed to improve mentors’ and school counselors’ communication with middle school–aged students.
STEM out-of-school time (OST) programs play an important role in helping youth develop the 21st century skills they need to prepare them for the workforce, particularly the teamwork skills necessary for the growing collaborative nature of work in STEM (National Research Council, 2015). However, there is a lack of appropriate tools to evaluate this key programmatic outcome in STEM OST settings. Through funding from the National Science Foundation, we carried out the Collaboration in the 21st Century (C2C) project to help address this need by developing and validating a survey, the Youth
Citizen science, the active participation of the public in scientific research projects, is a rapidly expanding field in open science and open innovation. It provides an integrated model of public knowledge production and engagement with science. As a growing worldwide phenomenon, it is invigorated by evolving new technologies that connect people easily and effectively with the scientific community. Catalysed by citizens’ wishes to be actively involved in scientific processes, as a result of recent societal trends, it also offers contributions to the rise in tertiary education. In addition
DATE:
TEAM MEMBERS:
Susanne HeckerMuki HaklayAnne BowserZen MakuchJohannes VogelAletta Bonn
This paper summarizes a study from 1987 on the Exploratorium's Explainer program. The Explainers serve as the primary staff available to the public on the floor of the museum. The purpose of the study was to determine whether science museums, through such programs, can significantly affect students' social development, their attitudes toward science, and their interest in science, teaching and museums. The study examines the impact of the Exploratorium on a group of students who may spend as much time in the museum as in school, and examined the program to understand its impact on the
Since the late 2000s, interest in the development and use of shared measures in the informal science, technology, engineering, and mathematics (STEM) education (ISE) field has increased. The intent is to build the capacity of evaluators to measure common outcomes of ISE experiences. We begin this chapter with a definition of shared measures, a description of related technical qualities of these measures, and a discussion of benefits and concerns around the use of shared measures. We then review recent conversations and developments around shared measures, including examples of observational
In the last twenty years, citizen science has blossomed as a way to engage a broad range of individuals in doing science. Citizen science projects focus on, but are not limited to, nonscientists participating in the processes of scientific research, with the intended goal of advancing and using scientific knowledge. A rich range of projects extend this focus in myriad directions, and the boundaries of citizen science as a field are not clearly delineated. Citizen science involves a growing community of professional practitioners, participants, and stakeholders, and a thriving collection of
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This third and final report reflects on the entire three-year grant period. It offers the External Review Team’s overall assessment and observations about the accomplishments and challenges experienced by the Child Trends Team while implementing the proof-of-concept study. It further presents several open questions and opportunities for future consideration.
This summative evaluation report presents findings and lessons learned on the STEM Ambassadors project. The STEM Ambassadors project, funded by the National Science Foundation’s (NSF) Advancing Informal STEM Learning (AISL) program, combines elements of existing programs designed to engage STEM professionals with the public around their scientific research to create a new model for public engagement of science. This new model recruits, provides training for, and assists STEM professionals in drawing on their own interests, hobbies and backgrounds to connect with audiences that may not have
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop and test a model for audience assessment that STEM professionals can use during their public engagement efforts. These on-the-spot assessments will allow scientists to monitor audience understanding and use this to make immediate improvements to their activity. This project fills a critical gap in the field of public science communication as expressed by outreach scientists and by the professional and academic organizations that train them. Project partners include The Astronomical Society of the Pacific, Oregon State University, Pacific Science Center, and the National Radio Astronomy Observatory. Research questions include: (1) How and under what conditions can scientists, regardless of discipline, learn to build assessment into outreach activities? (2) To what degree are scientists willing and able to change their outreach activities to include assessment to ascertain audience attentiveness or understanding? (3) To what degree will scientists be able to adjust their outreach and engagement efforts based on audience feedback, and what support do they need to do so? (4) With constraints on their time and resources, how can the model help scientists conduct audience assessment on their own? (5) Are audience members finding events more enjoyable and fruitful that use assessment techniques? Several iterative rounds of R&D will be used in the spiral design-based approach. A group of Design Testers will start each of the iterative cycles for the initial development and testing techniques, associated training, and support. Later phases will use Field Testers using a rubric for usability, validity, and reliability of various strategies. The summative evaluation of the project will begin early and add data over the life of the project. A mixed methods approach will be used including surveys of scientists once each year after they have participated in the Prototype training. Descriptive and inferential statistics will be used to document the extent to which the project has achieved its intended outcomes. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This workshop is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will conduct a two-day workshop that will gather citizen science project leaders to address barriers in citizen science research and infrastructure: The inability to holistically study the movement, engagement, persistence and learning outcomes among volunteers engaged in multiple projects. The past few years have been a time of tremendous growth in awareness of and interest in citizen science projects. The project will address an increasing gap preventing projects in three now-popular categories (apps, projects hosted on government websites, and event-based projects) from adopting the digital tools created and available through SciStarter.com. The workshop will bring citizen science project leaders together to deepen an understanding of their needs regarding the adoption of digital tools, developed by Scistarter, which will result in more comprehensive data in support of research in informal science learning outcomes of volunteers engaged in citizen science across projects and platforms. The in-person and online contributions from participants will guide the development of resources and tutorials to scale adoption.
SciStarter is a repository of hundreds of citizen science projects. Through previous NSF support, SciStarter developed digital affiliate tools which project leaders use on their own websites to enable analytics (statistics gathered from user activity online) to help projects more easily recruit and coordinator volunteers, help volunteers track their contributions across projects and platforms, and help researchers holistically study the movement and learning outcomes across projects and platforms. The proposed workshop will facilitate iteration and adoption of the tools among three classes of projects, not originally accounted for, which have dramatically increased in numbers during the past year: 1) app-based projects, 2) projects hosted on government websites, and 3) event-based projects.. By co-designing and implementing iterative versions of the tools among these projects, the project will address important gaps in research, enable a richer, more comprehensive understanding of volunteer engagement patterns, and discover opportunities to build a stronger community of citizen science practitioners who collaborate to enhance volunteer learning communities. The project will culminate in improved research in this field and improved management of citizen science projects for appropriate recruitment and retention that fosters STEM learning.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The theme of this conference project by the New York Hall of Science will be exploring how to better design exhibits to promote "public engagement with science." Here, "public engagement with science" refers to opportunities that go beyond traditional approaches to the public understanding of science. The event will invite professionals to consider how to shift exhibit designs toward engaging visitors with STEM in ways that emphasize the intersection of STEM innovation with visitors' daily lives, their personal agency, and their interdependence with their personal social networks and the institutions that advance STEM knowledge and innovation. The conference and its pre- and post-conference activities will bring together curators, exhibition developers, community outreach professionals, museum administrators, and learning scientists from the United States and Canada. They will work together to identify design principles and key obstacles to designing exhibits that can better help science museums achieve two goals: 1) making visitors' diverse and personal questions, concerns, and perspectives central to their experience of the exhibits; and 2) engaging visitors as contributors to the exhibit experience in ways that make their contributions visible and consequential. During this two-day event attendees will consider how exhibits can support broader and more diverse public participation in critical debates about the roles of STEM discovery and innovation in society. The effort is grounded in recent work on public engagement with science; on reorganizing museums to become sites for participation and contribution by visitors, and particularly by institutions' local communities; and on making and engineering design programming within museums. The goal is to chart a course toward a vision of the future of science museums in which they maintain their status as sources of trusted information, while also fulfilling their potential as sites of genuine participation and social interaction, in which visitors make meaningful contributions to the substance and workings of the museum floor while also engaging with, learning about and holding themselves accountable to the core concepts and practices of the STEM disciplines. The conference will build the capacity and collaborative engagement of a network of science centers whose work is central to achieving the museum field's ultimate goal of engaging the public of all ages in learning STEM in informal environments. The conference and associated activities will be evaluated by staff at the New York Hall of Science, with oversight by an external advisory committee of research and development professionals. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.